NBA Statistics Web Scraping Project
Budget: $30 – $250 USD
Project Overview
Develop and deploy a Python-based web scraping system to collect NBA player and team statistics from Basketball Reference, updating pre-configured Airtable sheets daily. The system will be hosted on AWS Lambda for automated execution.
Fixed Budget: $100
Project Scope
Data Collection Requirements
Scrape statistics for ~550 players (90 fields per player)
Scrape statistics for 30 teams (90 fields per team)
Data sources span 4-5 specific URLs from Basketball Reference
Update existing Airtable sheets with collected data
Match data to pre-defined columns in Airtable
Technical Requirements
Python Web Scraping
Implement robust scraping scripts using BeautifulSoup/Requests
Handle rate limiting and site restrictions
Include error handling and logging
Maintain efficient processing
AWS Implementation
Deploy on AWS Lambda
Set up daily trigger via CloudWatch
Configure proper timeout and memory settings
Include basic error monitoring
To ensure understanding of project requirements, include the phrase "NBA Stats Scraper 2024" in your proposal. This demonstrates familiarity with the project scope.
Airtable Integration
Update existing sheets without structural changes
Maintain data integrity during updates
Handle API rate limits appropriately
Deliverables
Complete Python source code with documentation
AWS Lambda deployment package
Setup instructions and configuration files
Basic error handling documentation
Test run confirmation with sample data
Required Skills
Python web scraping experience (BeautifulSoup/Requests)
AWS Lambda deployment experience
Airtable API integration experience
Experience handling rate limits and site restrictions
Understanding of sports statistics (preferred)
Project Timeline
Expected completion: 1 week
Including testing and deployment
Additional Notes
Airtable structure already configured
Column mappings will be provided
URLs for data collection will be provided
AWS credentials will be provided
Sample data format will be shared
Selection Criteria
Previous web scraping projects
AWS Lambda experience
Clean, maintainable code
Rate limit handling experience
Quick response time for questions
Required for Proposal
Brief outline of your scraping approach
Previous similar project examples
Estimated timeline breakdown
Questions about the project scope
Confirmation of AWS/Airtable experience
Out of Scope
UI development
Data analysis
Database design
Airtable structure changes
Additional data sources
Develop and deploy a Python-based web scraping system to collect NBA player and team statistics from Basketball Reference, updating pre-configured Airtable sheets daily. The system will be hosted on AWS Lambda for automated execution.
Fixed Budget: $100
Project Scope
Data Collection Requirements
Scrape statistics for ~550 players (90 fields per player)
Scrape statistics for 30 teams (90 fields per team)
Data sources span 4-5 specific URLs from Basketball Reference
Update existing Airtable sheets with collected data
Match data to pre-defined columns in Airtable
Technical Requirements
Python Web Scraping
Implement robust scraping scripts using BeautifulSoup/Requests
Handle rate limiting and site restrictions
Include error handling and logging
Maintain efficient processing
AWS Implementation
Deploy on AWS Lambda
Set up daily trigger via CloudWatch
Configure proper timeout and memory settings
Include basic error monitoring
To ensure understanding of project requirements, include the phrase "NBA Stats Scraper 2024" in your proposal. This demonstrates familiarity with the project scope.
Airtable Integration
Update existing sheets without structural changes
Maintain data integrity during updates
Handle API rate limits appropriately
Deliverables
Complete Python source code with documentation
AWS Lambda deployment package
Setup instructions and configuration files
Basic error handling documentation
Test run confirmation with sample data
Required Skills
Python web scraping experience (BeautifulSoup/Requests)
AWS Lambda deployment experience
Airtable API integration experience
Experience handling rate limits and site restrictions
Understanding of sports statistics (preferred)
Project Timeline
Expected completion: 1 week
Including testing and deployment
Additional Notes
Airtable structure already configured
Column mappings will be provided
URLs for data collection will be provided
AWS credentials will be provided
Sample data format will be shared
Selection Criteria
Previous web scraping projects
AWS Lambda experience
Clean, maintainable code
Rate limit handling experience
Quick response time for questions
Required for Proposal
Brief outline of your scraping approach
Previous similar project examples
Estimated timeline breakdown
Questions about the project scope
Confirmation of AWS/Airtable experience
Out of Scope
UI development
Data analysis
Database design
Airtable structure changes
Additional data sources