API Based twitter scraping tool for latest tweets development
Budget: $30 – $250 AUD
I’m looking to create a twitter scraping tool in either Python (potentially using BeautifulSoup & Tweepy) or Javascript.
Must run on a set schedule (once a minute),
Must use the twitter free api plan.
If the free api plan caps it to >1min then multiple twitter api accounts are to be used to circumvent this rate limit.
Check if any of the account list (hard coded list) have published a new tweet.
If so:
- parse the tweet searching for some characters preceded by a ‘$’ symbol and store it in a separate variable called TICKER.
- parse the tweet searching for a word with a minimum of four characters & a maximum of 8 characters that are all in capital letters (not preceded by a $) and if found store it in a variable called POTENTIAL
- If no TICKER or POTENTIAL were found in the tweet Email me using this structure
- in the subject of the email give: TwitterAccountName just tweeted: Nothing was found
- in the body of email provide the TwitterAccountName, the latest tweet, a link to the tweet.
- If a TICKER or POTENTIAL were found in the tweet Email me using this structure
- in the subject of the email give: TwitterAccountName: TICKER or POTENTIAL found in latest tweet!
- in the body of email provide the TwitterAccountName, the latest tweet, a link to the tweet. The value of TICKER is [TICKER]. The value of POTENTIAL is [POTENTIAL].
Skills and Experience:
- Experience in data scraping, especially Twitter API, is a paramount requirement.
- Ability to work under strict timelines, given the real-time nature of the data needed.
- Knowledge of various data storing formats like CSV, JSON, and database systems - to offer the best suggestion.
If you can match this frequency and have a solid understanding of these requirements, please bid.
ongoing contract work available
Must run on a set schedule (once a minute),
Must use the twitter free api plan.
If the free api plan caps it to >1min then multiple twitter api accounts are to be used to circumvent this rate limit.
Check if any of the account list (hard coded list) have published a new tweet.
If so:
- parse the tweet searching for some characters preceded by a ‘$’ symbol and store it in a separate variable called TICKER.
- parse the tweet searching for a word with a minimum of four characters & a maximum of 8 characters that are all in capital letters (not preceded by a $) and if found store it in a variable called POTENTIAL
- If no TICKER or POTENTIAL were found in the tweet Email me using this structure
- in the subject of the email give: TwitterAccountName just tweeted: Nothing was found
- in the body of email provide the TwitterAccountName, the latest tweet, a link to the tweet.
- If a TICKER or POTENTIAL were found in the tweet Email me using this structure
- in the subject of the email give: TwitterAccountName: TICKER or POTENTIAL found in latest tweet!
- in the body of email provide the TwitterAccountName, the latest tweet, a link to the tweet. The value of TICKER is [TICKER]. The value of POTENTIAL is [POTENTIAL].
Skills and Experience:
- Experience in data scraping, especially Twitter API, is a paramount requirement.
- Ability to work under strict timelines, given the real-time nature of the data needed.
- Knowledge of various data storing formats like CSV, JSON, and database systems - to offer the best suggestion.
If you can match this frequency and have a solid understanding of these requirements, please bid.
ongoing contract work available