Gathering data from an API
Budget: $30 – $250 USD
I need help creating a program to download historical data from an API, and also to download new data at specified intervals (e.g., every day at 3pm). The query is based on stock market ticker (such as aapl). Your code or program should be able to accept a single-column text file (CSV or TXT) as input, which contains a potentially long list of company name tickers. You also need to make sure that your code will not issue more than 100 calls per second, and not more than 1000 calls per second. If there is an error, your code should be able to resume where it encounters an error instead of starting from the first company in the CSV file. In addition, the results should be stored in a MySQL database. There should also be a column for the time of the data collection. Last but not least, for API calls that provide data for the previous x days, old data should not be deleted --- e.g., if the program runs today and then 10 days from now, data from 45 days ago should still be retained in the dataset.
The API provides very clear documentations, so this task should be straightforward for those with such experiences. Because I cannot share the token with you, most likely you won't be able to debug yourself (unless you sign up for the API yourself on a trial basis). Any delay due to that will not be your fault. As long as your codes are easy to implement I promise to get back to you with any error messages within 24 hours (most likely sooner).
Here is a sample code from the documentation. If you are interested, please send me a message (be sure to include your experience with similar projects), and I will share the API URL with you. You can then review that document and come back to me with a bid.
The API is based on REST. Responses are JSON. The API URL provides an example like the following:
import requests
url = "https://api.websiteAPI.com/beta/live/method1"
headers = {'accept': 'application/json',
'X-CSRFToken': 'abcdedfg',
'Authorization': 'Token {Your Token}'}
r = requests.get(url, headers=headers)
print(r.content)
There are 15 parts (15 types of data).
The API provides very clear documentations, so this task should be straightforward for those with such experiences. Because I cannot share the token with you, most likely you won't be able to debug yourself (unless you sign up for the API yourself on a trial basis). Any delay due to that will not be your fault. As long as your codes are easy to implement I promise to get back to you with any error messages within 24 hours (most likely sooner).
Here is a sample code from the documentation. If you are interested, please send me a message (be sure to include your experience with similar projects), and I will share the API URL with you. You can then review that document and come back to me with a bid.
The API is based on REST. Responses are JSON. The API URL provides an example like the following:
import requests
url = "https://api.websiteAPI.com/beta/live/method1"
headers = {'accept': 'application/json',
'X-CSRFToken': 'abcdedfg',
'Authorization': 'Token {Your Token}'}
r = requests.get(url, headers=headers)
print(r.content)
There are 15 parts (15 types of data).