Scrape Data, Transform Data, Pearson’s Correlation, Website Built and Automation
Budget: $100 – $750 USD
Scrape Data, Transform Data, Pearson’s Correlation, Website Built and Automation
1) Scrape data from https://www.gisaid.org/ (you will need to register for an account to access SARS-CoV-2 data)
2) Create a list of all “Lineages” (either from gisaid or from https://cov-lineages.org/lineage_list.html)
3) For each lineage, search the number of times that lineage has appeared each month using the “Collection” filter in GISAID.
4) For each lineage, determine the prevalence for each month.
5) Logarithmically transform the prevalence
6) Perform a Pearson’s correlation for each lineage comparing month as an interval (1, 2, 3, 4, 5 …etc) as the X-variable and log(prevalence) as the Y-variable.
7) Build a website and if the Pearson’s is greater than 0.9, publish the Lineage and Pearsons r-value to the website. Along with the prevalence from the previous month (if possible).
1) Scrape data from https://www.gisaid.org/ (you will need to register for an account to access SARS-CoV-2 data)
2) Create a list of all “Lineages” (either from gisaid or from https://cov-lineages.org/lineage_list.html)
3) For each lineage, search the number of times that lineage has appeared each month using the “Collection” filter in GISAID.
4) For each lineage, determine the prevalence for each month.
5) Logarithmically transform the prevalence
6) Perform a Pearson’s correlation for each lineage comparing month as an interval (1, 2, 3, 4, 5 …etc) as the X-variable and log(prevalence) as the Y-variable.
7) Build a website and if the Pearson’s is greater than 0.9, publish the Lineage and Pearsons r-value to the website. Along with the prevalence from the previous month (if possible).