Health Tech Webcrawler/Automation
Budget: $750 – $1,500 AUD
We have a set of steps that are too manual and would like to hire someone to automate them.
1) perform a web search/crawling for pages that mention top types of technology [according to a short list we have]
eg. heart monitors, assistive technology, parkinson's technology
2) extract the website links mentioning those into a database
eg. heart monitors is likely to return sites like: amazon, omron, wellue, ces top health devices. Preferrably detecting and tagging if it it relates to an article or product (contains shop/buy/checkout/order terms).
eg. Amazon will list products and prices, Mayo clinic may refer to research around the accuracy of heart monitors.
3) Scrape the products/page or image content into a database - whatever is easiest here, to give us some indication of what it is without clicking the link.
We are happy if you can choose the tool and set it up. We would like to be able to add search terms and maintain it ourselves. We will run the 'script' or repeat the scan weekly.
At first we're interested in as low a scope as possible, to see if this is the approach we'd like to take. Otherwise we could use a 3rd party provider but, as a startup, we'd love to see what we can do ourselves, and if the approach works, expand our scope with you. We use tools like airtable and zapier, so can join the dots with those tools ourselves if you can trawl and capture in whatever way is best.
Our website is available https://www.helloedlife.com/
Examples of how we use the results from heart monitors https://www.helloedlife.com/heart-monitoring-products. (we also run an algorithm to access the tech, after we identify it)
An an example of a super simple scan, putting the results into an airtable database, is here. You see the title of the page and a link. https://airtable.com/invite/l?inviteId=invkBLP9mNK4dkj5O&inviteToken=e0ff54b245e0432e536ecb37159a0d0abdb2ef5e135ac8a3a56466a727343921&utm_medium=email&utm_source=product_team&utm_content=transactional-alerts
An example of one set of search results we've collected into airtable is here
https://airtable.com/invite/l?inviteId=invkBLP9mNK4dkj5O&inviteToken=e0ff54b245e0432e536ecb37159a0d0abdb2ef5e135ac8a3a56466a727343921&utm_medium=email&utm_source=product_team&utm_content=transactional-alerts
1) perform a web search/crawling for pages that mention top types of technology [according to a short list we have]
eg. heart monitors, assistive technology, parkinson's technology
2) extract the website links mentioning those into a database
eg. heart monitors is likely to return sites like: amazon, omron, wellue, ces top health devices. Preferrably detecting and tagging if it it relates to an article or product (contains shop/buy/checkout/order terms).
eg. Amazon will list products and prices, Mayo clinic may refer to research around the accuracy of heart monitors.
3) Scrape the products/page or image content into a database - whatever is easiest here, to give us some indication of what it is without clicking the link.
We are happy if you can choose the tool and set it up. We would like to be able to add search terms and maintain it ourselves. We will run the 'script' or repeat the scan weekly.
At first we're interested in as low a scope as possible, to see if this is the approach we'd like to take. Otherwise we could use a 3rd party provider but, as a startup, we'd love to see what we can do ourselves, and if the approach works, expand our scope with you. We use tools like airtable and zapier, so can join the dots with those tools ourselves if you can trawl and capture in whatever way is best.
Our website is available https://www.helloedlife.com/
Examples of how we use the results from heart monitors https://www.helloedlife.com/heart-monitoring-products. (we also run an algorithm to access the tech, after we identify it)
An an example of a super simple scan, putting the results into an airtable database, is here. You see the title of the page and a link. https://airtable.com/invite/l?inviteId=invkBLP9mNK4dkj5O&inviteToken=e0ff54b245e0432e536ecb37159a0d0abdb2ef5e135ac8a3a56466a727343921&utm_medium=email&utm_source=product_team&utm_content=transactional-alerts
An example of one set of search results we've collected into airtable is here
https://airtable.com/invite/l?inviteId=invkBLP9mNK4dkj5O&inviteToken=e0ff54b245e0432e536ecb37159a0d0abdb2ef5e135ac8a3a56466a727343921&utm_medium=email&utm_source=product_team&utm_content=transactional-alerts