Web Scraping Data Collection Project (v)
Budget: $750 – $1,500 USD
The Laboratory for Innovation Science at Harvard is seeking individuals to collect information from websites of higher education institutions (e.g., colleges or universities). You will be provided with a list of 5 institutions’ websites and instructions including the list of publicly available data we would like you to compile (Name, Title, Department, etc.…).
Please be aware that this is a large-scale project and it is common for one school to contain between 1,000 to 3,000 contacts. We will ask you to use the individual department directories to complete this project instead of the central directory.
We will also provide a template output file for you to enter data into. The method of collection is up to you, however please be sure to review individual websites’ terms of use to make sure you are not violating any terms by scraping data.
Please note that we will set up an initial milestone in order to clarify this project’s instructions. For this milestone, we will ask you to submit a short sample of 200 contacts. Our team will review this sample and provide feedback in order to clarify any questions or concerns that may arise when beginning the project. We will release the first milestone payment after providing the feedback.
Please be aware that this is a large-scale project and it is common for one school to contain between 1,000 to 3,000 contacts. We will ask you to use the individual department directories to complete this project instead of the central directory.
We will also provide a template output file for you to enter data into. The method of collection is up to you, however please be sure to review individual websites’ terms of use to make sure you are not violating any terms by scraping data.
Please note that we will set up an initial milestone in order to clarify this project’s instructions. For this milestone, we will ask you to submit a short sample of 200 contacts. Our team will review this sample and provide feedback in order to clarify any questions or concerns that may arise when beginning the project. We will release the first milestone payment after providing the feedback.