Dark Web Monitoring for Master's Research
Budget: €30 – €250 EUR
I am conducting a study for my master's degree where I will be analyzing real-time pages and resources from the dark web. I'm looking for a web crawler that's capable of gathering and interpreting data for the following:
- Content and analysis of illegal activities including.he focus is not narrowed to a particular category. Rather, the study includes all forms of illegal activities found on these platforms.
The qualified freelancer needs to have:
- Prior experience with web crawling on the dark side of the internet.
- Deep understanding in interpretation of this data.
- Confidentiality, trustworthiness and legitimate means of sourcing the information.
- Ability to deliver real-time data for immediate analysis.
I have already started the proccess, I have created a script using scrapy for the crawling process but for the urls that are .onion I get an error. After crawling those pages I need to save data in a database and then analyze them with python.
Ethics and legality are paramount for this project. Although this is a study on illegal activities, the freelancer must operate within the boundaries of the law. Best practices should be used at all times to ensure we do not propagate or engage in these activities.
- Content and analysis of illegal activities including.he focus is not narrowed to a particular category. Rather, the study includes all forms of illegal activities found on these platforms.
The qualified freelancer needs to have:
- Prior experience with web crawling on the dark side of the internet.
- Deep understanding in interpretation of this data.
- Confidentiality, trustworthiness and legitimate means of sourcing the information.
- Ability to deliver real-time data for immediate analysis.
I have already started the proccess, I have created a script using scrapy for the crawling process but for the urls that are .onion I get an error. After crawling those pages I need to save data in a database and then analyze them with python.
Ethics and legality are paramount for this project. Although this is a study on illegal activities, the freelancer must operate within the boundaries of the law. Best practices should be used at all times to ensure we do not propagate or engage in these activities.