Project: Search Engine Web site
Budget: $30 – $250 USD
budget : $50
Project: Search Engine
Implement the simplified Search Engine described in Section 23.6 (Subsection; Search Engine) for the pages of a small Web site. Use all the words in the pages of the site as index terms, excluding stop words such as articles, prepositions, and pronouns.
Submit the following four files:
1. A read me file that contains details of your approach to the problem, including a description of the Algorithms and Data Structure used.
2. Your coded, well-commented code file in your favorite language, such as Python
3. The input file that contains the few pages you have used as input, including some links to your other pages..
4. Output file that has samples of your run. Make sure you have tested the boundary conditions.
5. Provide a short video demonstrating the execution of your project. (Include the testing of boundary conditions as well).
The following Question and Answers should be used as further guidance on your implementation:
1. Should I use internet documents or create my own?
Answer: You may download several pages (5 to 10) from Internet, or develop them yourself, and use them as input. Make sure there are some hyperlink between the documents and you can add more pages to your existing ones that is gathered by Web Crawler.
2. Can I use Other Search Engine or Data Structures?
Answer: No. You shall implement what is described in Section 23.6.4. using the approach specified. You are not allowed to use Algorithms and Data Structures that are not covered in the textbook, but you can develop new algorithms based on the data structures that you have seen and proved in the textbook.
3. What criteria should I use for ranking?
Answer: I leave that to you to come up with some simple criteria and algorithm to implement ranking, such as the number of times a word has appeared in the document or any other idea you have. But please explain your approach.
4. Can I provide screenshots of my output?
Answer: Yes.
5. How can I read the web pages in?
Answer:
If you are using java, use jsoup: https://jsoup.org/Links to an external site..
If you are using Python, use beautiful soup:https://www.crummy.com/software/BeautifulSoup/bs4/doc/
6. Can I use any available packages for parsing?
Answer: Yes
Note : i attached all required file (section 8_2, file 23_6)
Project: Search Engine
Implement the simplified Search Engine described in Section 23.6 (Subsection; Search Engine) for the pages of a small Web site. Use all the words in the pages of the site as index terms, excluding stop words such as articles, prepositions, and pronouns.
Submit the following four files:
1. A read me file that contains details of your approach to the problem, including a description of the Algorithms and Data Structure used.
2. Your coded, well-commented code file in your favorite language, such as Python
3. The input file that contains the few pages you have used as input, including some links to your other pages..
4. Output file that has samples of your run. Make sure you have tested the boundary conditions.
5. Provide a short video demonstrating the execution of your project. (Include the testing of boundary conditions as well).
The following Question and Answers should be used as further guidance on your implementation:
1. Should I use internet documents or create my own?
Answer: You may download several pages (5 to 10) from Internet, or develop them yourself, and use them as input. Make sure there are some hyperlink between the documents and you can add more pages to your existing ones that is gathered by Web Crawler.
2. Can I use Other Search Engine or Data Structures?
Answer: No. You shall implement what is described in Section 23.6.4. using the approach specified. You are not allowed to use Algorithms and Data Structures that are not covered in the textbook, but you can develop new algorithms based on the data structures that you have seen and proved in the textbook.
3. What criteria should I use for ranking?
Answer: I leave that to you to come up with some simple criteria and algorithm to implement ranking, such as the number of times a word has appeared in the document or any other idea you have. But please explain your approach.
4. Can I provide screenshots of my output?
Answer: Yes.
5. How can I read the web pages in?
Answer:
If you are using java, use jsoup: https://jsoup.org/Links to an external site..
If you are using Python, use beautiful soup:https://www.crummy.com/software/BeautifulSoup/bs4/doc/
6. Can I use any available packages for parsing?
Answer: Yes
Note : i attached all required file (section 8_2, file 23_6)