Python developer to create proof of concept web info extraction solution
Budget: $10 – $30 CAD
Please read the following job description and submit an initial idea for a solution for this project. Payment is $25 CAD, but there is a potential for future work upon successfully completing this job.
Objective: Our goal is to assess software documentation for accessibility compliance by analyzing content on official software websites, focusing on adherence to WCAG (Web Content Accessibility Guidelines) standards.
Project Description: We require a Python developer to automate evaluating software documentation for accessibility issues. The solution should encompass the following functionalities:
Automate Software Homepage Discovery: Use a search API, such as Google Custom Search API, to locate the homepage of specified software automatically, eliminating the need for manual input.
Scrape Accessibility Information: Upon locating the homepage, employ a web scraping framework like Scrapy to navigate to and extract content from the software's accessibility page by searching for related keywords.
Analyze Documentation Against WCAG Standards: Utilize a Language Learning Model (LLM) to efficiently compare the scraped information with WCAG guidelines, employing a vector database for this analysis.
Develop a User Interface: Implement a simple UI that allows users to input software names and receive comprehensive reports on WCAG compliance. Streamlit is suggested for its simplicity and effectiveness.
Technical Requirements:
1. Familiarity with Python, especially with Scrapy and Google's Custom Search API.
2. Experience with Natural Language Processing (NLP) and LLMs for content analysis (preferred).
Familiarity with WCAG guidelines and accessibility evaluation practices (preferred). (link: https://www.w3.org/TR/WCAG22/)
Code Snippets: Provided to illustrate expectations and offer a starting point, though modifications may be necessary based on the developer's approach.
Application Instructions: Interested candidates should submit a proposal detailing their experience with web scraping and LLMs, including a brief plan of approach for this project. Highlight any specific technologies or frameworks you intend to utilize.
Note about the solution: There are no initial first steps. I have outlined one potential solution in this job description, but the final solution is for you to come up with.
Objective: Our goal is to assess software documentation for accessibility compliance by analyzing content on official software websites, focusing on adherence to WCAG (Web Content Accessibility Guidelines) standards.
Project Description: We require a Python developer to automate evaluating software documentation for accessibility issues. The solution should encompass the following functionalities:
Automate Software Homepage Discovery: Use a search API, such as Google Custom Search API, to locate the homepage of specified software automatically, eliminating the need for manual input.
Scrape Accessibility Information: Upon locating the homepage, employ a web scraping framework like Scrapy to navigate to and extract content from the software's accessibility page by searching for related keywords.
Analyze Documentation Against WCAG Standards: Utilize a Language Learning Model (LLM) to efficiently compare the scraped information with WCAG guidelines, employing a vector database for this analysis.
Develop a User Interface: Implement a simple UI that allows users to input software names and receive comprehensive reports on WCAG compliance. Streamlit is suggested for its simplicity and effectiveness.
Technical Requirements:
1. Familiarity with Python, especially with Scrapy and Google's Custom Search API.
2. Experience with Natural Language Processing (NLP) and LLMs for content analysis (preferred).
Familiarity with WCAG guidelines and accessibility evaluation practices (preferred). (link: https://www.w3.org/TR/WCAG22/)
Code Snippets: Provided to illustrate expectations and offer a starting point, though modifications may be necessary based on the developer's approach.
Application Instructions: Interested candidates should submit a proposal detailing their experience with web scraping and LLMs, including a brief plan of approach for this project. Highlight any specific technologies or frameworks you intend to utilize.
Note about the solution: There are no initial first steps. I have outlined one potential solution in this job description, but the final solution is for you to come up with.