XML Sitemap URL Status Checker
Budget: $10 – $20 USD
Job Description:
We are looking for a skilled freelancer to help us identify and analyze URLs in our sitemap files that are returning 404 errors or other HTTP status issues. The project involves parsing our sitemap-index.xml file, extracting all URLs, and checking their status codes. If any URLs are broken (e.g., 404 errors), they must be reported in a detailed and organized format.
Responsibilities:
Access and parse the provided sitemap-index.xml file.
Extract all URLs from the sitemap(s), including those linked within an index file.
Perform HTTP status checks on all extracted URLs.
Identify and report URLs returning 404 errors, redirects, or other HTTP issues.
Provide the final report in a structured format (CSV or Excel) containing:
URL
HTTP Status Code
Error Details (if applicable)
Requirements:
Proven experience with web crawling, sitemap parsing, and HTTP status checking.
Proficiency in a scripting language like Python (preferred), PHP, or another suitable technology.
Familiarity with tools and libraries such as requests, BeautifulSoup, or similar for parsing and requests.
Ability to handle large sitemap files efficiently.
Strong organizational skills and attention to detail.
Deliverables:
A CSV/Excel report listing all URLs with their respective HTTP status codes.
Highlighted URLs that return 404 errors or other issues.
Optional: Suggestions for resolving errors if applicable.
Preferred Qualifications:
Experience with SEO and site audits.
Familiarity with tools like Screaming Frog, Sitebulb, or similar is a plus.
Ability to automate the process for future use.
We are looking for a skilled freelancer to help us identify and analyze URLs in our sitemap files that are returning 404 errors or other HTTP status issues. The project involves parsing our sitemap-index.xml file, extracting all URLs, and checking their status codes. If any URLs are broken (e.g., 404 errors), they must be reported in a detailed and organized format.
Responsibilities:
Access and parse the provided sitemap-index.xml file.
Extract all URLs from the sitemap(s), including those linked within an index file.
Perform HTTP status checks on all extracted URLs.
Identify and report URLs returning 404 errors, redirects, or other HTTP issues.
Provide the final report in a structured format (CSV or Excel) containing:
URL
HTTP Status Code
Error Details (if applicable)
Requirements:
Proven experience with web crawling, sitemap parsing, and HTTP status checking.
Proficiency in a scripting language like Python (preferred), PHP, or another suitable technology.
Familiarity with tools and libraries such as requests, BeautifulSoup, or similar for parsing and requests.
Ability to handle large sitemap files efficiently.
Strong organizational skills and attention to detail.
Deliverables:
A CSV/Excel report listing all URLs with their respective HTTP status codes.
Highlighted URLs that return 404 errors or other issues.
Optional: Suggestions for resolving errors if applicable.
Preferred Qualifications:
Experience with SEO and site audits.
Familiarity with tools like Screaming Frog, Sitebulb, or similar is a plus.
Ability to automate the process for future use.