C# Developer with MongoDB Experience for Web Crawling Tool
Budget: $30 – $250 USD
Job Description:
We are seeking an experienced C# developer to update our existing web crawling tool, which extracts data from Aliexpress.com and exports it to .CSV files. The tool also interacts with a MongoDB database. Aliexpress.com recently updated its data structure, making our tool non-functional. The successful candidate will need to understand the new data structure, modify our existing codebase, and restore the tool's functionality.
Responsibilities:
Understand the existing codebase of the web crawling tool, its design, and its interaction with both Aliexpress.com and MongoDB.
Conduct a thorough analysis of the updated data structure of Aliexpress.com and identify the necessary changes required to our existing tool.
Modify the C# code to ensure the tool properly interfaces with the new data structure of Aliexpress.com, successfully crawls and retrieves the required data.
Ensure seamless interaction between the updated tool and MongoDB, including data storage and retrieval operations.
Update the data exporting module to ensure the crawled data is correctly formatted and exported into .CSV files.
Perform comprehensive testing to ensure the updated tool operates as expected, handles edge cases and interacts flawlessly with MongoDB.
Document changes, code modifications, and update user manual for the tool.
Collaborate with the team to understand any additional requirements, and incorporate them if necessary.
Requirements:
Proficient in C# with a deep understanding of its ecosystems.
Proven experience in web crawling, data extraction, and managing different data structures.
Demonstrable experience with MongoDB - data manipulation, storage, and retrieval operations.
Knowledge of data export processes, preferably into .CSV files.
Experience with working and manipulating .NET Framework and .NET Core.
Strong understanding of web protocols, asynchronous programming, and performance considerations.
Exceptional troubleshooting skills with meticulous attention to detail.
Knowledge of writing clean, readable C# code.
Excellent communication skills for effective collaboration and documentation.
We are seeking an experienced C# developer to update our existing web crawling tool, which extracts data from Aliexpress.com and exports it to .CSV files. The tool also interacts with a MongoDB database. Aliexpress.com recently updated its data structure, making our tool non-functional. The successful candidate will need to understand the new data structure, modify our existing codebase, and restore the tool's functionality.
Responsibilities:
Understand the existing codebase of the web crawling tool, its design, and its interaction with both Aliexpress.com and MongoDB.
Conduct a thorough analysis of the updated data structure of Aliexpress.com and identify the necessary changes required to our existing tool.
Modify the C# code to ensure the tool properly interfaces with the new data structure of Aliexpress.com, successfully crawls and retrieves the required data.
Ensure seamless interaction between the updated tool and MongoDB, including data storage and retrieval operations.
Update the data exporting module to ensure the crawled data is correctly formatted and exported into .CSV files.
Perform comprehensive testing to ensure the updated tool operates as expected, handles edge cases and interacts flawlessly with MongoDB.
Document changes, code modifications, and update user manual for the tool.
Collaborate with the team to understand any additional requirements, and incorporate them if necessary.
Requirements:
Proficient in C# with a deep understanding of its ecosystems.
Proven experience in web crawling, data extraction, and managing different data structures.
Demonstrable experience with MongoDB - data manipulation, storage, and retrieval operations.
Knowledge of data export processes, preferably into .CSV files.
Experience with working and manipulating .NET Framework and .NET Core.
Strong understanding of web protocols, asynchronous programming, and performance considerations.
Exceptional troubleshooting skills with meticulous attention to detail.
Knowledge of writing clean, readable C# code.
Excellent communication skills for effective collaboration and documentation.