Update Python/Django E-commerce Scraper

I have an existing Python code-base built on Django 2.x that used to crawl an e-commerce site and capture pricing information, inventory numbers and other store-specific details. The core logic—parsers, database schema and most of the view/command wiring—is already in place, but the project has been dormant long enough that dependency upgrades and Django breaking changes have left it unusable.

Here’s what I need:

• Bring the project up to the current stable Django release (along with any ancillary package bumps such as Requests, BeautifulSoup4, Selenium or Scrapy if you prefer).
• Refactor or replace code that breaks under the new versions—URL routing, middleware, settings, models and any async or ORM changes included.
• Verify that the scraper can again log in, page through listings, and persist the target data points (prices, stock counts, store IDs) without manual intervention.
• Restore or add unit tests so future upgrades are painless.
• Document setup and a simple command (manage.py task, cron, or Celery beat job—your call) that kicks off the crawl and writes results to the database or CSV.

Once I can pull the repo, run the migration/requirements install, trigger the crawl and see fresh rows hitting the tables, we’re done. If you’re comfortable navigating legacy Django code and love turning red test suites green, let’s talk—you’ll have commit access and I’ll be available for quick clarifications throughout the process.