Darknet Leak & Ransomware Detection Platform -- 2
Budget: $250 – $750 USD
Leak & Ransomware Monitoring Platform — Specification
Core Features
Timeline Feed: Unified stream of posts from dark web (Tor), surface web blogs/news, Telegram channels, social media, RSS, GitHub, paste sites.
Post Capture: Store text, metadata, and full-page screenshot. Links included.
Search & Queries: Full-text search with filters (source, date, keywords). Saved queries become custom feeds/pages that auto-update.
Post Actions: Save/bookmark, mark as handled/downloaded, add notes/tags.
Reminders: Attach reminders to posts (e.g. ransomware deadlines). Posts reappear in a dedicated Reminders view on the chosen date.
Export: Selected posts or feeds exported to PDF (with screenshots) or Excel/CSV.
Ransomware Section: Highlight latest leak-site posts, grouped by ransomware actor.
Notifications (In-App): Bell icon for new matches (saved queries) and reminders. No external email/SMS.
Sources Management: Add/edit/remove sources (dark web, blogs, RSS, Telegram, etc.), categorize/tag, monitor health.
User Management: Multi-role system (Admin, Analyst, Viewer). Admins manage sources, users, backups.
Backup/Restore: One-click backup of database + screenshots; restore to new instance. Local storage only.
Backend (Python)
FastAPI for REST API with automatic Swagger/OpenAPI export.
PostgreSQL (or SQLite small-scale) for structured data.
Scrapers: Modular connectors for Tor (requests via proxy), Telegram (Telethon), RSS (feedparser), web (Scrapy/Playwright), GitHub API.
Scheduler: APScheduler or Celery for periodic scraping, reminder checks, notifications.
Auth: JWT-based sessions; role-based permissions.
Evidence Handling: Store both parsed text and screenshot files locally.
Frontend (NodeJS + Shadcn/UI)
React/Next.js with TypeScript.
Shadcn/UI + Tailwind for a clean analyst dashboard (timeline, search, reminders, admin panels).
API Integration: Generate TypeScript client from backend OpenAPI spec.
Views:
Timeline (all posts, filters)
Saved Queries (custom feeds)
Saved Items & Reminders
Sources & Users (admin)
Notifications dropdown/panel
Competitive Advantages
Covers all major leak channels (darknet forums, ransomware sites, Telegram, GitHub).
Preserves context + evidence (text + screenshots).
Custom feeds + reminders give analysts continuous watch-lists.
Local-only storage & backups for sensitive data control.
Extensible modular design (easy to add new connectors).
Core Features
Timeline Feed: Unified stream of posts from dark web (Tor), surface web blogs/news, Telegram channels, social media, RSS, GitHub, paste sites.
Post Capture: Store text, metadata, and full-page screenshot. Links included.
Search & Queries: Full-text search with filters (source, date, keywords). Saved queries become custom feeds/pages that auto-update.
Post Actions: Save/bookmark, mark as handled/downloaded, add notes/tags.
Reminders: Attach reminders to posts (e.g. ransomware deadlines). Posts reappear in a dedicated Reminders view on the chosen date.
Export: Selected posts or feeds exported to PDF (with screenshots) or Excel/CSV.
Ransomware Section: Highlight latest leak-site posts, grouped by ransomware actor.
Notifications (In-App): Bell icon for new matches (saved queries) and reminders. No external email/SMS.
Sources Management: Add/edit/remove sources (dark web, blogs, RSS, Telegram, etc.), categorize/tag, monitor health.
User Management: Multi-role system (Admin, Analyst, Viewer). Admins manage sources, users, backups.
Backup/Restore: One-click backup of database + screenshots; restore to new instance. Local storage only.
Backend (Python)
FastAPI for REST API with automatic Swagger/OpenAPI export.
PostgreSQL (or SQLite small-scale) for structured data.
Scrapers: Modular connectors for Tor (requests via proxy), Telegram (Telethon), RSS (feedparser), web (Scrapy/Playwright), GitHub API.
Scheduler: APScheduler or Celery for periodic scraping, reminder checks, notifications.
Auth: JWT-based sessions; role-based permissions.
Evidence Handling: Store both parsed text and screenshot files locally.
Frontend (NodeJS + Shadcn/UI)
React/Next.js with TypeScript.
Shadcn/UI + Tailwind for a clean analyst dashboard (timeline, search, reminders, admin panels).
API Integration: Generate TypeScript client from backend OpenAPI spec.
Views:
Timeline (all posts, filters)
Saved Queries (custom feeds)
Saved Items & Reminders
Sources & Users (admin)
Notifications dropdown/panel
Competitive Advantages
Covers all major leak channels (darknet forums, ransomware sites, Telegram, GitHub).
Preserves context + evidence (text + screenshots).
Custom feeds + reminders give analysts continuous watch-lists.
Local-only storage & backups for sensitive data control.
Extensible modular design (easy to add new connectors).