Data Extraction Script for Förderprogramme Database
Budget: €30 – €250 EUR
Description:
We are looking for a freelancer with strong experience in TypeScript and web scraping to build a script that automatically extracts all funding programs listed on the official German funding database:
https://www.foerderdatenbank.de/SiteGlobals/FDB/Forms/Suche/Foederprogrammsuche_Formular.html
The script should crawl through the overview pages and then retrieve all information from each detail page.
Requirements & Deliverables:
• Script written in TypeScript
• AWS S3 integration:
• All attachments (e.g. PDFs) must be uploaded to S3
• Each program should have its own folder identified by a UUID
• The script should run in one continuous execution (not interactive)
• Final output:
• A JSON array containing one object per funding program
• Each object should include the following fields:
{
slug: string;
files: string[];
type: "Garantie" | "Zuschuss" | "Darlehen";
area: string; // predefined enum of areas
contact: string;
name: string;
summarizeText: string;
link: string | null;
additionalInfosText: string;
legalBaseText: string;
}
Technical Notes:
• Must navigate from overview pages into detail pages to extract full information
• Ensure robust handling of different document formats (primarily PDFs)
• UUID-based folder structure in S3
Retrying on failed requests
Estimated Effort:
~5–10 hours
Skills Required:
• TypeScript (Node.js environment)
• Web scraping (cheerio, puppeteer, or similar libraries)
• AWS S3 SDK integration
• JSON structuring and data cleaning
I could have done this on my own - it's about finding someone for the long term / this is kind of the project to understand if the way of working fits
Clean code is important
We are looking for a freelancer with strong experience in TypeScript and web scraping to build a script that automatically extracts all funding programs listed on the official German funding database:
https://www.foerderdatenbank.de/SiteGlobals/FDB/Forms/Suche/Foederprogrammsuche_Formular.html
The script should crawl through the overview pages and then retrieve all information from each detail page.
Requirements & Deliverables:
• Script written in TypeScript
• AWS S3 integration:
• All attachments (e.g. PDFs) must be uploaded to S3
• Each program should have its own folder identified by a UUID
• The script should run in one continuous execution (not interactive)
• Final output:
• A JSON array containing one object per funding program
• Each object should include the following fields:
{
slug: string;
files: string[];
type: "Garantie" | "Zuschuss" | "Darlehen";
area: string; // predefined enum of areas
contact: string;
name: string;
summarizeText: string;
link: string | null;
additionalInfosText: string;
legalBaseText: string;
}
Technical Notes:
• Must navigate from overview pages into detail pages to extract full information
• Ensure robust handling of different document formats (primarily PDFs)
• UUID-based folder structure in S3
Retrying on failed requests
Estimated Effort:
~5–10 hours
Skills Required:
• TypeScript (Node.js environment)
• Web scraping (cheerio, puppeteer, or similar libraries)
• AWS S3 SDK integration
• JSON structuring and data cleaning
I could have done this on my own - it's about finding someone for the long term / this is kind of the project to understand if the way of working fits
Clean code is important