BigQuery Webhook Ingestion Pipeline

I need a Google Cloud / BigQuery specialist to stand up an end-to-end, webhook-driven data ingestion pipeline running in our production environment. When our external form system fires a webhook, your Cloud Function (or equivalent service) should capture the JSON payload, write the untouched record to a raw BigQuery table, then immediately process it.

The processing step must
• parse any nested JSON,
• flatten and clean each answer field,
• split the results into two purpose-built reporting tables, and
• guarantee idempotency through a hashing technique that blocks duplicates.

All components have to be secure, version-controlled, and able to scale with traffic spikes. This is strictly a backend/data-engineering job—no UI work is involved.