BigQuery Expert Needed: Resolve "Partition Filter Required" Error in Streaming Data Setup

Job ID: 37793142

Budget: $10 – $30 USD

We are encountering an issue with our Google BigQuery setup involving streaming data replication from MySQL. Suddenly, we started receiving the following error:

"The query cannot be executed because the table [table_name] requires partition filter and contains unapplied upsert data that is stale based on the max_staleness setting."

We have not made any recent changes to our setup, and this error appeared seemingly out of nowhere. We suspect it might be related to unapplied upsert operations and the max_staleness setting in BigQuery.

We are seeking a skilled BigQuery expert who can help us diagnose and resolve this issue promptly.