PyFlink Application for Kinesis Stream Processing
Budget: $30 – $250 USD
I need a PyFlink application developed that operates within AWS's managed Flink service. This application should read from an input Kinesis stream and write to a different Kinesis stream. The input stream only contains the 'after' field, so the application will need to use Flink's state group by reduce to calculate the 'before' value from 'after'. Furthermore, the application should also perform a stream join with the full state of a table being accessible.
Before calculating the 'before' value, certain transformations must be applied to the 'after' field. Specifically, the application needs to filter the data based on specific values.
Ideal Skills and Experience:
- Extensive knowledge and experience with PyFlink and AWS managed Flink
- Proficient in Kinesis stream processing
- Strong understanding of state group by reduce
- Experienced in data filtering
- Familiar with performing stream joins
Before calculating the 'before' value, certain transformations must be applied to the 'after' field. Specifically, the application needs to filter the data based on specific values.
Ideal Skills and Experience:
- Extensive knowledge and experience with PyFlink and AWS managed Flink
- Proficient in Kinesis stream processing
- Strong understanding of state group by reduce
- Experienced in data filtering
- Familiar with performing stream joins