Skip to content

feat: Add FlinkApplicationComputeEngine for materialization via the Flink Operator - #7183

Open
ntkathole wants to merge 1 commit into
feast-dev:masterfrom
ntkathole:feat/flink-application-compute-engine
Open

ntkathole wants to merge 1 commit into
feast-dev:masterfrom
ntkathole:feat/flink-application-compute-engine

Conversation

@ntkathole

@ntkathole ntkathole commented Nov 19, 2026 •

Copy link
Copy Markdown
Member

What this PR does / why we need it:

Feast has no way to run batch materialization on Apache Flink in Kubernetes. This adds a flink_application compute engine that materializes feature views as a FlinkDeployment, managed by the Apache Flink Kubernetes Operator - giving Flink users (and Confluent Platform for Apache Flink, which ships that operator) an operator-native materialization path.


Devin Review

@ntkathole ntkathole self-assigned this Nov 19, 2026
@ntkathole
ntkathole requested a review from a team as a code owner November 19, 2026 09:22
@codecov-commenter

codecov-commenter commented Nov 19, 2026 •

Copy link
Copy Markdown

⚠️ Please install the 'codecov app svg image' to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

❌ Patch coverage is 62.50000% with 93 lines in your changes missing coverage. Please review.
✅ Project coverage is 53.76%. Comparing base (cf013eb) to head (5692b56).
⚠️ Report is 1 commits behind head on master.

Files with missing lines Patch % Lines
...n/feast/infra/compute_engines/operator/launcher.py 57.60% 33 Missing and 6 partials ⚠️
...infra/compute_engines/flink_application/compute.py 57.69% 16 Missing and 6 partials ⚠️
...st/infra/compute_engines/flink_application/main.py 0.00% 14 Missing ⚠️
.../python/feast/infra/compute_engines/flink/utils.py 57.89% 7 Missing and 1 partial ⚠️
...st/infra/compute_engines/spark_application/main.py 0.00% 7 Missing ⚠️
...ast/infra/compute_engines/flink_application/job.py 92.10% 2 Missing and 1 partial ⚠️
❗ Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #7183      +/-   ##
==========================================
+ Coverage   53.63%   53.76%   +0.12%     
==========================================
  Files         462      467       +5     
  Lines       58537    58683     +146     
  Branches     8632     8643      +11     
==========================================
+ Hits        31397    31551     +154     
+ Misses      25005    24984      -21     
- Partials     2135     2148      +13     
Flag Coverage Δ
go-feature-server 30.96% <ø> (ø)
python-unit 55.35% <62.50%> (+0.13%) ⬆️
Files with missing lines Coverage Δ
.../infra/compute_engines/flink_application/config.py 100.00% <100.00%> (ø)
...on/feast/infra/compute_engines/operator/compute.py 69.41% <100.00%> (+1.17%) ⬆️
sdk/python/feast/repo_config.py 81.39% <ø> (+0.93%) ⬆️
...ast/infra/compute_engines/flink_application/job.py 92.10% <92.10%> (ø)
...st/infra/compute_engines/spark_application/main.py 0.00% <0.00%> (ø)
.../python/feast/infra/compute_engines/flink/utils.py 57.23% <57.89%> (-0.88%) ⬇️
...st/infra/compute_engines/flink_application/main.py 0.00% <0.00%> (ø)
...infra/compute_engines/flink_application/compute.py 57.69% <57.69%> (ø)
...n/feast/infra/compute_engines/operator/launcher.py 57.60% <57.60%> (ø)

Continue to review full report in Codecov by Harness.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update cf013eb...5692b56. Read the comment docs.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@devin-ai-integration devin-ai-integration Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Devin Review found 1 potential issue.

2 flags not posted on this PR by your GitHub settings — view them in Devin Review. (Configure)

Devin Review

@ntkathole
ntkathole force-pushed the feat/flink-application-compute-engine branch from e21aa50 to afb8df9 Compare November 19, 2026 09:37

@franciscojavierarceo franciscojavierarceo left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we need integration coverage for the new operator-backed materialization path before merging.

…link Operator

Signed-off-by: ntkathole <nikhilkathole2683@gmail.com>
@ntkathole
ntkathole force-pushed the feat/flink-application-compute-engine branch from afb8df9 to 5692b56 Compare November 19, 2026 13:24

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants