Repository navigation
Upgrade default Apache Pulsar version to 5.0.0 - #723
Merged
Merged
Conversation
Pulsar 5.0.0 no longer publishes the apachepulsar/pulsar-all image, so the chart now uses apachepulsar/pulsar everywhere. - Set appVersion to 5.0.0 and defaultPulsarImageRepository to apachepulsar/pulsar. - Remove the PULSAR_GC defaults so the Pulsar launcher selects the garbage collector options for the Java version in the image, as the Pulsar 5.0 upgrade guide recommends. Move -XX:+AlwaysPreTouch, -XX:+UseTransparentHugePages and -XX:+ExitOnOutOfMemoryError to PULSAR_MEM. - Test the previous LTS with Pulsar 4.0.14 instead of 3.0.17, using the apachepulsar/pulsar image, also with older chart versions that don't support defaultPulsarImageRepository. - Run all upgrade tests that install a previously released chart version with the previous LTS image so that Pulsar 5.0 is never deployed with an older chart version. - Use the default image in the Pulsar v5 Functions test instead of 5.0.0-M1. - Document the Pulsar 5.0 upgrade in README.md.
azure/setup-helm v5.0.0 was removed from the ASF approved actions list, which causes the CI workflow to fail with startup_failure.
Chart versions before 4.6.0 hard-code the BookKeeper statsProviderClass org.apache.bookkeeper.stats.prometheus.PrometheusMetricsProvider, which isn't included in the apachepulsar/pulsar 4.0.x image, so bookies fail to start when chart 3.2.0 is used with Pulsar 4.0.14. Chart 4.6.0 also supports defaultPulsarImageRepository, so the per-component image overrides are no longer needed.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Motivation
Apache Pulsar 5.0.0 has been released. It no longer publishes the
apachepulsar/pulsar-allimage, and the Pulsar 5.0 upgrade guide recommends removingPULSAR_GCoverrides so that the Pulsar launcher selects the garbage collector options for the Java version in the image.Modifications
appVersionto5.0.0anddefaultPulsarImageRepositorytoapachepulsar/pulsar.PULSAR_GCdefaults from all components (the previous defaults included the obsolete-XX:+ZGenerationalflag on Java 25, and the standalone and function worker defaults used G1). Move-XX:+AlwaysPreTouch,-XX:+UseTransparentHugePagesand-XX:+ExitOnOutOfMemoryErrortoPULSAR_MEM.4.0.14instead of3.0.17, usingapachepulsar/pulsar.4.6.0instead of3.2.0in the victoria-metrics-k8s-stack upgrade test. Chart versions before 4.6.0 hard-code the BookKeeperstatsProviderClassorg.apache.bookkeeper.stats.prometheus.PrometheusMetricsProvider, which isn't included in theapachepulsar/pulsar4.0.x image, so bookies fail to start.5.0.0-M1.azure/setup-helmto v5.0.1. v5.0.0 was removed from the ASF allowed actions list, which caused the CI workflow to fail withstartup_failure(also on master).pulsar-allremoval, offloaders and connectors, thePULSAR_GCremoval and the node configuration needed for Transparent Huge Pages, package management rollback settings, TLS hostname verification and the BookKeeper metrics provider class.The
apachepulsar/pulsar:5.0.0image includes the jcloud tiered-storage offloader (S3, GCS, Azure Blob, Aliyun), sobroker.storageOffloadkeeps working. The filesystem offloader and IO connectors are no longer bundled.Verifying this change