Release Notes - Kafka - Version 3.4.1

Below is a summary of the JIRA issues addressed in the 3.4.1 release of Kafka. For full documentation of the release, a guide to get started, and information about the project, see the Kafka project site.

Note about upgrades: Please carefully review the upgrade documentation for this release thoroughly before upgrading your cluster. The upgrade notes discuss any critical information about incompatibilities and breaking changes, performance changes, and any other changes that might impact your production deployment of Kafka.

The documentation for the most recent release can be found at https://kafka.apache.org/documentation.html.

Improvement

• [KAFKA-13659] - MM2 should read all offset syncs at start up
• [KAFKA-14285] - Delete quota node in zookeeper when configs are empty
• [KAFKA-14565] - Interceptor Resource Leak
• [KAFKA-14610] - Publish Mirror Maker 2 offset syncs in task commit method
• [KAFKA-14666] - MM2 should translate consumer group offsets behind replication flow
• [KAFKA-14837] - The MirrorCheckPointConnector of MM2 will rebalance frequently, when the source cluster group is many more and changes frequently (but the list of configured synchronous group does not change)
• [KAFKA-14842] - MirrorCheckpointTask can reduce the rpc calls of "listConsumerGroupOffsets(group)" of irrelevant groups at each poll
• [KAFKA-14887] - ZK session timeout can cause broker to shutdown
• [KAFKA-14988] - Upgrade scalaCollectionCompact to v2.9 for CVE-2022-36944

Bug

• [KAFKA-5756] - Synchronization issue on flush
• [KAFKA-12468] - Initial offsets are copied from source to target cluster
• [KAFKA-12558] - MM2 may not sync partition offsets correctly
• [KAFKA-13891] - sync group failed with rebalanceInProgress error cause rebalance many rounds in coopeartive
• [KAFKA-13972] - Reassignment cancellation causes stray replicas
• [KAFKA-14016] - Revoke more partitions than expected in Cooperative rebalance
• [KAFKA-14054] - Unexpected client shutdown as TimeoutException is thrown as IllegalStateException
• [KAFKA-14128] - Kafka Streams terminates on topic check
• [KAFKA-14172] - bug: State stores lose state when tasks are reassigned under EOS wit…
• [KAFKA-14295] - FetchMessageConversionsPerSec meter not recorded
• [KAFKA-14455] - Kafka Connect create and update REST APIs should surface failures while writing to the config topic
• [KAFKA-14545] - MirrorCheckpointTask throws NullPointerException when group hasn't consumed from some partitions
• [KAFKA-14639] - Kafka CooperativeStickyAssignor revokes/assigns partition in one rebalance cycle
• [KAFKA-14644] - Process should stop after failure in raft IO thread
• [KAFKA-14645] - Plugin classloader not used when retrieving connector plugin config defs via REST API
• [KAFKA-14649] - Failures instantiating Connect plugins hides other plugins from REST API, or crash worker
• [KAFKA-14659] - source-record-write-[rate|total] metrics include filtered records
• [KAFKA-14660] - Divide by zero security vulnerability (sonatype-2019-0422)
• [KAFKA-14676] - Token endpoint URL used for OIDC cannot be set on the JAAS config
• [KAFKA-14693] - KRaft Controller and ProcessExitingFaultHandler can deadlock shutdown
• [KAFKA-14704] - Follower should truncate before incrementing high watermark
• [KAFKA-14711] - kafaka-metadata-quorum.sh does not honor --command-config
• [KAFKA-14727] - Connect EOS mode should periodically call task commit
• [KAFKA-14743] - MessageConversionsTimeMs for fetch request metric is not updated
• [KAFKA-14774] - the removed listeners should not be reconfigurable
• [KAFKA-14781] - MM2 logs misleading error during topic ACL sync when broker does not have authorizer configured
• [KAFKA-14797] - MM2 does not emit offset syncs when conservative translation logic exceeds positive max.offset.lag
• [KAFKA-14799] - Source tasks fail if connector attempts to abort empty transaction
• [KAFKA-14809] - Connect incorrectly logs that no records were produced by source tasks
• [KAFKA-14816] - Connect loading SSL configs when contacting non-HTTPS URLs
• [KAFKA-14836] - Fix UtilsTest#testToLogDateTimeFormat failure in some cases
• [KAFKA-14843] - Connector plugins config endpoint does not include Common configs
• [KAFKA-14862] - Outer stream-stream join does not output all results with multiple input partitions
• [KAFKA-14864] - Memory leak in KStreamWindowAggregate with ON_WINDOW_CLOSE emit strategy
• [KAFKA-14880] - TransactionMetadata with producer epoch -1 should be expirable
• [KAFKA-14894] - MetadataLoader must call finishSnapshot after loading a snapshot
• [KAFKA-14946] - KRaft controller node shutting down while renouncing leadership
• [KAFKA-14963] - Incorrect partition count metrics for kraft controllers
• [KAFKA-14978] - ExactlyOnceWorkerSourceTask does not remove parent metrics
• [KAFKA-14994] - jose4j is vulnerable to CVE- Improper Cryptographic Algorithm
• [KAFKA-15015] - Binaries contain 2 versions of reload4j

Task

• [KAFKA-14674] - Backport fix for KAFKA-14455 to 3.3 and 3.4 branches
• [KAFKA-14731] - Upgrade ZooKeeper to 3.6.4
• [KAFKA-14869] - txn and group coordinator downgrade foundation
• [KAFKA-14974] - Restore backward compatibility in KafkaBasedLog
• [KAFKA-14983] - Upgrade jetty-server to 9.4.51

Test

• [KAFKA-12566] - Flaky Test MirrorConnectorsIntegrationSSLTest#testReplication
• [KAFKA-14905] - Failing tests in MM2 ForwardingAdmin test since KIP-894