Release Notes - Kafka - Version 3.6.1

Below is a summary of the JIRA issues addressed in the 3.6.1 release of Kafka. For full documentation of the release, a guide to get started, and information about the project, see the Kafka project site.

Note about upgrades: Please carefully review the upgrade documentation for this release thoroughly before upgrading your cluster. The upgrade notes discuss any critical information about incompatibilities and breaking changes, performance changes, and any other changes that might impact your production deployment of Kafka.

The documentation for the most recent release can be found at https://kafka.apache.org/documentation.html.

Improvement

• [KAFKA-15415] - In Java-client, backoff should be skipped for retried producer-batch to a new leader
• [KAFKA-15596] - Upgrade ZooKeeper to 3.8.3

Bug

• [KAFKA-13973] - block-cache-capacity metrics worth twice as much as normal
• [KAFKA-14767] - Gradle build fails with missing commitId after git gc
• [KAFKA-15481] - Concurrency bug in RemoteIndexCache leads to IOException
• [KAFKA-15491] - RackId doesn't exist error while running WordCountDemo
• [KAFKA-15502] - Handle large keystores in SslEngineValidator
• [KAFKA-15552] - Duplicate Producer ID blocks during ZK migration
• [KAFKA-15571] - StateRestoreListener#onRestoreSuspended is never called because wrapper DelegatingStateRestoreListener doesn't implement onRestoreSuspended
• [KAFKA-15602] - Breaking change in 3.4.0 ByteBufferSerializer
• [KAFKA-15605] - Topics marked for deletion in ZK are incorrectly migrated to KRaft
• [KAFKA-15607] - Possible NPE is thrown in MirrorCheckpointTask
• [KAFKA-15644] - Fix CVE-2023-4586 in netty:handler
• [KAFKA-15653] - NPE in ChunkedByteStream
• [KAFKA-15658] - Zookeeper.jar | CVE-2023-44981
• [KAFKA-15680] - Partition-Count is not getting updated Correctly in the Incremental Co-operative Rebalancing(ICR) Mode of Rebalancing
• [KAFKA-15693] - Disabling scheduled rebalance delay in Connect can lead to indefinitely unassigned connectors and tasks
• [KAFKA-15755] - LeaveGroupResponse v0-v2 should handle no members
• [KAFKA-15771] - ProduceRequest#partitionSizes() is not an atomic operation
• [KAFKA-15799] - ZK brokers incorrectly handle KRaft metadata snapshots
• [KAFKA-15800] - Malformed connect source offsets corrupt other partitions with DataException
• [KAFKA-15802] - Trying to access uncopied segments metadata on listOffsets
• [KAFKA-15825] - KRaft controller writes empty state to ZK after migration

Task

• [KAFKA-15093] - Add 3.5.0 to broker/client and streams upgrade/compatibility tests
• [KAFKA-15378] - Rolling upgrade system tests are failing
• [KAFKA-15479] - Remote log segments should be considered once for retention breach
• [KAFKA-15664] - Add 3.4.0 streams upgrade/compatibility tests

Test

• [KAFKA-15169] - Add tests for RemoteIndexCache
• [KAFKA-15793] - Flaky test ZkMigrationIntegrationTest.testMigrateTopicDeletions