Release Notes - Kafka - Version 2.7.1

Below is a summary of the JIRA issues addressed in the 2.7.1 release of Kafka. For full documentation of the release, a guide to get started, and information about the project, see the Kafka project site.

Note about upgrades: Please carefully review the upgrade documentation for this release thoroughly before upgrading your cluster. The upgrade notes discuss any critical information about incompatibilities and breaking changes, performance changes, and any other changes that might impact your production deployment of Kafka.

The documentation for the most recent release can be found at https://kafka.apache.org/documentation.html.

Improvement

• [KAFKA-10852] - AlterIsr should not be throttled
• [KAFKA-12310] - Update zookeeper to 3.5.9
• [KAFKA-12400] - Upgrade jetty to fix CVE-2020-27223
• [KAFKA-12409] - Leaking gauge in ReplicaManager

Bug

• [KAFKA-10021] - When reading to the end of the config log, check if fetch.max.wait.ms is greater than worker.sync.timeout.ms
• [KAFKA-10192] - Flaky test BlockingConnectorTest#testBlockInConnectorStop
• [KAFKA-10340] - Source connectors should report error when trying to produce records to non-existent topics instead of hanging forever
• [KAFKA-10413] - rebalancing leads to unevenly balanced connectors
• [KAFKA-10417] - suppress() with cogroup() throws ClassCastException
• [KAFKA-10658] - ErrantRecordReporter.report always return completed future even though the record is not sent to DLQ topic yet
• [KAFKA-10678] - Re-deploying Streams app causes rebalance and task migration
• [KAFKA-10689] - Assignor can't determine number of partitions on FJK with upstream windowed repartition
• [KAFKA-10705] - Avoid World Readable RocksDB
• [KAFKA-10706] - Liveness bug in truncation protocol can lead to indefinite URP
• [KAFKA-10716] - Streams processId is unstable across restarts resulting in task mass migration
• [KAFKA-10763] - Task already exists error on same worker due to skip removal of tasks
• [KAFKA-10792] - Source tasks can block herder thread by hanging during stop
• [KAFKA-10793] - Race condition in FindCoordinatorFuture permanently severs connection to group coordinator
• [KAFKA-10798] - Failed authentication delay doesn't work with some SASL authentication failures
• [KAFKA-10895] - Basic auth extension's JAAS config can be corrupted by other plugins
• [KAFKA-12152] - Idempotent Producer does not reset the sequence number of partitions without in-flight batches
• [KAFKA-12153] - follower can hit OffsetOutOfRangeException during truncation
• [KAFKA-12190] - Failure on Windows due to an UnsupportedOperationException when StateDirectory sets file permissions
• [KAFKA-12193] - Re-resolve IPs when a client is disconnected
• [KAFKA-12211] - NoSuchFileException will be thrown if hasPersistentStores is false when creating stateDir
• [KAFKA-12219] - Potential race condition in InMemoryKeyValueStore
• [KAFKA-12235] - ZkAdminManager.describeConfigs returns no config when 2+ configuration keys are specified
• [KAFKA-12259] - Consolidated Status endpoint returns 500 when config provider can't find a config
• [KAFKA-12270] - Kafka Connect may fail a task when racing to create topic
• [KAFKA-12272] - Kafka Streams metric commit-latency-max and commit-latency-avg is always 0
• [KAFKA-12321] - the comparison function for uuid type should be 'equals' rather than '=='
• [KAFKA-12323] - Record timestamps not populated in event
• [KAFKA-12324] - Upgrade jetty to fix CVE-2020-27218
• [KAFKA-12326] - MM2 fails to start to due missing required configuration "bootstrap.servers"
• [KAFKA-12339] - Add retry to admin client's listOffsets
• [KAFKA-12340] - Recent change to use SharedTopicAdmin results in potential resource leak in deprecated backing store constructors
• [KAFKA-12343] - Recent change to use SharedTopicAdmin in KakfkaBasedLog fails with AK 0.10.x brokers
• [KAFKA-12389] - Upgrade of netty-codec due to CVE-2021-21290
• [KAFKA-12462] - Threads in PENDING_SHUTDOWN entering a rebalance can cause an illegal state exception
• [KAFKA-12474] - Worker can die if unable to write new session key
• [KAFKA-12508] - Emit-on-change tables may lose updates on error or restart in at_least_once
• [KAFKA-12593] - Some Scala, Python, and Gradle files contain the wrong license header

Sub-task

• [KAFKA-10815] - EosTestDriver#verifyAllTransactionFinished should break loop if all partitions are verified
• [KAFKA-12623] - Fix LICENSE in 2.7