Release Notes - Kafka - Version 2.3.1

Below is a summary of the JIRA issues addressed in the 2.3.1 release of Kafka. For full documentation of the release, a guide to get started, and information about the project, see the Kafka project site.

Note about upgrades: Please carefully review the upgrade documentation for this release thoroughly before upgrading your cluster. The upgrade notes discuss any critical information about incompatibilities and breaking changes, performance changes, and any other changes that might impact your production deployment of Kafka.

The documentation for the most recent release can be found at https://kafka.apache.org/documentation.html.

New Feature

• [KAFKA-8952] - Vulnerabilities found for jackson-databind-2.9.9

Improvement

• [KAFKA-8676] - Avoid Stopping Unnecessary Connectors and Tasks

Bug

• [KAFKA-5998] - /.checkpoint.tmp Not found exception
• [KAFKA-6290] - Kafka Connect cast transformation should support logical types
• [KAFKA-6605] - Flatten SMT does not properly handle fields that are null
• [KAFKA-7157] - Connect TimestampConverter SMT doesn't handle null values
• [KAFKA-7941] - Connect KafkaBasedLog work thread terminates when getting offsets fails because broker is unavailable
• [KAFKA-8053] - kafka-topics.sh gives confusing error message when the topic doesn't exist
• [KAFKA-8262] - Flaky Test MetricsIntegrationTest#testStreamMetric
• [KAFKA-8263] - Flaky Test MetricsIntegrationTest#testStreamMetricOfWindowStore
• [KAFKA-8325] - Remove from the incomplete set failed. This should be impossible
• [KAFKA-8412] - Still a nullpointer exception thrown on shutdown while flushing before closing producers
• [KAFKA-8523] - InsertField transformation fails when encountering tombstone event
• [KAFKA-8530] - Consumer should handle authorization errors in OffsetFetch
• [KAFKA-8550] - Connector validation fails with aliased converters
• [KAFKA-8570] - Downconversion could fail when log contains out of order message formats
• [KAFKA-8586] - Source task producers silently fail to send records
• [KAFKA-8591] - NPE when reloading connector configuration using WorkerConfigTransformer
• [KAFKA-8592] - Broker Dynamic Configuration fails to resolve variables as per KIP-421
• [KAFKA-8602] - StreamThread Dies Because Restore Consumer is not Subscribed to Any Topic
• [KAFKA-8615] - Change to track partition time breaks TimestampExtractor
• [KAFKA-8620] - Race condition in StreamThread state change
• [KAFKA-8635] - Unnecessary wait when looking up coordinator before transactional request
• [KAFKA-8637] - WriteBatch objects leak off-heap memory
• [KAFKA-8649] - Error while rolling update from Kafka Streams 2.0.0 -> Kafka Streams 2.1.0
• [KAFKA-8653] - Regression in JoinGroup v0 rebalance timeout handling
• [KAFKA-8662] - Produce fails if a previous produce was to an unauthorized topic
• [KAFKA-8670] - kafka-topics.sh shows IllegalArgumentException when describing all topics if no topics exist on the cluster
• [KAFKA-8678] - LeaveGroup request getErrorResponse is incorrect on throttle time and error setting
• [KAFKA-8715] - Static consumer cannot join group due to ERROR in broker
• [KAFKA-8724] - log cleaner thread dies when attempting to clean a __consumer_offsets partition after upgrade from 2.0->2.3
• [KAFKA-8731] - InMemorySessionStore throws NullPointerException on startup
• [KAFKA-8736] - Performance: ThreadCache uses size() for empty cache check
• [KAFKA-8774] - Connect REST API exposes plaintext secrets in tasks endpoint if config value contains additional characters
• [KAFKA-8788] - Optimize client metadata handling with a large number of partitions
• [KAFKA-8791] - RocksDBTimestampedStore should open in regular mode for new stores
• [KAFKA-8802] - ConcurrentSkipListMap shows performance regression in cache and in-memory store
• [KAFKA-8816] - RecordCollector offsets updated indirectly by StreamTask
• [KAFKA-8824] - InMemoryTimeOrderedKeyValueBuffer propagates nulls when supress is configured
• [KAFKA-8861] - Fix flaky RegexSourceIntegrationTest.testMultipleConsumersCanReadFromPartitionedTopic
• [KAFKA-8875] - CreateTopic API should check topic existence before replication factor
• [KAFKA-8896] - NoSuchElementException after coordinator move
• [KAFKA-8950] - KafkaConsumer stops fetching
• [KAFKA-8974] - Sink Connectors can't handle topic list with whitespaces
• [KAFKA-9014] - AssertionError thrown by SourceRecordWriteCounter when SourceTask.poll returns an empty list
• [KAFKA-9053] - AssignmentInfo#encode hardcodes the LATEST_SUPPORTED_VERSION