Release Notes - Kafka - Version 0.7.1

Sub-task

[KAFKA-265] - Add a queue of zookeeper notifications in the zookeeper consumer to reduce the number of rebalancing attempts

Bug

[KAFKA-197] - Embedded consumer doesn't shut down if the server can't start
[KAFKA-204] - BoundedByteBufferReceive hides OutOfMemoryError
[KAFKA-212] - IllegalThreadStateException in topic watcher for Kafka mirroring
[KAFKA-218] - ZOOKEEPER-961 is nasty, upgrade to zk 3.3.4
[KAFKA-220] - LogManager test fails on linux
[KAFKA-225] - Bug in mirroring code causes mirroring to halt
[KAFKA-226] - SyncProducer connect may return failed connection on reconnect
[KAFKA-241] - ConsumerIterator throws a IllegalStateException after a ConsumerTimeout occurs
[KAFKA-247] - max.message.size and fetch.size defaults should be consistent
[KAFKA-256] - Bug in the consumer rebalancing logic leads to the consumer not pulling data from some partitions
[KAFKA-261] - Corrupted request shuts down the broker
[KAFKA-262] - Bug in the consumer rebalancing logic causes one consumer to release partitions that it does not own
[KAFKA-277] - Add a shallow iterator to the ByteBufferMessageSet, which is only used in SynchProducer.verifyMessageSize() function
[KAFKA-279] - kafka-console-producer does not take in customized values of --batch-size or --timeout
[KAFKA-286] - consumer sometimes don't release partition ownership properly in ZK during rebalance
[KAFKA-292] - broker deletes all file segments when cleaning up an empty log segment
[KAFKA-326] - CallbackHandler.afterDequeuingExistingData is not called during event queue timeout

Improvement

[KAFKA-198] - Avoid duplicated message during consumer rebalance
[KAFKA-200] - Support configurable send / receive socket buffer size in server
[KAFKA-210] - javaapi ZookeeperConsumerConnectorTest duplicates many tests in the scala version
[KAFKA-213] - make # of consumer rebalance retries configurable
[KAFKA-214] - SyncProducer should log host and port if can't connect.
[KAFKA-228] - Reduce duplicate messages served by the kafka consumer for uncompressed topics
[KAFKA-231] - avoid logging stacktrace directly
[KAFKA-234] - Make backoff time during consumer rebalance configurable
[KAFKA-244] - Improve log4j appender to use kafka.producer.Producer, and support zk.connect|broker.list options
[KAFKA-249] - Separate out Kafka mirroring into a stand-alone app
[KAFKA-257] - Hadoop producer should use software load balancer
[KAFKA-268] - Add another reconnection condition to the syncProducer: the time elapsed since last connection
[KAFKA-272] - add JMX on broker to track bytes/messages per topic
[KAFKA-274] - Handle corrupted messages cleanly
[KAFKA-283] - add jmx beans in broker to track # of failed requests
[KAFKA-285] - Increase maximum value of log.retention.size
[KAFKA-303] - Dead code in the Log4j appender
[KAFKA-315] - enable shallow iterator in ByteBufferMessageSet to allow mirroing data without decompression
[KAFKA-332] - Mirroring should use multiple producers; add producer retries to DefaultEventHandler
[KAFKA-365] - change copyright in NOTICE to 2012
[KAFKA-366] - add jmx beans in broker to track # bytes in consumer
[KAFKA-368] - use the pig core jar from maven instead of distributing it

Task

[KAFKA-254] - A tool to GET Zookeeper partition-offset and output to files
[KAFKA-255] - A tool to UPDATE Zookeeper partition-offset with input from a file

Test

[KAFKA-227] - Add Broker Failure Test for a Single Host