Package

kafka

message

Permalink

package message

Visibility
  1. Public
  2. All

Type Members

  1. sealed trait BrokerCompressionCodec extends AnyRef

    Permalink
  2. class BufferingOutputStream extends OutputStream

    Permalink
  3. class ByteBufferBackedInputStream extends InputStream

    Permalink
  4. class ByteBufferMessageSet extends MessageSet with Logging

    Permalink

    A sequence of messages stored in a byte buffer

    A sequence of messages stored in a byte buffer

    There are two ways to create a ByteBufferMessageSet

    Option 1: From a ByteBuffer which already contains the serialized message set. Consumers will use this method.

    Option 2: Give it a list of messages along with instructions relating to serialization format. Producers will use this method.

  5. sealed trait CompressionCodec extends AnyRef

    Permalink
  6. class InvalidMessageException extends RuntimeException

    Permalink

    Indicates that a message failed its checksum and is corrupt

  7. class Message extends AnyRef

    Permalink

    A message.

    A message. The format of an N byte message is the following:

    1. 4 byte CRC32 of the message 2. 1 byte "magic" identifier to allow format changes, value is 0 currently 3. 1 byte "attributes" identifier to allow annotations on the message independent of the version (e.g. compression enabled, type of codec used) 4. 4 byte key length, containing length K 5. K byte key 6. 4 byte payload length, containing length V 7. V byte payload

    Default constructor wraps an existing ByteBuffer with the Message object with no change to the contents.

  8. case class MessageAndMetadata[K, V](topic: String, partition: Int, rawMessage: Message, offset: Long, keyDecoder: Decoder[K], valueDecoder: Decoder[V]) extends Product with Serializable

    Permalink
  9. case class MessageAndOffset(message: Message, offset: Long) extends Product with Serializable

    Permalink
  10. class MessageLengthException extends RuntimeException

    Permalink

    Indicates the presense of a message that exceeds the maximum acceptable length (whatever that happens to be)

  11. abstract class MessageSet extends Iterable[MessageAndOffset]

    Permalink

    A set of messages with offsets.

    A set of messages with offsets. A message set has a fixed serialized form, though the container for the bytes could be either in-memory or on disk. The format of each message is as follows: 8 byte message offset number 4 byte size containing an integer N N message bytes as described in the Message class

  12. class MessageWriter extends BufferingOutputStream

    Permalink

Value Members

  1. object BrokerCompressionCodec

    Permalink
  2. object ByteBufferMessageSet

    Permalink
  3. object CompressionCodec

    Permalink
  4. object CompressionFactory

    Permalink
  5. object DefaultCompressionCodec extends CompressionCodec with BrokerCompressionCodec with Product with Serializable

    Permalink
  6. object GZIPCompressionCodec extends CompressionCodec with BrokerCompressionCodec with Product with Serializable

    Permalink
  7. object LZ4CompressionCodec extends CompressionCodec with BrokerCompressionCodec with Product with Serializable

    Permalink
  8. object Message

    Permalink

    Constants related to messages

  9. object MessageSet

    Permalink

    Message set helper functions

  10. object NoCompressionCodec extends CompressionCodec with BrokerCompressionCodec with Product with Serializable

    Permalink
  11. object ProducerCompressionCodec extends BrokerCompressionCodec with Product with Serializable

    Permalink
  12. object SnappyCompressionCodec extends CompressionCodec with BrokerCompressionCodec with Product with Serializable

    Permalink
  13. object UncompressedCodec extends BrokerCompressionCodec with Product with Serializable

    Permalink

Ungrouped