kafka

message

package message

Visibility
  1. Public
  2. All

Type Members

  1. class ByteBufferBackedInputStream extends InputStream

  2. class ByteBufferMessageSet extends MessageSet with Logging

    A sequence of messages stored in a byte buffer

    A sequence of messages stored in a byte buffer

    There are two ways to create a ByteBufferMessageSet

    Option 1: From a ByteBuffer which already contains the serialized message set. Consumers will use this method.

    Option 2: Give it a list of messages along with instructions relating to serialization format. Producers will use this method.

  3. sealed trait CompressionCodec extends AnyRef

  4. class InvalidMessageException extends RuntimeException

    Indicates that a message failed its checksum and is corrupt

  5. class Message extends AnyRef

    A message.

    A message. The format of an N byte message is the following:

    1. 4 byte CRC32 of the message 2. 1 byte "magic" identifier to allow format changes, value is 2 currently 3. 1 byte "attributes" identifier to allow annotations on the message independent of the version (e.g. compression enabled, type of codec used) 4. 4 byte key length, containing length K 5. K byte key 6. 4 byte payload length, containing length V 7. V byte payload

    Default constructor wraps an existing ByteBuffer with the Message object with no change to the contents.

  6. case class MessageAndMetadata[K, V](topic: String, partition: Int, rawMessage: Message, offset: Long, keyDecoder: Decoder[K], valueDecoder: Decoder[V]) extends Product with Serializable

  7. case class MessageAndOffset(message: Message, offset: Long) extends Product with Serializable

  8. class MessageLengthException extends RuntimeException

    Indicates the presense of a message that exceeds the maximum acceptable length (whatever that happens to be)

  9. abstract class MessageSet extends Iterable[MessageAndOffset]

    A set of messages with offsets.

    A set of messages with offsets. A message set has a fixed serialized form, though the container for the bytes could be either in-memory or on disk. The format of each message is as follows: 8 byte message offset number 4 byte size containing an integer N N message bytes as described in the Message class

Value Members

  1. object ByteBufferMessageSet

  2. object CompressionCodec

  3. object CompressionFactory

  4. object DefaultCompressionCodec extends CompressionCodec with Product with Serializable

  5. object GZIPCompressionCodec extends CompressionCodec with Product with Serializable

  6. object LZ4CompressionCodec extends CompressionCodec with Product with Serializable

  7. object Message

    Constants related to messages

  8. object MessageSet

    Message set helper functions

  9. object NoCompressionCodec extends CompressionCodec with Product with Serializable

  10. object SnappyCompressionCodec extends CompressionCodec with Product with Serializable

Ungrouped