Package

kafka

coordinator

Permalink

package coordinator

Visibility
  1. Public
  2. All

Type Members

  1. trait BaseKey extends AnyRef

    Permalink
  2. case class DelayedStore(messageSet: Map[TopicAndPartition, MessageSet], callback: (Map[TopicAndPartition, ProducerResponseStatus]) ⇒ Unit) extends Product with Serializable

    Permalink
  3. case class GroupConfig(groupMinSessionTimeoutMs: Int, groupMaxSessionTimeoutMs: Int) extends Product with Serializable

    Permalink
  4. class GroupCoordinator extends Logging

    Permalink

    GroupCoordinator handles general group membership and offset management.

    GroupCoordinator handles general group membership and offset management.

    Each Kafka server instantiates a coordinator which is responsible for a set of groups. Groups are assigned to coordinators based on their group names.

  5. case class GroupMetadataKey(version: Short, key: String) extends BaseKey with Product with Serializable

    Permalink
  6. class GroupMetadataManager extends Logging with KafkaMetricsGroup

    Permalink
  7. case class GroupOverview(groupId: String, protocolType: String) extends Product with Serializable

    Permalink

    Case class used to represent group metadata for the ListGroups API

  8. case class GroupSummary(state: String, protocolType: String, protocol: String, members: List[MemberSummary]) extends Product with Serializable

    Permalink

    Case class used to represent group metadata for the DescribeGroup API

  9. case class GroupTopicPartition(group: String, topicPartition: TopicAndPartition) extends Product with Serializable

    Permalink
  10. case class JoinGroupResult(members: Map[String, Array[Byte]], memberId: String, generationId: Int, subProtocol: String, leaderId: String, errorCode: Short) extends Product with Serializable

    Permalink
  11. case class MemberSummary(memberId: String, clientId: String, clientHost: String, metadata: Array[Byte], assignment: Array[Byte]) extends Product with Serializable

    Permalink
  12. case class OffsetConfig(maxMetadataSize: Int = OffsetConfig.DefaultMaxMetadataSize, loadBufferSize: Int = OffsetConfig.DefaultLoadBufferSize, offsetsRetentionMs: Long = ..., offsetsRetentionCheckIntervalMs: Long = ..., offsetsTopicNumPartitions: Int = ..., offsetsTopicSegmentBytes: Int = ..., offsetsTopicReplicationFactor: Short = ..., offsetsTopicCompressionCodec: CompressionCodec = ..., offsetCommitTimeoutMs: Int = ..., offsetCommitRequiredAcks: Short = ...) extends Product with Serializable

    Permalink

    Configuration settings for in-built offset management

    Configuration settings for in-built offset management

    maxMetadataSize

    The maximum allowed metadata for any offset commit.

    loadBufferSize

    Batch size for reading from the offsets segments when loading offsets into the cache.

    offsetsRetentionMs

    Offsets older than this retention period will be discarded.

    offsetsRetentionCheckIntervalMs

    Frequency at which to check for expired offsets.

    offsetsTopicNumPartitions

    The number of partitions for the offset commit topic (should not change after deployment).

    offsetsTopicSegmentBytes

    The offsets topic segment bytes should be kept relatively small to facilitate faster log compaction and faster offset loads

    offsetsTopicReplicationFactor

    The replication factor for the offset commit topic (set higher to ensure availability).

    offsetsTopicCompressionCodec

    Compression codec for the offsets topic - compression should be turned on in order to achieve "atomic" commits.

    offsetCommitTimeoutMs

    The offset commit will be delayed until all replicas for the offsets topic receive the commit or this timeout is reached. (Similar to the producer request timeout.)

    offsetCommitRequiredAcks

    The required acks before the commit can be accepted. In general, the default (-1) should not be overridden.

  13. case class OffsetKey(version: Short, key: GroupTopicPartition) extends BaseKey with Product with Serializable

    Permalink

Value Members

  1. object GroupCoordinator

    Permalink
  2. object GroupMetadataManager

    Permalink

    Messages stored for the group topic has versions for both the key and value fields.

    Messages stored for the group topic has versions for both the key and value fields. Key version is used to indicate the type of the message (also to differentiate different types of messages from being compacted together if they have the same field values); and value version is used to evolve the messages within their data types:

    key version 0: group consumption offset -> value version 0: [offset, metadata, timestamp]

    key version 1: group consumption offset -> value version 1: [offset, metadata, commit_timestamp, expire_timestamp]

    key version 2: group metadata -> value version 0: [protocol_type, generation, protocol, leader, members]

  3. object OffsetConfig extends Serializable

    Permalink

Ungrouped