kafka

log

package log

Visibility
  1. Public
  2. All

Type Members

  1. class CleanerConfig(numThreads: Int = 1, dedupeBufferSize: Long = 4.*(1024).*(1024L), dedupeBufferLoadFactor: Double = 0.9, ioBufferSize: Int = 1024.*(1024), maxMessageSize: Int = 32.*(1024).*(1024), maxIoBytesPerSecond: Double = scala.Double.MaxValue, backOffMs: Long = 15.*(1000), enableCleaner: Boolean = true, hashAlgorithm: String = "MD5") extends Product

    Configuration parameters for the log cleaner

  2. class FileMessageSet extends MessageSet with Logging

    An on-disk message set.

  3. class Log extends Logging with KafkaMetricsGroup

    An append-only log for storing messages.

  4. class LogCleaner extends Logging with KafkaMetricsGroup

    The cleaner is responsible for removing obsolete records from logs which have the dedupe retention strategy.

  5. class LogConfig(segmentSize: Int = 1024.*(1024), segmentMs: Long = scala.Long.MaxValue, flushInterval: Long = scala.Long.MaxValue, flushMs: Long = scala.Long.MaxValue, retentionSize: Long = scala.Long.MaxValue, retentionMs: Long = scala.Long.MaxValue, maxMessageSize: Int = scala.Int.MaxValue, maxIndexSize: Int = 1024.*(1024), indexInterval: Int = 4096, fileDeleteDelayMs: Long = 60.*(1000), deleteRetentionMs: Long = 24.*(60).*(60).*(1000L), minCleanableRatio: Double = 0.5, compact: Boolean = false) extends Product

    Configuration settings for a log

  6. class LogManager extends Logging

    The entry point to the kafka log management subsystem.

  7. class LogSegment extends Logging

    A segment of the log.

  8. class OffsetIndex extends Logging

    An index that maps offsets to physical file locations for a particular log segment.

  9. trait OffsetMap extends AnyRef

  10. class OffsetPosition(offset: Long, position: Int) extends Product

    The mapping between a logical log offset and the physical position in some log file of the beginning of the message set entry with the given offset.

  11. class SkimpyOffsetMap extends OffsetMap

    An hash table used for deduplicating the log.

Value Members

  1. object Log extends AnyRef

    Helper functions for logs

  2. object LogConfig extends AnyRef

  3. object LogFlushStats extends KafkaMetricsGroup