kafka.message

FileMessageSet

class FileMessageSet extends MessageSet

An on-disk message set. The set can be opened either mutably or immutably. Mutation attempts will fail on an immutable message set. An optional limit and offset can be applied to the message set which will control the offset into the file and the effective length into the file from which messages will be read

Inherited
  1. Hide All
  2. Show all
  1. MessageSet
  2. Iterable
  3. IterableLike
  4. Equals
  5. Traversable
  6. GenericTraversableTemplate
  7. TraversableLike
  8. TraversableOnce
  9. FilterMonadic
  10. HasNewBuilder
  11. AnyRef
  12. Any
Visibility
  1. Public
  2. All

Instance constructors

  1. new FileMessageSet(file: File, mutable: Boolean, needRecover: AtomicBoolean)

    Create a file message set with no limit or offset

    Create a file message set with no limit or offset

  2. new FileMessageSet(channel: FileChannel, mutable: Boolean, needRecover: AtomicBoolean)

    Create a file message set with no limit or offset

    Create a file message set with no limit or offset

  3. new FileMessageSet(file: File, mutable: Boolean)

    Create a file message set with no limit or offset

    Create a file message set with no limit or offset

  4. new FileMessageSet(channel: FileChannel, mutable: Boolean)

    Create a file message set with no limit or offset

    Create a file message set with no limit or offset

Type Members

  1. type Self = Iterable[MessageAndOffset]

    attributes: protected
    definition classes: TraversableLike

Value Members

  1. def !=(arg0: AnyRef): Boolean

    attributes: final
    definition classes: AnyRef
  2. def !=(arg0: Any): Boolean

    o != arg0 is the same as !(o == (arg0)).

    o != arg0 is the same as !(o == (arg0)).

    arg0

    the object to compare against this object for dis-equality.

    returns

    false if the receiver object is equivalent to the argument; true otherwise.

    attributes: final
    definition classes: Any
  3. def ##(): Int

    attributes: final
    definition classes: AnyRef → Any
  4. def $asInstanceOf[T0](): T0

    attributes: final
    definition classes: AnyRef
  5. def $isInstanceOf[T0](): Boolean

    attributes: final
    definition classes: AnyRef
  6. def ++[B >: MessageAndOffset, That](that: TraversableOnce[B])(implicit bf: CanBuildFrom[Iterable[MessageAndOffset], B, That]): That

    definition classes: TraversableLike
  7. def /:[B](z: B)(op: (B, MessageAndOffset) ⇒ B): B

    definition classes: TraversableOnce
  8. def :\[B](z: B)(op: (MessageAndOffset, B) ⇒ B): B

    definition classes: TraversableOnce
  9. def ==(arg0: AnyRef): Boolean

    o == arg0 is the same as if (o eq null) arg0 eq null else o.equals(arg0).

    o == arg0 is the same as if (o eq null) arg0 eq null else o.equals(arg0).

    arg0

    the object to compare against this object for equality.

    returns

    true if the receiver object is equivalent to the argument; false otherwise.

    attributes: final
    definition classes: AnyRef
  10. def ==(arg0: Any): Boolean

    o == arg0 is the same as o.equals(arg0).

    o == arg0 is the same as o.equals(arg0).

    arg0

    the object to compare against this object for equality.

    returns

    true if the receiver object is equivalent to the argument; false otherwise.

    attributes: final
    definition classes: Any
  11. def addString(b: StringBuilder): StringBuilder

    definition classes: TraversableOnce
  12. def addString(b: StringBuilder, sep: String): StringBuilder

    definition classes: TraversableOnce
  13. def addString(b: StringBuilder, start: String, sep: String, end: String): StringBuilder

    definition classes: TraversableOnce
  14. def append(messages: MessageSet): Unit

    Append this message to the message set

    Append this message to the message set

  15. def asInstanceOf[T0]: T0

    This method is used to cast the receiver object to be of type T0.

    This method is used to cast the receiver object to be of type T0.

    Note that the success of a cast at runtime is modulo Scala's erasure semantics. Therefore the expression1.asInstanceOf[String] will throw a ClassCastException at runtime, while the expressionList(1).asInstanceOf[List[String]] will not. In the latter example, because the type argument is erased as part of compilation it is not possible to check whether the contents of the list are of the requested typed.

    returns

    the receiver object.

    attributes: final
    definition classes: Any
  16. def canEqual(that: Any): Boolean

    definition classes: IterableLike → Equals
  17. def checkMutable(): Unit

  18. def clone(): AnyRef

    This method creates and returns a copy of the receiver object.

    This method creates and returns a copy of the receiver object.

    The default implementation of the clone method is platform dependent.

    returns

    a copy of the receiver object.

    attributes: protected
    definition classes: AnyRef
  19. def close(): Unit

    Close this message set

    Close this message set

  20. def collect[B, That](pf: PartialFunction[MessageAndOffset, B])(implicit bf: CanBuildFrom[Iterable[MessageAndOffset], B, That]): That

    definition classes: TraversableLike
  21. def companion: GenericCompanion[Iterable[A][A]]

    definition classes: Iterable → Traversable → GenericTraversableTemplate
  22. def copyToArray[B >: MessageAndOffset](xs: Array[B], start: Int, len: Int): Unit

    definition classes: IterableLike → TraversableLike → TraversableOnce
  23. def copyToArray[B >: MessageAndOffset](xs: Array[B]): Unit

    definition classes: TraversableOnce
  24. def copyToArray[B >: MessageAndOffset](xs: Array[B], start: Int): Unit

    definition classes: TraversableOnce
  25. def copyToBuffer[B >: MessageAndOffset](dest: Buffer[B]): Unit

    definition classes: TraversableOnce
  26. def count(p: (MessageAndOffset) ⇒ Boolean): Int

    definition classes: TraversableOnce
  27. def drop(n: Int): Iterable[MessageAndOffset]

    definition classes: TraversableLike
  28. def dropRight(n: Int): Iterable[MessageAndOffset]

    definition classes: IterableLike
  29. def dropWhile(p: (MessageAndOffset) ⇒ Boolean): Iterable[MessageAndOffset]

    definition classes: TraversableLike
  30. def elements: Iterator[MessageAndOffset]

    definition classes: IterableLike
      deprecated:
    1. use iterator' instead

  31. def eq(arg0: AnyRef): Boolean

    This method is used to test whether the argument (arg0) is a reference to the receiver object (this).

    This method is used to test whether the argument (arg0) is a reference to the receiver object (this).

    The eq method implements an [http://en.wikipedia.org/wiki/Equivalence_relation equivalence relation] on non-null instances of AnyRef: * It is reflexive: for any non-null instance x of type AnyRef, x.eq(x) returns true. * It is symmetric: for any non-null instances x and y of type AnyRef, x.eq(y) returns true if and only if y.eq(x) returns true. * It is transitive: for any non-null instances x, y, and z of type AnyRef if x.eq(y) returns true and y.eq(z) returns true, then x.eq(z) returns true.

    Additionally, the eq method has three other properties. * It is consistent: for any non-null instances x and y of type AnyRef, multiple invocations of x.eq(y) consistently returns true or consistently returns false. * For any non-null instance x of type AnyRef, x.eq(null) and null.eq(x) returns false. * null.eq(null) returns true.

    When overriding the equals or hashCode methods, it is important to ensure that their behavior is consistent with reference equality. Therefore, if two objects are references to each other (o1 eq o2), they should be equal to each other (o1 == o2) and they should hash to the same value (o1.hashCode == o2.hashCode).

    arg0

    the object to compare against this object for reference equality.

    returns

    true if the argument is a reference to the receiver object; false otherwise.

    attributes: final
    definition classes: AnyRef
  32. def equals(arg0: Any): Boolean

    This method is used to compare the receiver object (this) with the argument object (arg0) for equivalence.

    This method is used to compare the receiver object (this) with the argument object (arg0) for equivalence.

    The default implementations of this method is an [http://en.wikipedia.org/wiki/Equivalence_relation equivalence relation]: * It is reflexive: for any instance x of type Any, x.equals(x) should return true. * It is symmetric: for any instances x and y of type Any, x.equals(y) should return true if and only if y.equals(x) returns true. * It is transitive: for any instances x, y, and z of type AnyRef if x.equals(y) returns true and y.equals(z) returns true, then x.equals(z) should return true.

    If you override this method, you should verify that your implementation remains an equivalence relation. Additionally, when overriding this method it is often necessary to override hashCode to ensure that objects that are "equal" (o1.equals(o2) returns true) hash to the same scala.Int (o1.hashCode.equals(o2.hashCode)).

    arg0

    the object to compare against this object for equality.

    returns

    true if the receiver object is equivalent to the argument; false otherwise.

    definition classes: AnyRef → Any
  33. def exists(p: (MessageAndOffset) ⇒ Boolean): Boolean

    definition classes: IterableLike → TraversableLike → TraversableOnce
  34. def filter(p: (MessageAndOffset) ⇒ Boolean): Iterable[MessageAndOffset]

    definition classes: TraversableLike
  35. def filterNot(p: (MessageAndOffset) ⇒ Boolean): Iterable[MessageAndOffset]

    definition classes: TraversableLike
  36. def finalize(): Unit

    This method is called by the garbage collector on the receiver object when garbage collection determines that there are no more references to the object.

    This method is called by the garbage collector on the receiver object when garbage collection determines that there are no more references to the object.

    The details of when and if the finalize method are invoked, as well as the interaction between finalizeand non-local returns and exceptions, are all platform dependent.

    attributes: protected
    definition classes: AnyRef
  37. def find(p: (MessageAndOffset) ⇒ Boolean): Option[MessageAndOffset]

    definition classes: IterableLike → TraversableLike → TraversableOnce
  38. def first: MessageAndOffset

    definition classes: IterableLike
      deprecated:
    1. use head' instead

  39. def firstOption: Option[MessageAndOffset]

    definition classes: IterableLike
      deprecated:
    1. use headOption' instead

  40. def flatMap[B, That](f: (MessageAndOffset) ⇒ Traversable[B])(implicit bf: CanBuildFrom[Iterable[MessageAndOffset], B, That]): That

    definition classes: TraversableLike → FilterMonadic
  41. def flatten[B](implicit asTraversable: (MessageAndOffset) ⇒ Traversable[B]): Iterable[B]

    definition classes: GenericTraversableTemplate
  42. def flush(): Unit

    Commit all written data to the physical disk

    Commit all written data to the physical disk

  43. def foldLeft[B](z: B)(op: (B, MessageAndOffset) ⇒ B): B

    definition classes: TraversableOnce
  44. def foldRight[B](z: B)(op: (MessageAndOffset, B) ⇒ B): B

    definition classes: IterableLike → TraversableOnce
  45. def forall(p: (MessageAndOffset) ⇒ Boolean): Boolean

    definition classes: IterableLike → TraversableLike → TraversableOnce
  46. def foreach[U](f: (MessageAndOffset) ⇒ U): Unit

    definition classes: IterableLike → TraversableLike → TraversableOnce → FilterMonadic
  47. def genericBuilder[B]: Builder[B, Iterable[B]]

    definition classes: GenericTraversableTemplate
  48. def getClass(): java.lang.Class[_]

    Returns a representation that corresponds to the dynamic class of the receiver object.

    Returns a representation that corresponds to the dynamic class of the receiver object.

    The nature of the representation is platform dependent.

    returns

    a representation that corresponds to the dynamic class of the receiver object.

    attributes: final
    definition classes: AnyRef
  49. def groupBy[K](f: (MessageAndOffset) ⇒ K): Map[K, Iterable[MessageAndOffset]]

    definition classes: TraversableLike
  50. def grouped(size: Int): Iterator[Iterable[MessageAndOffset]]

    definition classes: IterableLike
  51. def hasDefiniteSize: Boolean

    definition classes: TraversableLike → TraversableOnce
  52. def hashCode(): Int

    Returns a hash code value for the object.

    Returns a hash code value for the object.

    The default hashing algorithm is platform dependent.

    Note that it is allowed for two objects to have identical hash codes (o1.hashCode.equals(o2.hashCode)) yet not be equal (o1.equals(o2) returns false). A degenerate implementation could always return 0. However, it is required that if two objects are equal (o1.equals(o2) returns true) that they have identical hash codes (o1.hashCode.equals(o2.hashCode)). Therefore, when overriding this method, be sure to verify that the behavior is consistent with the equals method.

    returns

    the hash code value for the object.

    definition classes: AnyRef → Any
  53. def head: MessageAndOffset

    definition classes: IterableLike → TraversableLike
  54. def headOption: Option[MessageAndOffset]

    definition classes: TraversableLike
  55. def highWaterMark(): Long

    The high water mark

    The high water mark

  56. def init: Iterable[MessageAndOffset]

    definition classes: TraversableLike
  57. def isEmpty: Boolean

    definition classes: IterableLike → TraversableLike → TraversableOnce
  58. def isInstanceOf[T0]: Boolean

    This method is used to test whether the dynamic type of the receiver object is T0.

    This method is used to test whether the dynamic type of the receiver object is T0.

    Note that the test result of the test is modulo Scala's erasure semantics. Therefore the expression1.isInstanceOf[String] will return false, while the expression List(1).isInstanceOf[List[String]] will return true. In the latter example, because the type argument is erased as part of compilation it is not possible to check whether the contents of the list are of the requested typed.

    returns

    true if the receiver object is an instance of erasure of type T0; false otherwise.

    attributes: final
    definition classes: Any
  59. def isTraversableAgain: Boolean

    attributes: final
    definition classes: TraversableLike → TraversableOnce
  60. def iterator: Iterator[MessageAndOffset]

    Get an iterator over the messages in the set

    Get an iterator over the messages in the set

    definition classes: FileMessageSetMessageSet → IterableLike
  61. def last: MessageAndOffset

    definition classes: TraversableLike
  62. def lastOption: Option[MessageAndOffset]

    definition classes: TraversableLike
  63. def map[B, That](f: (MessageAndOffset) ⇒ B)(implicit bf: CanBuildFrom[Iterable[MessageAndOffset], B, That]): That

    definition classes: TraversableLike → FilterMonadic
  64. def max[B >: MessageAndOffset](implicit cmp: Ordering[B]): MessageAndOffset

    definition classes: TraversableOnce
  65. def min[B >: MessageAndOffset](implicit cmp: Ordering[B]): MessageAndOffset

    definition classes: TraversableOnce
  66. def mkString: String

    definition classes: TraversableOnce
  67. def mkString(sep: String): String

    definition classes: TraversableOnce
  68. def mkString(start: String, sep: String, end: String): String

    definition classes: TraversableOnce
  69. val mutable: Boolean

  70. def ne(arg0: AnyRef): Boolean

    o.ne(arg0) is the same as !(o.eq(arg0)).

    o.ne(arg0) is the same as !(o.eq(arg0)).

    arg0

    the object to compare against this object for reference dis-equality.

    returns

    false if the argument is not a reference to the receiver object; true otherwise.

    attributes: final
    definition classes: AnyRef
  71. val needRecover: AtomicBoolean

  72. def newBuilder: Builder[MessageAndOffset, Iterable[MessageAndOffset]]

    attributes: protected[this]
    definition classes: GenericTraversableTemplate → HasNewBuilder
  73. def nonEmpty: Boolean

    definition classes: TraversableOnce
  74. def notify(): Unit

    Wakes up a single thread that is waiting on the receiver object's monitor.

    Wakes up a single thread that is waiting on the receiver object's monitor.

    attributes: final
    definition classes: AnyRef
  75. def notifyAll(): Unit

    Wakes up all threads that are waiting on the receiver object's monitor.

    Wakes up all threads that are waiting on the receiver object's monitor.

    attributes: final
    definition classes: AnyRef
  76. def partition(p: (MessageAndOffset) ⇒ Boolean): (Iterable[MessageAndOffset], Iterable[MessageAndOffset])

    definition classes: TraversableLike
  77. def product[B >: MessageAndOffset](implicit num: Numeric[B]): B

    definition classes: TraversableOnce
  78. def projection: IterableView[MessageAndOffset, Iterable[MessageAndOffset]]

    definition classes: IterableLike
      deprecated:
    1. use view' instead

  79. def read(readOffset: Long, size: Long): MessageSet

    Return a message set which is a view into this set starting from the given offset and with the given size limit.

    Return a message set which is a view into this set starting from the given offset and with the given size limit.

  80. def recover(): Long

    Recover log up to the last complete entry.

    Recover log up to the last complete entry. Truncate off any bytes from any incomplete messages written

  81. def reduceLeft[B >: MessageAndOffset](op: (B, MessageAndOffset) ⇒ B): B

    definition classes: TraversableOnce
  82. def reduceLeftOption[B >: MessageAndOffset](op: (B, MessageAndOffset) ⇒ B): Option[B]

    definition classes: TraversableOnce
  83. def reduceRight[B >: MessageAndOffset](op: (MessageAndOffset, B) ⇒ B): B

    definition classes: IterableLike → TraversableOnce
  84. def reduceRightOption[B >: MessageAndOffset](op: (MessageAndOffset, B) ⇒ B): Option[B]

    definition classes: TraversableOnce
  85. def repr: Iterable[MessageAndOffset]

    definition classes: TraversableLike
  86. def reversed: List[MessageAndOffset]

    attributes: protected[this]
    definition classes: TraversableOnce
  87. def sameElements[B >: MessageAndOffset](that: Iterable[B]): Boolean

    definition classes: IterableLike
  88. def scanLeft[B, That](z: B)(op: (B, MessageAndOffset) ⇒ B)(implicit bf: CanBuildFrom[Iterable[MessageAndOffset], B, That]): That

    definition classes: TraversableLike
  89. def scanRight[B, That](z: B)(op: (MessageAndOffset, B) ⇒ B)(implicit bf: CanBuildFrom[Iterable[MessageAndOffset], B, That]): That

    definition classes: TraversableLike
  90. def size: Int

    definition classes: TraversableOnce
  91. def sizeInBytes(): Long

    The number of bytes taken up by this file set

    The number of bytes taken up by this file set

    definition classes: FileMessageSetMessageSet
  92. def slice(from: Int, until: Int): Iterable[MessageAndOffset]

    definition classes: IterableLike → TraversableLike
  93. def sliding[B >: MessageAndOffset](size: Int, step: Int): Iterator[Iterable[MessageAndOffset]]

    definition classes: IterableLike
  94. def sliding[B >: MessageAndOffset](size: Int): Iterator[Iterable[MessageAndOffset]]

    definition classes: IterableLike
  95. def span(p: (MessageAndOffset) ⇒ Boolean): (Iterable[MessageAndOffset], Iterable[MessageAndOffset])

    definition classes: TraversableLike
  96. def splitAt(n: Int): (Iterable[MessageAndOffset], Iterable[MessageAndOffset])

    definition classes: TraversableLike
  97. def stringPrefix: String

    definition classes: TraversableLike
  98. def sum[B >: MessageAndOffset](implicit num: Numeric[B]): B

    definition classes: TraversableOnce
  99. def synchronized[T0](arg0: T0): T0

    attributes: final
    definition classes: AnyRef
  100. def tail: Iterable[MessageAndOffset]

    definition classes: TraversableLike
  101. def take(n: Int): Iterable[MessageAndOffset]

    definition classes: IterableLike → TraversableLike
  102. def takeRight(n: Int): Iterable[MessageAndOffset]

    definition classes: IterableLike
  103. def takeWhile(p: (MessageAndOffset) ⇒ Boolean): Iterable[MessageAndOffset]

    definition classes: IterableLike → TraversableLike
  104. def thisCollection: Iterable[MessageAndOffset]

    attributes: protected[this]
    definition classes: IterableLike → TraversableLike
  105. def toArray[B >: MessageAndOffset](implicit arg0: ClassManifest[B]): Array[B]

    definition classes: TraversableOnce
  106. def toBuffer[B >: MessageAndOffset]: Buffer[B]

    definition classes: TraversableOnce
  107. def toCollection(repr: Iterable[MessageAndOffset]): Iterable[MessageAndOffset]

    attributes: protected[this]
    definition classes: IterableLike → TraversableLike
  108. def toIndexedSeq[B >: MessageAndOffset]: IndexedSeq[B]

    definition classes: TraversableOnce
  109. def toIterable: Iterable[MessageAndOffset]

    definition classes: IterableLike → TraversableOnce
  110. def toIterator: Iterator[MessageAndOffset]

    definition classes: TraversableLike → TraversableOnce
  111. def toList: List[MessageAndOffset]

    definition classes: TraversableOnce
  112. def toMap[T, U](implicit ev: <:<[MessageAndOffset, (T, U)]): Map[T, U]

    definition classes: TraversableOnce
  113. def toSeq: Seq[MessageAndOffset]

    definition classes: IterableLike → TraversableOnce
  114. def toSet[B >: MessageAndOffset]: Set[B]

    definition classes: TraversableOnce
  115. def toStream: Stream[MessageAndOffset]

    definition classes: IterableLike → TraversableLike → TraversableOnce
  116. def toString(): String

    Returns a string representation of the object.

    Returns a string representation of the object.

    The default representation is platform dependent.

    returns

    a string representation of the object.

    definition classes: TraversableLike → AnyRef → Any
  117. def toTraversable: Traversable[MessageAndOffset]

    definition classes: TraversableLike → TraversableOnce
  118. def transpose[B](implicit asTraversable: (MessageAndOffset) ⇒ Traversable[B]): Iterable[Iterable[B]]

    definition classes: GenericTraversableTemplate
  119. def unzip[A1, A2](implicit asPair: (MessageAndOffset) ⇒ (A1, A2)): (Iterable[A1], Iterable[A2])

    definition classes: GenericTraversableTemplate
  120. def validate(): Unit

    Validate the checksum of all the messages in the set.

    Validate the checksum of all the messages in the set. Throws an InvalidMessageException if the checksum doesn't match the payload for any message.

    definition classes: MessageSet
  121. def view(from: Int, until: Int): IterableView[MessageAndOffset, Iterable[MessageAndOffset]]

    definition classes: IterableLike → TraversableLike
  122. def view: IterableView[MessageAndOffset, Iterable[MessageAndOffset]]

    definition classes: IterableLike → TraversableLike
  123. def wait(): Unit

    attributes: final
    definition classes: AnyRef
  124. def wait(arg0: Long, arg1: Int): Unit

    attributes: final
    definition classes: AnyRef
  125. def wait(arg0: Long): Unit

    attributes: final
    definition classes: AnyRef
  126. def withFilter(p: (MessageAndOffset) ⇒ Boolean): FilterMonadic[MessageAndOffset, Iterable[MessageAndOffset]]

    definition classes: TraversableLike → FilterMonadic
  127. def writeTo(destChannel: WritableByteChannel, writeOffset: Long, size: Long): Long

    Write some of this set to the given channel, return the ammount written

    Write some of this set to the given channel, return the ammount written

    definition classes: FileMessageSetMessageSet
  128. def zip[A1 >: MessageAndOffset, B, That](that: Iterable[B])(implicit bf: CanBuildFrom[Iterable[MessageAndOffset], (A1, B), That]): That

    definition classes: IterableLike
  129. def zipAll[B, A1 >: MessageAndOffset, That](that: Iterable[B], thisElem: A1, thatElem: B)(implicit bf: CanBuildFrom[Iterable[MessageAndOffset], (A1, B), That]): That

    definition classes: IterableLike
  130. def zipWithIndex[A1 >: MessageAndOffset, That](implicit bf: CanBuildFrom[Iterable[MessageAndOffset], (A1, Int), That]): That

    definition classes: IterableLike