com.redhat.et.silex.histogram.rdd

HistogramMethodsRDD

class HistogramMethodsRDD[T] extends HistogramMethods[T]

Enriched RDD methods for histogramming and counting from HistogramMethods

import com.redhat.et.silex.histogram.implicits._
rdd.histBy(f)  // or other methods from HistogramMethods interface
Linear Supertypes
HistogramMethods[T], Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. HistogramMethodsRDD
  2. HistogramMethods
  3. Serializable
  4. Serializable
  5. AnyRef
  6. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new HistogramMethodsRDD(data: RDD[T])(implicit arg0: ClassTag[T])

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  7. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  8. def countBy[U](f: (T) ⇒ U): Map[U, Long]

    Count the occurrences of values returned by a function applied to RDD rows

    Count the occurrences of values returned by a function applied to RDD rows

    U

    The return type of the function

    f

    The function to apply to each RDD row

    returns

    A Map from occurring values to their counts

    Definition Classes
    HistogramMethodsRDDHistogramMethods
  9. def countByFlat[U](f: (T) ⇒ TraversableOnce[U]): Map[U, Long]

    Count the occurrences of values in a sequence returned by a function applied to RDD rows

    Count the occurrences of values in a sequence returned by a function applied to RDD rows

    U

    The element type of the sequence returned by the function

    f

    The function to apply to each RDD row: returns a sequence of values

    returns

    A Map from occurring values to their counts

    Definition Classes
    HistogramMethodsRDDHistogramMethods
  10. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  11. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  12. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  13. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  14. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  15. def histBy[U](f: (T) ⇒ U, normalized: Boolean = false, cumulative: Boolean = false): Seq[(U, Double)]

    Histogram the occurrences of values returned by a function applied to RDD rows

    Histogram the occurrences of values returned by a function applied to RDD rows

    U

    The return type of the function

    f

    The function to apply to each RDD row

    normalized

    When true, histogram counts are normalized to sum to 1

    cumulative

    When true, histogram counts are cumulative

    returns

    A sequence ((u0, n0), (u1, n1), ...), sorted in decreasing order of counts nj

    Definition Classes
    HistogramMethodsRDDHistogramMethods
    Note

    When both cumulative and normalized are true, "counts" are analoglous to a sampled CDF

  16. def histByFlat[U](f: (T) ⇒ TraversableOnce[U], normalized: Boolean = false, cumulative: Boolean = false): Seq[(U, Double)]

    Histogram the occurrences of values in a sequence returned by a function applied to RDD rows

    Histogram the occurrences of values in a sequence returned by a function applied to RDD rows

    U

    The element type of the sequence returned by the function

    f

    The function to apply to each RDD row: returns a sequence of values

    normalized

    When true, histogram counts are normalized to sum to 1

    cumulative

    When true, histogram counts are cumulative

    returns

    A sequence ((u0, n0), (u1, n1), ...), sorted in decreasing order of counts nj

    Definition Classes
    HistogramMethodsRDDHistogramMethods
    Note

    When both cumulative and normalized are true, "counts" are analoglous to a sampled CDF

  17. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  18. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  19. final def notify(): Unit

    Definition Classes
    AnyRef
  20. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  21. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  22. def toString(): String

    Definition Classes
    AnyRef → Any
  23. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  24. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  25. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from HistogramMethods[T]

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped