org.apache.mahout.drivers

TextDelimitedIndexedDatasetReader

class TextDelimitedIndexedDatasetReader extends TDIndexedDatasetReader

Reads text delimited files into an IndexedDataset. Classes can be used to supply trait params in their constructor.

Note

The source is supplied to Reader#readElementsFrom .

Linear Supertypes
TDIndexedDatasetReader, Reader[IndexedDatasetSpark], AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. TextDelimitedIndexedDatasetReader
  2. TDIndexedDatasetReader
  3. Reader
  4. AnyRef
  5. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new TextDelimitedIndexedDatasetReader(readSchema: Schema)(implicit mc: DistributedContext)

    readSchema

    describes the delimiters and position of values in the text delimited file to be read.

    mc

    Spark context for reading files

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any

  3. final def ##(): Int

    Definition Classes
    AnyRef → Any

  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any

  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  7. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  8. def elementReader(mc: DistributedContext, readSchema: Schema, source: String, existingRowIDs: Option[BiDictionary] = None): IndexedDatasetSpark

    Read in text delimited elements from all URIs in the comma delimited source String and return the DRM of all elements updating the dictionaries for row and column dictionaries.

    Read in text delimited elements from all URIs in the comma delimited source String and return the DRM of all elements updating the dictionaries for row and column dictionaries. If there is no strength value in the element, assume it's presence means a strength of 1.

    mc

    context for the Spark job

    readSchema

    describes the delimiters and positions of values in the text delimited file.

    source

    comma delimited URIs of text files to be read from

    returns

    a new org.apache.mahout.sparkbindings.indexeddataset.IndexedDatasetSpark

    Attributes
    protected
    Definition Classes
    TDIndexedDatasetReader → Reader

  9. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  10. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  11. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  12. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  13. def hashCode(): Int

    Definition Classes
    AnyRef → Any

  14. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  15. implicit val mc: DistributedContext

    Spark context for reading files

    Spark context for reading files

    Definition Classes
    TextDelimitedIndexedDatasetReader → Reader

  16. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  17. final def notify(): Unit

    Definition Classes
    AnyRef

  18. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  19. def readElementsFrom(source: String, existingRowIDs: Option[BiDictionary]): IndexedDatasetSpark

    Definition Classes
    Reader

  20. def readRowsFrom(source: String, existingRowIDs: Option[BiDictionary]): IndexedDatasetSpark

    Definition Classes
    Reader

  21. val readSchema: Schema

    describes the delimiters and position of values in the text delimited file to be read.

    describes the delimiters and position of values in the text delimited file to be read.

    Definition Classes
    TextDelimitedIndexedDatasetReader → Reader

  22. def rowReader(mc: DistributedContext, readSchema: Schema, source: String, existingRowIDs: Option[BiDictionary] = None): IndexedDatasetSpark

    Read in text delimited rows from all URIs in this comma delimited source String and return the DRM of all elements updating the dictionaries for row and column dictionaries.

    Read in text delimited rows from all URIs in this comma delimited source String and return the DRM of all elements updating the dictionaries for row and column dictionaries. If there is no strength value in the element, assume it's presence means a strength of 1. Note: if the input file has a strength delimiter but none is seen in rows, we assume there is none and give the strength as 1 in the input DRM.

    mc

    context for the Spark job

    readSchema

    describes the delimiters and positions of values in the text delimited file.

    source

    comma delimited URIs of text files to be read into the IndexedDatasetSpark

    returns

    a new org.apache.mahout.sparkbindings.indexeddataset.IndexedDatasetSpark

    Attributes
    protected
    Definition Classes
    TDIndexedDatasetReader → Reader

  23. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  24. def toString(): String

    Definition Classes
    AnyRef → Any

  25. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  26. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  27. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from TDIndexedDatasetReader

Inherited from Reader[IndexedDatasetSpark]

Inherited from AnyRef

Inherited from Any

Ungrouped