org.apache.mahout.common

HDFSPathSearch

case class HDFSPathSearch(pathURI: String, filePattern: String = "", recursive: Boolean = false) extends Product with Serializable

Returns a java.lang.String, which is comma delimited list of URIs discovered based on parameters in the constructor. The String is formatted to be input into org.apache.spark.SparkContext#textFile()

pathURI

Where to start looking for inFiles, may be a list of comma delimited URIs

filePattern

regex that must match the entire filename to have the file returned

recursive

true traverses the filesystem recursively, default = false

Linear Supertypes
Serializable, Serializable, Product, Equals, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. HDFSPathSearch
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. AnyRef
  7. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new HDFSPathSearch(pathURI: String, filePattern: String = "", recursive: Boolean = false)

    pathURI

    Where to start looking for inFiles, may be a list of comma delimited URIs

    filePattern

    regex that must match the entire filename to have the file returned

    recursive

    true traverses the filesystem recursively, default = false

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any

  3. final def ##(): Int

    Definition Classes
    AnyRef → Any

  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any

  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  7. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  8. val conf: Configuration

  9. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  10. val filePattern: String

    regex that must match the entire filename to have the file returned

  11. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  12. val fs: FileSystem

  13. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  14. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  15. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  16. final def notify(): Unit

    Definition Classes
    AnyRef

  17. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  18. val pathURI: String

    Where to start looking for inFiles, may be a list of comma delimited URIs

  19. val recursive: Boolean

    true traverses the filesystem recursively, default = false

  20. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  21. def uris: String

    Returns a string of comma delimited URIs matching the filePattern When pattern matching dirs are never returned, only traversed.

  22. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  23. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  24. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from AnyRef

Inherited from Any

Ungrouped