public final class WikipediaToSequenceFile extends Object
Modifier and Type | Method and Description |
---|---|
static void |
main(String[] args)
Takes in two arguments:
The input
Path where the input documents live
The output Path where to write the classifier as a
SequenceFile
|
static void |
runJob(String input,
String output,
String catFile,
boolean exactMatchOnly,
boolean all,
boolean removeLabels)
Run the job
|
public static void main(String[] args) throws IOException
Path
where the input documents livePath
where to write the classifier as a
SequenceFile
IOException
public static void runJob(String input, String output, String catFile, boolean exactMatchOnly, boolean all, boolean removeLabels) throws IOException, InterruptedException, ClassNotFoundException
input
- the input pathname Stringoutput
- the output pathname StringcatFile
- the file containing the Wikipedia categoriesexactMatchOnly
- if true, then the Wikipedia category must match exactly instead of simply containing the
category stringall
- if true select all categoriesremoveLabels
- if true remove Category labels from document text after extracting.IOException
InterruptedException
ClassNotFoundException
Copyright © 2008–2017 The Apache Software Foundation. All rights reserved.