public class LineRecordReader extends FileRecordReader
appendLabel, currentFile, iter, labelsAPPEND_LABEL, LABELS, NAME_SPACE| Constructor and Description |
|---|
LineRecordReader() |
| Modifier and Type | Method and Description |
|---|---|
void |
close() |
Configuration |
getConf() |
String |
getCurrentDirectoryLabelPath() |
boolean |
hasNext() |
void |
initialize(Configuration conf,
InputSplit split)
Need to look at the lines in a set of files in directories
|
void |
initialize(InputSplit split) |
Collection<Writable> |
next()
Major difference here: we ALWAYS append label as string
- we've also kicked the responsibility of indexing labels UP a level to the vectorization engine for text
NEED to look at the file iterator (iter)
|
void |
setConf(Configuration conf) |
doInitialize, getCurrentLabel, getLabels, setLabelspublic void initialize(InputSplit split) throws IOException, InterruptedException
initialize in interface RecordReaderinitialize in class FileRecordReaderIOExceptionInterruptedExceptionpublic void initialize(Configuration conf, InputSplit split) throws IOException, InterruptedException
initialize in interface RecordReaderinitialize in class FileRecordReaderIOExceptionInterruptedExceptionpublic Collection<Writable> next()
next in interface RecordReadernext in class FileRecordReaderpublic boolean hasNext()
hasNext in interface RecordReaderhasNext in class FileRecordReaderpublic String getCurrentDirectoryLabelPath()
public void close()
throws IOException
close in interface Closeableclose in interface AutoCloseableclose in class FileRecordReaderIOExceptionpublic void setConf(Configuration conf)
setConf in interface ConfigurablesetConf in class FileRecordReaderpublic Configuration getConf()
getConf in interface ConfigurablegetConf in class FileRecordReaderCopyright © 2015. All rights reserved.