org.kitesdk.morphline.hadoop.rcfile
Class ReadRCFileBuilder
java.lang.Object
org.kitesdk.morphline.hadoop.rcfile.ReadRCFileBuilder
- All Implemented Interfaces:
- CommandBuilder
public final class ReadRCFileBuilder
- extends Object
- implements CommandBuilder
Command for reading Record Columnar (RC) Files. RCFile can be read in two
ways
1. Row Wise - Emits one record for every row in the RCFile, with columns
mapped with names as provided in the column map
2. Column Wise - For every row split (block) in the RC File, Emits one record
for each column with all the row values for that column as a List
For a RCFile with n rows and m columns. Row wise would emit n records and
Column wise would emit m * (row splits) records.
De-Compression is handled automatically
| Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
OUTPUT_MEDIA_TYPE
public static final String OUTPUT_MEDIA_TYPE
- See Also:
- Constant Field Values
RC_FILE_META_DATA
public static final String RC_FILE_META_DATA
- See Also:
- Constant Field Values
ReadRCFileBuilder
public ReadRCFileBuilder()
getNames
public Collection<String> getNames()
- Description copied from interface:
CommandBuilder
- Returns the names with which this command can be invoked.
The returned set can contain synonyms to enable backwards compatible name changes.
- Specified by:
getNames in interface CommandBuilder
build
public Command build(com.typesafe.config.Config config,
Command parent,
Command child,
MorphlineContext context)
- Description copied from interface:
CommandBuilder
- Creates and returns a command rooted at the given morphline JSON
config.
The command will feed records into child. The command will have
parent as it's parent. Additional parameters can be passed via the morphline
context.
- Specified by:
build in interface CommandBuilder
Copyright © 2013–2014. All rights reserved.