org.kitesdk.morphline.hadoop.rcfile
Class ReadRCFileBuilder
java.lang.Object
org.kitesdk.morphline.hadoop.rcfile.ReadRCFileBuilder
- All Implemented Interfaces:
- CommandBuilder
public final class ReadRCFileBuilder
- extends Object
- implements CommandBuilder
Command for reading Record Columnar (RC) Files. RCFile can be read in two
ways
1. Row Wise - Emits one record for every row in the RCFile, with columns
mapped with names as provided in the column map
2. Column Wise - For every row split (block) in the RC File, Emits one record
for each column with all the row values for that column as a List
For a RCFile with n rows and m columns. Row wise would emit n records and
Column wise would emit m * (row splits) records.
De-Compression is handled automatically
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
OUTPUT_MEDIA_TYPE
public static final String OUTPUT_MEDIA_TYPE
- See Also:
- Constant Field Values
RC_FILE_META_DATA
public static final String RC_FILE_META_DATA
- See Also:
- Constant Field Values
ReadRCFileBuilder
public ReadRCFileBuilder()
getNames
public Collection<String> getNames()
- Description copied from interface:
CommandBuilder
- Returns the names with which this command can be invoked.
The returned set can contain synonyms to enable backwards compatible name changes.
- Specified by:
getNames
in interface CommandBuilder
build
public Command build(com.typesafe.config.Config config,
Command parent,
Command child,
MorphlineContext context)
- Description copied from interface:
CommandBuilder
- Creates and returns a command rooted at the given morphline JSON
config
.
The command will feed records into child
. The command will have
parent
as it's parent. Additional parameters can be passed via the morphline
context
.
- Specified by:
build
in interface CommandBuilder
Copyright © 2013–2014. All rights reserved.