org.kitesdk.morphline.hadoop.parquet.avro
Class ReadAvroParquetFileBuilder

java.lang.Object
  extended by org.kitesdk.morphline.hadoop.parquet.avro.ReadAvroParquetFileBuilder
All Implemented Interfaces:
CommandBuilder

public final class ReadAvroParquetFileBuilder
extends Object
implements CommandBuilder

Command that parses a Hadoop File that contains Parquet data; for each Parquet Avro datum, the command emits a morphline record containing the record as an attachment in Fields.ATTACHMENT_BODY. The Avro schema that was used to write the data is retrieved from the Parquet file. Optionally, the Avro schema that shall be used for reading can be supplied as well.


Field Summary
static String AVRO_MEMORY_MIME_TYPE
          The MIME type identifier that will be filled into output records
static String FILE_UPLOAD_URL
          The morphline record field containing the HDFS Path of the Parquet file to read
 
Constructor Summary
ReadAvroParquetFileBuilder()
           
 
Method Summary
 Command build(com.typesafe.config.Config config, Command parent, Command child, MorphlineContext context)
          Creates and returns a command rooted at the given morphline JSON config.
 Collection<String> getNames()
          Returns the names with which this command can be invoked.
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Field Detail

FILE_UPLOAD_URL

public static final String FILE_UPLOAD_URL
The morphline record field containing the HDFS Path of the Parquet file to read

See Also:
Constant Field Values

AVRO_MEMORY_MIME_TYPE

public static final String AVRO_MEMORY_MIME_TYPE
The MIME type identifier that will be filled into output records

See Also:
Constant Field Values
Constructor Detail

ReadAvroParquetFileBuilder

public ReadAvroParquetFileBuilder()
Method Detail

getNames

public Collection<String> getNames()
Description copied from interface: CommandBuilder
Returns the names with which this command can be invoked. The returned set can contain synonyms to enable backwards compatible name changes.

Specified by:
getNames in interface CommandBuilder

build

public Command build(com.typesafe.config.Config config,
                     Command parent,
                     Command child,
                     MorphlineContext context)
Description copied from interface: CommandBuilder
Creates and returns a command rooted at the given morphline JSON config. The command will feed records into child. The command will have parent as it's parent. Additional parameters can be passed via the morphline context.

Specified by:
build in interface CommandBuilder


Copyright © 2013–2014. All rights reserved.