org.kitesdk.morphline.hadoop.parquet.avro

Class ReadAvroParquetFileBuilder

java.lang.Object

org.kitesdk.morphline.hadoop.parquet.avro.ReadAvroParquetFileBuilder

All Implemented Interfaces:

CommandBuilder

public final class ReadAvroParquetFileBuilder
extends Object
implements CommandBuilder

Command that parses a Hadoop File that contains Parquet data; for each Parquet Avro datum, the command emits a morphline record containing the record as an attachment in Fields.ATTACHMENT_BODY. The Avro schema that was used to write the data is retrieved from the Parquet file. Optionally, the Avro schema that shall be used for reading can be supplied as well.

Field Summary

Fields

Modifier and Type	Field and Description
static String	AVRO_MEMORY_MIME_TYPE The MIME type identifier that will be filled into output records
static String	FILE_UPLOAD_URL The morphline record field containing the HDFS Path of the Parquet file to read

Constructor Summary

Constructors

Constructor and Description
ReadAvroParquetFileBuilder()

Method Summary

Methods

Modifier and Type	Method and Description
Command	build(com.typesafe.config.Config config, Command parent, Command child, MorphlineContext context) Creates and returns a command rooted at the given morphline JSON config.
Collection<String>	getNames() Returns the names with which this command can be invoked.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

FILE_UPLOAD_URL

public static final String FILE_UPLOAD_URL

The morphline record field containing the HDFS Path of the Parquet file to read

See Also:

Constant Field Values

AVRO_MEMORY_MIME_TYPE

public static final String AVRO_MEMORY_MIME_TYPE

The MIME type identifier that will be filled into output records

See Also:

Constant Field Values

Constructor Detail

ReadAvroParquetFileBuilder

public ReadAvroParquetFileBuilder()

Method Detail

getNames

public Collection<String> getNames()

Description copied from interface: CommandBuilder

Returns the names with which this command can be invoked. The returned set can contain synonyms to enable backwards compatible name changes.

Specified by:

getNames in interface CommandBuilder

build

public Command build(com.typesafe.config.Config config,
            Command parent,
            Command child,
            MorphlineContext context)

Description copied from interface: CommandBuilder

Creates and returns a command rooted at the given morphline JSON config. The command will feed records into child. The command will have parent as it's parent. Additional parameters can be passed via the morphline context.

Specified by:

build in interface CommandBuilder