org.kitesdk.data.mapreduce

Class DatasetKeyOutputFormat<E>

java.lang.Object

org.apache.hadoop.mapreduce.OutputFormat<E,Void>

org.kitesdk.data.mapreduce.DatasetKeyOutputFormat<E>

Type Parameters:

E - The type of entities in the Dataset.

public class DatasetKeyOutputFormat<E>
extends OutputFormat<E,Void>

A MapReduce OutputFormat for writing to a Dataset. Since a Dataset only contains entities (not key/value pairs), this output format ignores the value.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	DatasetKeyOutputFormat.ConfigBuilder
static class	DatasetKeyOutputFormat.WriteMode

Field Summary

Fields

Modifier and Type	Field and Description
static String	KITE_COPY_RECORDS
static String	KITE_OUTPUT_URI
static String	KITE_PARTITION_DIR
static String	KITE_TYPE
static String	KITE_WRITE_MODE

Constructor Summary

Constructors

Constructor and Description
DatasetKeyOutputFormat()

Method Summary

Methods

Modifier and Type	Method and Description
void	checkOutputSpecs(JobContext jobContext)
static DatasetKeyOutputFormat.ConfigBuilder	configure(Configuration conf) Returns a helper to add output options to the given Configuration.
static DatasetKeyOutputFormat.ConfigBuilder	configure(Job job) Configures the Job to use the DatasetKeyOutputFormat and returns a helper to add further configuration.
OutputCommitter	getOutputCommitter(TaskAttemptContext taskAttemptContext)
RecordWriter<E,Void>	getRecordWriter(TaskAttemptContext taskAttemptContext)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

KITE_OUTPUT_URI

public static final String KITE_OUTPUT_URI

See Also:

Constant Field Values

KITE_PARTITION_DIR

public static final String KITE_PARTITION_DIR

See Also:

Constant Field Values

KITE_TYPE

public static final String KITE_TYPE

See Also:

Constant Field Values

KITE_WRITE_MODE

public static final String KITE_WRITE_MODE

See Also:

Constant Field Values

KITE_COPY_RECORDS

public static final String KITE_COPY_RECORDS

See Also:

Constant Field Values

Constructor Detail

DatasetKeyOutputFormat

public DatasetKeyOutputFormat()

Method Detail

configure

public static DatasetKeyOutputFormat.ConfigBuilder configure(Job job)

Configures the Job to use the DatasetKeyOutputFormat and returns a helper to add further configuration.

Parameters:

job - the Job to configure

Since:

0.15.0

configure

public static DatasetKeyOutputFormat.ConfigBuilder configure(Configuration conf)

Returns a helper to add output options to the given Configuration.

Parameters:

conf - a Configuration

Since:

0.15.0

getRecordWriter

public RecordWriter<E,Void> getRecordWriter(TaskAttemptContext taskAttemptContext)

Specified by:

getRecordWriter in class OutputFormat<E,Void>

checkOutputSpecs

public void checkOutputSpecs(JobContext jobContext)

Specified by:

checkOutputSpecs in class OutputFormat<E,Void>

getOutputCommitter

public OutputCommitter getOutputCommitter(TaskAttemptContext taskAttemptContext)

Specified by:

getOutputCommitter in class OutputFormat<E,Void>