org.kitesdk.data.mapreduce
Class DatasetKeyOutputFormat<E>

java.lang.Object
  org.apache.hadoop.mapreduce.OutputFormat<E,Void>
      org.kitesdk.data.mapreduce.DatasetKeyOutputFormat<E>

Type Parameters:

E - The type of entities in the Dataset.

@Beta
public class DatasetKeyOutputFormat<E>
extends OutputFormat<E,Void>

A MapReduce OutputFormat for writing to a Dataset. Since a Dataset only contains entities (not key/value pairs), this output format ignores the value.

Nested Class Summary

static class

DatasetKeyOutputFormat.ConfigBuilder

Field Summary

static String	KITE_CONSTRAINTS
static String	KITE_DATASET_NAME Deprecated.
static String	KITE_OUTPUT_URI
static String	KITE_PARTITION_DIR
static String	KITE_REPOSITORY_URI Deprecated.

Constructor Summary

DatasetKeyOutputFormat()

Method Summary

void	checkOutputSpecs(JobContext jobContext)
static DatasetKeyOutputFormat.ConfigBuilder	configure(Configuration conf) Returns a helper to add output options to the given Configuration.
static DatasetKeyOutputFormat.ConfigBuilder	configure(Job job) Configures the Job to use the DatasetKeyOutputFormat and returns a helper to add further configuration.
OutputCommitter	getOutputCommitter(TaskAttemptContext taskAttemptContext)
RecordWriter<E,Void>	getRecordWriter(TaskAttemptContext taskAttemptContext)
static void	setDatasetName(Job job, String name) Deprecated. will be removed in 0.16.0; use configure(Job) instead
static void	setRepositoryUri(Job job, URI uri) Deprecated. will be removed in 0.16.0; use configure(Job) instead
static <E> void	setView(Configuration conf, View<E> view) Deprecated. will be removed in 0.16.0; use configure(Configuration)
static <E> void	setView(Job job, View<E> view) Deprecated. will be removed in 0.16.0; use configure(Job) instead

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

KITE_OUTPUT_URI

public static final String KITE_OUTPUT_URI

See Also:

Constant Field Values

KITE_REPOSITORY_URI

@Deprecated
public static final String KITE_REPOSITORY_URI

Deprecated.

See Also:

Constant Field Values

KITE_DATASET_NAME

@Deprecated
public static final String KITE_DATASET_NAME

Deprecated.

See Also:

Constant Field Values

KITE_PARTITION_DIR

public static final String KITE_PARTITION_DIR

See Also:

Constant Field Values

KITE_CONSTRAINTS

public static final String KITE_CONSTRAINTS

See Also:

Constant Field Values

Constructor Detail

DatasetKeyOutputFormat

public DatasetKeyOutputFormat()

Method Detail

configure

public static DatasetKeyOutputFormat.ConfigBuilder configure(Job job)

Configures the Job to use the DatasetKeyOutputFormat and returns a helper to add further configuration.

Parameters:

job - the Job to configure

Since:

0.15.0

configure

public static DatasetKeyOutputFormat.ConfigBuilder configure(Configuration conf)

Returns a helper to add output options to the given Configuration.

Parameters:

conf - a Configuration

Since:

0.15.0

setRepositoryUri

public static void setRepositoryUri(Job job,
                                    URI uri)

Deprecated. will be removed in 0.16.0; use configure(Job) instead

setDatasetName

public static void setDatasetName(Job job,
                                  String name)

Deprecated. will be removed in 0.16.0; use configure(Job) instead

setView

public static <E> void setView(Job job,
                               View<E> view)

Deprecated. will be removed in 0.16.0; use configure(Job) instead

setView

public static <E> void setView(Configuration conf,
                               View<E> view)

Deprecated. will be removed in 0.16.0; use configure(Configuration)

getRecordWriter

public RecordWriter<E,Void> getRecordWriter(TaskAttemptContext taskAttemptContext)

Specified by:

getRecordWriter in class OutputFormat<E,Void>

checkOutputSpecs

public void checkOutputSpecs(JobContext jobContext)

Specified by:

checkOutputSpecs in class OutputFormat<E,Void>

getOutputCommitter

public OutputCommitter getOutputCommitter(TaskAttemptContext taskAttemptContext)

Specified by:

getOutputCommitter in class OutputFormat<E,Void>