|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.apache.hadoop.mapreduce.OutputFormat<E,Void>
org.kitesdk.data.mapreduce.DatasetKeyOutputFormat<E>
E
- The type of entities in the Dataset
.@Beta public class DatasetKeyOutputFormat<E>
A MapReduce OutputFormat
for writing to a Dataset
.
Since a Dataset
only contains entities (not key/value pairs), this output
format ignores the value.
Nested Class Summary | |
---|---|
static class |
DatasetKeyOutputFormat.ConfigBuilder
|
Field Summary | |
---|---|
static String |
KITE_CONSTRAINTS
|
static String |
KITE_DATASET_NAME
Deprecated. |
static String |
KITE_OUTPUT_URI
|
static String |
KITE_PARTITION_DIR
|
static String |
KITE_REPOSITORY_URI
Deprecated. |
static String |
KITE_TYPE
|
Constructor Summary | |
---|---|
DatasetKeyOutputFormat()
|
Method Summary | ||
---|---|---|
void |
checkOutputSpecs(JobContext jobContext)
|
|
static DatasetKeyOutputFormat.ConfigBuilder |
configure(Configuration conf)
Returns a helper to add output options to the given Configuration . |
|
static DatasetKeyOutputFormat.ConfigBuilder |
configure(Job job)
Configures the Job to use the DatasetKeyOutputFormat and
returns a helper to add further configuration. |
|
OutputCommitter |
getOutputCommitter(TaskAttemptContext taskAttemptContext)
|
|
RecordWriter<E,Void> |
getRecordWriter(TaskAttemptContext taskAttemptContext)
|
|
static void |
setDatasetName(Job job,
String name)
Deprecated. will be removed in 0.16.0; use configure(Job) instead |
|
static void |
setRepositoryUri(Job job,
URI uri)
Deprecated. will be removed in 0.16.0; use configure(Job) instead |
|
static
|
setView(Configuration conf,
View<E> view)
Deprecated. will be removed in 0.16.0; use configure(Configuration) |
|
static
|
setView(Job job,
View<E> view)
Deprecated. will be removed in 0.16.0; use configure(Job) instead |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Field Detail |
---|
public static final String KITE_OUTPUT_URI
@Deprecated public static final String KITE_REPOSITORY_URI
@Deprecated public static final String KITE_DATASET_NAME
public static final String KITE_PARTITION_DIR
public static final String KITE_CONSTRAINTS
public static final String KITE_TYPE
Constructor Detail |
---|
public DatasetKeyOutputFormat()
Method Detail |
---|
public static DatasetKeyOutputFormat.ConfigBuilder configure(Job job)
Job
to use the DatasetKeyOutputFormat
and
returns a helper to add further configuration.
job
- the Job
to configurepublic static DatasetKeyOutputFormat.ConfigBuilder configure(Configuration conf)
Configuration
.
conf
- a Configuration
public static void setRepositoryUri(Job job, URI uri)
configure(Job)
instead
public static void setDatasetName(Job job, String name)
configure(Job)
instead
public static <E> void setView(Job job, View<E> view)
configure(Job)
instead
public static <E> void setView(Configuration conf, View<E> view)
configure(Configuration)
public RecordWriter<E,Void> getRecordWriter(TaskAttemptContext taskAttemptContext)
getRecordWriter
in class OutputFormat<E,Void>
public void checkOutputSpecs(JobContext jobContext)
checkOutputSpecs
in class OutputFormat<E,Void>
public OutputCommitter getOutputCommitter(TaskAttemptContext taskAttemptContext)
getOutputCommitter
in class OutputFormat<E,Void>
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |