E
- The type of entities in the Dataset
.public class DatasetKeyInputFormat<E> extends InputFormat<E,Void> implements Configurable
InputFormat
for reading from a Dataset
.
Since a Dataset
only contains entities (not key/value pairs), this output
format ignores the value.Modifier and Type | Class and Description |
---|---|
static class |
DatasetKeyInputFormat.ConfigBuilder |
Modifier and Type | Field and Description |
---|---|
static String |
KITE_INPUT_URI |
static String |
KITE_PARTITION_DIR |
static String |
KITE_TYPE |
Constructor and Description |
---|
DatasetKeyInputFormat() |
Modifier and Type | Method and Description |
---|---|
static DatasetKeyInputFormat.ConfigBuilder |
configure(Configuration conf)
Adds settings to
Configuration to use DatasetKeyInputFormat
and returns a helper to add further configuration. |
static DatasetKeyInputFormat.ConfigBuilder |
configure(Job job)
Configures the
Job to use the DatasetKeyInputFormat and
returns a helper to add further configuration. |
RecordReader<E,Void> |
createRecordReader(InputSplit inputSplit,
TaskAttemptContext taskAttemptContext) |
Configuration |
getConf() |
List<InputSplit> |
getSplits(JobContext jobContext) |
void |
setConf(Configuration configuration) |
public static final String KITE_INPUT_URI
public static final String KITE_PARTITION_DIR
public static final String KITE_TYPE
public static DatasetKeyInputFormat.ConfigBuilder configure(Job job)
Job
to use the DatasetKeyInputFormat
and
returns a helper to add further configuration.job
- the Job
to configurepublic static DatasetKeyInputFormat.ConfigBuilder configure(Configuration conf)
Configuration
to use DatasetKeyInputFormat
and returns a helper to add further configuration.conf
- a Configuration
public Configuration getConf()
getConf
in interface Configurable
public void setConf(Configuration configuration)
setConf
in interface Configurable
public List<InputSplit> getSplits(JobContext jobContext) throws IOException, InterruptedException
getSplits
in class InputFormat<E,Void>
IOException
InterruptedException
public RecordReader<E,Void> createRecordReader(InputSplit inputSplit, TaskAttemptContext taskAttemptContext) throws IOException, InterruptedException
createRecordReader
in class InputFormat<E,Void>
IOException
InterruptedException
Copyright © 2013–2015. All rights reserved.