org.kitesdk.data.crunch
Class CrunchDatasets

java.lang.Object
  org.kitesdk.data.crunch.CrunchDatasets

@Beta
public class CrunchDatasets
extends Object

A helper class for exposing a filesystem-based dataset as a Crunch ReadableSource or Target.

Constructor Summary

CrunchDatasets()

Method Summary

static <E> ReadableSource<E>	asSource(Dataset<E> dataset, Class<E> type) Expose the given Dataset as a Crunch ReadableSource.
static <E> ReadableSource<E>	asSource(View<E> view, Class<E> type) Expose the given View as a Crunch ReadableSource.
static <E> Target	asTarget(Dataset<E> dataset) Expose the given Dataset as a Crunch Target.
static <E> Target	asTarget(View<E> view) Expose the given View as a Crunch Target.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CrunchDatasets

public CrunchDatasets()

Method Detail

asSource

public static <E> ReadableSource<E> asSource(Dataset<E> dataset,
                                             Class<E> type)

Expose the given Dataset as a Crunch ReadableSource.

Type Parameters:

E - the type of entity produced by the source

Parameters:

dataset - the dataset to read from

type - the Java type of the entities in the dataset

Returns:

a ReadableSource for the dataset

asSource

public static <E> ReadableSource<E> asSource(View<E> view,
                                             Class<E> type)

Expose the given View as a Crunch ReadableSource.

Type Parameters:

E - the type of entity produced by the source

Parameters:

view - the view to read from

type - the Java type of the entities in the dataset

Returns:

a ReadableSource for the view

Since:

0.14.0

asTarget

public static <E> Target asTarget(Dataset<E> dataset)

Expose the given Dataset as a Crunch Target.

Type Parameters:

E - the type of entity stored in the dataset

Parameters:

dataset - the dataset to write to

Returns:

a Target for the dataset

asTarget

public static <E> Target asTarget(View<E> view)

Expose the given View as a Crunch Target.

Type Parameters:

E - the type of entity stored in the view

Parameters:

view - the view to write to

Returns:

a Target for the view

Since:

0.14.0