A B C D E F G H I J K L M N O P R S T U V W X Y

A

AbstractCommand - Class in org.kitesdk.morphline.base
Base class for convenient implementation of Command classes.
AbstractCommand(CommandBuilder, Config, Command, Command, MorphlineContext) - Constructor for class org.kitesdk.morphline.base.AbstractCommand
Using the given builder, constructs a command rooted at the given morphline JSON config.
AbstractCommand(Config, Command, Command, MorphlineContext) - Constructor for class org.kitesdk.morphline.base.AbstractCommand
Deprecated. 
AbstractFieldTransformCommand - Class in org.kitesdk.morphline.stdlib
Base class for convenient implementation of commands that do in-place updates on a field.
AbstractFieldTransformCommand(CommandBuilder, Config, Command, Command, MorphlineContext) - Constructor for class org.kitesdk.morphline.stdlib.AbstractFieldTransformCommand
 
AbstractFieldTransformCommand(Config, Command, Command, MorphlineContext) - Constructor for class org.kitesdk.morphline.stdlib.AbstractFieldTransformCommand
Deprecated. 
AbstractParser - Class in org.kitesdk.morphline.stdio
Base class for convenient implementation of morphline parsers.
AbstractParser(CommandBuilder, Config, Command, Command, MorphlineContext) - Constructor for class org.kitesdk.morphline.stdio.AbstractParser
 
AbstractParser(Config, Command, Command, MorphlineContext) - Constructor for class org.kitesdk.morphline.stdio.AbstractParser
Deprecated. 
add(String, Object) - Method in class org.kitesdk.data.Key.Builder
Add a key value for the named field.
AddCurrentTimeBuilder - Class in org.kitesdk.morphline.stdlib
A command that adds the result of System.currentTimeMillis() to a given output field.
AddCurrentTimeBuilder() - Constructor for class org.kitesdk.morphline.stdlib.AddCurrentTimeBuilder
 
AddLocalHostBuilder - Class in org.kitesdk.morphline.stdlib
A command that adds the name or IP of the local host to a given output field.
AddLocalHostBuilder() - Constructor for class org.kitesdk.morphline.stdlib.AddLocalHostBuilder
 
addSupportedMimeType(String) - Method in class org.kitesdk.morphline.stdio.AbstractParser
 
AddValuesBuilder - Class in org.kitesdk.morphline.stdlib
For each input field value, add the value to the given record output field.
AddValuesBuilder() - Constructor for class org.kitesdk.morphline.stdlib.AddValuesBuilder
 
AddValuesIfAbsentBuilder - Class in org.kitesdk.morphline.stdlib
For each input field value, add the value to the given record output field if the value isn't already contained in that field.
AddValuesIfAbsentBuilder() - Constructor for class org.kitesdk.morphline.stdlib.AddValuesIfAbsentBuilder
 
append(Path, int, Progressable) - Method in class org.kitesdk.morphline.hadoop.rcfile.SingleStreamFileSystem
 
apply(S) - Method in class org.kitesdk.data.FieldPartitioner
Apply the partition function to the given value.
apply(Long) - Method in class org.kitesdk.data.partition.CalendarFieldPartitioner
 
apply(Long) - Method in class org.kitesdk.data.partition.DateFormatPartitioner
 
apply(Object) - Method in class org.kitesdk.data.partition.HashFieldPartitioner
 
apply(S) - Method in class org.kitesdk.data.partition.IdentityFieldPartitioner
 
apply(Integer) - Method in class org.kitesdk.data.partition.IntRangeFieldPartitioner
 
apply(S) - Method in class org.kitesdk.data.partition.ListFieldPartitioner
 
apply(Long) - Method in class org.kitesdk.data.partition.MonthFieldPartitioner
 
apply(String) - Method in class org.kitesdk.data.partition.RangeFieldPartitioner
 
asSource(Dataset<E>, Class<E>) - Static method in class org.kitesdk.data.crunch.CrunchDatasets
Expose the given Dataset as a Crunch ReadableSource.
asTarget(Dataset) - Static method in class org.kitesdk.data.crunch.CrunchDatasets
Expose the given Dataset as a Crunch Target.
ATTACHMENT_BODY - Static variable in class org.kitesdk.morphline.base.Fields
 
ATTACHMENT_CHARSET - Static variable in class org.kitesdk.morphline.base.Fields
 
ATTACHMENT_MIME_TYPE - Static variable in class org.kitesdk.morphline.base.Fields
 
ATTACHMENT_NAME - Static variable in class org.kitesdk.morphline.base.Fields
 
AVRO - Static variable in class org.kitesdk.data.Formats
AVRO: the Avro row-oriented format
AVRO_MEMORY_MIME_TYPE - Static variable in class org.kitesdk.morphline.avro.ReadAvroBuilder
The MIME type identifier that will be filled into output records
AVRO_MEMORY_MIME_TYPE - Static variable in class org.kitesdk.morphline.hadoop.parquet.avro.ReadAvroParquetFileBuilder
The MIME type identifier that will be filled into output records

B

BASE_ID - Static variable in class org.kitesdk.morphline.base.Fields
 
beginTransaction() - Method in interface org.kitesdk.morphline.solr.DocumentLoader
Begins a transaction
beginTransaction() - Method in class org.kitesdk.morphline.solr.SolrServerDocumentLoader
 
build() - Method in class org.kitesdk.data.DatasetDescriptor.Builder
Build an instance of the configured dataset descriptor.
build() - Method in class org.kitesdk.data.filesystem.FileSystemDatasetRepository.Builder
Build an instance of the configured FileSystemDatasetRepository.
build() - Method in class org.kitesdk.data.filesystem.FileSystemMetadataProvider.Builder
Build an instance of the configured FileSystemMetadataProvider.
build() - Method in class org.kitesdk.data.hcatalog.HCatalogDatasetRepository.Builder
Build an instance of the configured HCatalogDatasetRepository.
build() - Method in class org.kitesdk.data.Key.Builder
Build an instance of the configured key.
build() - Method in class org.kitesdk.data.PartitionStrategy.Builder
Build a configured PartitionStrategy instance.
build(Config, Command, Command, MorphlineContext) - Method in interface org.kitesdk.morphline.api.CommandBuilder
Creates and returns a command rooted at the given morphline JSON config.
build() - Method in class org.kitesdk.morphline.api.MorphlineContext.Builder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.avro.ExtractAvroPathsBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.avro.ExtractAvroTreeBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.avro.ReadAvroBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.avro.ReadAvroContainerBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.avro.ToAvroBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.avro.WriteAvroToByteArrayBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.hadoop.core.DownloadHdfsFileBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.hadoop.parquet.avro.ReadAvroParquetFileBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.hadoop.rcfile.ReadRCFileBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.hadoop.sequencefile.ReadSequenceFileBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.json.ExtractJsonPathsBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.json.ReadJsonBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.maxmind.GeoIPBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.metrics.servlets.RegisterJVMMetricsBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.metrics.servlets.StartReportingMetricsToHTTPBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.saxon.ConvertHTMLBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.saxon.XQueryBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.saxon.XSLTBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.solr.GenerateSolrSequenceKeyBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.solr.LoadSolrBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.solr.SanitizeUnknownSolrFieldsBuilder
 
build() - Method in class org.kitesdk.morphline.solr.SolrMorphlineContext.Builder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.solr.TokenizeTextBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.solrcell.SolrCellBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdio.ReadClobBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdio.ReadCSVBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdio.ReadLineBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdio.ReadMultiLineBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.AddCurrentTimeBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.AddLocalHostBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.AddValuesBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.AddValuesIfAbsentBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.CallParentPipeBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.ContainsBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.ConvertTimestampBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.DecodeBase64Builder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.DropRecordBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.EqualsBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.ExtractURIComponentBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.ExtractURIComponentsBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.ExtractURIQueryParametersBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.FindReplaceBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.GenerateUUIDBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.GrokBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.IfThenElseBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.JavaBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.LogDebugBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.LogErrorBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.LogInfoBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.LogTraceBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.LogWarnBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.NotBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.PipeBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.SeparateAttachmentsBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.SetValuesBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.SplitBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.SplitKeyValueBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.StartReportingMetricsToCSVBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.StartReportingMetricsToJMXBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.StartReportingMetricsToSLF4JBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.ToByteArrayBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.ToStringBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.TranslateBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.stdlib.TryRulesBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.tika.decompress.DecompressBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.tika.decompress.UnpackBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.tika.DetectMimeTypeBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.twitter.ReadJsonTestTweetsBuilder
 
build(Config, Command, Command, MorphlineContext) - Method in class org.kitesdk.morphline.useragent.UserAgentBuilder
 
buildCommand(Config, Command, Command) - Method in class org.kitesdk.morphline.base.AbstractCommand
Factory method to create a command rooted at the given cmdConfig.
buildCommandChain(Config, String, Command, boolean) - Method in class org.kitesdk.morphline.base.AbstractCommand
Factory method to create the chain of commands rooted at the given rootConfig.

C

calendarField - Variable in class org.kitesdk.data.partition.CalendarFieldPartitioner
 
CalendarFieldPartitioner - Class in org.kitesdk.data.partition
A FieldPartitioner that extracts the value of a Calendar field, such as Calendar.YEAR.
CalendarFieldPartitioner(String, String, int, int) - Constructor for class org.kitesdk.data.partition.CalendarFieldPartitioner
 
CallParentPipeBuilder - Class in org.kitesdk.morphline.stdlib
Command that routes records to the enclosing pipe morphline object.
CallParentPipeBuilder() - Constructor for class org.kitesdk.morphline.stdlib.CallParentPipeBuilder
 
close() - Method in interface org.kitesdk.data.DatasetReader
Close the reader and release any system resources.
close() - Method in interface org.kitesdk.data.DatasetWriter
Close the writer and release any system resources.
CombinedLogFormatConverter - Class in org.kitesdk.tools
A tool for converting files in Combined Log Format to a Dataset.
CombinedLogFormatConverter() - Constructor for class org.kitesdk.tools.CombinedLogFormatConverter
 
Command - Interface in org.kitesdk.morphline.api
A command transforms a record into zero or more records.
CommandBuilder - Interface in org.kitesdk.morphline.api
Interface to create instances of morphline commands.
commitTransaction() - Method in interface org.kitesdk.morphline.solr.DocumentLoader
Sends any outstanding documents to the destination and waits for a positive or negative ack (i.e.
commitTransaction() - Method in class org.kitesdk.morphline.solr.SolrServerDocumentLoader
 
compare(Integer, Integer) - Method in class org.kitesdk.data.partition.CalendarFieldPartitioner
 
compare(String, String) - Method in class org.kitesdk.data.partition.DateFormatPartitioner
 
compare(Integer, Integer) - Method in class org.kitesdk.data.partition.HashFieldPartitioner
 
compare(S, S) - Method in class org.kitesdk.data.partition.IdentityFieldPartitioner
 
compare(Integer, Integer) - Method in class org.kitesdk.data.partition.IntRangeFieldPartitioner
 
compare(Integer, Integer) - Method in class org.kitesdk.data.partition.ListFieldPartitioner
 
compare(String, String) - Method in class org.kitesdk.data.partition.RangeFieldPartitioner
 
compile(File, String, MorphlineContext, Command, Config...) - Method in class org.kitesdk.morphline.base.Compiler
Parses the given morphlineFile, then finds the morphline with the given morphlineId within, then compiles the morphline and returns the corresponding morphline command.
compile(Config, MorphlineContext, Command) - Method in class org.kitesdk.morphline.base.Compiler
Compiles the given morphline config using the given morphline context.
Compiler - Class in org.kitesdk.morphline.base
Tool to parse and compile a morphline file or morphline config.
Compiler() - Constructor for class org.kitesdk.morphline.base.Compiler
 
ConcurrentSchemaModificationException - Exception in org.kitesdk.data
Exception thrown when a schema modification collided with another client trying to modify the schema of the same dataset.
ConcurrentSchemaModificationException(String) - Constructor for exception org.kitesdk.data.ConcurrentSchemaModificationException
 
ConcurrentSchemaModificationException(Throwable) - Constructor for exception org.kitesdk.data.ConcurrentSchemaModificationException
 
ConcurrentSchemaModificationException(String, Throwable) - Constructor for exception org.kitesdk.data.ConcurrentSchemaModificationException
 
CONFIG_KEY_FIELD - Static variable in class org.kitesdk.morphline.hadoop.sequencefile.ReadSequenceFileBuilder
 
CONFIG_VALUE_FIELD - Static variable in class org.kitesdk.morphline.hadoop.sequencefile.ReadSequenceFileBuilder
 
Configs - Class in org.kitesdk.morphline.base
Helpers to traverse and read parts of a HOCON data structure.
Configs() - Constructor for class org.kitesdk.morphline.base.Configs
 
configuration(Configuration) - Method in class org.kitesdk.data.filesystem.FileSystemDatasetRepository.Builder
The Configuration used to find the FileSystem (optional).
configuration(Configuration) - Method in class org.kitesdk.data.filesystem.FileSystemMetadataProvider.Builder
The Configuration used to find the FileSystem.
configuration(Configuration) - Method in class org.kitesdk.data.hcatalog.HCatalogDatasetRepository.Builder
The Configuration used to find the FileSystem.
ContainsBuilder - Class in org.kitesdk.morphline.stdlib
Command that succeeds if one of the field values of the given named field is equal to one of the the given values, and fails otherwise; Multiple fields can be named, in which case the results are ANDed.
ContainsBuilder() - Constructor for class org.kitesdk.morphline.stdlib.ContainsBuilder
 
containsLifecycleEvent(Record, Notifications.LifecycleEvent) - Static method in class org.kitesdk.morphline.base.Notifications
Determine whether or not the given notification contains the given lifecycle event.
context - Variable in class org.kitesdk.morphline.api.MorphlineContext.Builder
 
ConvertHTMLBuilder - Class in org.kitesdk.morphline.saxon
Command that converts HTML to XHTML using the TagSoup library.
ConvertHTMLBuilder() - Constructor for class org.kitesdk.morphline.saxon.ConvertHTMLBuilder
 
ConvertTimestampBuilder - Class in org.kitesdk.morphline.stdlib
Command that converts the timestamps in a given field from one of a set of input date formats (in an input timezone) to an output date format (in an output timezone), while respecting daylight savings time rules.
ConvertTimestampBuilder() - Constructor for class org.kitesdk.morphline.stdlib.ConvertTimestampBuilder
 
copy() - Method in class org.kitesdk.morphline.api.Record
Returns a shallow copy of this record.
create(String, DatasetDescriptor) - Method in interface org.kitesdk.data.DatasetRepository
Create a Dataset with the supplied descriptor.
create(String, DatasetDescriptor) - Method in class org.kitesdk.data.filesystem.FileSystemDatasetRepository
 
create(String, DatasetDescriptor) - Method in class org.kitesdk.data.filesystem.FileSystemMetadataProvider
 
create(String, DatasetDescriptor) - Method in class org.kitesdk.data.hcatalog.HCatalogDatasetRepository
 
create(String, DatasetDescriptor) - Method in interface org.kitesdk.data.MetadataProvider
Create a DatasetDescriptor for the dataset named name.
create(String, DatasetDescriptor) - Method in interface org.kitesdk.data.RandomAccessDatasetRepository
 
create() - Method in class org.kitesdk.morphline.api.MorphlineContext.Builder
 
create(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.kitesdk.morphline.hadoop.rcfile.SingleStreamFileSystem
 
create() - Method in class org.kitesdk.morphline.solr.SolrMorphlineContext.Builder
 
createSolrContentHandler(Metadata, SolrParams, IndexSchema) - Method in class org.kitesdk.morphline.solrcell.StripNonCharSolrContentHandlerFactory
 
createSolrContentHandler(Metadata, SolrParams, IndexSchema) - Method in class org.kitesdk.morphline.solrcell.TrimSolrContentHandlerFactory
 
CrunchDatasets - Class in org.kitesdk.data.crunch
A helper class for exposing a filesystem-based dataset as a Crunch ReadableSource or Target.
CrunchDatasets() - Constructor for class org.kitesdk.data.crunch.CrunchDatasets
 
CSV - Static variable in class org.kitesdk.data.Formats
CSV: comma-separated values (read-only).

D

Dataset<E> - Interface in org.kitesdk.data
A logical representation of a set of data entities.
DatasetDescriptor - Class in org.kitesdk.data
The structural definition of a Dataset.
DatasetDescriptor(Schema, URL, Format, URI, Map<String, String>, PartitionStrategy) - Constructor for class org.kitesdk.data.DatasetDescriptor
Create an instance of this class with the supplied Schema, optional URL, Format, optional location URL, and optional PartitionStrategy.
DatasetDescriptor.Builder - Class in org.kitesdk.data
A fluent builder to aid in the construction of DatasetDescriptors.
DatasetDescriptor.Builder() - Constructor for class org.kitesdk.data.DatasetDescriptor.Builder
 
DatasetDescriptor.Builder(DatasetDescriptor) - Constructor for class org.kitesdk.data.DatasetDescriptor.Builder
Creates a Builder configured to copy descriptor, if it is not modified.
DatasetException - Exception in org.kitesdk.data
Exception thrown for dataset-related failures.
DatasetException() - Constructor for exception org.kitesdk.data.DatasetException
 
DatasetException(String) - Constructor for exception org.kitesdk.data.DatasetException
 
DatasetException(String, Throwable) - Constructor for exception org.kitesdk.data.DatasetException
 
DatasetException(Throwable) - Constructor for exception org.kitesdk.data.DatasetException
 
DatasetExistsException - Exception in org.kitesdk.data
Exception thrown when trying to create a dataset that already exists.
DatasetExistsException(String) - Constructor for exception org.kitesdk.data.DatasetExistsException
 
DatasetExistsException(String, Throwable) - Constructor for exception org.kitesdk.data.DatasetExistsException
 
DatasetExistsException(Throwable) - Constructor for exception org.kitesdk.data.DatasetExistsException
 
DatasetIOException - Exception in org.kitesdk.data
Exception thrown for dataset IO-related failures.
DatasetIOException(String, IOException) - Constructor for exception org.kitesdk.data.DatasetIOException
 
DatasetNotFoundException - Exception in org.kitesdk.data
Exception thrown to indicate that a dataset was not found.
DatasetNotFoundException(String) - Constructor for exception org.kitesdk.data.DatasetNotFoundException
 
DatasetNotFoundException(String, Throwable) - Constructor for exception org.kitesdk.data.DatasetNotFoundException
 
DatasetNotFoundException(Throwable) - Constructor for exception org.kitesdk.data.DatasetNotFoundException
 
DatasetReader<E> - Interface in org.kitesdk.data
A stream-oriented dataset reader.
DatasetReaderException - Exception in org.kitesdk.data
Exception thrown for dataset reader-related failures.
DatasetReaderException() - Constructor for exception org.kitesdk.data.DatasetReaderException
 
DatasetReaderException(String) - Constructor for exception org.kitesdk.data.DatasetReaderException
 
DatasetReaderException(String, Throwable) - Constructor for exception org.kitesdk.data.DatasetReaderException
 
DatasetReaderException(Throwable) - Constructor for exception org.kitesdk.data.DatasetReaderException
 
DatasetRepositories - Class in org.kitesdk.data
Convenience methods for working with DatasetRepository instances.
DatasetRepositories() - Constructor for class org.kitesdk.data.DatasetRepositories
 
DatasetRepository - Interface in org.kitesdk.data
A logical repository (storage system) of Datasets.
DatasetRepositoryException - Exception in org.kitesdk.data
Exception thrown for dataset repository-related failures.
DatasetRepositoryException() - Constructor for exception org.kitesdk.data.DatasetRepositoryException
 
DatasetRepositoryException(String) - Constructor for exception org.kitesdk.data.DatasetRepositoryException
 
DatasetRepositoryException(String, Throwable) - Constructor for exception org.kitesdk.data.DatasetRepositoryException
 
DatasetRepositoryException(Throwable) - Constructor for exception org.kitesdk.data.DatasetRepositoryException
 
DatasetWriter<E> - Interface in org.kitesdk.data
A stream-oriented dataset writer.
DatasetWriterException - Exception in org.kitesdk.data
Exception thrown for dataset writer-related failures.
DatasetWriterException() - Constructor for exception org.kitesdk.data.DatasetWriterException
 
DatasetWriterException(String) - Constructor for exception org.kitesdk.data.DatasetWriterException
 
DatasetWriterException(String, Throwable) - Constructor for exception org.kitesdk.data.DatasetWriterException
 
DatasetWriterException(Throwable) - Constructor for exception org.kitesdk.data.DatasetWriterException
 
dateFormat(String, String, String) - Static method in class org.kitesdk.data.partition.PartitionFunctions
 
dateFormat(String, String, String) - Method in class org.kitesdk.data.PartitionStrategy.Builder
Configure a partitioner that applies a custom date format to a timestamp field.
DateFormatPartitioner - Class in org.kitesdk.data.partition
A FieldPartitioner that formats a timestamp (long) in milliseconds since epoch, such as those returned by System.currentTimeMillis(), using SimpleDateFormat.
DateFormatPartitioner(String, String, String) - Constructor for class org.kitesdk.data.partition.DateFormatPartitioner
Construct a new DateFormatPartitioner for Universal Coordinated Time, UTC (+00:00), and cardinality 1095 (3 years, 1 day = 1 partition).
DateFormatPartitioner(String, String, String, int, TimeZone) - Constructor for class org.kitesdk.data.partition.DateFormatPartitioner
Construct a new DateFormatPartitioner for Universal Coordinated Time, UTC (+00:00).
day(String, String) - Static method in class org.kitesdk.data.partition.PartitionFunctions
 
day(String, String) - Method in class org.kitesdk.data.PartitionStrategy.Builder
Configure a partitioner for extracting the day from a timestamp field.
day(String) - Method in class org.kitesdk.data.PartitionStrategy.Builder
Configure a partitioner for extracting the day from a timestamp field.
DayOfMonthFieldPartitioner - Class in org.kitesdk.data.partition
 
DayOfMonthFieldPartitioner(String, String) - Constructor for class org.kitesdk.data.partition.DayOfMonthFieldPartitioner
 
DecodeBase64Builder - Class in org.kitesdk.morphline.stdlib
Command that converts a Base64 encoded String to a byte[] per Section 6.8.
DecodeBase64Builder() - Constructor for class org.kitesdk.morphline.stdlib.DecodeBase64Builder
 
DecompressBuilder - Class in org.kitesdk.morphline.tika.decompress
Command that decompresses the first attachment.
DecompressBuilder() - Constructor for class org.kitesdk.morphline.tika.decompress.DecompressBuilder
 
delete(String) - Method in interface org.kitesdk.data.DatasetRepository
Delete the named Dataset.
delete(String) - Method in class org.kitesdk.data.filesystem.FileSystemDatasetRepository
 
delete(String) - Method in class org.kitesdk.data.filesystem.FileSystemMetadataProvider
 
delete(String) - Method in class org.kitesdk.data.hcatalog.HCatalogDatasetRepository
 
delete(String) - Method in interface org.kitesdk.data.MetadataProvider
Delete all metadata associated with the dataset named name.
delete(Key) - Method in interface org.kitesdk.data.RandomAccessDataset
Deletes the entity in the dataset with Key key.
delete(E) - Method in interface org.kitesdk.data.RandomAccessDataset
Deletes the entity passed to this method in the dataset.
delete(Path, boolean) - Method in class org.kitesdk.morphline.hadoop.rcfile.SingleStreamFileSystem
 
detectCharset(Record, Charset) - Method in class org.kitesdk.morphline.stdio.AbstractParser
 
DetectMimeTypeBuilder - Class in org.kitesdk.morphline.tika
Command that auto-detects the MIME type of the first attachment, if no MIME type is defined yet.
DetectMimeTypeBuilder() - Constructor for class org.kitesdk.morphline.tika.DetectMimeTypeBuilder
 
DocumentLoader - Interface in org.kitesdk.morphline.solr
A vehicle to load a list of Solr documents into some kind of destination, such as a SolrServer or MapReduce RecordWriter.
doNotify(Record) - Method in class org.kitesdk.morphline.base.AbstractCommand
Processes the given notification on the control plane of the subtree rooted at this command.
doProcess(Record) - Method in class org.kitesdk.morphline.base.AbstractCommand
Processes the given record on the data plane of this command.
doProcess(Record) - Method in class org.kitesdk.morphline.stdio.AbstractParser
 
doProcess(Record, InputStream) - Method in class org.kitesdk.morphline.stdio.AbstractParser
 
doProcess(Record) - Method in class org.kitesdk.morphline.stdlib.AbstractFieldTransformCommand
 
DownloadHdfsFileBuilder - Class in org.kitesdk.morphline.hadoop.core
Command for transferring HDFS files, for example to help with centralized configuration file management.
DownloadHdfsFileBuilder() - Constructor for class org.kitesdk.morphline.hadoop.core.DownloadHdfsFileBuilder
 
dropPartition(PartitionKey) - Method in interface org.kitesdk.data.Dataset
Drop a partition for a PartitionKey.
DropRecordBuilder - Class in org.kitesdk.morphline.stdlib
Command that silently consumes records without ever emitting any record - think /dev/null.
DropRecordBuilder() - Constructor for class org.kitesdk.morphline.stdlib.DropRecordBuilder
 

E

ELAPSED_TIME - Static variable in class org.kitesdk.morphline.base.Metrics
 
equals(Object) - Method in class org.kitesdk.data.DatasetDescriptor
 
equals(Object) - Method in class org.kitesdk.data.Format
 
equals(Object) - Method in class org.kitesdk.data.Key
 
equals(Object) - Method in class org.kitesdk.data.partition.CalendarFieldPartitioner
 
equals(Object) - Method in class org.kitesdk.data.partition.DateFormatPartitioner
 
equals(Object) - Method in class org.kitesdk.data.partition.HashFieldPartitioner
 
equals(Object) - Method in class org.kitesdk.data.partition.IdentityFieldPartitioner
 
equals(Object) - Method in class org.kitesdk.data.partition.IntRangeFieldPartitioner
 
equals(Object) - Method in class org.kitesdk.data.partition.ListFieldPartitioner
 
equals(Object) - Method in class org.kitesdk.data.partition.RangeFieldPartitioner
 
equals(Object) - Method in class org.kitesdk.data.PartitionKey
 
equals(Object) - Method in class org.kitesdk.data.PartitionStrategy
 
equals(Object) - Method in class org.kitesdk.morphline.api.Record
 
EqualsBuilder - Class in org.kitesdk.morphline.stdlib
Command that succeeds if all field values of the given named fields are equal to the the given values, and fails otherwise.
EqualsBuilder() - Constructor for class org.kitesdk.morphline.stdlib.EqualsBuilder
 
evaluate(Record) - Method in class org.kitesdk.morphline.base.FieldExpression
Returns the values of a Record referred to by the given field expression
evaluate(Object...) - Method in class org.kitesdk.morphline.scriptengine.java.ScriptEvaluator
 
ExceptionHandler - Interface in org.kitesdk.morphline.api
Morphline-wide default handler that commands can choose to use to handle exceptions.
exists(String) - Method in interface org.kitesdk.data.DatasetRepository
Checks if there is a Dataset in this repository named name.
exists(String) - Method in class org.kitesdk.data.filesystem.FileSystemDatasetRepository
 
exists(String) - Method in class org.kitesdk.data.filesystem.FileSystemMetadataProvider
 
exists(String) - Method in class org.kitesdk.data.hcatalog.HCatalogDatasetRepository
 
exists(String) - Method in interface org.kitesdk.data.MetadataProvider
Checks if there is a DatasetDescriptor for the dataset named name.
ExtractAvroPathsBuilder - Class in org.kitesdk.morphline.avro
Command that uses zero or more avro path expressions to extract values from an Avro object.
ExtractAvroPathsBuilder() - Constructor for class org.kitesdk.morphline.avro.ExtractAvroPathsBuilder
 
ExtractAvroTreeBuilder - Class in org.kitesdk.morphline.avro
Command that converts an attached Avro datum to a morphline record by recursively walking the Avro tree and extracting all data into a single morphline record, with fields named by their path in the Avro tree.
ExtractAvroTreeBuilder() - Constructor for class org.kitesdk.morphline.avro.ExtractAvroTreeBuilder
 
ExtractJsonPathsBuilder - Class in org.kitesdk.morphline.json
Command that uses zero or more JSON path expressions to extract values from a JSON object.
ExtractJsonPathsBuilder() - Constructor for class org.kitesdk.morphline.json.ExtractJsonPathsBuilder
 
ExtractURIComponentBuilder - Class in org.kitesdk.morphline.stdlib
A command that extracts a subcomponent from the URIs contained in the given input field and appends it to the given output fields.
ExtractURIComponentBuilder() - Constructor for class org.kitesdk.morphline.stdlib.ExtractURIComponentBuilder
 
ExtractURIComponentsBuilder - Class in org.kitesdk.morphline.stdlib
A command that extracts subcomponents from the URIs contained in the given input field and appends them to output fields with the given prefix, namely scheme, authority, host, port, path, query, fragment, schemeSpecificPart, userInfo.
ExtractURIComponentsBuilder() - Constructor for class org.kitesdk.morphline.stdlib.ExtractURIComponentsBuilder
 
ExtractURIQueryParametersBuilder - Class in org.kitesdk.morphline.stdlib
A command that extracts the query parameters with a given name from the URIs contained in the given input field and appends them to the given output field.
ExtractURIQueryParametersBuilder() - Constructor for class org.kitesdk.morphline.stdlib.ExtractURIQueryParametersBuilder
 

F

FaultTolerance - Class in org.kitesdk.morphline.base
Mission critical, large-scale online production systems need to make progress without downtime despite some issues.
FaultTolerance(boolean, boolean) - Constructor for class org.kitesdk.morphline.base.FaultTolerance
 
FaultTolerance(boolean, boolean, String) - Constructor for class org.kitesdk.morphline.base.FaultTolerance
 
FIELD_NAME - Static variable in class org.kitesdk.morphline.stdlib.AddCurrentTimeBuilder
 
FIELD_NAME - Static variable in class org.kitesdk.morphline.stdlib.AddLocalHostBuilder
 
FIELD_NAME - Static variable in class org.kitesdk.morphline.stdlib.GenerateUUIDBuilder
 
FieldExpression - Class in org.kitesdk.morphline.base
Helper to fetch the values of a field of a Record referred to by a field expression, which is a String of the form @{fieldname}.
FieldExpression(String, Config) - Constructor for class org.kitesdk.morphline.base.FieldExpression
 
FieldPartitioner<S,T> - Class in org.kitesdk.data
Partitions values for a named field.
FieldPartitioner(String, Class<S>, Class<T>, int) - Constructor for class org.kitesdk.data.FieldPartitioner
 
FieldPartitioner(String, String, Class<S>, Class<T>, int) - Constructor for class org.kitesdk.data.FieldPartitioner
 
Fields - Class in org.kitesdk.morphline.base
Common record field names.
Fields() - Constructor for class org.kitesdk.morphline.base.Fields
 
FILE_UPLOAD_URL - Static variable in class org.kitesdk.morphline.hadoop.parquet.avro.ReadAvroParquetFileBuilder
The morphline record field containing the HDFS Path of the Parquet file to read
fileSystem(FileSystem) - Method in class org.kitesdk.data.filesystem.FileSystemDatasetRepository.Builder
The FileSystem to store metadata and dataset files in (optional).
FileSystemDatasetRepository - Class in org.kitesdk.data.filesystem
A DatasetRepository that stores data in a Hadoop FileSystem.
FileSystemDatasetRepository(Configuration, MetadataProvider) - Constructor for class org.kitesdk.data.filesystem.FileSystemDatasetRepository
Construct a FileSystemDatasetRepository for the given MetadataProvider for metadata storage.
FileSystemDatasetRepository.Builder - Class in org.kitesdk.data.filesystem
A fluent builder to aid in the construction of FileSystemDatasetRepository instances.
FileSystemDatasetRepository.Builder() - Constructor for class org.kitesdk.data.filesystem.FileSystemDatasetRepository.Builder
 
FileSystemMetadataProvider - Class in org.kitesdk.data.filesystem
A MetadataProvider that stores dataset metadata in a Hadoop FileSystem.
FileSystemMetadataProvider(Configuration, Path) - Constructor for class org.kitesdk.data.filesystem.FileSystemMetadataProvider
 
FileSystemMetadataProvider.Builder - Class in org.kitesdk.data.filesystem
A fluent builder to aid in the construction of FileSystemMetadataProvider instances.
FileSystemMetadataProvider.Builder() - Constructor for class org.kitesdk.data.filesystem.FileSystemMetadataProvider.Builder
 
find(String, Config, String) - Method in class org.kitesdk.morphline.base.Compiler
Finds the given morphline id within the given morphline config, using the given nameForErrorMsg for error reporting.
FindReplaceBuilder - Class in org.kitesdk.morphline.stdlib
Command that examines each string value in a given field and replaces each substring of the string value that matches the given string literal or grok pattern with the given replacement.
FindReplaceBuilder() - Constructor for class org.kitesdk.morphline.stdlib.FindReplaceBuilder
 
flush() - Method in interface org.kitesdk.data.DatasetWriter
Force or commit any outstanding data to storage.
format(Format) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
Configure the dataset's format (optional).
format(String) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
Configure the dataset's format from a format name String (optional).
Format - Class in org.kitesdk.data
The data format used for encoding the data in a Dataset when stored in a DatasetRepository.
Formats - Class in org.kitesdk.data
Contains constant definitions for the standard Format instances supported by the library.
from(String, Comparable) - Method in interface org.kitesdk.data.RefineableView
Creates a sub-View, restricted to entities whose name field is greater than or equal to the given value.
fromAfter(String, Comparable) - Method in interface org.kitesdk.data.RefineableView
Creates a sub-View, restricted to entities whose name field is greater than to the given value.
fromString(String) - Static method in class org.kitesdk.data.Formats
Return a Format for the format name specified.

G

GenerateSolrSequenceKeyBuilder - Class in org.kitesdk.morphline.solr
A command that assigns a record unique key that is the concatenation of the given baseIdField record field, followed by a running count of the record number within the current session.
GenerateSolrSequenceKeyBuilder() - Constructor for class org.kitesdk.morphline.solr.GenerateSolrSequenceKeyBuilder
 
GenerateUUIDBuilder - Class in org.kitesdk.morphline.stdlib
A command that sets a universally unique identifier on all records that are intercepted.
GenerateUUIDBuilder() - Constructor for class org.kitesdk.morphline.stdlib.GenerateUUIDBuilder
 
GeoIPBuilder - Class in org.kitesdk.morphline.maxmind
Command that returns Geolocation information for a given IP address, using an efficient in-memory Maxmind database lookup.
GeoIPBuilder() - Constructor for class org.kitesdk.morphline.maxmind.GeoIPBuilder
 
get(int) - Method in class org.kitesdk.data.Key
Returns the value for index.
get(int) - Method in class org.kitesdk.data.PartitionKey
Return the value at the specified index in the key.
get(Key) - Method in interface org.kitesdk.data.RandomAccessDataset
Return the entity stored in the dataset at the row specified with Key key.
get(String) - Method in class org.kitesdk.morphline.api.Record
Returns a view of the values associated with the given key.
getBatchSize() - Method in class org.kitesdk.morphline.solr.SolrLocator
 
getBoolean(Config, String, boolean) - Method in class org.kitesdk.morphline.base.Configs
 
getBoolean(Config, String) - Method in class org.kitesdk.morphline.base.Configs
 
getCalendarField() - Method in class org.kitesdk.data.partition.CalendarFieldPartitioner
 
getCardinality() - Method in class org.kitesdk.data.FieldPartitioner
 
getCardinality() - Method in class org.kitesdk.data.PartitionStrategy
Return the cardinality produced by the contained field partitioners.
getCharset(Config, String, Charset) - Method in class org.kitesdk.morphline.base.Configs
 
getChild() - Method in class org.kitesdk.morphline.base.AbstractCommand
Returns the child of this command.
getCollectionName() - Method in class org.kitesdk.morphline.solr.SolrLocator
 
getCommandBuilder(String) - Method in class org.kitesdk.morphline.api.MorphlineContext
 
getConfig() - Method in class org.kitesdk.morphline.base.AbstractCommand
Returns the JSON configuration of this command.
getConfig(Config, String, Config) - Method in class org.kitesdk.morphline.base.Configs
 
getConfig(Config, String) - Method in class org.kitesdk.morphline.base.Configs
 
getConfigList(Config, String, List<? extends Config>) - Method in class org.kitesdk.morphline.base.Configs
 
getConfigList(Config, String) - Method in class org.kitesdk.morphline.base.Configs
 
getConfigs() - Method in class org.kitesdk.morphline.base.AbstractCommand
Returns a helper for convenient access to the JSON configuration of this command.
getContext() - Method in class org.kitesdk.morphline.base.AbstractCommand
Returns the context of this command.
getCounter(String...) - Method in class org.kitesdk.morphline.base.AbstractCommand
Returns a counter for maintaining main-memory metrics.
getDataset() - Method in interface org.kitesdk.data.View
Returns the underlying Dataset that this is a View of.
getDescriptor() - Method in interface org.kitesdk.data.Dataset
Get the DatasetDescriptor associated with this dataset.
getDocumentLoader() - Method in class org.kitesdk.morphline.solr.SolrMorphlineContext
 
getDouble(Config, String, double) - Method in class org.kitesdk.morphline.base.Configs
 
getDouble(Config, String) - Method in class org.kitesdk.morphline.base.Configs
 
getEntrySet(Config) - Method in class org.kitesdk.morphline.base.Configs
 
getExceptionHandler() - Method in class org.kitesdk.morphline.api.MorphlineContext
 
getExtension() - Method in class org.kitesdk.data.Format
Get the extension for use in filenames.
getFieldPartitioners() - Method in class org.kitesdk.data.PartitionStrategy
Get the list of field partitioners used for partitioning.
getFields() - Method in class org.kitesdk.morphline.api.Record
Returns the fields that are stored in this record.
getFileStatus(Path) - Method in class org.kitesdk.morphline.hadoop.rcfile.SingleStreamFileSystem
 
getFirstValue(String) - Method in class org.kitesdk.morphline.api.Record
Returns the first value associated with the given key, or null if no such value exists
getFormat() - Method in class org.kitesdk.data.DatasetDescriptor
Get the associated Format that the data is stored in.
getHealthCheckRegistry() - Method in class org.kitesdk.morphline.api.MorphlineContext
 
getHistogram(String...) - Method in class org.kitesdk.morphline.base.AbstractCommand
Returns a histogram for maintaining main-memory metrics.
getIndexSchema() - Method in class org.kitesdk.morphline.solr.SolrLocator
 
getIndexSchema() - Method in class org.kitesdk.morphline.solr.SolrMorphlineContext
 
getInt(Config, String, int) - Method in class org.kitesdk.morphline.base.Configs
 
getInt(Config, String) - Method in class org.kitesdk.morphline.base.Configs
 
getIOException() - Method in exception org.kitesdk.data.DatasetIOException
 
getLength() - Method in class org.kitesdk.data.PartitionKey
Return the number of values in the key.
getLifecycleEvents(Record) - Static method in class org.kitesdk.morphline.base.Notifications
Get all lifecycle events from the given record.
getLoader() - Method in class org.kitesdk.morphline.solr.SolrLocator
 
getLocale(Config, String, Locale) - Method in class org.kitesdk.morphline.base.Configs
 
getLocale(Config, String) - Method in class org.kitesdk.morphline.base.Configs
 
getLocation() - Method in class org.kitesdk.data.DatasetDescriptor
Get the URL location where the data for this Dataset is stored (optional).
getLong(Config, String, long) - Method in class org.kitesdk.morphline.base.Configs
 
getLong(Config, String) - Method in class org.kitesdk.morphline.base.Configs
 
getMetadataProvider() - Method in class org.kitesdk.data.filesystem.FileSystemDatasetRepository
 
getMeter(String...) - Method in class org.kitesdk.morphline.base.AbstractCommand
Returns a meter for maintaining main-memory metrics.
getMetricRegistry() - Method in class org.kitesdk.morphline.api.MorphlineContext
 
getName() - Method in interface org.kitesdk.data.Dataset
Get the name of a Dataset.
getName() - Method in class org.kitesdk.data.FieldPartitioner
 
getName() - Method in class org.kitesdk.data.Format
Get the format's name.
getNames() - Method in interface org.kitesdk.morphline.api.CommandBuilder
Returns the names with which this command can be invoked.
getNames() - Method in class org.kitesdk.morphline.avro.ExtractAvroPathsBuilder
 
getNames() - Method in class org.kitesdk.morphline.avro.ExtractAvroTreeBuilder
 
getNames() - Method in class org.kitesdk.morphline.avro.ReadAvroBuilder
 
getNames() - Method in class org.kitesdk.morphline.avro.ReadAvroContainerBuilder
 
getNames() - Method in class org.kitesdk.morphline.avro.ToAvroBuilder
 
getNames() - Method in class org.kitesdk.morphline.avro.WriteAvroToByteArrayBuilder
 
getNames() - Method in class org.kitesdk.morphline.hadoop.core.DownloadHdfsFileBuilder
 
getNames() - Method in class org.kitesdk.morphline.hadoop.parquet.avro.ReadAvroParquetFileBuilder
 
getNames() - Method in class org.kitesdk.morphline.hadoop.rcfile.ReadRCFileBuilder
 
getNames() - Method in class org.kitesdk.morphline.hadoop.sequencefile.ReadSequenceFileBuilder
 
getNames() - Method in class org.kitesdk.morphline.json.ExtractJsonPathsBuilder
 
getNames() - Method in class org.kitesdk.morphline.json.ReadJsonBuilder
 
getNames() - Method in class org.kitesdk.morphline.maxmind.GeoIPBuilder
 
getNames() - Method in class org.kitesdk.morphline.metrics.servlets.RegisterJVMMetricsBuilder
 
getNames() - Method in class org.kitesdk.morphline.metrics.servlets.StartReportingMetricsToHTTPBuilder
 
getNames() - Method in class org.kitesdk.morphline.saxon.ConvertHTMLBuilder
 
getNames() - Method in class org.kitesdk.morphline.saxon.XQueryBuilder
 
getNames() - Method in class org.kitesdk.morphline.saxon.XSLTBuilder
 
getNames() - Method in class org.kitesdk.morphline.solr.GenerateSolrSequenceKeyBuilder
 
getNames() - Method in class org.kitesdk.morphline.solr.LoadSolrBuilder
 
getNames() - Method in class org.kitesdk.morphline.solr.SanitizeUnknownSolrFieldsBuilder
 
getNames() - Method in class org.kitesdk.morphline.solr.TokenizeTextBuilder
 
getNames() - Method in class org.kitesdk.morphline.solrcell.SolrCellBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdio.ReadClobBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdio.ReadCSVBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdio.ReadLineBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdio.ReadMultiLineBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.AddCurrentTimeBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.AddLocalHostBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.AddValuesBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.AddValuesIfAbsentBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.CallParentPipeBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.ContainsBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.ConvertTimestampBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.DecodeBase64Builder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.DropRecordBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.EqualsBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.ExtractURIComponentBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.ExtractURIComponentsBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.ExtractURIQueryParametersBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.FindReplaceBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.GenerateUUIDBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.GrokBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.IfThenElseBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.JavaBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.LogDebugBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.LogErrorBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.LogInfoBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.LogTraceBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.LogWarnBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.NotBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.PipeBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.SeparateAttachmentsBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.SetValuesBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.SplitBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.SplitKeyValueBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.StartReportingMetricsToCSVBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.StartReportingMetricsToJMXBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.StartReportingMetricsToSLF4JBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.ToByteArrayBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.ToStringBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.TranslateBuilder
 
getNames() - Method in class org.kitesdk.morphline.stdlib.TryRulesBuilder
 
getNames() - Method in class org.kitesdk.morphline.tika.decompress.DecompressBuilder
 
getNames() - Method in class org.kitesdk.morphline.tika.decompress.UnpackBuilder
 
getNames() - Method in class org.kitesdk.morphline.tika.DetectMimeTypeBuilder
 
getNames() - Method in class org.kitesdk.morphline.twitter.ReadJsonTestTweetsBuilder
 
getNames() - Method in class org.kitesdk.morphline.useragent.UserAgentBuilder
 
getNanoseconds(Config, String, long) - Method in class org.kitesdk.morphline.base.Configs
 
getNanoseconds(Config, String) - Method in class org.kitesdk.morphline.base.Configs
 
getParent() - Method in interface org.kitesdk.morphline.api.Command
Returns the parent of this command.
getParent() - Method in class org.kitesdk.morphline.base.AbstractCommand
 
getPartition(PartitionKey, boolean) - Method in interface org.kitesdk.data.Dataset
Get a partition for a PartitionKey, possibly creating the partition if it doesn't already exist.
getPartitions() - Method in interface org.kitesdk.data.Dataset
Return partitions, if this dataset is partitioned.
getPartitionStrategy() - Method in class org.kitesdk.data.DatasetDescriptor
Get the PartitionStrategy, if this dataset is partitioned.
getProperty(String) - Method in class org.kitesdk.data.DatasetDescriptor
Get a named property.
getSchema() - Method in class org.kitesdk.data.DatasetDescriptor
Get the associated Schema.
getSchemaUrl() - Method in class org.kitesdk.data.DatasetDescriptor
Get a URL from which the Schema may be retrieved (optional).
getServerUrl() - Method in class org.kitesdk.morphline.solr.SolrLocator
 
getSolrHomeDir() - Method in class org.kitesdk.morphline.solr.SolrLocator
 
getSolrServer() - Method in class org.kitesdk.morphline.solr.SolrServerDocumentLoader
 
getSourceName() - Method in class org.kitesdk.data.FieldPartitioner
 
getSourceType() - Method in class org.kitesdk.data.FieldPartitioner
The type of the source field, which is the type of the type expected by the apply function.
getString(Config, String, String) - Method in class org.kitesdk.morphline.base.Configs
 
getString(Config, String) - Method in class org.kitesdk.morphline.base.Configs
 
getStringList(Config, String, List<String>) - Method in class org.kitesdk.morphline.base.Configs
 
getStringList(Config, String) - Method in class org.kitesdk.morphline.base.Configs
 
getTimer(String...) - Method in class org.kitesdk.morphline.base.AbstractCommand
Returns a timer for maintaining main-memory metrics.
getTimeUnit(Config, String, TimeUnit) - Method in class org.kitesdk.morphline.base.Configs
 
getTimeUnit(Config, String) - Method in class org.kitesdk.morphline.base.Configs
 
getTimeUnit(String) - Method in class org.kitesdk.morphline.base.Configs
 
getType() - Method in class org.kitesdk.data.FieldPartitioner
The type of the target field, which is the type of the return value of the partition function.
getUpperBounds() - Method in class org.kitesdk.data.partition.RangeFieldPartitioner
 
getUri() - Method in class org.kitesdk.morphline.hadoop.rcfile.SingleStreamFileSystem
 
getValues() - Method in class org.kitesdk.data.PartitionKey
 
getWorkingDirectory() - Method in class org.kitesdk.morphline.hadoop.rcfile.SingleStreamFileSystem
 
getZkHost() - Method in class org.kitesdk.morphline.solr.SolrLocator
 
GrokBuilder - Class in org.kitesdk.morphline.stdlib
The Grok command uses regular expression pattern matching to extract structured fields from unstructured log data.
GrokBuilder() - Constructor for class org.kitesdk.morphline.stdlib.GrokBuilder
 

H

handleException(Throwable, Record) - Method in interface org.kitesdk.morphline.api.ExceptionHandler
Handle the given exception resulting from the given input record (the record can be null)
handleException(Throwable, Record) - Method in class org.kitesdk.morphline.base.FaultTolerance
 
hash(String, int) - Static method in class org.kitesdk.data.partition.PartitionFunctions
 
hash(String, String, int) - Static method in class org.kitesdk.data.partition.PartitionFunctions
 
hash(String, int) - Method in class org.kitesdk.data.PartitionStrategy.Builder
Configure a hash partitioner with the specified number of buckets .
hash(String, String, int) - Method in class org.kitesdk.data.PartitionStrategy.Builder
Configure a hash partitioner with the specified number of buckets .
hashCode() - Method in class org.kitesdk.data.DatasetDescriptor
 
hashCode() - Method in class org.kitesdk.data.Format
 
hashCode() - Method in class org.kitesdk.data.Key
 
hashCode() - Method in class org.kitesdk.data.partition.CalendarFieldPartitioner
 
hashCode() - Method in class org.kitesdk.data.partition.DateFormatPartitioner
 
hashCode() - Method in class org.kitesdk.data.partition.HashFieldPartitioner
 
hashCode() - Method in class org.kitesdk.data.partition.IdentityFieldPartitioner
 
hashCode() - Method in class org.kitesdk.data.partition.IntRangeFieldPartitioner
 
hashCode() - Method in class org.kitesdk.data.partition.ListFieldPartitioner
 
hashCode() - Method in class org.kitesdk.data.partition.RangeFieldPartitioner
 
hashCode() - Method in class org.kitesdk.data.PartitionKey
 
hashCode() - Method in class org.kitesdk.data.PartitionStrategy
 
hashCode() - Method in class org.kitesdk.morphline.api.Record
 
HashFieldPartitioner - Class in org.kitesdk.data.partition
 
HashFieldPartitioner(String, int) - Constructor for class org.kitesdk.data.partition.HashFieldPartitioner
 
HashFieldPartitioner(String, String, int) - Constructor for class org.kitesdk.data.partition.HashFieldPartitioner
 
hasNext() - Method in interface org.kitesdk.data.DatasetReader
Tests the reader to see if additional entities can be read.
hasProperty(String) - Method in class org.kitesdk.data.DatasetDescriptor
Check if a named property exists.
HCatalogDatasetRepository - Class in org.kitesdk.data.hcatalog
A DatasetRepository that uses the Hive/HCatalog metastore for metadata, and stores data in a Hadoop FileSystem.
HCatalogDatasetRepository.Builder - Class in org.kitesdk.data.hcatalog
A fluent builder to aid in the construction of HCatalogDatasetRepository instances.
HCatalogDatasetRepository.Builder() - Constructor for class org.kitesdk.data.hcatalog.HCatalogDatasetRepository.Builder
 
hour(String, String) - Static method in class org.kitesdk.data.partition.PartitionFunctions
 
hour(String, String) - Method in class org.kitesdk.data.PartitionStrategy.Builder
Configure a partitioner for extracting the hour from a timestamp field.
hour(String) - Method in class org.kitesdk.data.PartitionStrategy.Builder
Configure a partitioner for extracting the hour from a timestamp field.
HourFieldPartitioner - Class in org.kitesdk.data.partition
 
HourFieldPartitioner(String, String) - Constructor for class org.kitesdk.data.partition.HourFieldPartitioner
 

I

ID - Static variable in class org.kitesdk.morphline.base.Fields
 
identity(String, int) - Static method in class org.kitesdk.data.partition.PartitionFunctions
Deprecated. Use PartitionFunctions.identity(String, Class, int).
identity(String, Class<S>, int) - Static method in class org.kitesdk.data.partition.PartitionFunctions
 
identity(String, int) - Method in class org.kitesdk.data.PartitionStrategy.Builder
Deprecated. Use PartitionStrategy.Builder.identity(String, Class, int).
identity(String, Class<S>, int) - Method in class org.kitesdk.data.PartitionStrategy.Builder
Configure an identity partitioner for a given type with a cardinality hint of buckets size.
IdentityFieldPartitioner<S extends Comparable> - Class in org.kitesdk.data.partition
 
IdentityFieldPartitioner(String, Class<S>, int) - Constructor for class org.kitesdk.data.partition.IdentityFieldPartitioner
 
IfThenElseBuilder - Class in org.kitesdk.morphline.stdlib
An If-Then-Else command consists of a chain of zero or more conditions commands, as well as a chain of zero or or more commands that are processed if all conditions succeed ("then commands"), as well as a chain of zero or more commands that are processed if one of the conditions fails ("else commands").
IfThenElseBuilder() - Constructor for class org.kitesdk.morphline.stdlib.IfThenElseBuilder
 
importCommandBuilders(Collection<String>) - Method in class org.kitesdk.morphline.api.MorphlineContext
 
includes(E) - Method in interface org.kitesdk.data.View
Returns whether an entity Object would be included in this View if it were present in the Dataset.
IncompatibleSchemaException - Exception in org.kitesdk.data
Exception thrown when a schema update is not compatible with the previous schema (or schemas) or with existing datasets (if shared storage is used, for example).
IncompatibleSchemaException(String) - Constructor for exception org.kitesdk.data.IncompatibleSchemaException
 
IncompatibleSchemaException(String, Throwable) - Constructor for exception org.kitesdk.data.IncompatibleSchemaException
 
IncompatibleSchemaException(Throwable) - Constructor for exception org.kitesdk.data.IncompatibleSchemaException
 
increment(Key, String, long) - Method in interface org.kitesdk.data.RandomAccessDataset
Increment a field named fieldName on the entity by the specified amount.
incrementNumRecords() - Method in class org.kitesdk.morphline.stdio.AbstractParser
 
IntRangeFieldPartitioner - Class in org.kitesdk.data.partition
 
IntRangeFieldPartitioner(String, int...) - Constructor for class org.kitesdk.data.partition.IntRangeFieldPartitioner
 
IS_IGNORING_RECOVERABLE_EXCEPTIONS - Static variable in class org.kitesdk.morphline.base.FaultTolerance
 
IS_PRODUCTION_MODE - Static variable in class org.kitesdk.morphline.base.FaultTolerance
 
isMeasuringMetrics() - Method in class org.kitesdk.morphline.base.AbstractCommand
Returns whether or not metrics should be measured.
isOpen() - Method in interface org.kitesdk.data.DatasetReader
 
isOpen() - Method in interface org.kitesdk.data.DatasetWriter
 
isPartitioned() - Method in class org.kitesdk.data.DatasetDescriptor
Returns true if an associated dataset is partitioned (that is, has an associated PartitionStrategy), false otherwise.

J

JavaBuilder - Class in org.kitesdk.morphline.stdlib
The "java" command compiles the given Java code block, wrapped into a Java method with a boolean return type and several parameters, along with a Java class definition that contains the given import statements.
JavaBuilder() - Constructor for class org.kitesdk.morphline.stdlib.JavaBuilder
 
JobClasspathHelper - Class in org.kitesdk.tools
This class is an helper to copy the jars needed by the job in the Distributed cache.
JobClasspathHelper() - Constructor for class org.kitesdk.tools.JobClasspathHelper
 

K

Key - Class in org.kitesdk.data
A key for retrieving entities from a RandomAccessDataset.
Key.Builder - Class in org.kitesdk.data
A fluent builder to aid in the construction of Key objects.
Key.Builder(RandomAccessDataset) - Constructor for class org.kitesdk.data.Key.Builder
Construct a Key.Builder for a RandomAccessDataset.

L

LIFE_CYCLE - Static variable in class org.kitesdk.morphline.base.Notifications
The field in which the notification of the lifecycle is stored.
LIFE_CYLCLE - Static variable in class org.kitesdk.morphline.base.Notifications
Deprecated. (since 0.10.1) Use Notifications.LIFE_CYCLE instead.
list() - Method in interface org.kitesdk.data.DatasetRepository
List the names of the Datasets in this DatasetRepository.
list() - Method in class org.kitesdk.data.filesystem.FileSystemDatasetRepository
 
list() - Method in class org.kitesdk.data.filesystem.FileSystemMetadataProvider
 
list() - Method in class org.kitesdk.data.hcatalog.HCatalogDatasetRepository
 
list() - Method in interface org.kitesdk.data.MetadataProvider
List the names of the Datasets managed by this MetadataProvider.
ListFieldPartitioner<S> - Class in org.kitesdk.data.partition
 
ListFieldPartitioner(String, List<Set<S>>, Class<S>) - Constructor for class org.kitesdk.data.partition.ListFieldPartitioner
 
listProperties() - Method in class org.kitesdk.data.DatasetDescriptor
List the names of all custom properties set.
listStatus(Path) - Method in class org.kitesdk.morphline.hadoop.rcfile.SingleStreamFileSystem
 
load(String) - Method in interface org.kitesdk.data.DatasetRepository
Get the latest version of a named Dataset.
load(String) - Method in class org.kitesdk.data.filesystem.FileSystemDatasetRepository
 
load(String) - Method in class org.kitesdk.data.filesystem.FileSystemMetadataProvider
 
load(String) - Method in class org.kitesdk.data.hcatalog.HCatalogDatasetRepository
 
load(String) - Method in interface org.kitesdk.data.MetadataProvider
Load the dataset descriptor for the dataset name.
load(String) - Method in interface org.kitesdk.data.RandomAccessDatasetRepository
 
load(SolrInputDocument) - Method in interface org.kitesdk.morphline.solr.DocumentLoader
Loads the given document into the destination
load(SolrInputDocument) - Method in class org.kitesdk.morphline.solr.SolrServerDocumentLoader
 
LoadSolrBuilder - Class in org.kitesdk.morphline.solr
A command that loads a record into a SolrServer or MapReduce SolrOutputFormat.
LoadSolrBuilder() - Constructor for class org.kitesdk.morphline.solr.LoadSolrBuilder
 
location(URI) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
Configure the Dataset's location (optional).
location(Path) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
Configure the Dataset's location (optional).
location(String) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
Configure the Dataset's location (optional).
LOG - Variable in class org.kitesdk.morphline.base.AbstractCommand
 
Log4jAppender - Class in org.kitesdk.data.flume
 
Log4jAppender() - Constructor for class org.kitesdk.data.flume.Log4jAppender
 
Log4jAppender(String, int) - Constructor for class org.kitesdk.data.flume.Log4jAppender
Sets the hostname and port.
LogDebugBuilder - Class in org.kitesdk.morphline.stdlib
Command that logs to slf4j at DEBUG level.
LogDebugBuilder() - Constructor for class org.kitesdk.morphline.stdlib.LogDebugBuilder
 
LogErrorBuilder - Class in org.kitesdk.morphline.stdlib
Command that logs to slf4j at ERROR level.
LogErrorBuilder() - Constructor for class org.kitesdk.morphline.stdlib.LogErrorBuilder
 
LogInfoBuilder - Class in org.kitesdk.morphline.stdlib
Command that logs to slf4j at INFO level.
LogInfoBuilder() - Constructor for class org.kitesdk.morphline.stdlib.LogInfoBuilder
 
LogTraceBuilder - Class in org.kitesdk.morphline.stdlib
Command that logs to slf4j at TRACE level.
LogTraceBuilder() - Constructor for class org.kitesdk.morphline.stdlib.LogTraceBuilder
 
LogWarnBuilder - Class in org.kitesdk.morphline.stdlib
Command that logs to slf4j at WARN level.
LogWarnBuilder() - Constructor for class org.kitesdk.morphline.stdlib.LogWarnBuilder
 

M

main(String[]) - Static method in class org.kitesdk.morphline.base.PrettyPrinter
 
main(String...) - Static method in class org.kitesdk.tools.CombinedLogFormatConverter
 
MESSAGE - Static variable in class org.kitesdk.morphline.base.Fields
 
metadataProvider(MetadataProvider) - Method in class org.kitesdk.data.filesystem.FileSystemDatasetRepository.Builder
The MetadataProvider for metadata storage (optional).
MetadataProvider - Interface in org.kitesdk.data
A service provider interface for metadata system plugins.
MetadataProviderException - Exception in org.kitesdk.data
Exception thrown for metadata provider-related failures.
MetadataProviderException() - Constructor for exception org.kitesdk.data.MetadataProviderException
 
MetadataProviderException(String) - Constructor for exception org.kitesdk.data.MetadataProviderException
 
MetadataProviderException(String, Throwable) - Constructor for exception org.kitesdk.data.MetadataProviderException
 
MetadataProviderException(Throwable) - Constructor for exception org.kitesdk.data.MetadataProviderException
 
Metrics - Class in org.kitesdk.morphline.base
Common metric names.
Metrics() - Constructor for class org.kitesdk.morphline.base.Metrics
 
MIME_TYPE - Static variable in class org.kitesdk.morphline.avro.ReadAvroContainerBuilder
The MIME type that input attachments shall have
MIME_TYPE - Static variable in class org.kitesdk.morphline.json.ReadJsonBuilder
The MIME type identifier that will be filled into output records
minute(String, String) - Static method in class org.kitesdk.data.partition.PartitionFunctions
 
minute(String, String) - Method in class org.kitesdk.data.PartitionStrategy.Builder
Configure a partitioner for extracting the minute from a timestamp field.
minute(String) - Method in class org.kitesdk.data.PartitionStrategy.Builder
Configure a partitioner for extracting the minute from a timestamp field.
MinuteFieldPartitioner - Class in org.kitesdk.data.partition
 
MinuteFieldPartitioner(String, String) - Constructor for class org.kitesdk.data.partition.MinuteFieldPartitioner
 
mkdirs(Path, FsPermission) - Method in class org.kitesdk.morphline.hadoop.rcfile.SingleStreamFileSystem
 
month(String, String) - Static method in class org.kitesdk.data.partition.PartitionFunctions
 
month(String, String) - Method in class org.kitesdk.data.PartitionStrategy.Builder
Configure a partitioner for extracting the month from a timestamp field.
month(String) - Method in class org.kitesdk.data.PartitionStrategy.Builder
Configure a partitioner for extracting the month from a timestamp field.
MonthFieldPartitioner - Class in org.kitesdk.data.partition
 
MonthFieldPartitioner(String, String) - Constructor for class org.kitesdk.data.partition.MonthFieldPartitioner
 
MORPHLINE_APP - Static variable in class org.kitesdk.morphline.base.Metrics
 
MorphlineCompilationException - Exception in org.kitesdk.morphline.api
Indicates a parse error.
MorphlineCompilationException(String, Config) - Constructor for exception org.kitesdk.morphline.api.MorphlineCompilationException
 
MorphlineCompilationException(String, Config, Throwable) - Constructor for exception org.kitesdk.morphline.api.MorphlineCompilationException
 
MorphlineCompilationException(String, Config, Throwable, CommandBuilder) - Constructor for exception org.kitesdk.morphline.api.MorphlineCompilationException
 
MorphlineContext - Class in org.kitesdk.morphline.api
Additional user defined parameters that will be passed to all morphline commands.
MorphlineContext() - Constructor for class org.kitesdk.morphline.api.MorphlineContext
For public access use MorphlineContext.Builder.build() instead
MorphlineContext.Builder - Class in org.kitesdk.morphline.api
Helper to construct a MorphlineContext instance.
MorphlineContext.Builder() - Constructor for class org.kitesdk.morphline.api.MorphlineContext.Builder
 
MorphlineRuntimeException - Exception in org.kitesdk.morphline.api
Base class of all morphline exceptions.
MorphlineRuntimeException(String) - Constructor for exception org.kitesdk.morphline.api.MorphlineRuntimeException
 
MorphlineRuntimeException(String, Throwable) - Constructor for exception org.kitesdk.morphline.api.MorphlineRuntimeException
 
MorphlineRuntimeException(Throwable) - Constructor for exception org.kitesdk.morphline.api.MorphlineRuntimeException
 

N

newReader() - Method in interface org.kitesdk.data.View
Get an appropriate DatasetReader implementation based on this View of the underlying Dataset implementation.
newWriter() - Method in interface org.kitesdk.data.View
Get an appropriate DatasetWriter implementation based on this View of the underlying Dataset implementation.
next() - Method in interface org.kitesdk.data.DatasetReader
Fetch the next entity from the reader.
NotBuilder - Class in org.kitesdk.morphline.stdlib
A Not command consists of one nested command, the boolean return value of which is inverted.
NotBuilder() - Constructor for class org.kitesdk.morphline.stdlib.NotBuilder
 
Notifications - Class in org.kitesdk.morphline.base
Tools for notifications on the control plane.
Notifications() - Constructor for class org.kitesdk.morphline.base.Notifications
 
Notifications.LifecycleEvent - Enum in org.kitesdk.morphline.base
Enumerations of the standard lifecycle events.
notify(Record) - Method in interface org.kitesdk.morphline.api.Command
Processes the given notification on the control plane of the subtree rooted at this command.
notify(Record) - Method in class org.kitesdk.morphline.base.AbstractCommand
 
notifyBeginTransaction(Command) - Static method in class org.kitesdk.morphline.base.Notifications
Notify the given command that a transaction has begun.
notifyCommitTransaction(Command) - Static method in class org.kitesdk.morphline.base.Notifications
Notify the given command that a transaction has been committed.
notifyRollbackTransaction(Command) - Static method in class org.kitesdk.morphline.base.Notifications
Notify the given command that a transaction has been rolled back.
notifyShutdown(Command) - Static method in class org.kitesdk.morphline.base.Notifications
Notify the given command that a shutdown command has been issued.
notifyStartSession(Command) - Static method in class org.kitesdk.morphline.base.Notifications
Notify the given command that a session has started.
NUM_CACHE_HITS - Static variable in class org.kitesdk.morphline.base.Metrics
 
NUM_CACHE_MISSES - Static variable in class org.kitesdk.morphline.base.Metrics
 
NUM_EXCEPTION_RECORDS - Static variable in class org.kitesdk.morphline.base.Metrics
 
NUM_FAILED_RECORDS - Static variable in class org.kitesdk.morphline.base.Metrics
 
NUM_NOTIFY_CALLS - Static variable in class org.kitesdk.morphline.base.Metrics
 
NUM_PROCESS_CALLS - Static variable in class org.kitesdk.morphline.base.Metrics
 
NUM_RECORDS - Static variable in class org.kitesdk.morphline.base.Metrics
 

O

open() - Method in interface org.kitesdk.data.DatasetReader
Open the reader, allocating any necessary resources required to produce entities.
open(String) - Static method in class org.kitesdk.data.DatasetRepositories
Synonym for DatasetRepositories.open(java.net.URI) for String URIs.
open(URI) - Static method in class org.kitesdk.data.DatasetRepositories
Open a DatasetRepository for the given URI.
open() - Method in interface org.kitesdk.data.DatasetWriter
Open the writer, allocating any necessary resources required to store entities.
open(Path, int) - Method in class org.kitesdk.morphline.hadoop.rcfile.SingleStreamFileSystem
 
openRandomAccess(String) - Static method in class org.kitesdk.data.DatasetRepositories
Synonym for DatasetRepositories.openRandomAccess(java.net.URI) for String URIs.
openRandomAccess(URI) - Static method in class org.kitesdk.data.DatasetRepositories
Synonym for DatasetRepositories.open(java.net.URI) for RandomAccessDatasetRepositorys
org.kitesdk.data - package org.kitesdk.data
Provides interfaces and classes for reading and writing datasets.
org.kitesdk.data.crunch - package org.kitesdk.data.crunch
Provides helper classes for working with datasets using Crunch.
org.kitesdk.data.filesystem - package org.kitesdk.data.filesystem
Provides a dataset implementation for Hadoop filesystems, like HDFS.
org.kitesdk.data.flume - package org.kitesdk.data.flume
Provides classes for writing datasets via Flume.
org.kitesdk.data.hcatalog - package org.kitesdk.data.hcatalog
Provides a dataset implementation that uses the Hive/HCatalog metastore for metadata, and stores data in a Hadoop FileSystem.
org.kitesdk.data.partition - package org.kitesdk.data.partition
Provides common implementations of FieldPartitioner.
org.kitesdk.morphline.api - package org.kitesdk.morphline.api
This package contains the heart of the morphline API.
org.kitesdk.morphline.avro - package org.kitesdk.morphline.avro
 
org.kitesdk.morphline.base - package org.kitesdk.morphline.base
 
org.kitesdk.morphline.hadoop.core - package org.kitesdk.morphline.hadoop.core
 
org.kitesdk.morphline.hadoop.parquet.avro - package org.kitesdk.morphline.hadoop.parquet.avro
 
org.kitesdk.morphline.hadoop.rcfile - package org.kitesdk.morphline.hadoop.rcfile
 
org.kitesdk.morphline.hadoop.sequencefile - package org.kitesdk.morphline.hadoop.sequencefile
 
org.kitesdk.morphline.json - package org.kitesdk.morphline.json
 
org.kitesdk.morphline.maxmind - package org.kitesdk.morphline.maxmind
 
org.kitesdk.morphline.metrics.servlets - package org.kitesdk.morphline.metrics.servlets
 
org.kitesdk.morphline.saxon - package org.kitesdk.morphline.saxon
 
org.kitesdk.morphline.scriptengine.java - package org.kitesdk.morphline.scriptengine.java
 
org.kitesdk.morphline.solr - package org.kitesdk.morphline.solr
 
org.kitesdk.morphline.solrcell - package org.kitesdk.morphline.solrcell
 
org.kitesdk.morphline.stdio - package org.kitesdk.morphline.stdio
 
org.kitesdk.morphline.stdlib - package org.kitesdk.morphline.stdlib
 
org.kitesdk.morphline.tika - package org.kitesdk.morphline.tika
 
org.kitesdk.morphline.tika.decompress - package org.kitesdk.morphline.tika.decompress
 
org.kitesdk.morphline.twitter - package org.kitesdk.morphline.twitter
 
org.kitesdk.morphline.useragent - package org.kitesdk.morphline.useragent
 
org.kitesdk.tools - package org.kitesdk.tools
 
OUTPUT_MEDIA_TYPE - Static variable in class org.kitesdk.morphline.hadoop.rcfile.ReadRCFileBuilder
 
OUTPUT_MEDIA_TYPE - Static variable in class org.kitesdk.morphline.hadoop.sequencefile.ReadSequenceFileBuilder
 

P

PARQUET - Static variable in class org.kitesdk.data.Formats
PARQUET: the Parquet columnar format
parse(File, Config...) - Method in class org.kitesdk.morphline.base.Compiler
Loads the given config file from the local file system
PartitionFunctions - Class in org.kitesdk.data.partition
Convenience class so you can say, for example, hash("username", 2) in JEXL.
PartitionFunctions() - Constructor for class org.kitesdk.data.partition.PartitionFunctions
 
PartitionKey - Class in org.kitesdk.data
A key for retrieving partitions from a Dataset.
partitionKey(Object...) - Method in class org.kitesdk.data.PartitionStrategy
Construct a partition key with a variadic array of values corresponding to the field partitioners in this partition strategy.
partitionKeyForEntity(Object) - Method in class org.kitesdk.data.PartitionStrategy
Construct a partition key for the given entity.
partitionKeyForEntity(Object, PartitionKey) - Method in class org.kitesdk.data.PartitionStrategy
Construct a partition key for the given entity, reusing the supplied key if not null.
partitionKeyForPath(Dataset, URI) - Static method in class org.kitesdk.data.filesystem.FileSystemDatasetRepository
Get a PartitionKey corresponding to a partition's filesystem path represented as a URI.
partitionStrategy(PartitionStrategy) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
Configure the dataset's partitioning strategy (optional).
PartitionStrategy - Class in org.kitesdk.data
The strategy used to determine how a dataset is partitioned.
PartitionStrategy(List<FieldPartitioner>) - Constructor for class org.kitesdk.data.PartitionStrategy
Deprecated. will be removed in 0.12.0; use PartitionStrategy.Builder
PartitionStrategy.Builder - Class in org.kitesdk.data
A fluent builder to aid in the construction of PartitionStrategys.
PartitionStrategy.Builder() - Constructor for class org.kitesdk.data.PartitionStrategy.Builder
 
ping() - Method in interface org.kitesdk.morphline.solr.DocumentLoader
Issues a ping request to check if the server is alive
ping() - Method in class org.kitesdk.morphline.solr.SolrServerDocumentLoader
 
PipeBuilder - Class in org.kitesdk.morphline.stdlib
Factory to create morphline pipe instances.
PipeBuilder() - Constructor for class org.kitesdk.morphline.stdlib.PipeBuilder
 
populateAvroHeaders(Map<String, String>, Schema, Object) - Method in class org.kitesdk.data.flume.Log4jAppender
 
PREFIX_NAME - Static variable in class org.kitesdk.morphline.stdlib.GenerateUUIDBuilder
 
prepareClasspath(Configuration, Path, Class<?>...) - Method in class org.kitesdk.tools.JobClasspathHelper
 
PRESERVE_EXISTING_NAME - Static variable in class org.kitesdk.morphline.stdlib.AddCurrentTimeBuilder
 
PRESERVE_EXISTING_NAME - Static variable in class org.kitesdk.morphline.stdlib.AddLocalHostBuilder
 
PRESERVE_EXISTING_NAME - Static variable in class org.kitesdk.morphline.stdlib.GenerateUUIDBuilder
 
PrettyPrinter - Class in org.kitesdk.morphline.base
Utility to nicely indent and format a morphline config file.
PrettyPrinter() - Constructor for class org.kitesdk.morphline.base.PrettyPrinter
 
process(Record) - Method in interface org.kitesdk.morphline.api.Command
Processes the given record on the data plane of this command.
process(Record) - Method in class org.kitesdk.morphline.base.AbstractCommand
 
project(Predicate<S>) - Method in class org.kitesdk.data.FieldPartitioner
Projects a source-data constraint Predicate into the image of the backing partition function.
project(Predicate<Long>) - Method in class org.kitesdk.data.partition.CalendarFieldPartitioner
 
project(Predicate<Long>) - Method in class org.kitesdk.data.partition.DateFormatPartitioner
 
project(Predicate<Object>) - Method in class org.kitesdk.data.partition.HashFieldPartitioner
 
project(Predicate<S>) - Method in class org.kitesdk.data.partition.IdentityFieldPartitioner
 
project(Predicate<Integer>) - Method in class org.kitesdk.data.partition.IntRangeFieldPartitioner
 
project(Predicate<S>) - Method in class org.kitesdk.data.partition.ListFieldPartitioner
 
project(Predicate<String>) - Method in class org.kitesdk.data.partition.RangeFieldPartitioner
 
project(Predicate<Long>) - Method in class org.kitesdk.data.partition.YearFieldPartitioner
 
property(String, String) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
Add a key-value property to the descriptor.
put(E) - Method in interface org.kitesdk.data.RandomAccessDataset
Put the entity into the dataset.
put(String, Object) - Method in class org.kitesdk.morphline.api.Record
Adds the given value to the values currently associated with the given key.
putIfAbsent(String, Object) - Method in class org.kitesdk.morphline.api.Record
Adds the given value to the values currently associated with the given key, iff the key isn't already associated with that same value.

R

RandomAccessDataset<E> - Interface in org.kitesdk.data
A Dataset that supports random access operations on entities.
RandomAccessDatasetRepository - Interface in org.kitesdk.data
A logical repository (storage system) of RandomAccessDatasets.
range(String, int...) - Static method in class org.kitesdk.data.partition.PartitionFunctions
 
range(String, String...) - Static method in class org.kitesdk.data.partition.PartitionFunctions
 
range(String, int...) - Method in class org.kitesdk.data.PartitionStrategy.Builder
Configure a range partitioner with a set of upperBounds.
range(String, String...) - Method in class org.kitesdk.data.PartitionStrategy.Builder
Configure a range partitioner for strings with a set of upperBounds.
RangeFieldPartitioner - Class in org.kitesdk.data.partition
 
RangeFieldPartitioner(String, String...) - Constructor for class org.kitesdk.data.partition.RangeFieldPartitioner
 
RC_FILE_META_DATA - Static variable in class org.kitesdk.morphline.hadoop.rcfile.ReadRCFileBuilder
 
ReadAvroBuilder - Class in org.kitesdk.morphline.avro
Command that parses an InputStream that contains Avro data; for each Avro datum, the command emits a morphline record containing the datum as an attachment in Fields.ATTACHMENT_BODY.
ReadAvroBuilder() - Constructor for class org.kitesdk.morphline.avro.ReadAvroBuilder
 
ReadAvroContainerBuilder - Class in org.kitesdk.morphline.avro
Command that parses an InputStream that contains Avro binary container file data; for each Avro datum, the command emits a morphline record containing the datum as an attachment in Fields.ATTACHMENT_BODY.
ReadAvroContainerBuilder() - Constructor for class org.kitesdk.morphline.avro.ReadAvroContainerBuilder
 
ReadAvroParquetFileBuilder - Class in org.kitesdk.morphline.hadoop.parquet.avro
Command that parses a Hadoop File that contains Parquet data; for each Parquet Avro datum, the command emits a morphline record containing the record as an attachment in Fields.ATTACHMENT_BODY.
ReadAvroParquetFileBuilder() - Constructor for class org.kitesdk.morphline.hadoop.parquet.avro.ReadAvroParquetFileBuilder
 
ReadClobBuilder - Class in org.kitesdk.morphline.stdio
Command that emits one record for the entire input stream of the first attachment, interpreting the stream as a Character Large Object (CLOB).
ReadClobBuilder() - Constructor for class org.kitesdk.morphline.stdio.ReadClobBuilder
 
ReadCSVBuilder - Class in org.kitesdk.morphline.stdio
Command that extracts zero or more records from the input stream of the first attachment, representing a Comma Separated Values (CSV) file.
ReadCSVBuilder() - Constructor for class org.kitesdk.morphline.stdio.ReadCSVBuilder
 
ReadJsonBuilder - Class in org.kitesdk.morphline.json
Command that parses an InputStream that contains JSON data; for each JSON object in the stream, the command emits a morphline record containing the object as an attachment in Fields.ATTACHMENT_BODY.
ReadJsonBuilder() - Constructor for class org.kitesdk.morphline.json.ReadJsonBuilder
 
ReadJsonTestTweetsBuilder - Class in org.kitesdk.morphline.twitter
JSON parser that extracts search documents from twitter tweets obtained from the twitter 1% sample firehose with the delimited=length option.
ReadJsonTestTweetsBuilder() - Constructor for class org.kitesdk.morphline.twitter.ReadJsonTestTweetsBuilder
 
ReadLineBuilder - Class in org.kitesdk.morphline.stdio
Command that emits one record per line in the input stream of the first attachment.
ReadLineBuilder() - Constructor for class org.kitesdk.morphline.stdio.ReadLineBuilder
 
ReadMultiLineBuilder - Class in org.kitesdk.morphline.stdio
Multiline log parser that collapse multiline messages into a single record; supports "regex", "what" and "negate" configuration parameters similar to logstash.
ReadMultiLineBuilder() - Constructor for class org.kitesdk.morphline.stdio.ReadMultiLineBuilder
 
ReadRCFileBuilder - Class in org.kitesdk.morphline.hadoop.rcfile
Command for reading Record Columnar (RC) Files.
ReadRCFileBuilder() - Constructor for class org.kitesdk.morphline.hadoop.rcfile.ReadRCFileBuilder
 
ReadSequenceFileBuilder - Class in org.kitesdk.morphline.hadoop.sequencefile
Command that emits one record per sequence file entry in the input stream of the first attachment.
ReadSequenceFileBuilder() - Constructor for class org.kitesdk.morphline.hadoop.sequencefile.ReadSequenceFileBuilder
 
Record - Class in org.kitesdk.morphline.api
A record is a set of named fields where each field has a list of one or more values.
Record() - Constructor for class org.kitesdk.morphline.api.Record
Creates a new empty record.
RECOVERABLE_EXCEPTION_CLASSES - Static variable in class org.kitesdk.morphline.base.FaultTolerance
 
RefineableView<E> - Interface in org.kitesdk.data
A RefineableView specifies a subset of a Dataset by one or more logical constraints.
RegisterJVMMetricsBuilder - Class in org.kitesdk.morphline.metrics.servlets
Command that registers metrics that are related to the Java Virtual Machine with the MorphlineContext of the morphline.
RegisterJVMMetricsBuilder() - Constructor for class org.kitesdk.morphline.metrics.servlets.RegisterJVMMetricsBuilder
 
remove() - Method in interface org.kitesdk.data.DatasetReader
Remove the last entity from the reader (OPTIONAL).
removeAll(String) - Method in class org.kitesdk.morphline.api.Record
Removes all values that are associated with the given key
removeAttachments(Record) - Static method in class org.kitesdk.morphline.stdio.AbstractParser
 
rename(Path, Path) - Method in class org.kitesdk.morphline.hadoop.rcfile.SingleStreamFileSystem
 
replaceValues(String, Object) - Method in class org.kitesdk.morphline.api.Record
Removes all values that are associated with the given key, and then associates the given value with the given key.
requiresLayout() - Method in class org.kitesdk.data.flume.Log4jAppender
 
rollbackTransaction() - Method in interface org.kitesdk.morphline.solr.DocumentLoader
Performs a rollback of all non-committed documents pending.
rollbackTransaction() - Method in class org.kitesdk.morphline.solr.SolrServerDocumentLoader
 
rootDirectory(Path) - Method in class org.kitesdk.data.filesystem.FileSystemDatasetRepository.Builder
The root directory for metadata and dataset files.
rootDirectory(URI) - Method in class org.kitesdk.data.filesystem.FileSystemDatasetRepository.Builder
The root directory for metadata and dataset files.
rootDirectory(String) - Method in class org.kitesdk.data.filesystem.FileSystemDatasetRepository.Builder
The root directory for metadata and dataset files.
rootDirectory(Path) - Method in class org.kitesdk.data.filesystem.FileSystemMetadataProvider.Builder
The root directory for metadata files.
rootDirectory(Path) - Method in class org.kitesdk.data.hcatalog.HCatalogDatasetRepository.Builder
The root directory for dataset files.
rootDirectory(URI) - Method in class org.kitesdk.data.hcatalog.HCatalogDatasetRepository.Builder
The root directory for dataset files.
rootDirectory(String) - Method in class org.kitesdk.data.hcatalog.HCatalogDatasetRepository.Builder
The root directory for metadata and dataset files.
run(String...) - Method in class org.kitesdk.tools.CombinedLogFormatConverter
 

S

SanitizeUnknownSolrFieldsBuilder - Class in org.kitesdk.morphline.solr
Command that sanitizes record fields that are unknown to Solr schema.xml by either deleting them (renameToPrefix is absent or a zero length string), or by moving them to a field prefixed with the given renameToPrefix (e.g.
SanitizeUnknownSolrFieldsBuilder() - Constructor for class org.kitesdk.morphline.solr.SanitizeUnknownSolrFieldsBuilder
 
schema(Schema) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
Configure the dataset's schema.
schema(File) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
Configure the dataset's schema from a File.
schema(InputStream) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
Configure the dataset's schema from an InputStream.
schema(Class<T>) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
Configure the dataset's schema via a Java class type.
schemaFromAvroDataFile(File) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
Configure the dataset's schema by using the schema from an existing Avro data file.
schemaFromAvroDataFile(InputStream) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
Configure the dataset's schema by using the schema from an existing Avro data file.
schemaFromAvroDataFile(URI) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
Configure the dataset's schema by using the schema from an existing Avro data file.
schemaLiteral(String) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
Configure the dataset's schema from a String.
SchemaNotFoundException - Exception in org.kitesdk.data
Exception thrown to indicate that there was a problem finding a particular version of a schema.
SchemaNotFoundException(String) - Constructor for exception org.kitesdk.data.SchemaNotFoundException
 
SchemaNotFoundException(String, Throwable) - Constructor for exception org.kitesdk.data.SchemaNotFoundException
 
SchemaNotFoundException(Throwable) - Constructor for exception org.kitesdk.data.SchemaNotFoundException
 
schemaUri(URI) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
Configure the Dataset's schema from a URI.
schemaUri(String) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
Configure the Dataset's schema from a String URI.
SchemaValidationException - Exception in org.kitesdk.data
Exception thrown to indicate that there was a problem parsing or validating a schema.
SchemaValidationException(String) - Constructor for exception org.kitesdk.data.SchemaValidationException
 
SchemaValidationException(Throwable) - Constructor for exception org.kitesdk.data.SchemaValidationException
 
SchemaValidationException(String, Throwable) - Constructor for exception org.kitesdk.data.SchemaValidationException
 
ScriptEvaluator<T> - Class in org.kitesdk.morphline.scriptengine.java
Creates and compiles the given Java code block, wrapped into a Java method with the given return type and parameter types, along with a Java class definition that contains the given import statements.
ScriptEvaluator(String, String, Class<T>, String[], Class[], String) - Constructor for class org.kitesdk.morphline.scriptengine.java.ScriptEvaluator
 
SeparateAttachmentsBuilder - Class in org.kitesdk.morphline.stdlib
Command that emits one output record for each attachment in the input record's list of attachments; The result is a list of records, each of which has at most one attachment.
SeparateAttachmentsBuilder() - Constructor for class org.kitesdk.morphline.stdlib.SeparateAttachmentsBuilder
 
SEQUENCE_FILE_META_DATA - Static variable in class org.kitesdk.morphline.hadoop.sequencefile.ReadSequenceFileBuilder
 
SerializationException - Exception in org.kitesdk.data
Exception thrown when an object cannot be serialized to, or deserialized from, its binary representation.
SerializationException(String, Throwable) - Constructor for exception org.kitesdk.data.SerializationException
 
setBatchSize(int) - Method in class org.kitesdk.morphline.solr.SolrLocator
 
setCollectionName(String) - Method in class org.kitesdk.morphline.solr.SolrLocator
 
setDatasetName(String) - Method in class org.kitesdk.data.flume.Log4jAppender
 
setDatasetRepositoryClass(String) - Method in class org.kitesdk.data.flume.Log4jAppender
Deprecated. Use datasetRepositoryUri with a 'repo:' URI.
setDatasetRepositoryUri(String) - Method in class org.kitesdk.data.flume.Log4jAppender
 
setDocumentLoader(DocumentLoader) - Method in class org.kitesdk.morphline.solr.SolrMorphlineContext.Builder
 
setExceptionHandler(ExceptionHandler) - Method in class org.kitesdk.morphline.api.MorphlineContext.Builder
 
setHealthCheckRegistry(HealthCheckRegistry) - Method in class org.kitesdk.morphline.api.MorphlineContext.Builder
 
setIndexSchema(IndexSchema) - Method in class org.kitesdk.morphline.solr.SolrMorphlineContext.Builder
 
setMetricRegistry(MetricRegistry) - Method in class org.kitesdk.morphline.api.MorphlineContext.Builder
 
setServerUrl(String) - Method in class org.kitesdk.morphline.solr.SolrLocator
 
setSolrHomeDir(String) - Method in class org.kitesdk.morphline.solr.SolrLocator
 
SetValuesBuilder - Class in org.kitesdk.morphline.stdlib
For each input field, set the given record output field to the same values.
SetValuesBuilder() - Constructor for class org.kitesdk.morphline.stdlib.SetValuesBuilder
 
setWorkingDirectory(Path) - Method in class org.kitesdk.morphline.hadoop.rcfile.SingleStreamFileSystem
 
setZkHost(String) - Method in class org.kitesdk.morphline.solr.SolrLocator
 
shutdown() - Method in interface org.kitesdk.morphline.solr.DocumentLoader
Releases allocated resources
shutdown() - Method in class org.kitesdk.morphline.solr.SolrServerDocumentLoader
 
SingleStreamFileSystem - Class in org.kitesdk.morphline.hadoop.rcfile
Very simple Filesystem Implementation which serves an InputStream for a given path.
SingleStreamFileSystem(InputStream, Path) - Constructor for class org.kitesdk.morphline.hadoop.rcfile.SingleStreamFileSystem
 
SolrCellBuilder - Class in org.kitesdk.morphline.solrcell
Command that pipes the first attachment of a record into one of the given Tika parsers, then maps the Tika output back to a record using SolrCell.
SolrCellBuilder() - Constructor for class org.kitesdk.morphline.solrcell.SolrCellBuilder
 
SolrLocator - Class in org.kitesdk.morphline.solr
Set of configuration parameters that identify the location and schema of a Solr server or SolrCloud; Based on this information this class can return the schema and a corresponding DocumentLoader.
SolrLocator(MorphlineContext) - Constructor for class org.kitesdk.morphline.solr.SolrLocator
 
SolrLocator(Config, MorphlineContext) - Constructor for class org.kitesdk.morphline.solr.SolrLocator
 
SolrMorphlineContext - Class in org.kitesdk.morphline.solr
A context that is specific to Solr.
SolrMorphlineContext() - Constructor for class org.kitesdk.morphline.solr.SolrMorphlineContext
For public access use SolrMorphlineContext.Builder.build() instead
SolrMorphlineContext.Builder - Class in org.kitesdk.morphline.solr
Helper to construct a SolrMorphlineContext instance.
SolrMorphlineContext.Builder() - Constructor for class org.kitesdk.morphline.solr.SolrMorphlineContext.Builder
 
SolrServerDocumentLoader - Class in org.kitesdk.morphline.solr
A vehicle to load a list of Solr documents into a local or remote SolrServer.
SolrServerDocumentLoader(SolrServer, int) - Constructor for class org.kitesdk.morphline.solr.SolrServerDocumentLoader
 
SplitBuilder - Class in org.kitesdk.morphline.stdlib
Command that divides strings into substrings, by recognizing a separator (a.k.a.
SplitBuilder() - Constructor for class org.kitesdk.morphline.stdlib.SplitBuilder
 
SplitKeyValueBuilder - Class in org.kitesdk.morphline.stdlib
Command that iterates over the items in a given record input field, interprets each item as a key-value pair where the key and value are separated by the given separator character, and adds the pair's value to the record field named after the pair's key.
SplitKeyValueBuilder() - Constructor for class org.kitesdk.morphline.stdlib.SplitKeyValueBuilder
 
StartReportingMetricsToCSVBuilder - Class in org.kitesdk.morphline.stdlib
Command that starts periodically appending the metrics of the com.codahale.metrics.MetricRegistry of the morphline context to a set of CSV files, configured via a com.codahale.metrics.CsvReporter.Builder.
StartReportingMetricsToCSVBuilder() - Constructor for class org.kitesdk.morphline.stdlib.StartReportingMetricsToCSVBuilder
 
StartReportingMetricsToHTTPBuilder - Class in org.kitesdk.morphline.metrics.servlets
Command that exposes liveness status, health check status, metrics state and thread dumps via a set of HTTP URLs served by Jetty, using the AdminServlet.
StartReportingMetricsToHTTPBuilder() - Constructor for class org.kitesdk.morphline.metrics.servlets.StartReportingMetricsToHTTPBuilder
 
StartReportingMetricsToJMXBuilder - Class in org.kitesdk.morphline.stdlib
Command that starts publishing the metrics of the com.codahale.metrics.MetricRegistry of the morphline context to JMX, configured via a com.codahale.metrics.JmxReporter.Builder.
StartReportingMetricsToJMXBuilder() - Constructor for class org.kitesdk.morphline.stdlib.StartReportingMetricsToJMXBuilder
 
StartReportingMetricsToSLF4JBuilder - Class in org.kitesdk.morphline.stdlib
Command that starts periodically logging the metrics of the com.codahale.metrics.MetricRegistry of the morphline context to SLF4j, configured via a com.codahale.metrics.Slf4jReporter.Builder.
StartReportingMetricsToSLF4JBuilder() - Constructor for class org.kitesdk.morphline.stdlib.StartReportingMetricsToSLF4JBuilder
 
StripNonCharSolrContentHandlerFactory - Class in org.kitesdk.morphline.solrcell
SolrContentHandler and associated factory that strips non-characters anhd trims on output.
StripNonCharSolrContentHandlerFactory(Collection<String>) - Constructor for class org.kitesdk.morphline.solrcell.StripNonCharSolrContentHandlerFactory
 
SUPPORTED_MIME_TYPES - Static variable in class org.kitesdk.morphline.stdio.AbstractParser
 

T

TIMESTAMP - Static variable in class org.kitesdk.morphline.base.Fields
 
to(String, Comparable) - Method in interface org.kitesdk.data.RefineableView
Creates a sub-View, restricted to entities whose name field is less than or equal to the given value.
ToAvroBuilder - Class in org.kitesdk.morphline.avro
Command that converts a morphline record to an Avro record.
ToAvroBuilder() - Constructor for class org.kitesdk.morphline.avro.ToAvroBuilder
 
toBefore(String, Comparable) - Method in interface org.kitesdk.data.RefineableView
Creates a sub-View, restricted to entities whose name field is less than to the given value.
ToByteArrayBuilder - Class in org.kitesdk.morphline.stdlib
Command that converts the Java objects in a given field via Object.toString() to their string representation, and then via String.getBytes(Charset) to their byte array representation.
ToByteArrayBuilder() - Constructor for class org.kitesdk.morphline.stdlib.ToByteArrayBuilder
 
toConfig(String) - Method in class org.kitesdk.morphline.solr.SolrLocator
 
toExpression(FieldPartitioner) - Static method in class org.kitesdk.data.partition.PartitionFunctions
 
TokenizeTextBuilder - Class in org.kitesdk.morphline.solr
A command that uses the embedded Solr/Lucene Analyzer library to generate tokens from a text string, without sending data to a Solr server.
TokenizeTextBuilder() - Constructor for class org.kitesdk.morphline.solr.TokenizeTextBuilder
 
toString() - Method in class org.kitesdk.data.DatasetDescriptor
 
toString() - Method in class org.kitesdk.data.filesystem.FileSystemDatasetRepository
 
toString() - Method in class org.kitesdk.data.filesystem.FileSystemMetadataProvider
 
toString() - Method in class org.kitesdk.data.Format
 
toString() - Method in class org.kitesdk.data.Key
 
toString() - Method in class org.kitesdk.data.partition.CalendarFieldPartitioner
 
toString() - Method in class org.kitesdk.data.partition.HashFieldPartitioner
 
toString() - Method in class org.kitesdk.data.partition.IdentityFieldPartitioner
 
toString() - Method in class org.kitesdk.data.partition.IntRangeFieldPartitioner
 
toString() - Method in class org.kitesdk.data.partition.ListFieldPartitioner
 
toString() - Method in class org.kitesdk.data.partition.RangeFieldPartitioner
 
toString() - Method in class org.kitesdk.data.PartitionKey
 
toString() - Method in class org.kitesdk.data.PartitionStrategy
 
toString() - Method in class org.kitesdk.morphline.api.Record
 
toString() - Method in class org.kitesdk.morphline.solr.SolrLocator
 
ToStringBuilder - Class in org.kitesdk.morphline.stdlib
Command that converts the Java objects in a given field via Object.toString() to their string representation, and optionally also applies String.trim().
ToStringBuilder() - Constructor for class org.kitesdk.morphline.stdlib.ToStringBuilder
 
transformFieldValue(Object) - Method in class org.kitesdk.morphline.stdlib.AbstractFieldTransformCommand
Transforms the given input value to some output value
TranslateBuilder - Class in org.kitesdk.morphline.stdlib
Command that examines each string value in a given field and replaces it with the replacement value defined in a given dictionary aka hash table.
TranslateBuilder() - Constructor for class org.kitesdk.morphline.stdlib.TranslateBuilder
 
TrimSolrContentHandlerFactory - Class in org.kitesdk.morphline.solrcell
SolrContentHandler and associated factory that trims field values on output.
TrimSolrContentHandlerFactory(Collection<String>) - Constructor for class org.kitesdk.morphline.solrcell.TrimSolrContentHandlerFactory
 
TryRulesBuilder - Class in org.kitesdk.morphline.stdlib
A tryRules command consists of zero or more rules.
TryRulesBuilder() - Constructor for class org.kitesdk.morphline.stdlib.TryRulesBuilder
 

U

UnknownFormatException - Exception in org.kitesdk.data
Exception thrown when a Dataset is in an unknown format.
UnknownFormatException(String) - Constructor for exception org.kitesdk.data.UnknownFormatException
 
UnknownFormatException(String, Throwable) - Constructor for exception org.kitesdk.data.UnknownFormatException
 
UnknownFormatException(Throwable) - Constructor for exception org.kitesdk.data.UnknownFormatException
 
UnpackBuilder - Class in org.kitesdk.morphline.tika.decompress
Command that unpacks the first attachment.
UnpackBuilder() - Constructor for class org.kitesdk.morphline.tika.decompress.UnpackBuilder
 
update(String, DatasetDescriptor) - Method in interface org.kitesdk.data.DatasetRepository
Update an existing Dataset to reflect the supplied descriptor.
update(String, DatasetDescriptor) - Method in class org.kitesdk.data.filesystem.FileSystemDatasetRepository
 
update(String, DatasetDescriptor) - Method in class org.kitesdk.data.filesystem.FileSystemMetadataProvider
 
update(String, DatasetDescriptor) - Method in class org.kitesdk.data.hcatalog.HCatalogDatasetRepository
 
update(String, DatasetDescriptor) - Method in interface org.kitesdk.data.MetadataProvider
Update a DatasetDescriptor for the dataset named name.
update(String, DatasetDescriptor) - Method in interface org.kitesdk.data.RandomAccessDatasetRepository
 
USE_IP - Static variable in class org.kitesdk.morphline.stdlib.AddLocalHostBuilder
 
UserAgentBuilder - Class in org.kitesdk.morphline.useragent
Command that parses user agent strings and returns structured higher level data like user agent family, operating system, version, and device type, using the underlying API and regexes.yaml BrowserScope database from https://github.com/tobie/ua-parser.
UserAgentBuilder() - Constructor for class org.kitesdk.morphline.useragent.UserAgentBuilder
 
UTC - Static variable in class org.kitesdk.data.partition.CalendarFieldPartitioner
 

V

validateArguments() - Method in class org.kitesdk.morphline.base.AbstractCommand
Helper that checks if the user provided configuration parameters are valid.
validateArguments(Config) - Method in class org.kitesdk.morphline.base.Configs
 
validateEnum(Config, String, Class<T>, T...) - Method in class org.kitesdk.morphline.base.Validator
Validates that an enum of the given type with the given value exists, and that this enum is contained in the given list of permitted choices; finally returns that enum object.
validateRange(Config, T, Comparable<T>, Comparable<T>) - Method in class org.kitesdk.morphline.base.Validator
Validates that the given value is contained in the range [min, max]
Validator<T> - Class in org.kitesdk.morphline.base
Simple helper to validate user configurable parameters.
Validator() - Constructor for class org.kitesdk.morphline.base.Validator
 
valueFromString(String) - Method in class org.kitesdk.data.FieldPartitioner
Deprecated. will be removed in 0.12.0
valueFromString(String) - Method in class org.kitesdk.data.partition.CalendarFieldPartitioner
Deprecated. 
valueFromString(String) - Method in class org.kitesdk.data.partition.DateFormatPartitioner
Deprecated. 
valueFromString(String) - Method in class org.kitesdk.data.partition.HashFieldPartitioner
Deprecated. 
valueFromString(String) - Method in class org.kitesdk.data.partition.IdentityFieldPartitioner
Deprecated. 
valueFromString(String) - Method in class org.kitesdk.data.partition.IntRangeFieldPartitioner
Deprecated. 
valueFromString(String) - Method in class org.kitesdk.data.partition.ListFieldPartitioner
Deprecated. 
valueFromString(String) - Method in class org.kitesdk.data.partition.RangeFieldPartitioner
Deprecated. 
valueOf(String) - Static method in enum org.kitesdk.morphline.base.Notifications.LifecycleEvent
Returns the enum constant of this type with the specified name.
values() - Static method in enum org.kitesdk.morphline.base.Notifications.LifecycleEvent
Returns an array containing the constants of this enum type, in the order they are declared.
valueToString(T) - Method in class org.kitesdk.data.FieldPartitioner
Deprecated. will be removed in 0.12.0
valueToString(Integer) - Method in class org.kitesdk.data.partition.DayOfMonthFieldPartitioner
Deprecated. 
valueToString(Integer) - Method in class org.kitesdk.data.partition.HourFieldPartitioner
Deprecated. 
valueToString(Integer) - Method in class org.kitesdk.data.partition.MinuteFieldPartitioner
Deprecated. 
valueToString(Integer) - Method in class org.kitesdk.data.partition.MonthFieldPartitioner
Deprecated. 
View<E> - Interface in org.kitesdk.data
A View is a subset of a Dataset.

W

with(String, Object...) - Method in interface org.kitesdk.data.RefineableView
Creates a sub-View, restricted to entities whose name field is equal to any of the given values.
write(E) - Method in interface org.kitesdk.data.DatasetWriter
Writer an entity of type E to the associated dataset.
WriteAvroToByteArrayBuilder - Class in org.kitesdk.morphline.avro
Command that serializes the Avro records contained in the _attachment_body field into a byte array and replaces the _attachment_body field with that byte array.
WriteAvroToByteArrayBuilder() - Constructor for class org.kitesdk.morphline.avro.WriteAvroToByteArrayBuilder
 

X

XQueryBuilder - Class in org.kitesdk.morphline.saxon
Command that parses an InputStream that contains an XML document and runs the given XQuery over the XML document.
XQueryBuilder() - Constructor for class org.kitesdk.morphline.saxon.XQueryBuilder
 
XSLTBuilder - Class in org.kitesdk.morphline.saxon
Command that parses an InputStream that contains an XML document and runs the given XSL Transform over the XML document.
XSLTBuilder() - Constructor for class org.kitesdk.morphline.saxon.XSLTBuilder
 

Y

year(String, String) - Static method in class org.kitesdk.data.partition.PartitionFunctions
 
year(String, String) - Method in class org.kitesdk.data.PartitionStrategy.Builder
Configure a partitioner for extracting the year from a timestamp field.
year(String) - Method in class org.kitesdk.data.PartitionStrategy.Builder
Configure a partitioner for extracting the year from a timestamp field.
YearFieldPartitioner - Class in org.kitesdk.data.partition
 
YearFieldPartitioner(String, String) - Constructor for class org.kitesdk.data.partition.YearFieldPartitioner
 

A B C D E F G H I J K L M N O P R S T U V W X Y

Copyright © 2013–2014. All rights reserved.