Maven Goal: update-dataset
kite:update-dataset
Full name:
org.kitesdk:kite-maven-plugin:1.0.0:update-dataset
Description:
Update a dataset's schema.
Attributes:
- Requires dependency resolution of artifacts in scope: compile.
Optional Parameters
Name | Type | Since | Description |
---|---|---|---|
avroSchemaFile | String | - | The file containing the Avro schema. If no file with the specified
name is found on the local filesystem, then the classpath is
searched for a matching resource. One of either this property or
kite.avroSchemaReflectClass must be specified. User property is: kite.avroSchemaFile. |
avroSchemaReflectClass | String | - | The fully-qualified classname of the Avro reflect class to use to
generate a schema. The class must be available on the classpath.
One of either this property or kite.avroSchemaFile
must be specified. User property is: kite.avroSchemaReflectClass. |
columnDescriptorFile | String | - | (no description) User property is: kite.columnDescriptorFile. |
datasetName | String | - | The name of the dataset to update. Ignored if kite.uri is set. User property is: kite.datasetName. |
datasetNamespace | String | - | The name of the dataset to update. Ignored if kite.uri is set. Default value is: default. User property is: kite.datasetNamespace. |
hadoopConfiguration | Properties | - | Hadoop configuration properties. User property is: kite.hadoopConfiguration. |
hcatalog | boolean | - | If true, store dataset metadata in HCatalog, otherwise store it on
the filesystem. User property is: kite.hcatalog. |
repositoryUri | String | - | The URI specifying the dataset repository, e.g.
repo:hdfs://host:8020/data. Optional, but if specified then
kite.rootDirectory and kite.hcatalog are
ignored. User property is: kite.repositoryUri. |
rootDirectory | String | - | The root directory of the dataset repository. Optional if using
HCatalog for metadata storage. User property is: kite.rootDirectory. |
uri | String | - | A Kite dataset URI. User property is: kite.uri. |
Parameter Details
The file containing the Avro schema. If no file with the specified
name is found on the local filesystem, then the classpath is
searched for a matching resource. One of either this property or
kite.avroSchemaReflectClass must be specified.
- Type: java.lang.String
- Required: No
- User Property: kite.avroSchemaFile
The fully-qualified classname of the Avro reflect class to use to
generate a schema. The class must be available on the classpath.
One of either this property or kite.avroSchemaFile
must be specified.
- Type: java.lang.String
- Required: No
- User Property: kite.avroSchemaReflectClass
(no description)
- Type: java.lang.String
- Required: No
- User Property: kite.columnDescriptorFile
The name of the dataset to update. Ignored if kite.uri is set.
- Type: java.lang.String
- Required: No
- User Property: kite.datasetName
The name of the dataset to update. Ignored if kite.uri is set.
- Type: java.lang.String
- Required: No
- User Property: kite.datasetNamespace
- Default: default
Hadoop configuration properties.
- Type: java.util.Properties
- Required: No
- User Property: kite.hadoopConfiguration
If true, store dataset metadata in HCatalog, otherwise store it on
the filesystem.
- Type: boolean
- Required: No
- User Property: kite.hcatalog
The URI specifying the dataset repository, e.g.
repo:hdfs://host:8020/data. Optional, but if specified then
kite.rootDirectory and kite.hcatalog are
ignored.
- Type: java.lang.String
- Required: No
- User Property: kite.repositoryUri
The root directory of the dataset repository. Optional if using
HCatalog for metadata storage.
- Type: java.lang.String
- Required: No
- User Property: kite.rootDirectory
uri:
A Kite dataset URI.
- Type: java.lang.String
- Required: No
- User Property: kite.uri