kite:update-dataset
Full name:
org.kitesdk:kite-maven-plugin:0.14.1:update-dataset
Description:
Update a dataset's schema.
Attributes:
- Requires dependency resolution of artifacts in scope: compile.
Required Parameters
Name | Type | Since | Description |
---|---|---|---|
datasetName | String | - | The name of the dataset to update. User property is: kite.datasetName. |
Optional Parameters
Name | Type | Since | Description |
---|---|---|---|
avroSchemaFile | String | - | The file containing the Avro schema. If no file with the specified name is found on the local filesystem, then the classpath is searched for a matching resource. One of either this property or kite.avroSchemaReflectClass must be specified. User property is: kite.avroSchemaFile. |
avroSchemaReflectClass | String | - | The fully-qualified classname of the Avro reflect class to use to generate a schema. The class must be available on the classpath. One of either this property or kite.avroSchemaFile must be specified. User property is: kite.avroSchemaReflectClass. |
columnDescriptorFile | String | - | (no description) User property is: kite.columnDescriptorFile. |
hadoopConfiguration | Properties | - | Hadoop configuration properties. User property is: kite.hadoopConfiguration. |
hcatalog | boolean | - | If true, store dataset metadata in HCatalog, otherwise store it on the filesystem. User property is: kite.hcatalog. |
repositoryUri | String | - | The URI specifying the dataset repository, e.g. repo:hdfs://host:8020/data. Optional, but if specified then kite.rootDirectory and kite.hcatalog are ignored. User property is: kite.repositoryUri. |
rootDirectory | String | - | The root directory of the dataset repository. Optional if using HCatalog for metadata storage. User property is: kite.rootDirectory. |
Parameter Details
The file containing the Avro schema. If no file with the specified name is found on the local filesystem, then the classpath is searched for a matching resource. One of either this property or
kite.avroSchemaReflectClass must be specified.
- Type: java.lang.String
- Required: No
- User Property: kite.avroSchemaFile
The fully-qualified classname of the Avro reflect class to use to generate a schema. The class must be available on the classpath. One of either this property or
kite.avroSchemaFile must be specified.
- Type: java.lang.String
- Required: No
- User Property: kite.avroSchemaReflectClass
(no description)
- Type: java.lang.String
- Required: No
- User Property: kite.columnDescriptorFile
The name of the dataset to update.
- Type: java.lang.String
- Required: Yes
- User Property: kite.datasetName
Hadoop configuration properties.
- Type: java.util.Properties
- Required: No
- User Property: kite.hadoopConfiguration
If true, store dataset metadata in HCatalog, otherwise store it on the filesystem.
- Type: boolean
- Required: No
- User Property: kite.hcatalog
The URI specifying the dataset repository, e.g.
repo:hdfs://host:8020/data. Optional, but if specified then
kite.rootDirectory and
kite.hcatalog are ignored.
- Type: java.lang.String
- Required: No
- User Property: kite.repositoryUri
The root directory of the dataset repository. Optional if using HCatalog for metadata storage.
- Type: java.lang.String
- Required: No
- User Property: kite.rootDirectory