Inferring a Schema from an Avro Data File
You can use the DatasetDescriptor.Builder.schemaFromAvroDataFile
method to use the schema of an existing data file in Avro format. The source can be a local file, an InputStream, or a URI.
An Avro data file is not meant to be human readable (though my superhuman co-workers tell me that they can read them). Imagine that you have a file named movies.avro
. If you pass it to the method, as shown:
1 2 3 |
DatasetDescriptor movieDesc = new DatasetDescriptor.Builder() .schemaFromAvroDataFile("movies.avro") .build() |
The method returns a dataset descriptor, configured to use the same Avro schema as the sample file, ready to be used for creating or updating a dataset.