Amazon Kinesis Analytics can now discover data schemas from sample S3 objects
You can now configure your Amazon Kinesis Analytics applications to automatically discover the schema of an Amazon S3 object. This new feature allows you to infer the schema for your streaming application by specifying sample data stored in S3. Kinesis Analytics infers column names, data types, and position of the data elements in the sample. With this new feature, you can predefine your schema prior to sending records to your Kinesis Firehose or Kinesis Streams. This builds upon the current functionality which infers the schema based on a sample of records from your data stream.
You can now configure your Amazon Kinesis Analytics applications to automatically discover the schema of an Amazon S3 object. This new feature allows you to infer the schema for your streaming application by specifying sample data stored in S3. Kinesis Analytics infers column names, data types, and position of the data elements in the sample. With this new feature, you can predefine your schema prior to sending records to your Kinesis Firehose or Kinesis Streams. This builds upon the current functionality which infers the schema based on a sample of records from your data stream.
You can learn more about this new feature in the Using the Schema Discovery Feature on Static Data in the Kinesis Analytics Developer Guide.
Kinesis Analytics is the easiest way to process streaming data in real time with standard SQL without having to learn new programming languages or processing frameworks. Kinesis Analytics enables you to query streaming data or build entire streaming applications using SQL, so that you can gain actionable insights and respond to your business and customer needs promptly. Kinesis Analytics is available in the US East (N. Virginia), US West (Oregon), and EU (Ireland) regions.