AWS Glue now supports serverless streaming ETL jobs
AWS Glue now supports serverless streaming ETL jobs. This feature makes it easy to set up continuous ingestion pipelines that prepare data like IoT event streams, clickstreams, and network logs and make them available for analysis in seconds. AWS Glue can now consume data from streaming sources like Amazon Kinesis and Apache Kafka, clean and transform it in flight, then continuously load the results into Amazon S3 data lakes, data warehouses, and other data stores. AWS Glue streaming ETL jobs run on the Apache Spark Structured Streaming engine, so customers can use them to enrich, aggregate, and combine data, as well as run a variety of complex analytics and machine learning operations.