AWS Glue DataBrew Recipes Integrated into AWS Glue Studio Visual ETL Jobs

Amazon Web Services (AWS) has announced a deeper integration between its AWS Glue DataBrew and AWS Glue Studio services. This update allows users to utilize DataBrew's visual data transformation recipes directly within the graphical ETL (Extract, Transform, Load) job builder of AWS Glue Studio.

AWS Glue Studio provides a visual interface for creating, running, and monitoring ETL jobs within AWS Glue. DataBrew, on the other hand, is a visual data preparation tool designed for cleaning and normalizing data without requiring code. The over 200 transformations available in DataBrew can now be incorporated into AWS Glue Studio's visual ETL jobs.

This integration is particularly beneficial for existing DataBrew users, who can now orchestrate their previously authored recipes as part of a larger visual workflow. It also allows for the use of advanced job configurations and the latest AWS Glue engine version. Users gain a centralized view of the entire end-to-end ETL process within AWS Glue Studio.

DataBrew recipes can leverage AWS Glue features such as bookmarks for incremental data processing, automatic retries, auto-scaling, and grouping small files for enhanced efficiency. This new capability simplifies the data preparation pipeline for organizations needing complex data transformations without extensive coding expertise.