Cloud Masters Episode #110
No longer a pipe dream — GenAI and data pipelines
Understanding GenAI’s Impact on Data Engineering
Cloud Masters Episode #110

With DoiT Spot Scaling, automate your AWS Spot Instances to save up to 90% on compute spend without compromising reliability.

Cloud Masters
Cloud Masters
No longer a pipe dream — GenAI and data pipelines
Loading
/
Cloud Masters
Cloud Masters
No longer a pipe dream — GenAI and data pipelines
Loading
/

Episode notes

Jump into the latest Cloud Masters podcast episode, where our hosts, Matan Bordo and Sam Clark, dive into the transformative power of Generative AI (GenAI) in the realm of data engineering. Alongside our esteemed guests, Sean Knapp, the CEO of Ascend.io, and Sascha Heyer, a Senior Machine Learning specialist from DoiT, the group unravels the intricacies of data pipeline automation, Ascend.io’s significant role, and how GenAI is revolutionizing automation processes. Sean introduces the idea of the “Citizen Data Engineer” and the episode shines a light on pressing matters like data protection, privacy concerns with GenAI, the evolving landscape of data engineering pipelines, and the advancements in data labeling and tagging automation. It’s packed with insightful discussions for data engineers and anyone looking to elevate their craft with GenAI technology.
Key Moments

01:21: Exploring the Impact of Generative AI on Data Engineering
04:13: The Concept of Citizen Data Engineer
07:43: Adoption of GenAI in Data Engineering
10:29 : The Potential of GenAI in Data Migration
12:25 : The Impact of GenAI on Data Analysis
15:39 : The Future of Data Pipeline Automation
34:22 : Data Sensitivity in Generative AI

About the guests

Sean Knapp
Sean Knapp is the founder and CEO of Ascend.io, the leader in data pipeline automation for building the world’s most intelligent data pipelines. With over 15 years of experience in software development, web and mobile applications, and data engineering, he is passionate about empowering data teams to accelerate data-driven insights and innovation.
Sascha Heyer
Sascha Heyer, a Senior Machine Learning Specialist at DoiT, stands out as a Google Developer Expert and Google Cloud Innovator. He has been crucial in helping over 306 companies grow in the field of Machine Learning. Sascha believes in keeping things simple, a mindset that has helped clarify complex tech concepts. Moreover, as an author, this expertise is showcased through engaging YouTube presentations and insightful Medium articles (https://medium.com/@saschaheyer), effectively demystifying complex tech topics for a broad audience.
Sean Knapp is the founder and CEO of Ascend.io, the leader in data pipeline automation for building the world’s most intelligent data pipelines. With over 15 years of experience in software development, web and mobile applications, and data engineering, he is passionate about empowering data teams to accelerate data-driven insights and innovation.
Sascha Heyer, a Senior Machine Learning Specialist at DoiT, stands out as a Google Developer Expert and Google Cloud Innovator. He has been crucial in helping over 306 companies grow in the field of Machine Learning. Sascha believes in keeping things simple, a mindset that has helped clarify complex tech concepts. Moreover, as an author, this expertise is showcased through engaging YouTube presentations and insightful Medium articles (https://medium.com/@saschaheyer), effectively demystifying complex tech topics for a broad audience.

Related content

Automate BigQuery reservations and assignments using Dataform
Using BigQuery’s reservation SQL APIs with Dataform to automate pricing plan adjustments.
Read more
Cloud Data Pipeline Bake-Off: Ascend.io versus dbt
Evaluating two data transformation tools used to build cloud data pipelines, head to head.
Read more
Leverage Malloy and Looker for a Unified, Future-Proof Data Warehouse
Successfully design a scalable, collaboratively developed data warehouse and reporting system with Malloy and Looker
Read more
Let’s do it

From cost optimization to cloud migration, machine learning and CloudOps,
we’re here to make the public cloud easy.

From cost optimization to cloud migration, machine learning and CloudOps, we’re here to make the public cloud easy.

Ready to get started?

Get in touch

Company

Offering

Support

Never miss an update.

Subscribe to updates, news and more.

Schedule a call with our team

You will receive a calendar invite to the email address provided below for a 15-minute call with one of our team members to discuss your needs.

You will be presented with date and time options on the next step