Data archiving techniques with PySpark & Iceberg
Talk

Data archiving techniques with PySpark & Iceberg

by Le Wagon

Description

Join us for an exciting tech talk with Antonello Benedetto, Lead Data Engineer at Wise, and discover how to use advanced data archiving techniques with PySpark & Iceberg.

Who you'll hear from:
🎤 Arthur Caron, Data Engineer and Teacher at Le Wagon
🎤 Antonello Benedetto, Lead Data Engineer at Wise

What you'll learn:
✅ How to effectively design and implement an archiving solution with cutting-edge technologies
✅ The benefits and challenges of using Airflow, AWS EMR, and Iceberg table format for large-scale data management
✅ Lessons from a real-world project, including pros and cons to consider for your own implementations

If you're curious about the world of Data Engineering, this isn't one to miss - sign up for your free ticket today.
Calendar Date and Time
Ran on Tuesday, 27 August 2024
Location Location
Online
Invite your friends
Facebook logo Linkedin logo
https://www.lewagon.com/events/data-archiving-techniques-with-pyspark-iceberg-z9jcwP

Description

Join us for an exciting tech talk with Antonello Benedetto, Lead Data Engineer at Wise, and discover how to use advanced data archiving techniques with PySpark & Iceberg.

Who you'll hear from:
🎤 Arthur Caron, Data Engineer and Teacher at Le Wagon
🎤 Antonello Benedetto, Lead Data Engineer at Wise

What you'll learn:
✅ How to effectively design and implement an archiving solution with cutting-edge technologies
✅ The benefits and challenges of using Airflow, AWS EMR, and Iceberg table format for large-scale data management
✅ Lessons from a real-world project, including pros and cons to consider for your own implementations

If you're curious about the world of Data Engineering, this isn't one to miss - sign up for your free ticket today.