Data archiving techniques with PySpark & Iceberg
Charla

Data archiving techniques with PySpark & Iceberg

Organizado por Le Wagon

Descripción

Join us for an exciting tech talk with Antonello Benedetto, Lead Data Engineer at Wise, and discover how to use advanced data archiving techniques with PySpark & Iceberg.

Who you'll hear from:
🎤 Arthur Caron, Data Engineer and Teacher at Le Wagon
🎤 Antonello Benedetto, Lead Data Engineer at Wise

What you'll learn:
✅ How to effectively design and implement an archiving solution with cutting-edge technologies
✅ The benefits and challenges of using Airflow, AWS EMR, and Iceberg table format for large-scale data management
✅ Lessons from a real-world project, including pros and cons to consider for your own implementations

If you're curious about the world of Data Engineering, this isn't one to miss - sign up for your free ticket today.
Calendar Fecha y hora
Organizado el martes 27 agosto 2024
Location Ubicación
Online
Invita a tus amigos
Facebook logo Linkedin logo
https://www.lewagon.com/es/events/data-archiving-techniques-with-pyspark-iceberg-z9jcwP

Descripción

Join us for an exciting tech talk with Antonello Benedetto, Lead Data Engineer at Wise, and discover how to use advanced data archiving techniques with PySpark & Iceberg.

Who you'll hear from:
🎤 Arthur Caron, Data Engineer and Teacher at Le Wagon
🎤 Antonello Benedetto, Lead Data Engineer at Wise

What you'll learn:
✅ How to effectively design and implement an archiving solution with cutting-edge technologies
✅ The benefits and challenges of using Airflow, AWS EMR, and Iceberg table format for large-scale data management
✅ Lessons from a real-world project, including pros and cons to consider for your own implementations

If you're curious about the world of Data Engineering, this isn't one to miss - sign up for your free ticket today.