Data archiving techniques with PySpark & Iceberg
Conversa

Data archiving techniques with PySpark & Iceberg

por Le Wagon

Descrição

Join us for an exciting tech talk with Antonello Benedetto, Lead Data Engineer at Wise, and discover how to use advanced data archiving techniques with PySpark & Iceberg.

Who you'll hear from:
🎤 Arthur Caron, Data Engineer and Teacher at Le Wagon
🎤 Antonello Benedetto, Lead Data Engineer at Wise

What you'll learn:
✅ How to effectively design and implement an archiving solution with cutting-edge technologies
✅ The benefits and challenges of using Airflow, AWS EMR, and Iceberg table format for large-scale data management
✅ Lessons from a real-world project, including pros and cons to consider for your own implementations

If you're curious about the world of Data Engineering, this isn't one to miss - sign up for your free ticket today.
Calendar Data e hora
Funcionou terça-feira 27 agosto 2024
Location Localização
Online
Convide os seus amigos
Facebook logo Linkedin logo
https://www.lewagon.com/pt-BR/events/data-archiving-techniques-with-pyspark-iceberg-z9jcwP

Descrição

Join us for an exciting tech talk with Antonello Benedetto, Lead Data Engineer at Wise, and discover how to use advanced data archiving techniques with PySpark & Iceberg.

Who you'll hear from:
🎤 Arthur Caron, Data Engineer and Teacher at Le Wagon
🎤 Antonello Benedetto, Lead Data Engineer at Wise

What you'll learn:
✅ How to effectively design and implement an archiving solution with cutting-edge technologies
✅ The benefits and challenges of using Airflow, AWS EMR, and Iceberg table format for large-scale data management
✅ Lessons from a real-world project, including pros and cons to consider for your own implementations

If you're curious about the world of Data Engineering, this isn't one to miss - sign up for your free ticket today.