Talk
Data archiving techniques with PySpark & Iceberg
by Le Wagon
Description
Join us for an exciting tech talk with Antonello Benedetto, Lead Data Engineer at Wise, and discover how to use advanced data archiving techniques with PySpark & Iceberg.
Who you'll hear from:
🎤 Arthur Caron, Data Engineer and Teacher at Le Wagon
🎤 Antonello Benedetto, Lead Data Engineer at Wise
What you'll learn:
✅ How to effectively design and implement an archiving solution with cutting-edge technologies
✅ The benefits and challenges of using Airflow, AWS EMR, and Iceberg table format for large-scale data management
✅ Lessons from a real-world project, including pros and cons to consider for your own implementations
If you're curious about the world of Data Engineering, this isn't one to miss - sign up for your free ticket today.
Description
Join us for an exciting tech talk with Antonello Benedetto, Lead Data Engineer at Wise, and discover how to use advanced data archiving techniques with PySpark & Iceberg.
Who you'll hear from:
🎤 Arthur Caron, Data Engineer and Teacher at Le Wagon
🎤 Antonello Benedetto, Lead Data Engineer at Wise
What you'll learn:
✅ How to effectively design and implement an archiving solution with cutting-edge technologies
✅ The benefits and challenges of using Airflow, AWS EMR, and Iceberg table format for large-scale data management
✅ Lessons from a real-world project, including pros and cons to consider for your own implementations
If you're curious about the world of Data Engineering, this isn't one to miss - sign up for your free ticket today.