Data archiving techniques with PySpark & Iceberg
トーク

Data archiving techniques with PySpark & Iceberg

によってLe Wagon

説明

Join us for an exciting tech talk with Antonello Benedetto, Lead Data Engineer at Wise, and discover how to use advanced data archiving techniques with PySpark & Iceberg.

Who you'll hear from:
🎤 Arthur Caron, Data Engineer and Teacher at Le Wagon
🎤 Antonello Benedetto, Lead Data Engineer at Wise

What you'll learn:
✅ How to effectively design and implement an archiving solution with cutting-edge technologies
✅ The benefits and challenges of using Airflow, AWS EMR, and Iceberg table format for large-scale data management
✅ Lessons from a real-world project, including pros and cons to consider for your own implementations

If you're curious about the world of Data Engineering, this isn't one to miss - sign up for your free ticket today.
Calendar 日時
走った火曜日 27 8月 2024
Location 所在地
オンライン
友人を招待する
Facebook logo Linkedin logo
https://www.lewagon.com/ja/events/data-archiving-techniques-with-pyspark-iceberg-z9jcwP

説明

Join us for an exciting tech talk with Antonello Benedetto, Lead Data Engineer at Wise, and discover how to use advanced data archiving techniques with PySpark & Iceberg.

Who you'll hear from:
🎤 Arthur Caron, Data Engineer and Teacher at Le Wagon
🎤 Antonello Benedetto, Lead Data Engineer at Wise

What you'll learn:
✅ How to effectively design and implement an archiving solution with cutting-edge technologies
✅ The benefits and challenges of using Airflow, AWS EMR, and Iceberg table format for large-scale data management
✅ Lessons from a real-world project, including pros and cons to consider for your own implementations

If you're curious about the world of Data Engineering, this isn't one to miss - sign up for your free ticket today.