Techorama Netherlands 2019

As Data Engineers and ETL Developers, our main responsibilities are to move, transform, integrate and prepare data for our end users as quickly and efficiently as possible. With the ever-increasing volume and variety of data, this can easily start to feel like a daunting task. Azure Data Factory (ADF) is a hybrid data integration service that lets you build, orchestrate and monitor complex and scalable data pipelines - without writing any code. The first version of Azure Data Factory may not have lived entirely up to its nickname "SSIS in the Cloud", but the second version has been drastically improved and expanded with new capabilities. But wait, what's that? You have already invested years and millions in a comprehensive SSIS solution, you say? No problem! You can lift and shift your existing SSIS packages into Azure Data Factory to start modernizing your solution while retaining the investments you have already made. In this session, we will first go through the fundamentals of Azure Data Factory and see how easy it is to build new data pipelines or migrate your existing SSIS packages. Then, we will explore some of the major improvements in Azure Data Factory v2, including the new Mapping Data Flows. Finally, we will look at design patterns and best practices for development to speed up productivity while keeping costs down.