Automate Data integration setup with Azure DevOps

In this session we will dive into an actual use case from a recent project, running a secure data integration setup in Azure, leveraging some of the many PaaS services like Data Factory, Data Lake and Azure SQL and control and automate deployment it with Azure DevOps.
We will look into how we can secure the data stored in the services and how we can isolate the environment, so no uncontrolled changes can be done to it.
Furthermore, we will touch on how we can automate the deployment of Azure services, including Data Factory pipelines and SQL tables as Infrastructure as Code, while secure secrets with Key Vault rather than exposing them in our code.

 

Big Data & Analytics, Cloud Governence, Data Scientists (i.e people working with advanced analytics), Development & Test, Insights & Advanced Analytics, IT Operations & Governance, Security