Data Engineering
- Home
- Data Engineering
Course Description
This course is ideal for:
- Individuals who are new to Azure, require zero prerequisites.
- Beginners in the field of data analysis.
- Those eager to learn Azure Data Factory (ADF), Databricks, and Synapse.
- Professionals currently working with Informatica, SSIS, and Power BI, seeking to transition into Azure.
- Data analysts are looking to make a switch to Azure.
Course Information
- Course Module:
- Understanding Azure basics: subscription, resource group, management group creation, and an introduction to Azure Data Factory (ADF).
- Exploring Blob and Data Lake Gen2 storage.
- Integration runtime, linked services, data sets, pipelines, and activities in ADF. Copying data for a single file.
- Advanced copy data activities: Recursive, wildcard, file listing, mapping, user properties, and various settings.
- Implementing For Each loop for copying multiple files.
- Copying data to SQL Server: upsert, pre-copy script, and AutoCreate table options.
- Lookup activity and handling multiple files using lookup.
- Delta load strategy for a single file.
- Delta load for multiple files.
- Git integration and Azure DevOps collaboration.
- Overview of Azure Databricks integration.
- Delta table and properties of Delta Lake.
- Course Module:
- Azure Active Directory, tenant, subscription, and user management.
- Advanced activities: If-else, metadata, and web activities.
- Triggers: event-based, scheduled, and tumbling window triggers.
- Azure Synapse: SQL, serverless pool, and dedicated pool.
- Data flow concepts: mapping, wrangling, and processing CSV, JSON, and XML with Pyspark, Scala, and Python.
- Azure Key Vault and shared integration runtime.
- JDBC connector and secret scope in Azure Databricks.
- Fact and dimension
- star, snowflake schemas, and data modeling.
- Creating stored procedures for data modeling.
- Sending email alerts using Logic App.
- Advanced data processing with CSV, JSON, and XML in Pyspark, Scala, and Python.
- Delta Lake principles and best practices
Price
Course Fees - $1200