Azure Data Engineer at Viva Tech Solutions — NeverHard
Azure Data Engineer at Viva Tech Solutions in Toronto, Ontario. Skills: Apache Airflow, Azure, Azure Data Factory, Azure Databricks, Azure DevOps. Apply on NeverHard.
Company
Viva Tech Solutions
Location
Toronto, Ontario
Type
full_time
Remote: Yes
Required skills:
Apache Airflow
Azure
Azure Data Factory
Azure Databricks
Azure DevOps
CI/CD
Delta Lake
GIT
PySpark
Python
Strong hands-on experience with Azure Data Factory (ADF), Azure Databricks, Python, PySpark, SQL, and Azure cloud services.
Expertise in developing scalable data ingestion, transformation, and orchestration pipelines using Databricks and Apache Airflow.
Experience implementing Medallion Architecture (Bronze, Silver, Gold), Delta Lake, and reusable data engineering frameworks.
Develop reusable Databricks notebooks, data transformation components, orchestration workflows, and automated data quality checks.
Strong experience with Azure DevOps, Git, CI/CD pipelines, and automated deployment processes.
Experience with Spark performance tuning, pipeline troubleshooting, data reconciliation, and workload optimization.
Knowledge of data governance, metadata management, Unity Catalog, and enterprise data engineering best practices.
#J-18808-Ljbffr