NeverHard

Azure Data Engineer at Viva Tech Solutions — NeverHard

Azure Data Engineer at Viva Tech Solutions in Toronto, Ontario. Skills: Apache Airflow, Azure, Azure Data Factory, Azure Databricks, Azure DevOps. Apply on NeverHard.

Company
Viva Tech Solutions
Location
Toronto, Ontario
Type
full_time

Remote: Yes

Required skills:

Strong hands-on experience with Azure Data Factory (ADF), Azure Databricks, Python, PySpark, SQL, and Azure cloud services. Expertise in developing scalable data ingestion, transformation, and orchestration pipelines using Databricks and Apache Airflow. Experience implementing Medallion Architecture (Bronze, Silver, Gold), Delta Lake, and reusable data engineering frameworks. Develop reusable Databricks notebooks, data transformation components, orchestration workflows, and automated data quality checks. Strong experience with Azure DevOps, Git, CI/CD pipelines, and automated deployment processes. Experience with Spark performance tuning, pipeline troubleshooting, data reconciliation, and workload optimization. Knowledge of data governance, metadata management, Unity Catalog, and enterprise data engineering best practices. #J-18808-Ljbffr