RQ11576 - DataOps/Cloud Data Engineer - Senior at Flexstaf IT — NeverHard
RQ11576 - DataOps/Cloud Data Engineer - Senior at Flexstaf IT in Toronto, Ontario. Skills: APIs, Azure Data Factory, Azure DevOps Services, Cloud-native data engineering, Data Governance. Apply on NeverHard.
Company
Flexstaf IT
Location
Toronto, Ontario
Type
not_specified
Required skills:
APIs
Azure Data Factory
Azure DevOps Services
Cloud-native data engineering
Data Governance
DataOps
Databricks
Databricks SQL
Delta Lake
ETL/ELT
Job DescriptionJob Description
HM is looking for a Data Engineer - with the tech stack below:
Must Have:
Experience with
Databricks
, Delta Lake and Databricks SQL.
Knowledge of
Medallion
Architecture.
Experience with
Azure Data Services/Azure Data Factor
y
Experience with Informatica or equivalent integration platforms.
Experience operationalizing common data models and metadata repositories.
Experience and Skill Set Requirements
General Skills (80%)
Demonstrated experience designing, implementing and supporting cloud-based data platforms and services.
Experience developing scalable ETL/ELT processes, data pipelines and integration solutions.
Experience implementing DataOps practices including deployment automation, testing, monitoring and operational support.
Experience with cloud-native data engineering and modern data platform architectures.
Experience implementing metadata, lineage and data quality capabilities within cloud data environments.
Experience developing integration solutions using APIs, event-driven architectures and batch or streaming technologies.
Knowledge of data governance, security and operational best practices for cloud platforms.
Experience automating metadata collection, data movement and operational processes.
Experience supporting cloud modernization and data migration initiatives.
Experience collaborating with architects, modellers and governance teams to operationalize data standards, metadata and common data models.
Knowledge of performance optimization and scalability considerations for cloud data platforms.
Ability to troubleshoot complex technical problems and develop practical solutions.
Strong analytical, organizational and communication skills.
Resource will support the following deliverables:
Data pipelines and integration services
Automated metadata collection and synchronization processes
Cloud data platform implementation and configuration
Data quality and lineage enablement
CI/CD and DataOps automation
Data migration and interoperability services
Cloud-hosted data products and reusable data services
Metadata and governance platform integrations
Desirable Skills (20%)
Experience with Databricks, Delta Lake and Databricks SQL.
Knowledge of Medallion Architecture.
Experience with Microsoft Fabric and Azure Data Services.
Experience with Microsoft Purview.
Experience with Informatica or equivalent integration platforms.
Experience operationalizing common data models and metadata repositories.
Experience with graph technologies and semantic repositories.
Knowledge and understanding of AODA and related standards.
Ability to meet tight deadlines and adapt to changing project priorities.
Nice to have:
Prior OPS/Public sector exp.
Experience with Microsoft Purview and Microsoft Fabric