DataOps Cloud Data Engineer - Senior at Innosystech Inc — NeverHard
DataOps Cloud Data Engineer - Senior at Innosystech Inc in Regent Park, City of Toronto. Skills: AWS Code Pipeline, Azure Data Lake, Azure DevOps, Azure Key Vault, Azure Monitor. Apply on NeverHard.
Company
Innosystech Inc
Location
Regent Park, City of Toronto
Type
full_time
Required skills:
AWS Code Pipeline
Azure Data Lake
Azure DevOps
Azure Key Vault
Azure Monitor
Azure SQL
Azure Storage Account
CI/CD
Data Migration
Data Modeling
Job Title: DataOps Cloud Data Engineer - Senior
Location: Toronto, Ontario
Work Model: Onsite
Description / Responsibilities / Skills
Must Have
Expert experience with Microsoft Azure technologies including Azure pipeline, DACPAC, storage account, disk, file share, Azure key vault, Azure portal, virtual machine, Azure DevOps, Data Lake, Data Lakehouse, Azure monitoring tools
Description
Responsibilities
Participate in review of project artefacts including use cases and system requirements
Design and deliver system design documents aligned to Ministry standards
Design, develop and optimize data and database CI CD pipelines
Develop Azure CI CD release pipelines for DACPAC promotion
Promote database changes across development, QA, UAT and production environments
Design and implement data loading, conversion and migration solutions
Perform large-scale data transformation across OLTP and OLAP environments
Design and implement data warehouse, data lake and data lakehouse architectures
Develop fact and dimension models and data mapping solutions
Provision and manage data in cloud environments
Administer and tune performance of Oracle, Azure SQL and Synapse databases
Support data replication across heterogeneous cloud and enterprise systems
Develop and optimize PL SQL programs and SQL Server stored procedures
Monitor incidents, troubleshoot issues and provide resolution
Develop database automation, backup and recovery scripts
Perform database administration including patching, upgrades, monitoring and capacity planning
Document technical solutions and provide knowledge transfer to Ministry staff
General Skills
Experience working with data platforms, database systems and cloud environments
Experience with system design, development and maintenance
Experience working with structured and unstructured data systems
Strong analytical, troubleshooting and problem-solving skills
Ability to collaborate with technical teams and stakeholders
Desirable Skills
Knowledge of enterprise data integration and data exchange frameworks
Experience working with large-scale data environments
Familiarity with performance tuning and data optimization techniques
Skills
Experience and Skill Set Requirements
Cloud DataOps 40 percent
Experience with Microsoft Azure technologies including pipelines, DevOps and data storage
Experience developing data pipelines, orchestration and automation
Experience with DataOps principles and Agile delivery practices
Experience implementing CI CD for data solutions
Experience with data provisioning, exchange and security
Experience working with structured and unstructured data
Experience with data performance monitoring and tuning
Database Management 40 percent
Experience administering Azure SQL, Synapse, Oracle, DB2 or IMS databases
Strong experience with SQL Server stored procedures and Oracle PL SQL
Experience with database performance tuning and optimization
Data Replication Pipelines 20 percent
Experience implementing data replication across Azure SQL, Oracle and DB2 environments
Experience supporting cloud-based data replication solutions