Data Engineer at Insight Global in Toronto, Ontario. Skills: Apache NiFi, DBT, Data Engineering, Event Streams, Medallion Architecture. Apply on NeverHard.
Company
Insight Global
Location
Toronto, Ontario
Type
not_specified
Required skills:
Apache NiFi
DBT
Data Engineering
Event Streams
Medallion Architecture
OAuth2
Oracle
RBAC
REST APIs
SQL Server
Job Description Design and hands-on build of end-to-end data solutions on Snowflake, owning functional and non-functional designs from concept through to production. Develop ingestion and integration pipelines using Snowflake Openflow (Apache NiFi 2.0-based): building visual, low-code flow definitions to ingest multi-source data (CDC from SQL Server/Oracle, REST APIs, event streams, files, SharePoint) into Snowflake without managing separate ETL infrastructure. Configure NiFi processors, controller services, and parameter groups for structured, semi-structured, streaming and unstructured data movement in both batch and streaming modes, applying secure OAuth2/TLS authentication and RBAC. Work closely with Ops and Infrastructure architects to productionize robust, resilient, and maintainable solutions, and with customer architects to agree functional and non-functional designs, advising, questioning, and guiding sound design outcomes. Build Snowflake-native transformations (dbt, Snowpark, Notebooks, tasks/streams, dynamic tables) and medallion (Bronze/Silver/Gold) architectures with automated, metadata-driven pipelines and robust error handling. Develop policy and standards, share knowledge, and mentor, coach and develop a small number of staff. We may use artificial intelligence tools to assist with the screening, assessment, or selection of potential applicants for this position. We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/. Skills and Requirements Experience leading multi-skilled agile teams as a Sr Data Engineer. Proven, hands-on experience designing, building and productionizing modern data-intensive applications, including orchestration and operation. Deep, hands-on Snowflake expertise: warehouse design, SQL/Snowpark, dbt, dynamic tables, data sharing, cost/performance optimization. Strong Apache NiFi / Snowflake Openflow skills: designing, deploying and monitoring flow-based pipelines, custom processors, and CDC/streaming ingestion at scale. Broad knowledge of the full spectrum of data technologies (ingestion, transformation, storage, presentation, consumption) and the ability to integrate them into successful solutions. Strategic design-thinking experience: problem conceptualization, roadmap definition, architecture realization, and risk management. Strong Proficiency in SQL and Python, with a solid understanding of ETL/ELT patterns, data modelling (star/snowflake schema, SCD), and CI/CD for data (Git, testing, orchestration).