NeverHard
Lead Data Platform Engineer ( AI/ML , Start-up) at Talent To Hire Inc. — NeverHard
Lead Data Platform Engineer ( AI/ML , Start-up) at Talent To Hire Inc. in Toronto, Ontario. View salary, required skills, and apply on NeverHard.
- Company
- Talent To Hire Inc.
- Location
- Toronto, Ontario
- Type
- full_time
Job DescriptionJob Description
Data Platform Software Lead Engineer – AI/ML Systems
Location:
Hybrid (4 days onsite – Downtown Toronto)
Type:
Full-Time | Start-up
About the Role
Join our team as a
Data Platform Software Lead Engineer
and drive the architecture that fuels our AI and ML pipelines, focusing on large-scale, code-based text datasets. You'll design and build reliable systems for data ingestion, transformation, and delivery—enabling teams to train, iterate, and deploy models with confidence.
What You’ll Do
Architect and implement scalable data platforms for code/text dataset ingestion, processing, and delivery.
Build web-scale crawling and metadata extraction tools from open-source code repositories.
Develop reliable, distributed pipelines with frameworks like
Spark, Kafka, and Airflow/Prefect
.
Enable data visualization, sampling, and analytics for research teams to improve model performance.
Collaborate with researchers, infrastructure, and compliance teams to meet technical and governance requirements.
Must-Have Skills
8+ years in data-intensive software engineering.
Proficiency in Python, Go, or Scala; Spark or Ray; Airflow or Prefect; Kafka; Redis; Postgres or ClickH
This page requires JavaScript. Please enable it in your browser, or explore
neverhard.com for more information.