Senior Software Developer, ML Platform & Infrastructure at Gomyneed Private Limited — NeverHard
Senior Software Developer, ML Platform & Infrastructure at Gomyneed Private Limited in Toronto, Ontario. Skills: AWS Bedrock, GPU cluster management, GenAI, Kubernetes, LLM. Apply on NeverHard.
Company
Gomyneed Private Limited
Location
Toronto, Ontario
Type
full_time
Required skills:
AWS Bedrock
GPU cluster management
GenAI
Kubernetes
LLM
MLOps
Observability
RAY
Triton
vLLM
# Senior Software Developer, ML Platform & InfrastructureWealthsimple Toronto Headquarters Full-timeFull-timeAI & Machine Learning---## About this roleWealthsimple is hiring a Senior Software Developer, ML Platform & Infrastructure (Toronto Headquarters). This is an on-site AI & machine learning role listed on the official Wealthsimple careers site.About the Role:We're proud of what we've built — and we're just getting started. Read our Culture Manual and learn more about how we work .Key Responsibilities:• Turn MLOps expertise to GenAI: Transition traditional ML lifecycle and serving patterns into state-of-the-art LLM inference engines and GPU orchestration systems• Build model-routing architecture: Design low-latency routing frameworks (e.g., LiteLLM integration) to dynamically direct requests across managed cloud providers (AWS Bedrock) and self-hosted open-source models• Provision & scale GPU infrastructure: Architect and manage high-performance GPU serving environments on Kubernetes using engines like vLLM, Ray, and Triton• Develop evaluation & benchmarking tooling: Build automated Evals and observability frameworks to empower engineers and data scientists to validate model quality, latency, and drift...• Empower self-serve ML across Wealthsimple: Partner with product engineering and data science teams to build framework-agnostic platform tooling that abstracts infrastructure complexityRequirements & Details:• Drive cost & performance optimization: Improve price-performance across self-hosted and managed inference by optimizing capacity, utilization, batching, routing, and model selection while meeting quality...• 7+ years of software engineering experience in ML Infrastructure, MLOps, ML Tooling, or Data Platform engineering• Deep experience in MLOps/ML Platform practices: Proven track record building and operating self-serve ML platforms, model registry workflows, experiment tracking, or production serving infrastructure...• Strong platform fundamentals: Advanced proficiency in Python, container orchestration via Kubernetes , infrastructure-as-code ( Terraform ), and cloud provider ecosystem (AWS)• Strong appetite to specialize in LLM serving: A genuine desire to leverage your existing MLOps skillset to tackle LLM-specific challenges (vLLM, model routing, prompt...Salary: CA$152K – CA$189K • Offers EquityJob Type: Full-timeWork Mode: On-siteApply directly on the Wealthsimple careers page using the Apply button.
#J-18808-Ljbffr