QA engineer with AI at Confiar Services — NeverHard
QA engineer with AI at Confiar Services in Québec, Canada. Skills: AI Systems Evaluation, API Automation, Automation testing, GenAI, LLM. Apply on NeverHard.
Company
Confiar Services
Location
Québec, Canada
Type
not_specified
Required skills:
AI Systems Evaluation
API Automation
Automation testing
GenAI
LLM
LangChain
LangGraph
Load Testing
Performance Testing
Playwright
Based on the requirement, this is a
Senior QA Engineer / QA Lead (AI Testing)
profile. The client is looking for a combination of:
Mandatory Skills AI Testing & GenAI
Testing of LLM-based applications
Prompt engineering and prompt validation
Hallucination detection
Bias, safety, and toxicity testing
RAG (Retrieval-Augmented Generation) testing
Vector database validation
Embeddings and similarity search concepts
Experience with LangChain and/or LangGraph
AI evaluation frameworks and metrics
Automation Testing
Python (mandatory)
Robot Framework (mandatory)
Playwright (mandatory)
API automation
Test framework development
Performance Testing
Load and performance testing experience
Ability to validate AI and traditional application performance at scale
QA Leadership
Test strategy creation
Regression planning
Defect management
Production support
Stakeholder communication
Mentoring junior QA engineers
Domain Knowledge
Banking / Capital Markets
Asset Management
Fixed Income
Securitization (preferred)
Financial Services platforms
Nice-to-Have Skills
MCP (Model Context Protocol)
Vector databases such as:
Pinecone
Weaviate
Chroma
FAISS
Azure OpenAI / OpenAI integrations
ML model validation
Cloud platforms (AWS/Azure/GCP)