Senior Engineer – GenAI Quality Assurance

Responsibilities

• Design and implement automated and manual QA strategies for GenAI systems
• Build regression tests, generate synthetic test data, build test harnesses and evaluation pipelines for accuracy
• Validate prompt logic, model behavior and evaluation metrics
• Execute tests and debug pipelines
• Support deployment of GenAI products
• Lead system design reviews
• Collaborate closely with data scientists and developers
• Establish testing standards and workflows for continuous integration and deployment
• Conduct code reviews and document system design decisions

Requirements

• 3+ years of experience as a software engineer
• Familiarity with RAG & Graph frameworks
• 5+ years of experience in production systems
• 1+ year experience in GenAI systems
• Advanced Python skills
• Experience with LLM-based systems
• Hands‑on experience with: LLM APIs, AWS Bedrock, Azure Foundry, GCP
• Proven ability to implement test frameworks
• Knowledge of API testing, data validation, data pipeline testing
• Experience with version control (Git)

Core Competencies

Demonstrates expertise in designing and implementing QA strategies for GenAI systems, with advanced skills in Python and experience in LLM-based systems. xcskxlj Proficient in establishing testing standards, conducting code reviews, and collaborating with cross‑functional teams to ensure product quality.

#J-18808-Ljbffr