Software Quality Operations Specialist, Domain Expansion

Job description

Job responsibilities

• Partner with Engineering to design, test, and deploy cutting-edge Machine Learning (ML) and Generative AI (Gen-AI) models and tools to drive improvements in issue discovery & detection, triage efficiency, and quality…
• Leverage AI-powered insights and traditional triage signals to proactively identify emerging on-road issue trends, new risk scenarios, and edge cases.
• Serve as the key link between AI/ML development and operational execution. Define and document new policies, guidelines, and Standard Operating Procedures (SOPs) that integrate AI tools and insights into daily vendor…
• Design and implement robust quality control processes for both human and AI-generated outputs. Perform meta-quality checks, validate the integrity of vendor work, and provide feedback to improve both human and model…
• Act as the subject matter expert for our Software Quality Operations, working closely with stakeholders, program leads, and vendor teams to ensure seamless adoption and maximum impact of AI/ML advancements in our…
• Provide technical leadership and consultation to stakeholders to enhance our workflows and quality. You'll be at the forefront of identifying and escalating issues with our tools, providing technical requirements to…
• Scale workflow from 16/5 to 24/7 coordinating with external stakeholders, vendor team, and FTE team

Job requirements

• BS/BA degree and 4 years of relevant work experience in QC or AV Software Quality Operations
• Increased competency in supporting all phases of the machine learning development life-cycle: data preparation, training, validation, deployment, and continuous monitoring
• Experience with ML testing and validation, including dataset quality assurance, bias detection, edge-case scenario testing, and performance evaluation using statistical metrics
• Ability to quickly learn and implement new concepts and utilize proprietary tools. Strong understanding of driving rules and regulations
• A proven ability to work in a fast-paced, high-stress environment while maintaining good judgment
• Excellent communication and interpersonal skills to effectively collaborate with a wide range of individuals in a diverse and dynamic work environment
• Demonstrated strong execution with ability to drive outcomes
• Ability to effectively and efficiently communicate with cross-functional stakeholders