Join to apply for the QA Engineer (EST hours) ID35731 role at AgileEngine 2 weeks ago Be among the first 25 applicants Join to apply for the QA Engineer (EST hours) ID35731 role at AgileEngine Get AI-powered advice on this job and more exclusive features. AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. WHY JOIN US If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you! WHAT YOU WILL DO -Design and execute both automated and manual end-to-end test strategies across all layers of the testing pyramid; - Validate AI model performance, including accuracy, confidence thresholds, and fallback behavior; - Automate quality processes from data ingestion to extraction and classification, with a focus on speed, repeatability, and resilience; - Test and validate integration points between AI components and core business logic; - Support and enhance CI/CD pipelines by maintaining test infrastructure and defining quality gates, automated scripts, and synthetic data; - Define and track quality metrics that matter to the business (e.g., turnaround time, confidence scores, correction rates); - Stay on the cutting edge—continuously learn and apply the latest AI and QA practices to make the impossible possible for our customers. MUST HAVES -Bachelor’s degree in Computer Science, Engineering, Information Systems, or equivalent experience; - 3+ years of experience in QA , Test Engineering, or related roles with a strong grasp of QA methodologies; - Solid understanding of SDLC, Agile methodologies, and software quality principles; - Hands-on experience with automation frameworks like Pytest, Selenium, Cypress, Postman , etc.; - Comfortable working with REST APIs, data pipelines , and backend services; - Familiarity with cloud platforms (AWS or Azure) and CI/CD tools; - Detail-oriented mindset with a sharp eye for edge cases and a strong sense of ownership; - Quick, proactive learner—especially important in the fast-evolving world of AI; - Upper-Intermediate English level. NICE TO HAVES - Experience testing AI/ML systems in production environments; - Familiarity with GenAI model evaluation metrics; - Experience setting up monitoring/alerting for model drift, workflow failures, or performance issues. PERKS AND BENEFITS - Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps. - Competitive compensation: We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities. - A selection of exciting projects: Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands. - Flextime: Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive. Seniority level Seniority level Mid-Senior level Employment type Employment type Full-time Job function Industries IT Services and IT Consulting Referrals increase your chances of interviewing at AgileEngine by 2x Get notified about new Quality Assurance Engineer jobs in Cali, Valle del Cauca, Colombia . QA Engineer / Functional & Automation / (Bilingual ES/EN) We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr