QA Engineer – Automation & Agentic Applications

We are looking for a QA Engineer with strong automation expertise and experience testing intelligent/agentic applications to join our growing engineering team. You will play a critical role in ensuring the quality, safety, and reliability of our platform by developing automated test. frameworks, validating agent autonomy and decision-making, and collaborating closely with developers, product owners, and DevOps. This role goes beyond traditional QA: you will be working with AI-driven, agentic applications that can plan, act, and adapt. Your job will be to make sure they behave correctly, safely, and predictably under real-world conditions. 

Key Responsibilities 

1. Design, develop, and maintain automated test frameworks and test scripts using Python. 
2. Write and execute manual and automated test cases to validate product features, agent behavior, and functionality. 
3. Integrate automated tests into CI/CD pipelines to ensure continuous quality and fast feedback. 
4. Collaborate with developers and product managers to identify, reproduce, and resolve defects early in the lifecycle.
5. Define and document test plans, strategies, and acceptance criteria for both deterministic and agentic features.
6. Perform scenario-based, exploratory, and chaos testing to validate agent decision making under uncertainty, failure, and edge conditions.
7. Verify observability and explainability of agent behavior (logs, traces, intermediate actions) to ensure compliance, transparency, and auditability.
8. Test human-in-the-loop workflows, ensuring proper escalation, overrides, and user safety.
9. Conduct root cause analysis of production issues, including agent misbehavior, and contribute to long-term fixes.
10. Contribute to the development and enforcement of QA standards and best practices.

Must-Have Qualifications 

1. 5+ years of experience in QA Engineering with a focus on test automation. 
2. Proficient in Python for writing test scripts and tools.
3. Hands-on experience with testing frameworks such as Pytest, Selenium, or Playwright. 
4. Strong understanding of software testing methodologies, including unit, integration, system, and end-to-end testing. 
5. Familiarity with REST APIs and tools like Postman, Swagger, or Bruno for API testing 
6. Solid understanding of Agile/Scrum methodologies.
7. Strong problem-solving skills with the ability to think beyond “happy path” testing.

Nice-to-Have Qualifications

1. Experience testing agentic or AI-driven applications (e.g., autonomous decision making, multi-step workflows) 
2. Experience with scenario-based or chaos testing frameworks 
3. Familiarity with observability and monitoring tools (e.g., Datadog, Grafana, AWS CloudWatch) to validate agent behavior
4. Experience testing microservices
5. Experience with CI/CD tools like GitHub Actions, Jenkins, or GitLab CI
6. Knowledge of security and guardrail testing (role-based access, safe action validation)