24/08/2026
We’re Hiring: QA Engineer
Cloudly is looking for a detail-oriented QA Engineer to ensure the quality, reliability, and performance of our web, mobile, and AI/ML-powered applications.
The ideal candidate should combine strong manual and automation testing skills with an understanding of modern AI testing challenges, including LLM and RAG output evaluation.
Key Responsibilities:
-Design, write, and execute detailed test cases, test plans, and test scenarios from requirements, user stories, and acceptance criteria.
-Perform functional, regression, integration, exploratory, smoke, and sanity testing across web and/or mobile applications.
-Build, maintain, and extend automated test suites to expand coverage and reduce manual effort.
-Identify, document, and track defects with clear, reproducible steps, severity/priority, and supporting evidence; verify fixes and manage them through to closure.
-Integrate automated tests into CI/CD pipelines and monitor test runs, triaging failures promptly.
-Conduct API testing and validate data flows, responses, and error handling.
-Plan and execute performance and load tests (e.g., k6, JMeter) to assess system responsiveness, throughput, and stability under load, and report on bottlenecks.
-Test AI/ML-powered features by validating model outputs for accuracy, relevance, and consistency, and evaluating LLM/RAG responses for hallucinations and groundedness against source data.
-Collaborate with developers and project managers during grooming and planning to clarify requirements and flag testability concerns early.
-Contribute to QA process improvements, test strategy, and quality metrics reporting.
Required Qualifications:
-Solid grasp of QA methodologies, the SDLC, and the defect lifecycle.
-Hands-on experience building and maintaining automated tests with a modern framework (Playwright/Cypress).
-Proficiency in at least one programming language for automation (e.g., JavaScript/TypeScript, Python).
-Experience with API testing tools (Postman, Newman) and validating RESTful services.
-Hands-on experience with performance/load testing tools such as k6 or JMeter.
-Familiarity with test management and defect-tracking tools (Git Issues/Jira/TestRail).
-Working knowledge of Git and CI/CD concepts.
-Experience testing AI/ML features — validating model outputs for accuracy, relevance, consistency, and edge cases.
-Basic understanding of LLMs and RAG systems, including how retrieval quality and prompts shape responses.
-Familiarity with evaluating AI outputs for hallucinations, groundedness, and factual correctness against source data.
-Awareness of prompt-based testing and building evaluation sets to measure AI feature quality.
-Understanding of AI testing challenges such as non-deterministic outputs and tolerance-based validation.
-Strong analytical and problem-solving skills with sharp attention to detail.
-Working knowledge of SQL for querying and validating data.
-Clear written and verbal communication for documenting issues and collaborating across teams.
Compensation & Benefits
💰 Negotiable salary
🎉 Two festival bonuses combined are equivalent to one month’s salary.
📅 2-day weekend
🌴 8 casual + 8 sick leave days
🍽️ Fully subsidized lunch, snacks, tea & coffee
🌎 Opportunity to work with experienced teams and USA-based clients
If you have a strong QA foundation and are interested in working on both traditional software systems and emerging AI/LLM-powered products, we’d love to hear from you.
📩 Apply now: [email protected]
