Principal QA Engineer

freeC's Client

• Assist in evaluating and validating AI-generated outputs (e.g., LLMs) by conducting prompt testing, analyzing edge cases, and ensuring consistency.
• Collaborate with AI and product teams to establish quality assessment metrics (e.g., helpfulness, accuracy, coherence) and develop scalable QA frameworks.
• Review product requirements, resolve ambiguities, and provide insights on testing impact and feasibility.
• Develop comprehensive test cases based on an in-depth understanding of business logic and system architecture.
• Perform end-to-end testing across the software development lifecycle, including exploratory, functional, regression, and integration testing.
• Design, implement, and maintain automated test scripts for web and API testing.
• Work closely with developers and product owners in an agile environment to uphold high-quality standards.
• Systematically identify, document, and track defects, ensuring clear and effective issue reporting.
• Continuously refine test coverage, QA methodologies, and overall testing processes to enhance efficiency.
• Provide mentorship to junior QA engineers and actively contribute to knowledge-sharing initiatives within the team.

REQUIREMENTS

Must-have:

• 8+ years of experience in software testing for web and mobile applications.
• Strong knowledge of QA principles, testing methodologies, and industry best practices.
• Practical experience with:

1. Programming or scripting languages such as JavaScript, Python, or Shell.
2. Designing and executing test cases for various software applications.
3. Automated testing using frameworks like Selenium, Playwright, or Cypress.
4. API testing with Postman or similar tools.
5. Bug tracking and test case management tools such as Jira, TestRail, or Zephyr.

• Familiarity with CI/CD pipelines and the role of QA in software release cycles.
• Ability to interpret logs, analyze API responses, and debug frontend/backend code.

Nice-to-have:

• Experience in evaluating and testing AI/ML systems, including LLM outputs, hallucination detection, and user feedback assessment.
• Knowledge of prompt engineering, AI output validation (rubric-based scoring), and A/B testing for AI-driven features.
• Background in working within cross-functional teams alongside developers, designers, and product managers.
• Exposure to performance, security, or accessibility testing methodologies.
• Understanding of cloud environments (e.g., AWS).
• ISTQB certification or equivalent QA credentials.

Communication & Collaboration

• Proactive and effective communicator with strong teamwork skills.
• Experience in mentoring junior team members or leading QA initiatives.
• Strong sense of ownership and commitment to quality assurance.
• Proficient in English for business-level reading and writing.

• Full salary during the probationary period
• Performance and salary review: twice/ a year in June and December
• 13th-month salary
• Monthly and biannual Recognition Awards
• An annual health check is provided
• Various insurances, including Social, Health, and Unemployment Insurance, are applied during the probation period. 
• Private health and accident insurance are also included, with additional benefits for family members at the Managing level.
• The hybrid working model allows for 3 days of remote work and 2 days in the office, with flexible start times.
• The facility is well-equipped, providing items such as a MacBook Pro and additional monitors. 
• Employees are entitled to 16-24 paid days off, with extra paternity leave days available.
• The company sponsors foreign language and international technology-related certifications.
• Annual company trips, quarterly team-building activities, and recreational clubs such as billiards and running.
• Employees have access to external and internal training courses, soft-skill workshops, and tech seminars.