About Qualysoft
· 25 years of experience in software engineering, established in Vienna, Austria
· Active in Romania since 2007, with office in central Bucharest (Bd. Iancu de Hunedoara 54B)
· Delivering End to End IT Consulting Services - From Team Augmentation and Dedicated Teams to Custom Software Development
· We deliver scalable enterprise systems, intelligent automation frameworks, and digital transformation platforms
· Cross-industry experience by sustaining global players in BSFI (Banking, financial services and insurance), Telecom,Retail & E-commerce, Energy and Utilities, Automotive, Manufacturing, Logitics, High Tech
· Global Presence: Switzerland, Germany, Austria, Sweden, Hungary, Slovakia, Serbia, Romania, and Indonesia
· International team of 500+ software engineers
· Strategic partnerships: Microsoft Cloud Certified Partner, Tricentis Solutions Partner in Test Automation and Test Management, Creatio Exclusive Partner, Doxee Implementation Partner
· Powered by cutting-edge technologies: AI, Data & Analytics, Cloud, DevOps, IoT, and Test Automation.
· Project beneficiaries ranging from large-scale enterprises to startups
· Stable growth and revenue increase year over year, a resilient organisation in volatile IT market conditions
· Quality-first mindset, culture of innovation, and long-term client partnerships
· Global and local reach – trusted by key industry players in Europe and the US
Responsibilities:
• Establish and maintain automated frontend testing.
• Build API and integration test coverage for routers and database flows.
• Design and implement E2E tests with Playwright for critical user flows.
• Create stable mocking and fixture strategies (MSW, pytest fixtures, predefined test data).
• Configure quality gates in CI for linting, unit/integration/E2E tests, code coverage, and reporting.
• Extend coverage into non-test UI and workflow areas and prevent regressions.
• Build an LLM evaluation discipline with golden datasets and measurable quality gates.
• Track reliability of model outputs, detect drift, and condition releases on quality/stability thresholds.
• Improve test maintainability, eliminate flakiness, and optimize runtimes.
Qualifications:
3+ years in QA automation on production systems.
• Strong Python testing skills with pytest.
• Strong frontend testing skills.
• Experience building and maintaining E2E suites with Playwright/Selenium.
• Experience in API testing (REST, schema validation, authentication/error scenarios).
• Experience with SQL/PostgreSQL testing and test data management.
• Experience with CI/CD pipelines (GitHub Actions, Azure Pipelines or Jenkins).
• Practical understanding of testing non-deterministic outputs of LLM models.
• A plus
• Experience in performance and benchmark testing.
• Experience in WebSocket testing.
• Knowledge of security and dependency scanning.
• Experience in legal-tech, fintech or other regulated domains.
• Familiarity with LLM quality metrics (schema validity, hallucination tracking, consistency).
• Tech Stack
• Backend Testing: pytest, pytest-asyncio, coverage.py
• E2E: Playwright
• CI/CD: GitHub Actions
• Data: PostgreSQL, pgvector
• Application Stack Tested: FastAPI, React, TypeScript, Keycloak, Azure OpenAI