About Qualysoft
· 25 years of experience in software engineering, established in Vienna, Austria
· Active in Romania since 2007, with office in central Bucharest (Bd. Iancu de Hunedoara 54B)
· Delivering End to End IT Consulting Services - From Team Augmentation and Dedicated Teams to Custom Software Development
· We deliver scalable enterprise systems, intelligent automation frameworks, and digital transformation platforms
· Cross-industry experience by sustaining global players in BSFI (Banking, financial services and insurance), Telecom,Retail & E-commerce, Energy and Utilities, Automotive, Manufacturing, Logitics, High Tech
· Global Presence: Switzerland, Germany, Austria, Sweden, Hungary, Slovakia, Serbia, Romania, and Indonesia
· International team of 500+ software engineers
· Strategic partnerships: Microsoft Cloud Certified Partner, Tricentis Solutions Partner in Test Automation and Test Management, Creatio Exclusive Partner, Doxee Implementation Partner
· Powered by cutting-edge technologies: AI, Data & Analytics, Cloud, DevOps, IoT, and Test Automation.
· Project beneficiaries ranging from large-scale enterprises to startups
· Stable growth and revenue increase year over year, a resilient organisation in volatile IT market conditions
· Quality-first mindset, culture of innovation, and long-term client partnerships
· Global and local reach – trusted by key industry players in Europe and the US
Responsibilities:
Build API and integration test coverage for Java/Spring routers and database workflows.
• Design and implement Playwright E2E tests for critical user journeys.
• Create stable mocking and fixture strategies (MSW, test fixtures, seeded test data).
• Set up CI quality gates for linting, unit/integration/E2E tests, coverage, and reporting.
• Expand coverage to untested UI and workflow areas and prevent regressions.
• Build an LLM evaluation discipline with golden datasets and measurable quality gates.
• Track model output reliability, detect drift, and gate releases on quality/stability thresholds.
• Improve test maintainability, remove flakiness, and optimize runtime.
• LLM QA Tooling
• Use LangChain4j for JVM-native LLM application support, including agents, RAG, and guardrails.
• Use Langfuse Java SDK and OpenTelemetry for trace capture, prompt/version tracking, and experiment comparison.
• Use the OpenAI Java SDK for structured outputs, function calling, webhook verification, and response validation.
• Use Promptfoo in CI when you need language-agnostic regression and red-team checks around the Java stack.
• Use Java schema validation and guardrail patterns with Jackson, Swagger annotations, and LangChain4j guardrails.
• Use OpenTelemetry-based traces and Langfuse datasets as the reproducible source of truth for release gates.
Qualifications:
3+ years in QA automation for production systems.
• Strong Java backend testing skills.
• Strong frontend testing.
• Experience building and maintaining Playwright/Cypress/Selenium E2E suites.
• API testing experience (REST, schema validation, auth/error scenarios).
• Experience with SQL/PostgreSQL testing and test data management.
• CI/CD pipeline experience (GitHub Actions, Azure Pipelines, or Jenkins).
• Practical understanding of testing non-deterministic LLM outputs.
Nice to have:
Familiarity with Java-compatible LLM evaluation and regression tooling such as Promptfoo and Langfuse, plus tracebased observability and output validation via API/OpenTelemetry integrations.
• Performance and benchmark testing experience.
• WebSocket testing experience.
• Security and dependency scanning awareness.
• Experience in legal-tech, fintech, or other regulated domains.