Senior AI Test Automation Engineer

Empresa: UST
Provincia: hibrido
Población: 
Descripción: We are looking for the very Top Talent... and we would be delighted if you were to join our team! More in detail, UST is a multinational company based in North America, certified as a Top Employer and Great Place to Work, with over 35,000 employees worldwide and presence in more than 35 countries. We are leaders in digital technology services, delivering large-scale technological solutions to top-tier companies. What we look for? We are looking for a Senior AI Test Automation Engineer to join the ML and AI ART, owning the end-to-end test automation strategy for an advanced AI/MLOps platform. This platform powers business-critical AI capabilities such as LLM-based assistants, RAG systems, agentic workflows, and ML pipelines. Main tasks and accountabilities will be: - Define and evolve the test automation architecture aligned with the Bank’s Test Strategy - Design scalable, reusable automation frameworks and patterns across teams - Analyse requirements and ensure testability during Agile ceremonies (PI Planning, Backlog Refinement, etc.) - Design and automate test cases (functional and non-functional) based on risk and coverage - Implement automation using Python frameworks (Playwright, pytest, Behave/BDD) - Develop AI/ML-specific testing approaches (LLM evaluation, non-deterministic behaviour, RAG workflows) - Build and maintain API contract tests and microservices validation - Integrate and run automated tests in CI/CD pipelines (GitLab) - Use Docker/Kubernetes for reproducible test environments - Manage test execution across environments (DEV, INT, UAT, pre-PROD) - Monitor test health, handle flaky tests, and ensure reliable reporting - Report defects in Jira with proper traceability and evidence - Produce audit-ready test artefacts and ensure compliance with governance standards - Collaborate with cross-functional teams (POs, Engineers, MLOps, Data Engineers) - Act as Test Automation Ambassador within the ART - Ensure end-to-end traceability across requirements, tests, and results - Maintain and evolve test suites as systems (APIs, models, prompts) change What do we expect from you? - Strong experience in Python-based test automation (Playwright, pytest, BDD frameworks) - Proven ability to design and own test frameworks, not just test scripts - Experience integrating automation into CI/CD pipelines (GitLab preferred) - Knowledge of parallel execution, reporting tools, and flaky test management - Solid understanding of Git, clean code, and code review practices - Experience with Docker and basic knowledge of Kubernetes - Exposure to AI/ML testing (LLMs, RAG, non-deterministic systems) or strong motivation to learn - Understanding of APIs, microservices, event-driven architectures - Familiarity with SAFe, Agile, and DevOps principles - Experience with Jira and test management tools (Xray, Agile Hive, etc.) - Strong analytical mindset with end-to-end system understanding - Awareness of data privacy, ...
Tecnologías: Python, Playwright, pytest, Behave, BDD, GitLab CI,
Tipo de Contrato: Indefinido
Salario: Sin especificar
Experiencia: 3-5 años
Funciones: Tester/QA
Descubre más: https://www.tecnoempleo.com/senior-ai-test-automation-engineer-ust/python-playwright/rf-3b5e172a028f236ab047