Senior AI QA Engineer

ABOUT BEAMERY With the rapid expansion of AI and automation, the future of work has never been more challenging for organizations. Beamery’s unique jobs, skills and tasks data platform helps organizations navigate these challenges and make more informed decisions across Talent Lifecycle Management. Our solutions power recruitment, mobility, upskilling, diversity, work architecture and workforce planning for some of the world’s most forward-thinking companies. We believe that where you work is much more than just a job. Millions of people are being left behind every day in their careers, and we’re on a mission to fix this by creating equal access to meaningful work, skills and careers for all. We are an equal opportunity employer committed to building a representative Beamery, creating an equitable, inclusive and engaging environment for our people. So, what are you waiting for? Join us and help us transform the future of work once and for all. What’s ahead — and why it’s an exciting time to join the team:  Deepening our native integrations with SAP, Workday, Microsoft, and LinkedIn to seamlessly embed our skills intelligence into the platforms where critical workforce decisions are made. Embedding our agentic AI to help customers plan smarter for the future—powering workforce strategies, internal mobility, and skills forecasting. Advancing our use of proprietary LLMs and knowledge graph technology to help organizations unlock broader talent pools, make fairer decisions, and expand access to opportunity at scale. But it’s not all about creating high-quality products, we also very much value the company culture we have worked hard to create; built on trust, empathy & honesty ensuring our workforce is able to bring their full selves to work. ABOUT THE ROLE Beamery’s Job Architecture product uses AI to generate structured role profiles, including skills, tasks, proficiency levels, human agency, and priorities, at scale for some of the world’s largest enterprises. These outputs go directly into our customers’ talent platforms, so accuracy and consistency matter in everything we deliver. As a Senior QA Engineer, you’ll be the person who checks and improves the quality of job architecture outputs we produce. You’ll work closely with our Data Science and Professional Services teams to review AI-generated data, spot issues, fix errors, and make sure each project is delivered accurately and on time. This is a great role for someone who enjoys working with data,using AI agentic tools (e.g. Claude), has a sharp eye for detail. You’ll also help build and document the QA processes we use, so you’ll have a real say in how things are done. WHAT WILL YOU DO AS A SENIOR QA ENGINEER AT BEAMERY? REVIEW AND IMPROVE AI-GENERATED OUTPUTS * Check AI-generated role profiles against our quality standards, looking at skills, proficiency levels, and priority assignments to make sure they’re accurate and consistent. * Spot errors, gaps, or inconsistencies in the data and fix them, making sure the overall structure stays intact. * Work with the Professional Services team to manage the QA stage of each project, keeping things on track and within agreed timelines. * Review Beamery’s Taxonomies and ensure the accuracy of Skills, Tasks and Role titles. * Use AI agentic tools like Claude to review the output and implement deterministic agentic flow to accelerate and scale Beamery’s QA activities. * Flag anything that needs a decision before sign-off and communicate clearly about what changes you’ve made and why. COLLABORATE WITH DATA SCIENCE * Work with the Data Science team on defining, implementing and tracking QA metrics to enhance the AI output quality. * Keep a clear record of the issues you find during QA, what went wrong, how often it happens, and what’s likely causing it, so the Data Science team can improve the AI pipeline. * Help test pipeline updates between projects to check that fixes work as expected and don’t introduce new problems. * Turn your QA findings into straightforward recommendations that the team can act on. HELP BUILD OUR QA PROCESSES * Write and maintain documentation for our QA workflows so that new team members can get up to speed quickly. * Spot gaps in our current quality checks and suggest improvements, whether that’s adding new review steps, refining how we measure quality, or updating what “good” looks like. * Help shape our quality standards as the product and customer needs evolve. WHO ARE WE LOOKING FOR? * Experience (3+ years) in QA, data analysis, or a similar role where attention to detail and data accuracy mattered. Internships and placement years count. * Experience (1+ years) in using Agentic tools for QA. * Basic knowledge in Agentic technologies. * A sharp eye for detail, you’re the kind of person who spots the inconsistency everyone else missed. * An analytical mindset, when something looks wrong, you don’t just fix it; you want to understand why it happened so it doesn’t happen again. * Good organisational skills, you can manage your own work across a few projects at once without things falling through the cracks. * Clear communication, you can explain what you found and what you changed to both technical and non-technical people, in writing and in conversation. * Comfort with ambiguity, some of our processes are still being built out, and you’re happy to help shape them rather than waiting for a playbook. This is not a checklist of requirements, don’t worry if you don’t tick every box. We’d still love to hear from you. NICE TO HAVE * Any exposure to AI-generated content, NLP outputs, or taxonomy/classification systems. * An interest in HR technology, talent management, or how organisations think about skills and roles. * Experience defining what “good” looks like for data, for example, writing acceptance criteria or quality metrics. * You’ve helped set up a process or workflow from scratch, even informally. WHY THIS ROLE? This is an early hire in a growing team. As the first QA Analyst focused on job architecture at Beamery, you’ll have a real impact on how quality is defined and maintained across the product. You’ll sit at the intersection of Data Science and customer delivery, and your work will directly shape the outputs that enterprise clients rely on. If you care about getting the details right, want to work with AI-powered products, and are looking for a role where you can grow and make an early mark, we’d love to talk. Beamery is for Everybody. Diversity and open expression are fundamental to us. We acknowledge the challenges in our industry and strive to develop an inclusive culture where everybody can contribute. We are dedicated to creating an inclusive environment for everyone, regardless of ethnicity, religion, color, sexual orientation, gender identity, race, national origin, age, disability status, or caregiver status. If, for whatever reason, you need us to make reasonable adjustments and adaptations to our recruitment process, please email accommodations@beamery.com Visit our Diversity, Equality and Inclusion page to learn more about progress and commitments.

WHY DEPT®? We are pioneers at heart. What this means, is that we are always leaning forward, thinking of what we can create tomorrow that does not exist today. We were born digital and we are a new model of agency, with a deep skillset in tech and marketing. That’s why we hire curious, self-driven, talented people who never stop innovating. Our culture is big enough to cope and small enough to care. Meaning, that with people across 20+ countries, we’re big enough to provide you with the best tools, global opportunities, and benefits that help you thrive. While acting small by investing in you, your growth, your team, and giving you the autonomy to solve our clients’ problems, no matter where you are in the world.  We seek a Principal QA Automation Engineer with a strong background in Cypress, JavaScript/TypeScript, and proven experience working in AI-driven applications within an AWS cloud environment. This is a hands-on leadership role for someone who thrives at the intersection of quality engineering, automation strategy, and modern AI integration. As a senior technical leader, you will own the design, development, and maintenance of a robust test automation framework, ensure seamless integration with CI/CD pipelines, and bring forward-thinking approaches to testing intelligent, adaptive systems. KEY RESPONSIBILITIES * Lead the design and implementation of end-to-end test automation frameworks using Cypress with TypeScript. * Define quality strategies for applications with AI/ML components, including deterministic and non-deterministic testing approaches. * Collaborate with engineering, DevOps, and AI/ML teams to ensure quality across AI-infused features in production environments. * Build and scale testing strategies for threaded AI applications running in AWS cloud infrastructure. * Integrate automated tests into CI/CD pipelines to support frequent, reliable deployments. * Mentor and guide mid- and senior-level QA engineers, setting best practices and driving a culture of quality-first development. * Evaluate and introduce new tools, libraries, and frameworks to improve test coverage, performance, and developer experience. * Participate in architectural discussions to ensure testability and reliability are baked into software designs from the start. * Analyze test results, track quality metrics, and communicate risk and coverage to stakeholders. QUALIFICATIONS * 4+ years of hands-on experience with Cypress for UI and end-to-end automation testing. * Expert-level proficiency in TypeScript, JavaScript and Python * Proven experience testing AI-powered or machine learning applications, including AI model validation techniques. * Strong understanding of AWS services (e.g., Lambda, S3, SQS, CloudWatch, ECS/EKS) and how to validate applications deployed in cloud environments. * Experience with threaded/multi-agent AI tools and how they impact test design and validation. * Familiarity with version control (Git), containerization (Docker), and CI/CD pipelines (e.g., GitHub Actions, Jenkins, or CircleCI). * Strong communication, leadership, and mentoring skills. PREFERRED QUALIFICATIONS * Knowledge of AI model evaluation, model versioning, and monitoring tools (e.g., SageMaker, MLflow, LangChain, Vector Databases). * Experience testing APIs, microservices, and event-driven architectures. * Background in testing non-deterministic systems, including applying statistical or heuristic testing approaches. * Contributions to open-source testing or AI tools are a plus. WHAT DO WE OFFER? * We enjoy spending time together, working closely with other local colleagues, and getting to know one another. Our Buenos Aires offices (Villa Crespo or Mar del Plata) are fully equipped with refreshments and great common spaces! * Premium healthcare through OSDE for the employee and their immediate family members * Mendel prepaid card with a monthly allowance for grocery purchases * Monthly reimbursements for Wi-Fi/electricity expenses * Monthly reimbursements for training/English classes * 100% covered “Plan Total” membership at Sportclub * Access to a our benefits platform through Bonda * A flexible vacation policy WE SUPPORT YOU BEING YOU DEPT® is an equal opportunity employer (EOE). We believe our work is at its best when our people feel safe and free to be themselves. We’re committed to an inclusive and barrier-free recruitment and selection process and workplace, regardless of anyone’s lived experience, race, color, religion, sex, national origin, age, disability, and genetic information. So tell us about any accommodations you need. It’s totally confidential and only used to make sure you feel fully supported at every step. We are a B Corp-certified company passionate about purpose-driven work. Our hope is that you can feel good about the contributions DEPT® is making to the world, and we always have an open door for your ideas in making the world a better place. DEPT® is a pioneering technology and marketing services company that creates integrated end-to-end digital experiences for brands such as Google, KFC, Philips, Audi, Twitch, Patagonia, eBay and more. Its team of 2,500+ digital specialists across 30+ locations on 5 continents delivers pioneering work on a global scale with a boutique culture. Learn more about DEPT® DIVERSITY, EQUITY, & INCLUSION At DEPT®, we take pride in creating an inclusive workplace where everyone has an equal opportunity to thrive. We actively seek to recruit, develop, nurture, and retain talented individuals from diverse backgrounds, with varying skills and perspectives. Not sure you meet all qualifications? Apply, and let us decide! Research shows that women and members of underrepresented groups tend not to apply for jobs when they think they may not meet every requirement, when in fact they do. We believe in giving everyone a fair chance to shine. We also encourage you to reach out to us and discuss any reasonable adjustments we can make to support you throughout the recruitment process and your time with us. Want to know more about our dedication to diversity, equity, and inclusion? Check out our efforts here.