Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million

hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique

stays and experiences that make it possible for guests to connect with communities in a more authentic way.

The Community You Will Join:

AI and ML are at the heart of the Airbnb product. From Trust to Payments, and from Customer Service to Marketing, we rely on ML to

ensure that guests and hosts have the best possible experience with Airbnb.

The Core ML team is responsible for driving CSxAI (Customer Support x Artificial Intelligence) initiatives by adopting Generative

AI technologies to enable an intelligent, scalable, and exceptional service experience. The team develops and enhances AI models,

ML services, and tools including LLM fine-tuning and optimization, RAG/Search, LLM evaluation and testing automation,

feedback-based learning, and guardrails for a wide range of applications at Airbnb.

The richness of Airbnb's data, the complexity of its marketplace, and the variety innate in our product mean that we need to

operate at the state of the art of AI practice. We are committed to long-term innovation to solve complex problems, and to do that

we need experienced ML

The Difference You Will Make:

In this Senior Staff role, you will set technical direction and lead execution for ML evaluation and the end-to-end data flywheel

powering CSxAI products (e.g., assistive agents, issue resolution, and tooling). Your work will define how we measure quality, how

we turn feedback into learning signals, and how we continuously improve models and products safely and efficiently. You will

partner closely with product, engineering, design, operations to build evaluation systems that are trusted, scalable, and

actionable - connecting offline metrics to online outcomes.

A Typical Day:

Define evaluation strategy and success metrics for GenAI systems, aligning offline evaluation with online business and customer

experience outcomes.

Build and scale evaluation frameworks (golden sets, synthetic data, automated regressions, rubric-based grading, LLM-as-judge

where appropriate) with strong controls for bias, drift, and reliability.

Design the data flywheel: instrumentation, feedback collection, data quality checks, labeling strategy, dataset versioning, and

governance to support continuous improvement.

Lead cross-functional quality initiatives across product, ops, and engineering, driving clarity on what “good” looks like and

how teams act on evaluation results.

Develop and productionize pipelines for dataset creation, model monitoring, evaluation-at-scale, and continuous testing

(pre-deploy and post-deploy).

Drive technical decisions and architecture for evaluation and data infrastructure, balancing speed, rigor, cost, and safety.

Minimum Qualifications:

Educational Background: PhD in Computer Science, Mathematics, Statistics, or related technical field (or equivalent practical

experience).

Industry Experience: 10+ years building, testing, and shipping ML/AI systems end-to-end; including 2+ years of experience with

GenAI/LLM systems in production.

Leadership Experience: 5+ years leading large, ambiguous technical initiatives as a senior IC, influencing roadmap and

engineering/science direction across teams.

Technical Proficiency:
Deep expertise in evaluation methodology (offline/online alignment, metric design, human-in-the-loop evaluation, A/B testing,

power analysis, regression testing).

Hands-on experience with GenAI systems, including orchestration, retrieval, tool calling, memory, etc.
Experience building data pipelines and quality systems (labeling workflows, dataset curation, versioning, monitoring, and

governance).

Solid ML fundamentals and best practices (model selection, training/serving, monitoring, reliability, and model lifecycle

management).

Preferred Qualifications:

Customer Support Systems: Experience applying ML/AI to customer support workflows (e.g., agent assist, classification/routing,

resolution recommendation, QA).

Infrastructure & Quality at Scale: Experience building robust evaluation platforms for agent behavior validation,

safety/guardrails, and continuous improvement.

Agile Practice for Applied AI: Proven ability to take evaluation and data flywheel work from incubation to production,

iterating quickly while maintaining scientific rigor.

Your Location:

This position is US - Remote Eligible. The role may include occasional work at an Airbnb office or attendance at offsites, as

agreed to with your manager. While the position is Remote Eligible, you must live in a state where Airbnb, Inc. has a registered

entity. Click here for the up-to-date list of excluded states. This list is continuously evolving, so please check back with us if

the state you live in is on the exclusion list. If your position is employed by another Airbnb entity, your recruiter will inform

you what states you are eligible to work from.

How We'll Take Care of You:

Our job titles may span more than one career level. The actual base pay is dependent upon many factors, such as: training,

transferable skills, work experience, business needs and market demands. The base pay range is subject to change and may be

modified in the future. This role may also be eligible for bonus, equity, benefits, and Employee Travel Credits.

Pay Range

$244,000—$305,000 USD

Role

Senior Staff Machine Learning Engineer, Data & Eval

Similar Jobs

Senior Staff Data Engineer - Data Stewardship

Airbnb

United States•Posted: Jun 11•Deadline: Aug 17

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way. The Community You Will Join: The Data Stewardship team is a group of passionate data practitioners with a diverse background in analytics, data modeling, governance, compliance, and scaled data quality. We are responsible for ensuring Airbnb is meeting its compliance obligations across our data ecosystem and ensuring data consumers are able to easily identify the best data for their needs. We support the pipelines, programs, and policy-bodies that make this possible. You’ll be part of the overall Data Infrastructure organization that is responsible for online and offline data infrastructure across the company, and the components that transition data between these environments. The Difference You Will Make * Set the North Star: you will define the multi-year vision for Data Governance and Data Quality that scales with our global business and evolving AI landscape. * Organizational Influence: Act as a primary consultant for executive leadership on data governance, ensuring that compliance and stewardship are integrated into the data product lifecycle from day one. A Typical Day * Architect Ecosystems: Lead the design of overarching data architectures that don't just solve today’s batch needs but anticipate future real-time and AI-driven requirements. * Scale Best Practices: Rather than just "ensuring quality," you will define the best practices, tooling, and culture that enable data organizations to maintain high-quality data autonomously. * Policy Stewardship: Lead cross-functional task forces (Infosec, Legal, Privacy) to navigate complex regulatory landscapes (like GDPR or AI Act) and translate them into engineering requirements. * Mentor and Multiply: Coach Senior and Staff engineers across the organization on data best practices, fostering a community of excellence. Your Expertise * Leadership Track: 12+ years of industry experience, with a proven track record of leading large-scale data initiatives across multiple departments or business units. * System Design at Scale: Demonstrated expertise in designing and evolving complex data ecosystems within complex, high-volume environments (e.g., Airbnb). * Strategic Collaboration: Experience influencing product and business strategy by leveraging data integrity as a competitive advantage. * Tech Stack Mastery: Deep expertise in the Java/Scala/Spark ecosystem (preferably with knowledge of S3 and Iceberg) with the ability to vet and introduce proven industry approaches and new technologies to the stack. Strong knowledge of relational databases and query authoring (SQL). * Change Management: Strong ability to drive cultural shifts regarding data ownership and quality across an entire engineering organization. Your Location: This position is US - Remote Eligible. The role may include occasional work at an Airbnb office or attendance at offsites, as agreed to with your manager. While the position is Remote Eligible, you must live in a state where Airbnb, Inc. has a registered entity. Click here for the up-to-date list of excluded states. This list is continuously evolving, so please check back with us if the state you live in is on the exclusion list. If your position is employed by another Airbnb entity, your recruiter will inform you what states you are eligible to work from. Our Commitment To Inclusion & Belonging: Airbnb is committed to working with the broadest talent pool possible. We believe diverse ideas foster innovation and engagement, and allow us to attract creatively-led people, and to develop the best products, services and solutions. All qualified individuals are encouraged to apply. We strive to also provide a disability inclusive application and interview process. If you are a candidate with a disability and require reasonable accommodation in order to submit an application, please contact us at: reasonableaccommodations@airbnb.com. Please include your full name, the role you’re applying for and the accommodation necessary to assist you with the recruiting process. We ask that you only reach out to us if you are a candidate whose disability prevents you from being able to complete our online application. How We'll Take Care of You: Our job titles may span more than one career level. The actual base pay is dependent upon many factors, such as: training, transferable skills, work experience, business needs and market demands. The base pay range is subject to change and may be modified in the future. This role may also be eligible for bonus, equity, benefits, and Employee Travel Credits. Pay Range $248,000—$310,000 USD

Senior Staff Product Manager, Query

Mongodb

United States•Posted: Jul 16•Deadline: Aug 17

The MongoDB Query Team is seeking a Senior Staff Product Manager to provide division-wide, product leadership for our fast, modular distributed query engine and flexible query system. As the most senior product management contributor, you will shape the multi-year strategy, product architecture, and market trajectory for the entire Query business unit. You will be the primary product authority on the most complex trade-offs, anticipating systemic risks and cutting through structural friction that blocks multiple teams and initiatives. This role requires collaboration with distinguished engineers to rigorously debate strategy and pressure-test assumptions and advise executive leadership on options that balance long-term monetization, strategy, and business outcomes. And, where relevant, owns the pricing and monetization strategy for the product line. We are looking to speak to candidates who are based in New York City for our hybrid working model. RESPONSIBILITIES * Product Vision and Roadmap: Spearhead strategic unity across multiple product areas over a multi-year horizon to drive a coherent product experience * Business Leadership: Originate and de-risk the division’s most consequential strategic bets, owning rigorous business cases and advising leadership on multi-year economic outcomes * Customer Advocacy: Engage with strategically significant customers at the senior level (e.g., advisory boards and executive briefings) to surface cross-portfolio opportunities and inform the roadmap * PM Excellence: Elevate the global standard of product management by mentoring Staff and Senior PMs and pioneering new data-driven playbooks across the organization. Create frameworks and standards for customer and market research that others use for conducting high-quality customer and market research * Cross-Functional Alignment and Execution: Partner with Directors and VPs to shape investment allocation and sequencing across the query, developer experiences, and core database portfolio * Market and Engagement: Act as a primary external face for the product line, representing MongoDB to the industry, developers, standards bodies and at major conferences REQUIREMENTS * Experience: 10+ years of professional experience, including significant leadership in product management for platform, infrastructure, or database domains * Communication: Exceptional ability to communicate complex technical issues simply and convincingly to a wide range of audiences, including executive leadership * Strategic Execution: Proven success in delivering complex cross-functional projects and the ability to write, defend, and execute on multi-year business cases * Education: B.Sc. in a technical discipline, with Computer Science preferred, or equivalent relevant experience * Domain Expertise: Deep technical fluency in database query engines, query languages (SQL, MQL, etc.), developer experiences, distributed systems, and potentially AI platform tooling or LLM orchestration NICE TO HAVE * MBA, M.Sc., or Ph.D. in relevant technical or business domains * Experience with MongoDB or other non-relational database technologies * Demonstrated success leading products targeting developer personas in fast-paced, growing environments * Familiarity with open-source and cloud-native technologies ABOUT MONGODB MongoDB is built for change, empowering our customers and our people to innovate at the speed of the market. We have redefined the data platform for the AI era, enabling builders to create, transform, and disrupt industries with software. MongoDB’s unified data platform, the most widely available, globally distributed data platform on the market, helps organizations modernize legacy workloads, embrace innovation, and unleash AI. Our cloud-native platform, MongoDB Atlas, is the only globally distributed, multi-cloud data platform and is available across AWS, Google Cloud, and Microsoft Azure. With offices worldwide and over 67,000 customers, including 75% of the Fortune 100 and AI-native startups, relying on MongoDB for their most important applications, we’re powering the next era of software. Our compass at MongoDB is our Leadership Commitment, guiding how and why we make decisions, show up for each other, and win. It’s what makes us MongoDB. To drive the personal growth and business impact of our employees, we’re committed to developing a supportive and enriching culture for everyone. From employee affinity groups, to fertility assistance and a generous parental leave policy, we value our employees’ wellbeing and want to support them along every step of their professional and personal journeys. Learn more about what it’s like to work at MongoDB, and help us make an impact on the world! MongoDB is committed to providing any necessary accommodations for individuals with disabilities within our application and interview process. To request an accommodation due to a disability, please inform your recruiter. MongoDB, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type and makes all hiring decisions without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. Req. ID: 2273467505 MongoDB’s base salary range for this role is posted below. Compensation at the time of offer is unique to each candidate and based on a variety of factors such as skill set, experience, qualifications, and work location. Salary is one part of MongoDB’s total compensation and benefits package. Other benefits for eligible employees may include: equity, participation in the employee stock purchase program, flexible paid time off, 20 weeks fully-paid gender-neutral parental leave, fertility and adoption assistance, 401(k) plan, mental health counseling, access to transgender-inclusive health insurance coverage, and health benefits offerings. Please note, the base salary range listed below and the benefits in this paragraph are only applicable to U.S.-based candidates. MongoDB’s base salary range for this role in the U.S. is: $185,000—$363,000 USD

Staff Product Manager, Security and Compliance (Public Sector)

Mongodb

United States•Posted: Jul 17•Deadline: Aug 17

MongoDB’s Security Product Management team is seeking a Staff Product Manager to own security, compliance, and public sector product strategy within Atlas for Government (A4G). In this role, you will be a key member of the security product management team, helping make data security a market differentiator that enables MongoDB to win in enterprise and regulated industries. You will lead product strategy and execution for capabilities and programs that support federal compliance requirements and broader regulated-industry needs. You will work across Engineering, Compliance, Legal, Security, and Go-to-Market teams to translate complex regulatory and customer requirements into clear product investments, roadmaps, and outcomes. This role is suited for a candidate who can orchestrate multiple interlinked product areas, own cross-team product and architectural trade-offs, and align senior stakeholders around multi-year bets. You will be expected to identify opportunities and dependencies that cut across team boundaries, bring clarity to ambiguous problem spaces, and establish reusable ways of working that help MongoDB deliver secure, compliant platform capabilities for public sector and other regulated markets. You will partner closely with senior engineering and business leaders to evaluate trade-offs, sequence investments, and bring clarity to decisions that balance customer impact, execution risk, and long-term business value. This role can be based out of of our offices or remotely in the United States. The Federal Risk and Authorization Management Program (FedRAMP) is a US government-wide program that provides a standardized approach to security assessment, authorization, and continuous monitoring for cloud products and services. Our FedRAMP program requires that anyone who is accessing customer data or metadata inside the Authorization Boundary be a US Citizen on US Soil. RESPONSIBILITIES Security and Compliance Product Strategy * Own the public sector compliance roadmap, translating requirements e.g., FedRAMP, IL5, and DoD programs into clear product priorities * Define goals and milestones for major compliance programs, including FedRAMP High, and drive accountability across teams * Lead gap assessments and scope compliance-driven engineering work Cross-Functional Program Leadership * Drive complex, multi-team programs by setting governance, success metrics, and operating cadence across teams * Partner with Compliance and Engineering on control interpretation, implementation decisions, and audit readiness * Embed security- and compliance-first workflows into product development and delivery Market Expansion and Public Sector go-to-market (GTM) * Lead product strategy for expanding Atlas for Government into new regions, provisioning targets, and regulated markets * Evaluate control plane and infrastructure options, assess engineering trade-offs, and align teams on expansion requirements * Partner with Finance, Engineering, Legal, and GTM on pricing, certification, and launch decisions for new markets Customer-Driven Product Development * Build strong feedback loops with Customer Engineering, Solutions Architects, Support, and GTM to ensure roadmap priorities reflect field needs * Translate customer escalations, support trends, and market gaps into a prioritized public sector roadmap * Serve as an internal expert on emerging security, compliance, and regulatory trends that shape product direction Stakeholder Alignment and Executive Communication * Align Engineering, Legal, Compliance, Product Marketing, and GTM around product strategy and execution * Define KPIs and success metrics for security and compliance investments * Represent MongoDB with customers and prospects as a subject matter expert on secure cloud deployments and data protection REQUIREMENTS * 10+ years of product management or equivalent experience with encryption or deep data security * Hands-on experience with federal compliance frameworks: FedRAMP, DoD IL levels, NIST 800-53, or equivalent * Experience working with security focused engineers in a diverse team * Some experience with Cloud providers such as AWS, Azure, and GCP * The ability to drive complex projects across multiple teams and deliver results * Excellent written and verbal communication; comfortable presenting to executive and field audiences alike * Ability to write, promote, and execute business cases * Comfortable with stage presence and public speaking * B.Sc. in Computer Science, or equivalent experience NICE TO HAVE * Certifications or similar evidence of professional milestone completion and continuous training * Community support and participation to advance data and cloud security such as conference or meetup panels and blog or paper authorship * MBA, M.Sc. or Ph.D. in relevant domains ABOUT MONGODB MongoDB is built for change, empowering our customers and our people to innovate at the speed of the market. We have redefined the data platform for the AI era, enabling builders to create, transform, and disrupt industries with software. MongoDB’s unified data platform, the most widely available, globally distributed data platform on the market, helps organizations modernize legacy workloads, embrace innovation, and unleash AI. Our cloud-native platform, MongoDB Atlas, is the only globally distributed, multi-cloud data platform and is available across AWS, Google Cloud, and Microsoft Azure. With offices worldwide and over 67,000 customers, including 75% of the Fortune 100 and AI-native startups, relying on MongoDB for their most important applications, we’re powering the next era of software. Our compass at MongoDB is our Leadership Commitment, guiding how and why we make decisions, show up for each other, and win. It’s what makes us MongoDB. To drive the personal growth and business impact of our employees, we’re committed to developing a supportive and enriching culture for everyone. From employee affinity groups, to fertility assistance and a generous parental leave policy, we value our employees’ wellbeing and want to support them along every step of their professional and personal journeys. Learn more about what it’s like to work at MongoDB, and help us make an impact on the world! MongoDB is committed to providing any necessary accommodations for individuals with disabilities within our application and interview process. To request an accommodation due to a disability, please inform your recruiter. MongoDB, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type and makes all hiring decisions without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. Req ID: 2273490764 MongoDB’s base salary range for this role is posted below. Compensation at the time of offer is unique to each candidate and based on a variety of factors such as skill set, experience, qualifications, and work location. Salary is one part of MongoDB’s total compensation and benefits package. Other benefits for eligible employees may include: equity, participation in the employee stock purchase program, flexible paid time off, 20 weeks fully-paid gender-neutral parental leave, fertility and adoption assistance, 401(k) plan, mental health counseling, access to transgender-inclusive health insurance coverage, and health benefits offerings. Please note, the base salary range listed below and the benefits in this paragraph are only applicable to U.S.-based candidates. MongoDB’s base salary range for this role in the U.S. is: $151,000—$297,000 USD