ABOUT FATHOM

We created Fathom to eliminate the needless overhead of meetings. Our AI assistant captures, summarizes, and organizes the key

moments of your calls, so you and your team can stay fully present without sacrificing context or clarity. From instant,

searchable call summaries to seamless CRM updates and team-wide sharing, Fathom transforms meetings from a source of friction into

a place for alignment and momentum.

We’re a small company that creates magical experiences through the hard work of focused builders. We try to live our values - Care

Deeply, Seek Leverage, Share Ownership, Sustain Urgency, and Be Tenacious - in everything we do, every day.

We started Fathom to rid us all of the tyranny of note-taking, and people seem to really love what we've built so far:

🥇 #1 Most Used App of the Year on HubSpot for 2025

🔥 #1 Rated on G2 with 4,500+ reviews and a perfect 5/5 rating

🥇 #1 Product of the Day and #2 AI Product of the Year

🚀 Most installed AI meeting assistant on both the Zoom and HubSpot marketplaces

📈 We’re hitting revenue and usage records every week

We think you’ll be pretty excited about Fathom too if you give it a try. Sign up today (it’s free)!

ROLE OVERVIEW

We're hiring a Model Performance Engineer to own the speed, cost, and reliability of our model inference stack, and to build the

fine-tuning infrastructure that makes the rest of the AI team faster.

This is not a research role. You'll be optimizing real systems serving millions of meetings — choosing between quantization

trade-offs, debugging speculative decoding, or figuring out why one GPU family's tail latency explodes at high concurrency while

another stays stable.

You'll own two things:

1. Inference performance. You'll make our models faster and cheaper — speculative decoding, quantization, serving configuration,

GPU selection, batching strategies, cold start mitigation, adapter swapping. Our traffic is extremely spiky (meetings end in

30-minute blocks), so you need to think about throughput curves. Our team greatly values offering a fast product.

2. Fine-tuning pipelines. The AI team constantly fine-tunes models for new tasks — distilling large teacher models for

classification, training adapters for domain-specific behavior, DPO for preference tuning. Right now each project reinvents the

training loop. You'll build repeatable infrastructure so an AI Engineer can go more quickly from dataset to deployed model.

HOW YOU’LL HELP US WIN

Benchmark FP8 quantization across GPU families, find that FP8 KV cache causes catastrophic repetition loops, identify static

quantization as 6% faster than dynamic on certain hardware, and ship a production config that gets 1.3x speedup with <1%

quality degradation

Evaluate serving frameworks (vLLM vs SGLang) with speculative decoding — discover that ngram speculation degrades ASR quality

while EAGLE3 draft models don't, and that torch.compile makes certain GPUs 7% slower

Build a fine-tuning pipeline that takes a JSONL dataset and produces an optimized tune ready for serving, so a teammate can

train a small classifier in an afternoon instead of a week

Optimize GPU spend — know which GPU families are best for batch workloads (stable under high concurrency) vs latency-sensitive

paths (40% faster, but tail latency blows up under load), and when a 30% cost premium isn't worth it

Debug production inference issues — trace a quality regression to a serving framework upgrade that changed the default

attention backend, or find that audio format handling in the multimodal pipeline silently drops segments

REQUIREMENTS

Hard Skills:

Deep experience with LLM serving frameworks (vLLM, SGLang, TensorRT-LLM, or similar) — not just deploying them, but tuning

them: attention backends, scheduling strategies, CUDA graph warmup, prefix caching

Hands-on quantization experience — you've gone beyond "apply FP8 and hope." You understand weight vs activation quantization,

per-channel vs per-tensor scaling, and when dynamic quantization introduces more overhead than it saves

Production fine-tuning experience — LoRA/QLoRA SFT, familiarity with training frameworks (ms-swift, Axolotl, torchtune, or

similar), understanding of data formatting, learning rate schedules, and how to diagnose training failures

Strong Python. You'll write serving infrastructure, benchmarking harnesses, and training pipelines — not notebooks

Comfort with GPU profiling and performance analysis. You should be able to look at a benchmark result and know whether the

bottleneck is compute, memory bandwidth, or scheduling overhead

Strong signal:

Cost modeling for GPU infrastructure — you've had to choose between GPU types and justify the tradeoff

Experience with multimodal models (audio/vision encoders + LLM decoders)

Experience with Modal, Ray Serve, or similar serverless GPU platforms

Understanding of audio processing (codecs, chunking, sample rates)

Experience building internal tooling that other engineers use — this role succeeds when the rest of the team ships faster

Not required:

ML research background or publications

Prompt engineering expertise (we have a team for that)

Frontend or full-stack experience

Masters/PhD (though it's fine if you have one)

WHAT'S IN IT FOR YOU

The opportunity to shape the foundational software services of a growing company

A role that balances innovation and incremental improvement

A dynamic and collaborative engineering team

Competitive compensation and benefits

A supportive environment that encourages innovation and personal growth

WHY YOU SHOULD JOIN US

Opportunity for impact. We’re established enough to ship instead of fighting fires and early enough that your work will have a

real impact.

Startup experience. You’ll work closely with our CEO, a 2X Founder/CEO with a background in computer science and product

design.

We embrace being fully remote. We schedule meetings sparingly and instead heavily use async comms (Slack, Notion, Loom)

ABOUT THE INTERVIEW

You’ll meet the entire team. We think it’s important that you get to meet everyone you’ll be working with.

No bullshit. Ask us anything you like. We’ve never understood why companies pretend they’re something that they’re not in the

hiring process - you’re going to find out eventually so we’d rather you know who we are up front so we can both make sure this

is a good fit for all involved.

Quick turnaround time. We know you have lots of options so we move fast usually in less than a week from start to finish.

HOW TO APPLY

Include a brief write-up or demo of inference optimization or model serving work you've done. We care about the reasoning behind

your decisions — why you chose a specific quantization strategy, how you diagnosed a performance regression, what tradeoffs you

navigated. A GitHub repo, blog post, or even a few paragraphs in your cover letter works.

Role

AI Engineer - Model Performance

Locations

Remote

Published

May 5

Deadline

August 16

Tags for this job

Python AI Go HubSpot

Similar Jobs

Head of ML Demand Generation

Neon

Remote•Posted: Feb 18•Deadline: Aug 16

About Neon Many large companies make billions each year by monetizing Americans’ personal data. At Neon, we’re finally cutting consumers in on the deal. Neon allows our users to make hundreds (or even thousands) of dollars per year by securely selling their anonymized data. We recently raised $25 million dollars from Lightspeed, Upper90, Upfront Ventures, and other cool investors. About the role We have a rapidly growing proprietary dataset generated by our 500,000+ users, and the AI industry is starving for exactly this kind of high-quality, human-generated data. Your job is to go sell it to them. As the Head of ML demand generation, you are the tip of the spear for our revenue engine. You are an adept Go-To-Market leader capable of engaging in both technical and business conversations at the highest levels of an organization, pitching directly to CTOs, CFOs, and Lead ML Researchers. You will own the full customer journey from initial awareness and licensing to customer success and follow-on expansion. Your analytical nature means you bias toward winning business by proving exactly how a client's model performance and business objectives benefit from partnering with Neon. You will also lead cross-functional efforts, acting as the bridge between our customers and our product and engineering teams to align what we build with what you sell. You have… * Authorization to work in the US. * Elite enterprise execution. You have a proven track record handling yearly quotas of $2M+ and closing complex, annual contracts in the $250k to $3M+ range * Deep AI fluency & technical background. You possess a deep understanding of the AI landscape. You can comfortably talk shop about pre-training, post-training, fine-tuning (SFT), APIs, and model evaluations. Previous experience as a sales engineer or a technical educational background is highly valued * The "Hunter" DNA. You are relentless. You know how to independently identify high-probability customers and high-value verticals, map out complex organizations, and find the actual economic buyer * Complex deal navigation. You are completely comfortable driving deals through the grueling legal, privacy, and procurement reviews that come with selling high-volume datasets to massive tech companies * Cross-functional leadership. You are ready to build the foundation for revenue and customer success from the ground up, with the ability to eventually manage dedicated resources (AEs, SDRs, CS) to deliver on the GTM plan you develop Bonus points * A massive AI rolodex. You already have deep relationships and trust with technical buyers at top frontier AI labs (OpenAI, Anthropic, Google, Meta, etc.) or major enterprise AI teams * Data licensing expertise. Deep familiarity with modern AI data licensing structures * Startup agility. You thrive in highly ambiguous, unstructured environments and are always looking for opportunities to step outside your role to level up the business

AIGoRust

Data Engineering Lead

Moniepoint

Remote•Posted: Jun 29•Deadline: Aug 16

Who we are Moniepoint Inc. is Africa’s all-in-one financial platform, helping 20 million businesses and individuals access seamless payments, banking, credit, cross-border, and business management tools each month. As Nigeria’s largest merchant acquirer, we power most of the country’s point-of-sale (POS) transactions. Through our subsidiaries, Moniepoint Inc. processes over $250 billion in digital payment transaction value annually. About the role : At Moniepoint, data is at the core of everything we do. We are a customer-centric company, and your work will enable our teams to make informed, data-driven decisions that directly impact the success of our business. As a Data Engineering Lead, you will help craft robust, scalable systems that support our business intelligence and data-driven operations. We value leaders who are not only technically adept but also excited about mentoring others and pushing the boundaries of what’s possible with data. Curious about what makes Moniepoint an incredible place to work? Check out posts on how we cultivate a culture of innovation, teamwork, and growth. What you will get to do * Build and maintain robust data pipelines processing large volumes of data * Analysis of large data sets using tools such as Python & SQL * Update and optimize our data platform for speed, scalability and cost * Coordinate with different functional teams to understand and meet their data needs * Develop processes and tools to monitor and analyze model performance and data accuracy * Solve general data-related problems * Setting up new pipelines for the full stream/enrichment/curation process * Upkeep of source code locations * Investigating and utilising ML & AI to improve the cloud offering * Development of junior staff members To succeed in this role, you should have * Proven experience as a Data Engineer (5-7+ years, can be made up for with accomplishments) * Strong Leadership experience * Strong problem solving skills * Advanced proficiency with SQL * Proficiency with Python * Experience with cloud platforms (e.g. Google Cloud, AWS, Azure) * Experience using version control tools such as git * Excellent written and verbal communication skills * A drive to learn and master new technologies and techniques * A bachelor’s degree in Computer Science, Statistics, Mathematics, Engineering, or any other related field Experience with the following would be a plus * Data governance * Building and deploying machine learning models * Terraform or other infrastructure as code tools What we can offer you * Culture - We put our people first and prioritize the well-being of every team member. We have built a company where all opinions carry weight and where all voices are heard. We value and respect each other and always look out for one another. Above all, we are human. * Learning - We have a learning and development-focused environment with an emphasis on knowledge sharing, training, and regular internal technical talks. * Compensation - You’ll receive an attractive salary, pension, health insurance, annual bonus, plus other benefits. What to expect in the hiring process * A preliminary phone call with the recruiter * A take-home assessment * A technical interview with a Lead in our Engineering Team * A behavioural and technical interview with a member of the Executive team. Moniepoint is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees and candidates.

Staff Backend Engineer (Ruby on Rails/AI), Verify

Gitlab

Remote•Posted: Jun 11•Deadline: Aug 16

GitLab is the intelligent orchestration platform for DevSecOps. GitLab enables organizations to increase developer productivity, improve operational efficiency, reduce security and compliance risk, and accelerate digital transformation. More than 50 million registered users and more than 50% of the Fortune 100* trust GitLab to ship better, more secure software faster. The same principles built into our products are reflected in how our team works: we embrace AI as a core productivity multiplier, with all team members expected to incorporate AI into their daily workflows to drive efficiency, innovation, and impact. GitLab is where careers accelerate, innovation flourishes, and every voice is valued. Our high-performance culture is driven by our values and continuous knowledge exchange, enabling our team members to reach their full potential while collaborating with industry leaders to solve complex problems. Co-create the future with us as we build technology that transforms how the world develops software. *Fortune 500® is a registered trademark of Fortune Media IP Limited, used under license. Claim based on GitLab data. Fortune 100 refers to the top 20% ranked companies in the 2025 Fortune 500 list, published in June 2025. Fortune and Fortune Media IP Limited are not affiliated with, and do not endorse products or services of GitLab. AN OVERVIEW OF THIS ROLE As a Staff Backend Engineer (AI) in the Verify stage at GitLab, you'll help shape and scale the core infrastructure behind GitLab CI. You'll play a central role in how we integrate AI into CI/CD workflows. Your work will impact performance, reliability, and usability for people running millions of CI jobs, from small teams to the largest enterprises. AI is a top priority in the year ahead. In this role, you'll go beyond using AI tools and help define how we design, build, and iterate on AI-assisted and agentic CI experiences. You'll set standards for what good looks like across our AI agent portfolio, including how we measure success, how we instrument behavior in production, and how we account for large language model limitations. You'll also help responsibly integrate GitLab's Duo Agent Platform into CI workflows at scale, on a foundation that's fast, reliable, secure, and observable. We have ambitious goals for Agentic CI in FY27. As a Staff Engineer, you will: * Partner with Engineering, Product, and UX leadership to pressure-test our priorities: where we can move faster, where we're missing data, and where there's whitespace to innovate. Part of this includes learning and growing with the Engineering team you will collaborate closely with. * Define what success looks like across our agent portfolio and make sure we're tracking against it — not just shipping, but learning. * Bring a sharp eye to the competitive landscape, helping us understand what it takes to keep GitLab CI best-in-class in an increasingly agentic world. * Examples of Agentic CI work we have planned for the upcoming year: * AI Pipeline Builder, the foundational CI agent that auto-creates pipelines for new projects and serves as the launchpad for onboarding new CI users. * Automate the Fix a Failing Pipeline flow at scale – from dogfooding on internal GitLab projects through to safe, controlled rollout for customers, solving real infrastructure and scalability challenges. * Build the instrumentation and observability layer that makes agentic CI trustworthy — trigger volume dashboards, retry rates, cost safeguards — so we can measure what's working, catch what isn't, and iterate with confidence. * Harden the CI pipeline execution infrastructure that these agents depend on: database access patterns, background processing, and job orchestration built to handle the additional load that AI-driven automation introduces at enterprise scale. WHAT YOU’LL DO * Shape and scale GitLab CI backend infrastructure to improve performance, reliability, and usability for users running jobs at high volume. * Design and implement AI-powered features for Agentic CI, including agents, agentic flows, and LLM-backed tooling that integrates with GitLab's Duo Agent Platform. * Define what success looks like for AI in CI before you build, including baselines, measurable outcomes, and clear signals that help the team learn and iterate. * Build the instrumentation and observability needed to make AI-assisted CI trustworthy in production, including feature behavior metrics, dashboards, and safeguards. * Own and drive measurable performance improvements across CI systems (for example, database access patterns, background processing, and job orchestration) by forming hypotheses, running experiments, and validating results with data. * Write secure, well-tested, maintainable Ruby on Rails code in a large monolith, improving existing features while reducing technical debt and operational risk. * Lead cross-functional technical work with Product, UX, and Infrastructure, influencing architecture and execution across the Verify stage. * Share standards, patterns, and learnings with other engineers, raising the bar for responsible AI integration and evidence-driven engineering across CI. WHAT YOU’LL BRING * Advanced proficiency with Ruby and Ruby on Rails, with experience building and maintaining reliable backend services in a large codebase. * Strong PostgreSQL skills, including data modeling, query tuning, and scaling large tables through proactive performance investigation and remediation. * Hands-on experience building, running, and debugging high-traffic production systems, ideally in CI, workflow orchestration, or adjacent infrastructure-heavy domains. * Practical experience designing and shipping AI-powered backend features and integrations, including sound judgment about large language model limitations and responsible use in production. * A data-driven approach to engineering: defining hypotheses, establishing baseline metrics, instrumenting changes, and measuring outcomes against clear success criteria. * Familiarity with observability patterns and tools (metrics, logging, tracing) to diagnose issues, improve reliability, and guide iteration. * Strong backend architecture and delivery practices, including secure design, well-tested code, and strategies for safe rollouts and zero-downtime changes. * Clear written and verbal communication skills, including writing technical proposals and documentation, and collaborating effectively in a remote, asynchronous, cross-functional environment. ABOUT THE TEAM The Verify stage focuses on collaboration, iteration, and helping GitLab users run fast, reliable, and scalable Continuous Integration (CI) pipelines for projects of all sizes, from small teams to large enterprises. For more on how we work, see Team Handbook Page and Related Initiative. Remote-Global HOW GITLAB SUPPORTS FULL-TIME EMPLOYEES * Benefits to support your health, finances, and well-being * Flexible Paid Time Off * Team Member Resource Groups * Equity Compensation & Employee Stock Purchase Plan * Growth and Development Fund * Parental Leave Please note that we welcome interest from candidates with varying levels of experience; many successful candidates do not meet every single requirement. Additionally, studies have shown that people from underrepresented groups are less likely to apply to a job unless they meet every single qualification. If you're excited about this role, please apply and allow our recruiters to assess your application. ---------------------------------------------------------------------------------------------------------------------------------- Country Hiring Guidelines: GitLab hires new team members in countries around the world. All of our roles are remote, however some roles may carry specific location-based eligibility requirements. Our Talent Acquisition team can help answer any questions about location after starting the recruiting process. Privacy Policy: Please review our Recruitment Privacy Policy. Your privacy is important to us. GitLab is proud to be an equal opportunity workplace and is an affirmative action employer. GitLab’s policies and practices relating to recruitment, employment, career development and advancement, promotion, and retirement are based solely on merit, regardless of race, color, religion, ancestry, sex (including pregnancy, lactation, sexual orientation, gender identity, or gender expression), national origin, age, citizenship, marital status, mental or physical disability, genetic information (including family medical history), discharge status from the military, protected veteran status (which includes disabled veterans, recently separated veterans, active duty wartime or campaign badge veterans, and Armed Forces service medal veterans), or any other basis protected by law. GitLab will not tolerate discrimination or harassment based on any of these characteristics. See also GitLab’s EEO Policy and EEO is the Law. If you have a disability or special need that requires accommodation, please let us know during the recruiting process.