Senior Observability Infrastructure Engineer

Okta

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. * Position Overview We are seeking a highly technical Senior Site Reliability Engineer (P3) to help build, run, and scale Okta’s enterprise-grade multi-cloud observability ecosystem. In this role, you will be a core engine driving our full-stack telemetry infrastructure—ensuring that massive streams of Metrics, Logs, Traces, and Alerts are processed efficiently, securely, and cost-effectively. As a Senior SRE, you will treat Monitoring as Code (MaC). You will utilize automation frameworks like Terraform and write robust code (Go/Python) to build self-healing pipelines, optimize backend telemetry engines (Splunk and Grafana/Mimir/Loki), and eliminate manual operations. About Team: Workforce Identity Cloud Okta Workforce Identity Cloud (WIC) provides easy, secure access for your workforce so you can focus on other strategic priorities—like reducing costs, and doing more for your customers. If you like to be challenged and have a passion for solving large-scale automation, testing, and tuning problems, we would love to hear from you. The ideal candidate is someone who exemplifies the ethics of, “If you have to do something more than once, automate it” and who can rapidly self-educate on new concepts and tools. Key Responsibilities * Full-Stack Telemetry Operations: Own and optimize the end-to-end collection, processing, and visualization pipelines for Metrics, Logs, Traces, and Alerts across highly distributed multi-cloud (AWS/GCP) environments. * Splunk & Grafana Optimization: Act as a hands-on expert in optimizing log pipelines. Drive indexer performance, tune search efficiency (SPL), and clean up heavy dashboard queries to reduce latency and infrastructure footprint (FinOps). * Monitoring as Code (MaC): Standardize, deploy, and maintain core observability tools, agent relays, and collectors natively using Terraform and automated CI/CD pipelines. * Distributed Tracing & Metrics: Implement and scale OpenTelemetry (OTel) standards, Prometheus/Mimir, and tracing frameworks to map end-to-end request flows across core microservices (such as our Project Harmony initiative). * Alert & Dashboard Governance: Implement smart, programmatic alerting guardrails to combat alert fatigue. Deflate noise by building intelligent, actionable alert pathways that route directly to auto-remediation workflows. * Operational Drive: Help lead the execution against our operational backlog, eliminating systemic technical debt through automation and structural engineering changes. * On-Call & Incident Co-Pilot: Participate in on-call rotations, providing tier-3 technical escalation support. Run technical post-incident reviews to convert major outages into programmatic observability checks. Required Skills & Experience (The Essentials) * Experience: 5+ years of dedicated experience in an SRE, DevOps, or Platform Engineering role managing highly resilient, large-scale distributed systems. * Log Analytics Mastery (Splunk): Deep, practical experience with Splunk administration, search optimization, cluster maintenance, and writing highly efficient SPL queries at scale. * Full-Stack Tooling: Hands-on proficiency with major observability tooling suites, specifically Grafana, Prometheus, Loki/Mimir, Cortex, or equivalent cloud-native stacks. * Telemetry Standards: Practical experience instrumenting applications and infrastructure using OpenTelemetry (OTel), Prometheus metrics, or Jaeger/Tempo distributed tracing. * Strong Programming Skills: Highly proficient in Go (Golang) or Python for building internal automation, custom exporters, and engineering custom SRE tooling. * Infrastructure as Code: Solid experience writing, modularizing, and executing production-grade Terraform configurations. * Cloud & Containers: Deep understanding of Linux internals, core networking protocols (TCP/IP, DNS, TLS), and container orchestration platforms like Amazon EKS / Kubernetes. Bonus Skills (The "Nice-to-Haves") * AI & Agentic SRE: Experience or interest in building AI/LLM-driven troubleshooting assistants, automated alert triaging, or smart pattern-matching tools. * Multi-Cloud Networking: Experience bridging telemetry across hybrid cloud footprints (AWS to GCP). * Security & Compliance: Familiarity with logging compliance standards, such as Federal STIGs or FIPS-compliant data handling.   #LI-Hybrid P24819_3370625 The Okta Experience * Supporting Your Well-Being  * Driving Social Impact  * Developing Talent and Fostering Connection + Community We are intentional about connection. Our global community, spanning over 20 offices worldwide, is united by a drive to innovate. Your journey begins with an immersive, in-person onboarding experience designed to accelerate your impact and connect you to our mission and team from day one. Okta is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, marital status, age, physical or mental disability, or status as a protected veteran. We also consider for employment qualified applicants with arrest and convictions records, consistent with applicable laws. If reasonable accommodation is needed to complete any part of the job application, interview process, or onboarding please use this Form to request an accommodation. Notice for New York City Applicants & Employees: Okta may use Automated Employment Decision Tools (AEDT), as defined by New York City Local Law 144, that use artificial intelligence, machine learning, or other automated processes to assist in our recruitment and hiring process. In accordance with NYC Local Law 144, if you are an applicant or employee residing in New York City, please click here to view our full NYC AEDT Notice.

Okta

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. The Auth0 Platform Observability team owns the observability tooling that monitors the Auth0 Platform, and we are looking for an Observability Engineer to help ensure that our Product and Platform Engineers can monitor and observe our platform while continuing to rapidly ship software that our customers love. Our engineers maintain and automate observability tooling for our entire platform, including metrics, logs, and traces. We are looking for engineers passionate about monitoring, observing, measuring uptime and availability, and ensuring platform stability. If you have experience within the Site Reliability Engineering (SRE) field or working as a Development Operations (DevOps) engineer, and you have a passion for Observability tooling, this position will allow you to further your learning and development in these areas. As a Senior Engineer on this team, you will act as a core technical leader. You will work cross-functionally to help integrate services with our instrumentation libraries, support product teams, and actively investigate incidents to identify our observability gaps. RESPONSIBILITIES: * Proven ability to champion observability best practices, acting as an educator who can effectively correct anti-patterns and teach other engineering teams how to build robust, standardized instrumentation. * Be an expert in running services in production environments * Contribute to the process of designing services for high growth and high availability. * Provision, configure, and monitor cloud-native infrastructure and services * Design, build, and maintain scalable observability infrastructure using tools like Terraform. * Troubleshoot performance issues and operational issues. * Automating operational tasks and improving scripts. * Assisting with and providing feedback for performance testing and automation * Actively participate in major incident response to diagnose root causes and identify critical gaps in our current telemetry tooling. * Act as a technical leader, driving cross-team initiatives to improve instrumentation and observability standards across the broader engineering organization. QUALIFICATIONS: * 5+ years of platform engineering, SRE, or DevOps experience * Experience with cloud infrastructure like AWS, Google Cloud, or Azure * Expertise in the Datadog ecosystem (Metrics, Logs, Traces, and Error Tracking), including establishing alerting standards, implementing tagging taxonomies, and managing Datadog configurations via Terraform. * Strong coding skills in Node.js or Golang * Experience with containerization and orchestration tools (e.g., Docker, Kubernetes). * A data-driven approach to debugging complex, cross-service performance bottlenecks. * Deep understanding of microservice architecture and best practices. * Experience in coaching and mentoring more junior engineers. * Proven ability to lead cross-functional technical initiatives and collaborate seamlessly with multiple engineering teams. * Hands-on experience with OpenTelemetry (OTel), Vector, or similar frameworks for instrumenting applications.   P-1074 #LI-Hybrid Below is the annual base salary range for candidates located in California (excluding San Francisco Bay Area), Colorado, Illinois, New York and Washington. Your actual base salary will depend on factors such as your skills, qualifications, experience, and work location. In addition, Okta offers equity (where applicable), bonus, and benefits, including health, dental and vision insurance, 401(k), flexible spending account, and paid leave (including PTO and parental leave) in accordance with our applicable plans and policies. To learn more about our Total Rewards program please visit: https://rewards.okta.com/us.    The annual base salary range for this position for candidates located in California (excluding San Francisco Bay Area), Colorado, Illinois, New York, and Washington is between: $147,000—$202,000 USD The Okta Experience * Supporting Your Well-Being  * Driving Social Impact  * Developing Talent and Fostering Connection + Community We are intentional about connection. Our global community, spanning over 20 offices worldwide, is united by a drive to innovate. Your journey begins with an immersive, in-person onboarding experience designed to accelerate your impact and connect you to our mission and team from day one. Okta is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, marital status, age, physical or mental disability, or status as a protected veteran. We also consider for employment qualified applicants with arrest and convictions records, consistent with applicable laws. If reasonable accommodation is needed to complete any part of the job application, interview process, or onboarding please use this Form to request an accommodation. Notice for New York City Applicants & Employees: Okta may use Automated Employment Decision Tools (AEDT), as defined by New York City Local Law 144, that use artificial intelligence, machine learning, or other automated processes to assist in our recruitment and hiring process. In accordance with NYC Local Law 144, if you are an applicant or employee residing in New York City, please click here to view our full NYC AEDT Notice.

Workday Sweden Aktiebolag

Sana is an AI lab building superintelligence for work. We believe organizations can accomplish their missions faster when teams can effortlessly access knowledge, automate repetitive work, and learn anything with the help of agentic AI. As part of Workday, we are committed to building AI that augments people - not replaces them. We bring this mission to life through two products. Sana Agents provide a seamless way to access all your company’s apps, knowledge, and data, enabling AI agents to do real work so teams can process and act on information at unprecedented scale. Sana Learn is an AI-powered learning hub that combines the simplicity of a modern learning platform with intelligent features like an AI tutor, automated content generation, and interactive apps, making knowledge not just accessible but actionable. We’re a talent-dense, product-obsessed team of engineers and designers from companies like Google, Spotify, Apple, and Databricks, united by deep technical excellence and rapid iteration. Our tools already help over a million people learn and work better across hundreds of leading enterprises - and we’re just getting started. About the Role As an Infrastructure Engineer, you will support our engineering teams by building and maintaining the technical foundation that enables our products to scale. You'll work on cloud infrastructure, deployment systems, and developer tooling, serving as a technical partner to other engineering teams while focusing on reliability and performance. In this role, you will Be the backbone of our ambitious goals, ensuring our infrastructure is robust and scalable. Support feature development teams with infrastructure decisions and deployments. Act as Site Reliability Engineer (SRE) and continuously enhance our Developer Experience (DX). Design and implement scalable cloud infrastructure solutions. About You Basic Qualifications: 3+ years of experience in infrastructure, platform, or site reliability engineering. 3+ years of hands-on experience with GCP or equivalent cloud platforms, including managing production environments. 3+ years of experience with Kubernetes, including deployment, scaling, and operations. 3+ years of experience with infrastructure-as-code tooling, such as Terraform. 3+ years of experience designing and operating highly available, scalable, and reliable backend systems. 2+ years of experience coding backend applications, with a strong track record of writing reliable, maintainable services. Other Qualifications: Experience acting as an SRE, with a strong understanding of site reliability principles in production environments. Experience improving developer experience through internal tooling, CI/CD pipelines, and deployment automation. Familiarity with TypeScript in a backend context, enabling effective collaboration with product engineering teams. Experience with Postgres and Redis in production, including performance tuning and reliability practices. Experience supporting feature development teams with infrastructure decisions, reviews, and hands-on deployment support. Strong observability skills, including logging, metrics, alerting, and incident response. Ability to navigate ambiguity and drive infrastructure projects from concept to production. Strong communication skills, with the ability to partner effectively across engineering and product teams.