Staff Software Engineer, Big Data, tvScientific

Staff Software Engineer, Big Data

Cognitiv

Are you ready to revolutionize the advertising industry?    At Cognitiv, we are not just another AdTech company—we are industry trailblazers redefining media buying with our Deep Learning Advertising Platform. Since 2015, we have harnessed the power of cutting-edge deep learning technology and data science to transform how brands connect with their customers. Our mission? To bring intelligence to advertising and deliver unparalleled precision, relevance, and impact at scale.    With our innovative platform, advertisers enjoy unprecedented flexibility—whether it is activating Dynamic Deals through their preferred DSP, leveraging our managed service DSP, or utilizing our industry-first ContextGPT product. As a part of Cognitiv, you will be at the forefront of AI-driven advertising solutions, driving change and achieving remarkable growth in a rapidly evolving industry.   Now, we’re growing! The Role As a Staff Software Engineer, Big Data, you will define and drive the long-term technical direction of the data platform that powers Cognitiv's AI-driven advertising products. You will lead the architecture and evolution of critical data systems spanning ingestion, warehousing, machine learning feature generation, identity resolution, and activation at massive scale. As a senior technical leader, you will identify systemic challenges, align teams around durable solutions, and drive complex initiatives that span engineering, science, machine learning, and product organizations. Your work will shape the scalability, reliability, and strategic capabilities of Cognitiv's data platform for years to come. Location: Our Vancouver office will open on September 1 in Mount Pleasant. The Founding Engineering team will work remotely through the summer. Starting September 1, the role will transition to a hybrid model: in-office Monday-Wednesday, with remote flexibility on Thursday and Friday. Your Impact In this role, success is measured by the durability of your technical solutions, the health of the data platform, and your influence across the engineering organization. You will: * Lead Platform Architecture: Define and evolve the architecture of Cognitiv's large-scale data platform, ensuring ingestion, storage, processing, and serving systems can scale to support future business growth, AI initiatives, and increasing data volumes. * Drive Multi-Team Data Initiatives: Lead complex, cross-functional programs spanning Data Engineering, Machine Learning, Science, and Product teams. Align stakeholders, reduce execution risk, and deliver outcomes that improve platform capabilities across the organization. * Shape Long-Term Technical Direction: Evaluate architectural tradeoffs with a 3–5 year horizon, establish technical standards and paved-road solutions, and drive modernization efforts that improve scalability, reliability, developer productivity, and operational efficiency. * Elevate Reliability and Operational Excellence: Lead architecture reviews, failure-mode analysis, and incident retrospectives. Establish mechanisms to proactively identify, prioritize, and reduce technical risk across critical data systems. * Own Cost and Efficiency at Scale: Treat cost as a first-class architectural dimension for a multi-petabyte data platform. Lead cost vs. performance tradeoff decisions across storage tiering, compute, file layout, and data movement, and build the visibility and guardrails that let teams reason about unit economics when they design systems. * Advance Data and ML Platform Capabilities: Guide the evolution of foundational systems including the identity graph, ML feature platform, feature projection infrastructure, warehouse architecture, and large-scale distributed processing frameworks. * Partner on Strategic Priorities: Collaborate with Engineering, Product, Science, and Machine Learning leadership to align platform investments with business objectives, balancing technical debt, platform health, and product velocity. * Grow Engineering Talent: Mentor senior engineers and emerging technical leaders. Raise engineering standards through design reviews, architectural guidance, technical artifacts, and thoughtful coaching. Tech Stack: Java/Python, Spark, Flink, Kafka, Iceberg, ClickHouse, and AWS services (EMR, EKS, S3) Who You Are * Staff-Level Technical Leader. You bring 10+ years of experience building and evolving large-scale distributed systems, data platforms, or backend infrastructure, with a track record of influencing technical direction beyond a single team. * Expert in Big Data Systems. You have deep experience designing and operating large-scale data processing platforms using technologies such as Spark, Kafka, Flink, Iceberg, ClickHouse, or similar distributed systems. * Architectural Thinker. You have led architectural decisions for complex systems and can balance scalability, performance, reliability, maintainability, and business needs when making technical tradeoffs. * Cross-Team Influencer. You have successfully driven complex initiatives across multiple teams and functions, aligning stakeholders around durable technical solutions without direct authority. * Cloud-Native Systems Builder. You have extensive experience building and operating data-intensive systems in cloud environments such as AWS, Azure, or GCP. * Strategic Problem Solver. You identify systemic technical challenges, proactively create solutions, and drive execution with minimal guidance. * Mentor and Multiplier. You elevate the effectiveness of engineers around you through mentorship, technical leadership, and establishing engineering best practices. * Exceptional Communicator. You effectively communicate technical strategy, architectural decisions, and tradeoffs to engineering leaders, product stakeholders, and executive audiences. Bonus Points If You Have * Experience designing, scaling, and maintaining petabyte-scale data platforms * Expertise in distributed systems architecture and large-scale data processing * Experience building ML infrastructure, feature stores, or feature engineering platforms * Experience driving platform modernization or data architecture transformations * Experience operating in high-growth startup or scale-up environments * Deep familiarity with Flink, ClickHouse, Kafka, Iceberg, or similar modern data technologies What We Offer At Cognitiv, we believe great work happens when people feel supported, challenged, and empowered to grow. Our Vancouver team receives a competitive total rewards package that includes extended health benefits, paid parental leave, unlimited PTO, Work-From-Anywhere August, equity, RRSP matching, wellness and cell phone stipends, daily team lunches, and a hybrid work environment. We also invest deeply in career development through clear advancement paths and comprehensive onboarding via Cognitiv University — plus additional perks designed to support both your professional and personal wellbeing. Salary: $170,000 - $240,000 CAD Base Salary + Equity WHAT WE OFFER Compensation is based on experience, skills, and other factors. Base salary is just one part of your total rewards at Cognitiv—you’ll also receive equity and a comprehensive benefits package.   Highlights include: * Medical, Dental and Vision plan for US employees & Extended Health Benefits for Canadian employees * 12 weeks paid parental leave + 4 weeks WFH * Unlimited PTO + Work-From-Anywhere August * Career development with clear advancement paths * Equity for all employees * Hybrid work model & daily team lunch * Health & wellness stipend + cell phone reimbursement * 401(k) & RRSP with employer match * Parking (CA, WA, Vancouver offices) & pre-tax commuter benefits * Employee Assistance Program * Comprehensive onboarding (Cognitiv University) * …and more! WHAT YOU’LL FIND AT COGNITIV * Festiv – We make work fun with cross-team games, events, and creative team bonding. * Responsiv – You’ll be close to clients and leadership, influencing real outcomes. * Inclusiv – Diversity and individuality are celebrated across all levels. * Inventiv – We reward curiosity and embrace bold ideas. * Transformativ – We support your growth with training, mentorship, and flexibility. * Collaborativ – We operate across coasts, connected by purpose and teamwork. Cognitiv is proud to be an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive workplace for all.   Note on AI Use: Cognitiv may use AI technology to assist with certain administrative aspects of the hiring process, such as note-taking, interview documentation, and reporting. However, every resume and application is reviewed directly by our recruiting team. AI tools are used solely for operational support and do not influence candidate evaluation or hiring decisions.

Staff Software Engineer, Ads Data Platform

Instacart

We're transforming the grocery industry At Instacart, we invite the world to share love through food because we believe everyone should have access to the food they love and more time to enjoy it together. Where others see a simple need for grocery delivery, we see exciting complexity and endless opportunity to serve the varied needs of our community. We work to deliver an essential service that customers rely on to get their groceries and household goods, while also offering safe and flexible earnings opportunities to Instacart Personal Shoppers. Instacart has become a lifeline for millions of people, and we’re building the team to help push our shopping cart forward. If you’re ready to do the best work of your life, come join our table. Instacart is a Flex First team There’s no one-size fits all approach to how we do our best work. Our employees have the flexibility to choose where they do their best work—whether it’s from home, an office, or your favorite coffee shop—while staying connected and building community through regular in-person events. Learn more about our flexible approach to where we work. Overview As a Staff Software Engineer, you will play a key role in shaping and advancing a robust data platform that addresses strategic challenges within Ads and across Instacart. You will design and build systems that capture and enforce data compliance requirements while enhancing self-service capabilities for internal consumers, all while maintaining strong guarantees around data integrity and consistency. By consolidating diverse requirements and collaborating across multiple engineering teams, you will help drive the platform’s north-star vision, ensuring strategic alignment and continuous delivery. You will be part of a dynamic team focused on transforming raw data into actionable insights for a wide range of stakeholders, including advertisers, data scientists, machine learning engineers, and sales teams. The team owns and operates critical systems such as metrics transformation and storage, billing, spam detection, and lift testing, supporting multiple facets of Instacart’s data infrastructure. Through this work, you will empower teams across the organization to make data-driven decisions and directly contribute to achieving key business outcomes. About the Job * Lead and break down complex problems while keeping the broader data vision in focus. * Collaborate with engineers and engineering teams, providing mentorship and fostering a strong engineering culture. * Directly contribute to our data vision and engineering architecture. Produce and review technical artifacts that align with business goals. * Oversee engineering initiatives end-to-end, proactively managing risks, setting goals, and ensuring smooth execution and delivery. * Balance maintainability with tech debt and the development of new features. About You Minimum Qualifications * 10+ years of software development experience. * Proven ability to work with multiple stakeholders and manage ambiguity and conflicting requirements. * Self-motivated with a strong sense of ownership in a fast-paced startup environment. * Expertise in Spark, ETLs, Distributed System architecture, MapReduce, SQL, and Big Data infrastructure. * Experience in balancing urgency and pragmatism with high-quality, long-term solutions. Preferred Qualifications * 10+ years of experience * Strong background in Scala and functional programming. * Familiarity with Snowflake, Databricks, DBT, Airflow, Python, Terraform, and Go. Instacart provides highly market-competitive compensation and benefits in each location where our employees work. This role is remote and the base pay range for a successful candidate is dependent on their permanent work location. Please review our Flex First remote work policy here. Offers may vary based on many factors, such as candidate experience and skills required for the role. Additionally, this role is eligible for a new hire equity grant as well as annual refresh grants. Please read more about our benefits offerings here. For US based candidates, the base pay ranges for a successful candidate are listed below. CA, NY, CT, NJ $265,000—$279,500 USD WA $254,000—$268,000 USD OR, DE, ME, MA, MD, NH, RI, VT, DC, PA, VA, CO, TX, IL, HI $243,000—$256,000 USD All other states $221,000—$233,000 USD

Staff Software Engineer - Distributed Data Systems

Databricks

P-186 At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high value challenges that are central to their own missions. Founded in 2013 by the original creators of Apache Spark™, Databricks has grown from a tiny corner office in Berkeley, California to a global organization with over 1000 employees. Thousands of organizations, from small to Fortune 100, trust Databricks with their mission-critical workloads, making us one of the fastest growing SaaS companies in the world. Our engineering teams build highly technical products that fulfill real, important needs in the world. We constantly push the boundaries of data and AI technology, while simultaneously operating with the resilience, security and scale that is critical to making customers successful on our platform. We develop and operate one of the largest scale software platforms. The fleet consists of millions of virtual machines, generating terabytes of logs and processing exabytes of data per day. At our scale, we regularly observe cloud hardware, network, and operating system faults, and our software must gracefully shield our customers from any of the above. Modern data analysis employs sophisticated methods such as machine learning that go well beyond the roll-up and drill-down capabilities of traditional SQL query engines. As a software engineer on the Runtime team at Databricks, you will be building the next generation distributed data storage and processing systems that can outperform specialized SQL query engines in relational query performance, yet provide the expressiveness and programming abstractions to support diverse workloads ranging from ETL to data science. Below are some example projects: Apache Spark™: Develop the de facto open source standard framework for big data. Data Plane Storage: Deliver reliable and high performance services and client libraries for storing and accessing humongous amount of data on cloud storage backends, e.g., AWS S3, Azure Blob Store. Delta Lake: A storage management system that combines the scale and cost-efficiency of data lakes, the performance and reliability of a data warehouse, and the low latency of streaming. Its higher level abstractions and guarantees, including ACID transactions and time travel, drastically simplify the complexity of real-world data engineering architecture. Delta Pipelines: It's difficult to manage even a single data engineering pipeline. The goal of the Delta Pipelines project is to make it simple and possible to orchestrate and operate tens of thousands of data pipelines. It provides a higher level abstraction for expressing data pipelines and enables customers to deploy, test & upgrade pipelines and eliminate operational burdens for managing and building high quality data pipelines. Performance Engineering: Build the next generation query optimizer and execution engine that's fast, tuning free, scalable, and robust. What we look for: * BS in Computer Science, related technical field or equivalent practical experience. * Optional: MS or PhD in databases, distributed systems. * Comfortable working towards a multi-year vision with incremental deliverables. * Driven by delivering customer value and impact. * 8+ years of production level experience in either Java, Scala or C++. * Strong foundation in algorithms and data structures and their real-world use cases. * Experience with distributed systems, databases, and big data systems (Apache Spark™, Hadoop).   Pay Range Transparency Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles.  Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks anticipates utilizing the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page here.   Local Pay Range $192,000—$260,000 USD About Databricks Databricks is the data and AI company. More than 10,000 organizations worldwide — including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region click here. Our Commitment to Diversity and Inclusion At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics. Compliance If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.