Data Operations Engineer - Python

Qube Research & Technologies

Qube Research & Technologies (QRT) is a global quantitative and systematic investment manager, operating in all liquid asset classes across the world. We are a technology and data driven group implementing a scientific approach to investing. Combining data, research, technology and trading expertise has shaped QRT’s collaborative mindset which enables us to solve the most complex challenges. QRT’s culture of innovation continuously drives our ambition to deliver high quality returns for our investors. Your future role within QRT * Your core objective is to manage the multiple and extensive dataset used in the QRT research and trading platform * Contributing to design and implementing QRT data store and its API * Monitoring fetching processes and data health * Integrating alternative datasets * Supporting users (Quants & Traders)   Your present skillset * 2-10+ years' experience in a related field * Advanced knowledge of Python is a must * C#, Rust, JavaScript nice to have * Previous experience handling and processing large amounts of both structured and unstructured data  * Experience using new age technologies like data-lake, data-mesh in cloud * Prior experience in financial assets, market data and it's data vendors is a plus * Intellectual curiosity to learn new technologies to build scalable and robust products * Capacity to work with autonomy within a global team * Advanced English, both written and verbal communication skills required to understand business requirements QRT is an equal opportunity employer. We welcome diversity as essential to our success. QRT empowers employees to work openly and respectfully to achieve collective success. In addition to professional achievement, we are offering initiatives and programs to enable employees achieve a healthy work-life balance.

Qube Research & Technologies

Qube Research & Technologies (QRT) is a global quantitative and systematic investment manager, operating in all liquid asset classes across the world. We are a technology and data driven group implementing a scientific approach to investing. Combining data, research, technology and trading expertise has shaped QRT’s collaborative mindset which enables us to solve the most complex challenges. QRT’s culture of innovation continuously drives our ambition to deliver high quality returns for our investors.   Your future role within QRT * Your core objective is to develop and maintain web scraping tools to build datasets for research and trading * Contributing to integrate datasets from internal or external providers * Manage the multiple and extensive dataset used in the QRT research and trading platform * Monitoring fetching processes and data health * Supporting users (Quants & Traders)   Your present skillset * 4+ years’ experience in web scraping * Advanced English, both written and verbal communication skills * Polyglot developer, Python coding is important * Software engineering best practices * Ability to communicate and understand user needs * Structured and unstructured data management expertise is a plus * Knowledge of the financial data of equity/derivatives is a plus * Intellectual curiosity to learn new technologies * Capacity to work with autonomy within a global team   QRT is an equal opportunity employer. We welcome diversity as essential to our success. QRT empowers employees to work openly and respectfully to achieve collective success. In addition to professional achievement, we are offering initiatives and programs to enable employees achieve a healthy work-life balance.

WPP

WPP is the trusted growth partner for the world’s leading brands.  We unite cutting-edge media intelligence and data solutions, world-class creativity, next-generation production, transformative enterprise solutions and expert strategic counsel in a single company – powered by exceptional talent and our agentic marketing platform, WPP Open, to help our clients navigate change, capture opportunity and deliver transformational growth.    We work with the world's most valuable brands and have global reach across 100+ markets, with deep local expertise.   Our people are the key to our success. We're committed to fostering a culture of creativity, belonging and continuous learning, attracting and developing the brightest talent, and providing exciting career opportunities that help our people grow.    For more information, visit WPP.com.   Why we're hiring: WPP Media is embarking on a transformative data journey through Databridge - our internal data integration framework - designed to unify our fragmented global data landscape. We are moving from isolated, market-specific implementations to a standardized, scalable, cloud-agnostic, and AI-ready data platform built on a modern tech stack: dbt, Databricks, Python (dlthub), and GitHub Actions. As a Data Operations Engineer, you will be a foundational member of our new Data Integration & Operations team in Chennai. You will be the bridge between development and production, ensuring data pipelines are delivered reliably, consistently, and securely across global markets. This is a hands-on technical role focused on operationalizing, automating, and monitoring data workflows. You will implement CI/CD for data pipelines, enforce data quality standards, manage production deployments, respond to incidents, and continuously improve data delivery. What you'll be doing: * CI/CD Implementation & Automation * Build and maintain automated CI/CD pipelines for data workflows using GitHub Actionsand Databricks Asset Bundles * Implement automated testing gates including code quality checks, data quality validation, and pre-commit hooks * Configure and manage multiple environments with proper isolation and access controls * Automate deployment processes ensuring repeatable, zero-touch releases * Data Pipeline Operations & Monitoring * Monitor daily execution of Databricks Jobs/Workflows, tracking pipeline health, data quality, and SLA compliance * Set up comprehensive alerting and notifications for failures, SLA breaches, and cost anomalies * Use monitoring dashboards to proactively identify and resolve issues * Perform regular health checks on production data products * Data Quality & Governance * Enforce platform-wide data quality standards by creating reusable test macros and validation patterns * Review Data Engineer code for proper test coverage, documentation, and adherence to standards * Support Databricks Unity Catalogintegration for metadata management, lineage tracking, and access control * Production Deployment & Incident Management * Own production deployment workflows and manage Databricks Jobsconfigurations * Maintain version-controlled job definitions in Git for Infrastructure as Code * Act as first responder for production incidents, performing triage and root cause analysis * Use operational runbooks to diagnose and resolve common issues * Escalate to Data Engineers or DevOps when needed and document incidents with detailed RCA * Participate in on-call rotation for operational coverage * Documentation & Continuous Improvement * Create and maintain operational runbooks detailing schedules, troubleshooting steps, escalation paths, and recovery procedures * Document standards, guidelines, and workflows in Confluence * Contribute to the Central Data Solution Repositorywith reusable templates and patterns * Analyze incident trends and participate in retrospectives to drive platform optimization What you'll need: * Experience * 5+ yearsof hands-on experience in data operations, data engineering, or platform engineering * Proven track record supporting production data pipelines and operational workflows * Technical Expertise * Databricks Platform: * Practical experience with Databricks SQL Warehouses, Jobs/Workflows, and CLI * Understanding of Unity Catalogfor governance, access control, and lineage * Knowledge of Delta Lakeand performance tuning * Familiarity with Databricks Asset Bundlesfor Infrastructure as Code * * Data Transformation Pipeline - Operational Proficiency: * Strong working knowledge of SQL-based transformation frameworksfor operational purposes (e.g., dbt, Dataform, SQLMesh, or orchestrated transformation pipelines) * Understanding transformation project structure, dependency management, testing frameworks, and documentation standards * Reading and understanding SQL transformations for validation and troubleshooting * Running transformation commands/workflows for CI/CD and production operations * CI/CD integration, environment management, and automated deployment * Troubleshooting production transformation pipeline issues using logs and error messages * Production experience with data quality testing and validation at scale * * CI/CD & Automation: * Proficiency with GitHub Actionsincluding workflows, secrets management, and environment configuration * Understanding of Git workflows and code review processes * Familiarity with pre-commit hooks, linting, and automated testing * Basic knowledge of Infrastructure as Code principles * * Python & SQL: * Proficient in Pythonfor scripting and automation (experience with dlthub is a plus) * Strong SQLskills for data validation and troubleshooting * Ability to read and understand complex data transformation logic * * Cloud & Operational Skills: * Solid understanding of core cloud services in Azure and/or GCP * Experience with production monitoring, alerting, and incident response * Understanding of SLA management and operational metrics * Strong problem-solving skills for diagnosing distributed system issues * Excellent communication and documentation skills * Detail-oriented with commitment to operational excellence * Preferred Skills * Production operational experience with dbt Core (our primary transformation framework) including project structure, models, tests, macros, and CLI operations * Understanding of FinOps practices for cloud cost optimization * Exposure to Power BI or similar BI tools * Experience with Terraform or other Infrastructure as Code tools * Familiarity with Confluence and Jira Who you are: You're open: We are inclusive and collaborative; we encourage the free exchange of ideas; we respect and celebrate diverse views. We are open-minded: to new ideas, new partnerships, new ways of working. You're optimistic: We believe in the power of creativity, technology and talent to create brighter futures or our people, our clients and our communities. We approach all that we do with conviction: to try the new and to seek the unexpected. You're extraordinary: we are stronger together: through collaboration we achieve the amazing. We are creative leaders and pioneers of our industry; we provide extraordinary every day.   What we'll give you: Passionate, inspired people – We aim to create a culture in which people can do extraordinary work. Scale and opportunity – We offer the opportunity to create, influence and complete projects at a scale that is unparalleled in the industry. Challenging and stimulating work – Unique work and the opportunity to join a group of creative problem solvers. Are you up for the challenge?   We believe the best work happens when we're together, fostering creativity, collaboration, and connection. That's why we’ve adopted a hybrid approach, with teams in the office around four days a week. If you require accommodations or flexibility, please discuss this with the hiring team during the interview process. WPP is an equal opportunity employer and considers applicants for all positions without discrimination or regard to particular characteristics. We are committed to fostering a culture of respect in which everyone feels they belong and has the same opportunities to progress in their careers. PLEASE READ OUR PRIVACY NOTICE (HTTPS://WWW.WPP.COM/EN/CAREERS/WPP-PRIVACY-POLICY-FOR-RECRUITMENT) FOR MORE INFORMATION ON HOW WE PROCESS THE INFORMATION YOU PROVIDE.