Lead Data Engineer

CreateFuture

Who we are CreateFuture is fast becoming the UK’s most recognisable digital consultancy, with years of experience building digital products and services for major organisations whilst putting our people first. We have offices in the centre of Edinburgh, Leeds, Manchester, and London as well as remote employees located throughout the country.    We are a team of creators - whether that’s code, project plans, go to market strategies, culture initiatives, marketing campaigns, large language models or people policies. And together, with our clients, we create the future. This has seen us collaborate and partner across a multitude of industries and sectors, with the likes of PayPal, adidas, Natwest, FanDuel and Money Saving Expert, to name just a few.   Our reputation as a partner determined to deliver high-quality, robust and thoughtful products has enabled us to scale to over 500 people in the last couple of years, and it is our amazing people - along with the safe, supportive and friendly culture we have built - that makes CreateFuture a great place to work. Don’t just take our word for it though, we have been recognised by Best Workplaces UK multiple years in a row - across a number of categories - and our employee exit rate is astonishingly low.  Join us on our journey… Let’s create something awesome, together, today. About the role and team: We're looking for an experienced Lead Data Engineer to join our growing Data Practice, specialising in iGaming. You'll work as part of a multidisciplinary team delivering data solutions for some of the world's largest betting and gaming operators — organisations processing millions of events per day across sportsbook, casino, and exchange platforms. This is a role for someone who understands the pressures of the iGaming data landscape: sub-second odds feeds, high-stakes data integrity requirements, complex regulatory reporting, and large-scale platform migrations from legacy on-premises estates to cloud-native architectures on AWS. As a Lead, you'll shape technical direction, mentor engineers, and act as a trusted partner to client data and engineering teams.   WHAT YOU'LL BE DOING * Leading large-scale data migrations from on-premises or legacy platforms to cloud-native architectures on AWS — including Lakehouse designs using Databricks or Snowflake * Designing and building low-latency data pipelines that process real-time betting events, odds updates, and market data at high throughput * Implementing robust data integrity controls — validation, reconciliation, and auditability — across betting, trading, and customer data domains * Architecting streaming and micro-batch solutions using AWS Kinesis, Apache Kafka, or MSK for real-time sportsbook and in-play data feeds * Working with AWS platform services including S3, Glue, Lambda, Athena, Redshift, Lake Formation, Step Functions, and MWAA * Supporting regulatory and compliance reporting — ensuring data pipelines meet the auditability and lineage requirements of the UK Gambling Commission and international regulators * Leading and mentoring a team of data engineers, setting standards for code quality, testing, and documentation * Contributing to technical proposals, pre-sales scoping, and architecture reviews with iGaming clients   WE'D LOVE TO TALK TO YOU IF... YOU KNOW THE IGAMING DATA LANDSCAPE * You've worked in or closely with sportsbook, exchange, or casino platforms — and understand the data models behind markets, selections, bets, and settlements * You've built or maintained low-latency data feeds — odds ingestion, in-play event streams, price change feeds — where milliseconds matter * You understand the data integrity challenges specific to betting: reconciliation between trading and settlement systems, detection of data drift, and auditability for regulatory purposes * You've delivered or contributed to large-scale data migrations — moving high-volume transactional or event data from legacy estates to the cloud without losing fidelity or uptime   YOU'RE STRONG ON AWS DATA ENGINEERING * AWS is your primary cloud — you're confident across Glue, Lambda, Athena, S3, Redshift, RDS, Kinesis, MSK, and Step Functions * You've built real-time or near-real-time pipelines using streaming frameworks — Kinesis Data Streams, Kafka, Flink, or Spark Streaming * You understand AWS cost models and how to optimise high-throughput workloads — Spot compute, reserved capacity, and right-sizing for event-driven architectures * AWS certifications are a bonus — Solutions Architect or Data Analytics Specialty   YOU KNOW YOUR TOOLS * Solid experience with Python, SQL, and Spark — and pipeline tools such as dbt or Airflow * Comfortable with data quality frameworks and testing — Great Expectations, dbt tests, or custom validation layers * Experience with infrastructure-as-code (Terraform, AWS CDK) is a plus * Familiar with broader cloud platforms — Azure (Data Factory, Synapse) or GCP (Dataflow, BigQuery) — is beneficial but not essential   YOU THRIVE IN A CONSULTANCY SETTING * You've led or mentored data engineers and are comfortable owning technical direction on a complex engagement * You can navigate the politics of a large operator — multiple teams, competing priorities, and legacy systems that can't just be switched off * You balance hands-on delivery with client engagement, and know when to push back on scope and when to be pragmatic   TECH SNAPSHOT Primary cloud AWS — Glue, Lambda, Athena, S3, Redshift, RDS, Kinesis, MSK, Lake Formation, Step Functions, MWAA Streaming AWS Kinesis, Apache Kafka / MSK, Apache Flink, Spark Streaming Languages Python, SQL, Spark Pipeline tools dbt, Airflow / AWS MWAA, AWS Glue Platforms Databricks, Snowflake, Amazon Redshift Data quality Great Expectations, dbt tests, custom reconciliation frameworks IaC / DevOps Terraform, AWS CDK (desirable)   WHAT WE’LL OFFER YOU: We trust people to do their best work. That means flexibility over rigid rules, impact over activity, and real investment in your growth both professionally and personally. You’ll be part of a supportive, and friendly culture, surrounded by smart, curious people who care deeply about what they do. We offer flexible working, including hybrid and remote options. Our office hubs are located in Edinburgh, Leeds, Manchester, London and Bulgaria, with occasional travel to client sites or CreateFuture offices when needed. We trust you to manage your time balancing collaboration with client time and focused work. What matters is the impact you have, not how busy you look. OUR HIRING PROCESS We try to keep our hiring process clear, fair and respectful of your time. We aim to get back to everyone who applies and we will be upfront about where you are in the process. It usually looks like this: * Call with our Talent Acquisition Team  * Role specific capability interview  Depending on the role, we might also ask you to do a short presentation, a practical or technical task or have a values focused conversation. We will explain what is involved before anything happens. INCLUSION AT CREATEFUTURE  We believe diverse teams build better workplaces and better products. We want CreateFuture to be a place where people feel able to be themselves and do their best work. If you need any adjustments or support during the application process, just. We will do what we can to help. We look forward to your application!

CreateFuture

Who we are CreateFuture is fast becoming the UK’s most recognisable digital consultancy, with years of experience building digital products and services for major organisations whilst putting our people first. We have offices in the centre of Edinburgh, Leeds, Manchester, and London as well as remote employees located throughout the country.    We are a team of creators - whether that’s code, project plans, go to market strategies, culture initiatives, marketing campaigns, large language models or people policies. And together, with our clients, we create the future. This has seen us collaborate and partner across a multitude of industries and sectors, with the likes of PayPal, adidas, Natwest, FanDuel and Money Saving Expert, to name just a few.   Our reputation as a partner determined to deliver high-quality, robust and thoughtful products has enabled us to scale to over 500 people in the last couple of years, and it is our amazing people - along with the safe, supportive and friendly culture we have built - that makes CreateFuture a great place to work. Don’t just take our word for it though, we have been recognised by Best Workplaces UK multiple years in a row - across a number of categories - and our employee exit rate is astonishingly low.  Join us on our journey… Let’s create something awesome, together, today. About the role and team: ABOUT THE ROLE AND TEAM We're looking for a Principal Data Engineer to join our Data Practice and own the technical direction of our iGaming data engineering capability. You'll work with some of the world's largest betting and gaming operators — organisations processing hundreds of millions of events per day across sportsbook, casino, exchange, and lottery platforms. A Principal at Create Future operates above the delivery line as well as within it. You'll define how we solve the hardest data engineering problems in iGaming: petabyte-scale migrations from legacy on-premises estates, sub-millisecond event pipelines, settlement reconciliation at bookmaker scale, and the data foundations that keep operators compliant with gambling regulators globally. You'll influence the shape of engagements from pre-sales through to delivery, grow the engineering talent around you, and be a recognisable voice for Create Future in the iGaming market.   WHAT YOU'LL BE DOING TECHNICAL LEADERSHIP * Defining and owning the data engineering architecture patterns Create Future uses across iGaming engagements — migration frameworks, streaming architectures, data integrity standards, and Lakehouse design * Acting as the most senior technical authority on client engagements — making critical architecture decisions, resolving design disputes, and setting the bar for quality * Reviewing and signing off technical designs produced by Lead and Senior engineers across active engagements * Identifying and driving the adoption of new tooling, patterns, and AWS services that improve delivery outcomes across the iGaming practice   DELIVERY * Leading the technical design and execution of large-scale data migrations — moving high-volume transactional and event data from on-premises or legacy cloud estates to AWS, without loss of fidelity or operational continuity * Architecting real-time and near-real-time data pipelines for sportsbook and in-play use cases — odds feeds, market events, bet placement streams, and settlement pipelines — where latency and correctness are non-negotiable * Designing and enforcing data integrity frameworks across betting, trading, and customer data domains — including reconciliation between source and target systems, anomaly detection, and audit trail requirements * Overseeing the implementation of regulatory and compliance reporting pipelines that meet the requirements of the UK Gambling Commission and international licensing bodies * Working with AWS services including S3, Glue, Lambda, Athena, Redshift, RDS, Kinesis, MSK, Lake Formation, Step Functions, and MWAA — selecting the right tool for each problem rather than defaulting to a stack   PRACTICE AND PEOPLE * Mentoring and growing Lead and Senior Data Engineers — through code review, pairing, architecture sessions, and career conversations * Building the iGaming data engineering playbook: reusable patterns, accelerators, and reference architectures that reduce time-to-value on new engagements * Contributing to hiring — defining what great looks like for data engineering roles and playing an active part in assessment * Representing Create Future externally — at industry events, in technical blog posts, and in client-facing settings — as a credible voice on iGaming data engineering   COMMERCIAL * Shaping and leading technical responses to iGaming opportunities — scoping complex engagements, writing architecture proposals, and presenting to senior client stakeholders * Identifying expansion opportunities within existing client relationships — spotting data engineering problems we can help solve and framing them as propositions * Partnering with AWS on joint go-to-market activity where relevant, leveraging Create Future's Advanced Partner status   WHAT WE'RE LOOKING FOR DEEP IGAMING DOMAIN EXPERTISE * Extensive experience working in or closely with sportsbook, exchange, or casino platforms — you understand the data models, operational pressures, and regulatory constraints from the inside * You've led or made decisive contributions to large-scale data migrations in iGaming — moving live betting, customer, or trading data at scale while maintaining integrity and uptime * You've designed or owned low-latency data pipelines where correctness and throughput are both critical — odds ingestion, in-play event streams, bet settlement, or equivalent * You understand what data integrity means in a regulated gambling context: reconciliation, audit trails, lineage, and the consequences of getting it wrong   AWS DATA ENGINEERING MASTERY * AWS is your primary cloud and you can design across the full data engineering stack — from ingestion and streaming through to warehousing, serving, and cost optimisation * You have deep experience with streaming architectures — Kinesis, Kafka/MSK, Flink, or Spark Streaming — and know when each is the right choice * You can model the cost implications of architecture decisions and advise clients on trade-offs between throughput, latency, durability, and spend * AWS certification at professional or specialty level is strongly preferred   ENGINEERING EXCELLENCE * Mastery of Python, SQL, and Spark — and strong opinions on how they should be used in production data pipelines * Deep experience with dbt, Airflow, or equivalent orchestration — including how to build pipelines that are testable, observable, and operationally sound * Strong understanding of data quality engineering — not just validation rules, but how to build systems that detect and surface integrity issues before they reach consumers * Comfortable with infrastructure-as-code (Terraform, AWS CDK) and treating data platform infrastructure as a first-class engineering concern   CONSULTANCY AND LEADERSHIP * You've operated at Principal or equivalent level — making architectural decisions that affect multiple teams, and being accountable for their outcomes * You're comfortable in C-suite and VP-level client conversations, translating technical complexity into business risk and opportunity * You can hold a room on a difficult technical topic and reach a decision — not just present options * You've grown engineering talent around you and take it seriously as a leadership responsibility   TECH SNAPSHOT Primary cloud AWS — Glue, Lambda, Athena, S3, Redshift, RDS, Kinesis, MSK, Lake Formation, Step Functions, MWAA Streaming AWS Kinesis, Apache Kafka / MSK, Apache Flink, Spark Streaming Languages Python, SQL, Spark Pipeline tools dbt, Airflow / AWS MWAA, AWS Glue Platforms Databricks, Snowflake, Amazon Redshift Data quality Great Expectations, dbt tests, reconciliation frameworks, data observability tooling IaC / DevOps Terraform, AWS CDK Certification AWS Professional or Specialty level strongly preferred WHAT WE’LL OFFER YOU: We trust people to do their best work. That means flexibility over rigid rules, impact over activity, and real investment in your growth both professionally and personally. You’ll be part of a supportive, and friendly culture, surrounded by smart, curious people who care deeply about what they do. We offer flexible working, including hybrid and remote options. Our office hubs are located in Edinburgh, Leeds, Manchester, London and Bulgaria, with occasional travel to client sites or CreateFuture offices when needed. We trust you to manage your time balancing collaboration with client time and focused work. What matters is the impact you have, not how busy you look. OUR HIRING PROCESS We try to keep our hiring process clear, fair and respectful of your time. We aim to get back to everyone who applies and we will be upfront about where you are in the process. It usually looks like this: * Call with our Talent Acquisition Team  * Role specific capability interview  Depending on the role, we might also ask you to do a short presentation, a practical or technical task or have a values focused conversation. We will explain what is involved before anything happens. INCLUSION AT CREATEFUTURE  We believe diverse teams build better workplaces and better products. We want CreateFuture to be a place where people feel able to be themselves and do their best work. If you need any adjustments or support during the application process, just. We will do what we can to help. We look forward to your application!

Coor Service Management AB

Join Coor in Stockholm and grow into a Tech Lead role, helping structure and develop our Databricks and Azure data platform Have you worked a few years with Databricks and feel ready to take the technical lead? Coor is building a modern Azure and Databricks platform, and we are now looking for a Data Engineer who wants to step inte technical ownership. A new Databricks environment is in place, and several large source systems, including finance and transaction platforms, are moving to SaaS, changing how data is structured, integrated, and delivered. Coor is now strengthening how we design, build, and structure our data platform. This is the right role for you who enjoy hands-on engineering and want to take ownership of how things are built. THE OPPORTUNITY - This is an opportunity to grow into technical leadership in a supportive and engaged team. We offer you: - To step into a role where your technical voice will be heard and valued - The opportunity to grow alongside a platform that is still taking shape - A team with strong collaboration, open discussions, and high engagement - To influence how we structure and mature our Databricks environment from an early stage YOUR CHALLENGE In this role, you combine hands-on data engineering with growing technical leadership. You will spend a significant part of your time building solutions in Databricks, while also shaping how the team approaches design, structure, and quality. More concretely, you will: - Design and build scalable data solutions in Azure and Databricks - Develop and refine ETL/ELT pipelines, including near real-time data flows - Contribute to architectural decisions together with architects and stakeholders - Bring clarity to coding standards, branching strategies, and documentation - Review code and promote consistency, quality, and maintainability - Support sprint planning by helping break down and refine technical solutions before development starts Beyond the day-to-day development work, you will also help structure how we apply Delta Lake, Unity Catalog, and Lakehouse principles in practice, ensuring that what we build is sustainable over time. THE TEAM AND WORKPLACE You will join Coor’s Data & Analytics team, which consists of two main focus areas: business deliveries in Qlik and platform development within Azure and Databricks. You will work closely with our Analytics Architect as well as the engineers in the team. Many of us have worked together for a long time and there is a high level of trust across roles - discussions are open, ideas are welcomed, and technical topics are explored together before decisions are made. We are based in our brand-new offices in Solna, where we meet three days a week in a hybrid setup based on the team’s needs. ABOUT YOU You have worked hands on with Databricks for a few years and feel confident building solutions in the Azure data ecosystem. You are strong in SQL and comfortable using Python when needed. You have experience building data pipelines and working with data models, and you understand how data lakes and analytical data products are structured. You may already have taken informal technical responsibility in your team (reviewing code, guiding discussions, or suggesting better ways of working) and now feel ready to formalize that role. You bring structure where needed and enjoy making technical decisions clear and understandable, both verbally and in documentation. You are comfortable working in Swedish and English. Most importantly, you are motivated to grow into a technical lead role while helping the team build sustainable and scalable solutions. About the position - Type of employment: Permanent - Scope of work: Full time - Working hours: Hybrid - Start date: TBD - Probationary period: 6 months To ensure a fair and accurate recruitment process, we use personality assessments and conduct background checks on all employees upon employment. Additional information If you have any questions, please contact: Mikaela Ströberg, mikaela.stroberg@adadigital.se We review applications on an ongoing basis, so don’t wait – apply today! To comply with GDPR, we only accept applications submitted through our advertisement. We kindly ask recruitment agencies and sales representatives to refrain from contacting us regarding this position. We look forward to receiving your application! Coor is a leading provider of workplace services in the Nordics. We are present at thousands of workplaces across the region, making us experts in smart, safe, and sustainable working life. We take care of our customers’ properties, cook food, clean, welcome guests, deliver mail, and design offices. In total, we offer more than 100 services as part of our mission – to create the happiest, healthiest and most prosperous workplace environments in the Nordic region. Together, we create value by performing, leading, and streamlining our customers’ service operations, so they can focus on what they do best. We take care of the rest.