Data Engineer

CreateFuture

Please note: This is not a live vacancy. We are hiring ahead of demand and building a talent pipeline for upcoming client engagements. By applying, you're expressing interest in future opportunities, and we'll be in touch as soon as a matching role becomes available. ---------------------------------------------------------------------------------------------------------------------------------- DATA ENGINEER ABOUT THE ROLE AND TEAM Hands-on delivery engineers working under the Architect to execute data migrations. Responsible for building and fixing data pipelines, resolving technical debt, and getting platforms to a stable, production-ready state. WHAT YOU'LL BE DOING * Design, build, and optimise data pipelines on the AWS stack * Identify and resolve existing technical debt in migrations * Work collaboratively with client engineering teams to transfer knowledge * Contribute to stabilising platforms and hitting delivery milestones * Support the Architect in defining and implementing the target state WE'D LOVE TO TALK TO YOU IF YOU HAVE * Experience with the AWS data stack: S3, Glue, Redshift, Lake Formation * Familiarity with Lakehouse patterns and architecture * Strong proficiency in Python and SQL * Experience in regulated or high-volume data environments * Betting and/or gaming domain knowledge required WHAT WE’LL OFFER YOU: We trust people to do their best work. That means flexibility over rigid rules, impact over activity, and real investment in your growth both professionally and personally. You’ll be part of a supportive, and friendly culture, surrounded by smart, curious people who care deeply about what they do. We offer flexible working, including hybrid and remote options. Our office hubs are located in Edinburgh, Leeds, Manchester, London and Bulgaria, with occasional travel to client sites or CreateFuture offices when needed. We trust you to manage your time balancing collaboration with client time and focused work. What matters is the impact you have, not how busy you look. OUR HIRING PROCESS We try to keep our hiring process clear, fair and respectful of your time. We aim to get back to everyone who applies and we will be upfront about where you are in the process. It usually looks like this: * Call with our Talent Acquisition Team  * Role specific capability interview  Depending on the role, we might also ask you to do a short presentation, a practical or technical task or have a values focused conversation. We will explain what is involved before anything happens. INCLUSION AT CREATEFUTURE  We believe diverse teams build better workplaces and better products. We want CreateFuture to be a place where people feel able to be themselves and do their best work. If you need any adjustments or support during the application process, just. We will do what we can to help. We look forward to your application!

Kpler

At Kpler, we are dedicated to helping our clients navigate complex markets with ease. By simplifying global trade information and providing valuable insights, we empower organisations to make informed decisions in commodities, energy, and maritime sectors.   Since our founding in 2014, we have focused on delivering top-tier intelligence through user-friendly platforms. Our team of over 850 experts from 69 countries works tirelessly to transform intricate data into actionable strategies, ensuring our clients stay ahead in a dynamic market landscape. Join us to leverage cutting-edge innovation for impactful results and experience unparalleled support on your journey to success.   The Power team is responsible for a product covering the whole product related to the European power market. This includes large datasets to retrieve, normalize and distribute to our users, and also offer different proprietary datasets such as real time availability computation or market forecasts on different time horizons, from intraday to long term.

DATAPAO

At DATAPAO, data ignites passion, community fuels collaboration, and growth knows no bounds. We are a leading Data Engineering and AI consulting company backed by Databricks and recognized for our unmatched delivery standards and rapid growth. We have been named Databricks EMEA Emerging Business Partner of the Year (2024), achieved the Golden Tier status in the Databricks Partner Program, and made three consecutive appearances on the Financial Times FT1000 list. We are currently looking for a Senior Data Engineer to join us remotely in the UK as we plan to set up a hub in the UK in the following 6-12 months to enable our GTM strategy. You will work with our EMEA and US customers to help them solve their data engineering, ML, ML Ops, and cloud migration puzzles. "As a Data Engineer at DATAPAO, you will have the unique opportunity to push the boundaries of technology and lead the way in how data transforms the world. We work with customers who want to innovate and change their industries. So it never gets boring! Sorting out a complex technical puzzle, setting up a new data architecture from scratch, or guiding our customers through adopting the latest technologies is our routine here. Hence, we'd expect you to be more than just a (data) engineer. We'd expect you to breathe and live data, to thrive for knowledge and excellence, and to be keen to build something enduring and impactful for our customers. We'd expect you to be a (data) Paoneer!"  (Máté Gulyás, CEO) What will you do? As a Senior Data Engineer, you are expected to deliver (across industries) on some of our most complex projects - individually or by leading small delivery teams. Although we work for the biggest multinational companies where years-long behemoth projects are the norm, our projects are fast-paced, typically 2 to 4 months long. Most are delivered using Apache Spark/Databricks on AWS/Azure and require you to directly manage the customer relationship alone or in collaboration with a Project Manager. Additionally, at this seniority level, we expect you to compound your impact across the team and the organization - by supporting our pre-sales process, mentoring more junior engineers, and contributing to hiring best-in-class data talent. What does it take to fit the bill? Technical Expertise * You (ideally) have 5+ years of experience in Data Engineering, with a focus on cloud platforms (AWS, Azure, GCP); * You have a proven track record working with Databricks (PySpark, SQL, Delta Lake, Unity Catalog); * You have extensive experience in ETL/ELT development and data pipeline orchestration (e.g., Databricks Workflows, DLT, Airflow, ADF, Glue, and Step Functions.); * You’re proficient in SQL and Python, using them to transform and optimize data like a pro; * You know your way around CI/CD pipelines and Infrastructure as Code (Terraform, CloudFormation, or Bicep); * You’ve hands-on experience integrating Databricks with BI tools (Power BI, Tableau, Looker).  Consulting & Client-Facing Skills * Ideally, you bring a proven history in consulting, from scoping to gathering requirements, designing solutions, and communicating effectively with stakeholders. If you bring a product company background with you, that's also fine as long as you can show a good consulting mindset and desire to be customer-facing; * You’ve successfully delivered projects like Data Lakehouse buildouts and cloud data migrations; * You excel in explaining technical concepts to non-technical audiences and drive decision-making. Operational Readiness & Soft Skills * You’re (almost) ready to hit the ground running, immediately contributing to live client projects; * In a fast-paced consulting environment, where no two days are the same, flexibility and problem-solving comes naturally to you. Furthermore, resilience and thriving on challenges are essential traits in our industry; * Your communication skills are on point—whether you’re writing, speaking, or collaborating with stakeholders, you know how to keep everyone in the loop. WHAT DO WE OFFER? You'll have the rare opportunity to join DATAPAO at a time when you can still meaningfully impact our growth trajectory and organizational success. Furthermore, you’ll also get to spearhead our regional expansion. Surely, we know everyone needs a little something to do their best work. Here is a list of some other extras we offer:   * The chance to work remotely - as we don't have a physical office in the UK yet, we offer a fully remote setup for the time being. However, given our strong community emphasis, we'd expect you to spend one month in our Budapest hub during onboarding and visit the office for one week every quarter; * World-class educational benefits - there’s no shortage of learning opportunities at DATAPAO, meaning that you'll get access to Databricks' public and internal courses to learn all the tricks of Distributed Data Processing, MLOps, Apache Spark, Databricks, and Cloud Migration from the best. Additionally, we'll pay for various data & cloud certifications, you'll get dedicated time for learning during work hours, and access to our internal library;  * Flexible PTO days - we’re flexible with how many days you take off if that does not conflict with customer success and the work getting done; * 4 weeks of paternity leave - because we think it’s important for both parents to be there when it matters the most; * Employee Assistance Program (EAP) - life always happens! And we'd like to be there for you when it counts the most. Through EAP, we offer our employees access to psychology, financial, and legal consulting services via phone or in person; * Pension scheme enrollment and a comprehensive private health insurance plan - offered via our EOR (Employer of Record) provider, Remote.com. Remote will be your official employer in the UK for the foreseeable future until we establish our own legal entity in the UK; * Top-notch working equipment - working comfortably means working well. You will get a MacBook Pro and a sign-up bonus of 500 GBP gross (to be paid with your first payroll) to set up your home office or whatever else is needed to give your best; * The chance to make an impact in a high-transparency culture - open feedback and no politics are things we value a lot at DATAPAO. Additionally, you'll get the chance to work in the field of data & AI and shape the future of a rapidly growing tech company. IMPORTANT NOTE: Given that we are still sorting our ways out in the UK, this list will likely get an update in the following months, and we're also committed to growing it with us over time. The gross salary for this position ranges from 70.000 to 100.000 GBP/year, depending on your assessed seniority level during the selection process. Please note that currently we are unable to support transfer or offer full sponsorship for Skilled Worker visas as we’re just setting foot into the UK. WANT TO KNOW MORE ABOUT US? DATAPAO is a Data Engineering and AI company that covers the entire data transformation from architecture to implementation. Beyond delivering solutions, we also provide data and AI training and enablement. We are backed by Databricks - the creators of Apache Spark, and act as a delivery partner and training provider for them in Europe. Additionally, we are Microsoft Gold Partners in delivering cloud migration and data architecture on Azure. Our delivery partnerships enable us to work in a wide range of industries and with some of the most prominent global companies, such as Norsk-Hydro, Richter, Bayer, Schufa, GetYourGuide, TechnoAlpin, and Logically, to name just a few. As a training provider, we deliver onsite and online courses globally for Databricks and on our own. We have been teaching professionals at Apple, Amazon, Uber, Microsoft, T-Mobile, GE, Ericsson, and many more to improve their impact with data. For even more insights, check the links below: * Designing and Implementing a Real-time Data Lake with Dynamically Changing Schema (EN) by Máté Gulyás (2021, Spark AI Summit) * Productionising Machine Learning models (EN) by Máté Gulyás (2023, Mndwrk Event) * "Ha a data governance jól működik, az olyan, mint egy láthatatlan szupererő” (HU) by Máté Gulyás (2023, Com-Forth Zóna Podcast) You can also follow us on LinkedIn for all the good stuff or just hit our recruitment team at jobs@datapao.com We’re firm believers in scaling up a team without judgment or prejudice. What we really care about is working with the best people out there, no matter their background. And you should also not worry if you don't tick every box in the requirements. If you’re passionate about data and learning new things, you’ll fit right in, and we'd love to hear back from you. When we hear back from you, we'd like you to know that we are committed to your privacy and keeping your data safe. We do not share your data with any third parties (except the ones we use to run our recruitment process) and keep your application for two years unless you ask us otherwise. We use your data solely for recruitment purposes, such as letting you know about new career opportunities at DATAPAO and/or managing your application. But if you want to know more about how we store and manage your data, check our privacy policy.