Senior Databricks Consulting Engineer (m/f/*)

Valtech

Why Valtech? We’re the experience innovation company - a trusted partner to the world’s most recognized brands. To our people we offer growth opportunities, a values-driven culture, international careers and the chance to shape the future of experience.  THE OPPORTUNITY At Valtech, you’ll find an environment designed for continuous learning, meaningful impact, and professional growth. Whether you're pioneering new digital solutions, challenging conventional thinking or building the next generation of customer experiences, your work will help transform industries.  We are proud of:  * The work we do and the innovation we drive  * Our values of share, care and dare  * A workplace culture that fosters creativity, diversity and autonomy  * Our borderless, global framework, which enables seamless collaboration  The role   We are looking for an experienced Senior Data Engineer to design, build, and optimize modern, cloud-based data platforms that power analytics, AI, and data products across the organization. Beyond technical delivery, we're looking for someone genuinely curious about the business problems behind the data — someone who can apply common sense thinking, detailed analysis, and experience-based recommendations to help derive and shape business requirements, not just implement them as given. You will work on scalable batch, streaming, and near-real-time pipelines, enabling high-quality, curated datasets while ensuring robust data governance, security, and observability across the data ecosystem. You will also play a key role in supporting AI and GenAI systems, enabling pipelines for machine learning, causal modeling, and LLM-powered applications such as RAG and agent-based systems. Our preferred platforms are Microsoft Azure / Fabric (primary), GCP, AWS, Databricks, and Snowflake, with Azure experience being highly transferable to Fabric. You will collaborate closely with data scientists, ML engineers, and platform teams to ensure the data foundation supports production-grade, decision-oriented AI systems. Role responsibilities Build & Data Platform Engineering Design and implement scalable data platforms and pipelines across cloud environments (Azure/Fabric, AWS, GCP, Databricks, Snowflake). This includes developing reliable batch, streaming, and near-real-time pipelines using technologies such as Spark and Delta Lake, and building ingestion, transformation, and curation workflows for both structured and unstructured data. You will implement modern data architectures including lakehouse patterns and medallion layering (bronze, silver, gold), ensuring systems are reusable, scalable, and aligned with enterprise needs. Enable AI, GenAI & Data Products Deliver high-quality datasets that support analytics, machine learning, causal modeling, and optimization systems. You will enable data pipelines for GenAI use cases (including LLMs, RAG pipelines, and vector-based data flows), as well as agent-based architectures and intelligent workflows, ensuring that data is model-ready and production-grade. Data Modeling, Orchestration & Automation Design scalable logical and physical data models for analytical and operational use cases, ensuring consistency across domains. Orchestrate workflows using tools such as Airflow, dbt, Lakeflow, or equivalents, with strong focus on automation, reliability, and maintainability of end-to-end pipelines. Architecture, Governance & Observability Apply modern architecture patterns including event-driven and streaming architectures, and ensure adherence to best practices in data governance, lineage, quality, and access control (RBAC/ABAC). Establish strong data observability, including monitoring of data freshness, pipeline reliability, and SLA adherence, ensuring systems remain trustworthy and production-ready. Data Serving, Integration & Optimization Enable data serving layers (APIs, feature inputs, analytical endpoints) to support downstream systems, including ML and AI platforms. Continuously monitor and optimize pipelines and infrastructure for performance, scalability, and cost efficiency. Requirements Discovery & Business Partnership Bring genuine curiosity to every engagement — ask the right questions to understand not just what stakeholders are asking for, but why. Apply common sense thinking, detailed analysis, and experience-based recommendations to help derive and refine business requirements, surfacing gaps or better alternatives where they exist rather than simply executing a brief as written. Collaboration Work closely with data scientists, ML engineers, analysts, and business stakeholders to translate requirements into robust data solutions. Support adoption of data products and contribute to best practices across the data and AI ecosystem. Must have qualifications Technical skills Strong hands-on experience with Apache Spark and Delta Lake, and strong programming skills in Python and SQL. Proven experience building batch and streaming data pipelines and production-grade data platforms, with solid understanding of data modeling, data quality, and governance principles. Cloud & Platforms (Key Requirement) Experience with one or more major cloud platforms, with preference for Microsoft Azure / Fabric, as well as AWS or GCP. Familiarity with modern data platforms such as Databricks and Snowflake is expected. Architecture & Systems Thinking Experience with lakehouse architectures and distributed data systems, and strong understanding of scalability, reliability, and performance considerations in data pipelines. Mindset Naturally curious, with strong problem-solving skills focused on scalability and reliability, and a collaborative approach to working in cross-functional teams. Comfortable applying common sense thinking, detailed analysis, and experience-based recommendations to help derive and challenge business requirements rather than taking them at face value. Experience in Agile or consulting environments is beneficial. Nice to have qualifications   Experience with GenAI and AI data systems (e.g., RAG pipelines, vector databases, LLM data preparation), as well as CI/CD for data pipelines and infrastructure-as-code tools such as Terraform, ARM, or CloudFormation.  Additional exposure to streaming technologies (e.g., Kafka), Spark optimization, or advanced analytics and ML workloads (including causal or experimentation platforms) is valuable. Experience building data products or large-scale analytics platforms is also beneficial.  Commitment to reaching all kinds of people  We design experiences that work for all kinds of people - and that starts with our own teams. At Valtech, we’re intentional about building an inclusive culture where everyone feels supported to grow, thrive and achieve their goals. No matter your background, you belong here. Explore our Diversity & Inclusion site to see how we’re creating a more equitable Valtech for all.  THE BENEFITS   This is a position based in Portugal.  Beyond a competitive compensation package, we offer:  * Flexibility, with remote and hybrid work options (country-dependent)  * Career advancement, with international mobility and professional development programs  * Learning and development, with access to cutting-edge tools, training and industry experts  Our benefits are tailored to each location. Your Talent Partner will provide full details during the hiring process.  YOUR APPLICATION PROCESS Once you apply, our Talent Acquisition team will review your application. Your CV should cover key information on relevant experiences and expertise. We do not require information such as age, gender, marital status, or a headshot in your application. We review all candidates based on skills, experience, and potential. ⚠️ Beware of recruitment fraud! We are committed to inclusion and accessibility. If you need reasonable accommodations during the interview process, please either indicate it in your application or let your Talent Partner know.  ABOUT VALTECH Valtech is the experience innovation company that exists to unlock a better way to experience the world. By blending crafts, categories, and cultures, we help brands unlock new value in an increasingly digital world.  At the intersection of data, AI, creativity, and technology, we drive transformation for leading organizations, including L’Oréal, Mars, Audi, P&G, Volkswagen Dolby, and more.  At Valtech, we don’t just talk about transformation. We make it happen. Our people are the heart of our success, and we foster a workplace where everyone has the support to thrive, grow and innovate.  Are you ready to create what’s next? Join us.

Ultra Tendency

Ultra Tendency is a global Data & AI consultancy with teams across Europe, Asia, and the Americas. As we continue to expand our presence across Europe, we are looking for a Senior Data Engineer – Databricks to join our growing team and contribute to the development of scalable data platforms for international clients. In this role, you will work closely with data engineers, data scientists, architects, and business stakeholders to design and implement robust data solutions using modern cloud and data technologies. We offer a competitive compensation package aligned with Portuguese market standards, based on experience, location, and qualifications. ---------------------------------------------------------------------------------------------------------------------------------- YOUR RESPONSIBILITIES * Design, implement, and maintain scalable data pipelines on the Databricks Lakehouse Platform using technologies such as Apache Spark and Delta Lake. * Develop and optimize batch and streaming data workflows that support analytics, machine learning, and business intelligence use cases. * Collaborate with cross-functional teams to translate business and data requirements into reliable, production-ready solutions. * Improve the performance, scalability, and cost efficiency of data processing workloads within Databricks environments. * Support the implementation of best practices for data quality, governance, security, and compliance. * Contribute to architectural discussions and help shape modern data platform strategies for clients. * Mentor and support junior engineers while fostering knowledge sharing across the team. ---------------------------------------------------------------------------------------------------------------------------------- YOUR EXPERIENCE * Strong hands-on experience with Databricks and Apache Spark (PySpark, SQL, and/or Scala). * Experience building and operating cloud-based data platforms on AWS, Azure, or GCP. * Solid understanding of distributed data processing, data modeling, data warehousing, and performance optimization. * Experience with CI/CD practices and version control systems such as Git. * Familiarity with orchestration frameworks such as Airflow, Azure Data Factory, or Databricks Workflows. * Experience working in agile and cross-functional environments. * Strong communication skills in English, Portuguese is a plus. * A collaborative mindset and passion for building reliable, scalable, and maintainable data solutions. ---------------------------------------------------------------------------------------------------------------------------------- WHAT WE OFFER * Work with leading enterprise customers across Europe.  * Be part of a rapidly growing Data & AI consultancy.  * Access to cutting-edge technologies in Data Engineering, Analytics, AI, and GenAI.  * Opportunity to shape and expand Ultra Tendency's Databricks practice.  * Continuous learning and certification support.  * Flexible and remote-friendly working environment.  * Competitive compensation package.  * Collaborative, entrepreneurial, and international culture.  ---------------------------------------------------------------------------------------------------------------------------------- ELIGIBILITY  Applicants must currently reside in Portugal and possess the legal right to work in the country. Unfortunately, we are unable to provide relocation assistance or visa sponsorship for this position.  ---------------------------------------------------------------------------------------------------------------------------------- INTERESTED? We would love to hear from you. Apply today or reach out to learn more about the role, our team, and the exciting projects you'll have the opportunity to work on. ABOUT US Ultra Tendency is an international Data Engineering consultancy specializing in Big Data, Cloud, Streaming, IIoT, and Microservices. Since 2010, we have helped leading organizations—including the European Central Bank, Deutsche Telekom, and Europe’s largest automotive manufacturer—build and operate large-scale, data-driven platforms. With 8 offices across 10 countries and a growing global team, we combine deep technical expertise with a strong commitment to open source. Our consultants actively contribute to projects such as Apache Kafka, Apache NiFi, Terraform, and Ansible, and we are a trusted Databricks partner. At Ultra Tendency, you'll work on challenging projects that push the boundaries of Data and AI while collaborating with talented colleagues in a culture built on learning, knowledge sharing, and mutual support. We evaluate candidates based on skills, experience, and business fit, and welcome applicants from all backgrounds. Data privacy statement: Data Protection for Applicants – Ultra Tendency

GoCardless

About us GoCardless is a global bank payment company. Over 100,000 businesses, from start-ups to household names, use GoCardless to collect and send payments through direct debit, real-time payments and open banking.  GoCardless processes US$130bn+ of payments annually, across 30+ countries; helping customers collect and send both recurring and one-off payments, without the chasing, stress or expensive fees. We use AI-powered solutions to improve payment success and reduce fraud. And, with open banking connectivity to over 2,500 banks, we help our customers make faster, more informed decisions. We are headquartered in the UK with offices in London and Leeds, and additional locations in Australia, France, Ireland, Latvia, Portugal and the United States. At GoCardless, we're all about supporting you! We’re committed to making our hiring process inclusive and accessible. If you need extra support or adjustments, reach out to your Talent Partner — we’re here to help!  And remember: we don’t expect you to meet every single requirement. If you’re excited by this role, we encourage you to apply! THE ROLE Fraud prevention is an ever-evolving puzzle, making it one of the most rewarding and impactful areas in fintech. At GoCardless, our Fraud Prevention team develops the intelligent systems that protect our platform, our merchants, and their customers. As a Senior Data Scientist, you will guide the design and delivery of models that operate in real time across our global payment network. You’ll work at the intersection of machine learning, graph-based detection, and behavioural modelling to stay ahead of changing patterns turning research into production systems that make a tangible difference in the fight against financial crime. You’ll collaborate closely with Engineers, Fraud Analysts, and Product Managers to help shape the technical roadmap as we expand into new markets. Our stack is centred around Google Cloud Platform and Vertex AI, using Python, SQL, and BigQuery to build and support high-performance models at scale. WHAT YOU'LL DO * Contribute to the full model lifecycle, from initial discovery and feature engineering through to production, experimentation, and continuous monitoring. * Design and refine real-time ML systems that reduce false positives and ensure a smooth, secure experience for legitimate customers. * Foster a responsive feedback loop, adapting models as patterns evolve to ensure our defences remain robust and effective. * Help shape the technical direction of fraud prevention ML at GoCardless, exploring new approaches as we grow globally. * Support the team’s growth through technical mentorship, knowledge sharing, and a commitment to high-quality code. WHAT EXCITES YOU * Solving complex, dynamic problems: Developing systems that can adapt and respond to changing environments. * End-to-end ownership: Seeing a project through from a conceptual business need to a live, impactful solution. * Strategic influence: Contributing to the ML roadmap and helping determine what we build next, rather than just how we build it. * Holistic Data Science: Engaging in deep-dive analysis, prototyping, and live experimentation. * Modern Infrastructure: Building production-grade models on GCP and Vertex AI, with the flexibility to explore advanced architectures. WHAT EXCITES US * You hold a degree (or PhD) in a STEM discipline, or bring equivalent depth through commercial experience. * You have hands-on experience with modelling approaches such as deep learning, graph-based methods, or sequence models. While fintech experience is great, we value transferable skills from fields like cybersecurity or risk modelling. * You have a track record of deploying models in production that create measurable value. * You can translate complex ML concepts into clear, practical solutions for stakeholders across the business. * You enjoy writing clean code and helping the team thrive through thoughtful reviews and shared learning.   Base salary range: €55,200 - €82,800 Please note this range is indicative. The budget for this role is flexible and will be shaped by the hiring process - we're open to discussing what's right based on the individual. Base salary ranges are based on role, job level, location, and market data.  Please note that whilst we strive to offer competitive compensation, our approach is to pay between the minimum and the mid-point of the pay range until performance can be assessed in role. Offers will take into account level of experience, interview assessment, budgets and parity between you and fellow employees at GoCardless doing similar work. (SOME OF) THE GOOD STUFF * Wellbeing - stay healthy with dedicated support and medical cover * Work away scheme - gives you the option to work away from your country of residence for up to 90 days in any 12 month period * Adaptive Working - allows you to work flexibly, around your lifestyle * Equity - all permanently employed GCs get equity to help you make a valuable contribution * Parental leave - to suit everyone embarking on life's great adventure * Learning Budget - lead your own development with an annual learning budget * Time off - generous holiday allowance, + 3 annual volunteer days, + 4 annual business-wide wellness days (‘GC Fridays’) LIFE AT GOCARDLESS   We're an organisation defined by our values; We start with why before we begin any project, to ensure it’s aligned with our mission. We act with integrity, always. We care deeply about what we do and we know it's essential that we be humble whilst we do it. Working this way creates the GC magic- the reason we all love showing up to work.  DIVERSITY & INCLUSION As of April 2025, we had 806 employees (GeeCees) globally, with 524 based in the UK, 163 based in Latvia and 119 across our other offices. To ensure that we're representative of the world around us - and to be able to review relevant benchmarks - we ask GeeCees to voluntarily disclose diversity data. This year, the proportion of GeeCees providing data increased to 88% (up from 79% in 2024). With regards to diversity within GoCardless, we can see GeeCees identifying as: Asian, Black, Mixed or Other — 25%  Neurodiverse — 9%  LGBTQIA+ — 9%  Disabled — 1%  Average age — 33 Female — 45% Male —  55%  We’re rooting for you during your application and GoCardless aims to provide reasonable adjustments to make our recruitment process as remarkable and accessible as we can. Please speak to your Talent Partner if you need extra support. If you want to learn more, you can read about our Employee Resource Groups and objectives here Sustainability We’re committed to reducing our impact on the environment, leaving a more sustainable world for future generations. Check out our sustainability action plan here. Find out more about Life at GoCardless via Twitter, Instagram and LinkedIn.