Senior Data Engineer - Databricks (m/f/*)

Ultra Tendency

ABOUT ULTRA TENDENCY Ultra Tendency is a leading data and AI consultancy helping organizations accelerate digital transformation through modern data platforms, advanced analytics, and AI-driven solutions. As a trusted partner to enterprise customers across Europe, we specialize in delivering cloud-native data architectures and scalable solutions that unlock business value. We are expanding our Databricks practice and are looking for an experienced Senior Databricks Consulting Engineer to work closely with our clients and delivery teams across EMEA. ---------------------------------------------------------------------------------------------------------------------------------- THE ROLE As a Senior Databricks Consulting Engineer, you will serve as a trusted technical advisor and strategic partner to enterprise customers. You will guide organizations through their data and AI transformation journeys, helping them design, implement, and optimize modern data platforms built on Databricks. You will combine deep technical expertise with strong stakeholder management skills to ensure customers realize measurable value from their Databricks investments. Working alongside client teams, executives, engineers, and Ultra Tendency consultants, you will lead architecture decisions, promote best practices, and drive successful adoption of the Databricks Lakehouse Platform. This is a highly customer-facing role requiring both hands-on technical capability and executive-level communication skills. ---------------------------------------------------------------------------------------------------------------------------------- KEY RESPONSIBILITIES CUSTOMER ADVISORY & ARCHITECTURE * Act as the primary technical advisor for strategic Databricks customers. * Design and review scalable data, analytics, and AI architectures leveraging the Databricks Lakehouse Platform. * Lead architecture workshops, solution design sessions, and technical roadmap discussions. * Translate business requirements into technical solutions and implementation plans. * Advise customers on platform modernization, cloud migration, data governance, and AI initiatives. SOLUTION DELIVERY & OPTIMIZATION * Support the successful implementation and adoption of Databricks solutions. * Review data engineering, analytics, machine learning, and GenAI workloads for scalability, performance, security, and cost optimization. * Identify and resolve technical blockers during customer engagements. * Drive architectural best practices for data pipelines, Lakehouse design, Unity Catalog, governance, and platform operations. TECHNICAL LEADERSHIP * Serve as a subject matter expert on Databricks capabilities and emerging data & AI technologies. * Mentor customer teams and Ultra Tendency consultants on architecture patterns and best practices. * Deliver executive presentations, technical workshops, and enablement sessions. * Contribute to reusable assets, reference architectures, and practice development initiatives. BUSINESS DEVELOPMENT SUPPORT * Partner with sales and account teams during strategic customer engagements. * Support technical discovery, solution positioning, and proposal development. * Provide architecture guidance during pre-sales and proof-of-concept activities. * Identify opportunities for platform expansion and increased customer value. ---------------------------------------------------------------------------------------------------------------------------------- REQUIRED QUALIFICATIONS * 7+ years of experience in data engineering, cloud architecture, analytics, or related fields. * 3+ years working with Databricks in enterprise environments. * Strong expertise in modern data platform architecture and cloud-native solutions. * Hands-on experience designing and implementing Lakehouse architectures. * Strong knowledge of: * Databricks Data Intelligence Platform * Apache Spark * Delta Lake * Unity Catalog * Data Governance & Security * Data Warehousing and Lakehouse Design * ETL/ELT Architectures * Data Modeling * Experience with at least one major cloud platform: * Microsoft Azure (preferred) * AWS * Google Cloud Platform * Proficiency in: * Python * SQL * Spark * Experience engaging with executive stakeholders and technical leadership teams. * Excellent communication and presentation skills in English. PREFERRED QUALIFICATIONS * Databricks certifications such as: * Databricks Certified Data Engineer Professional * Databricks Certified Solutions Architect * Databricks Certified Machine Learning Professional * Experience with: * Generative AI and LLM solutions * MLflow * MLOps * Data Governance frameworks * Data Mesh architectures * Real-time and streaming data platforms * Experience in consulting or professional services environments. ---------------------------------------------------------------------------------------------------------------------------------- WHAT SUCCESS LOOKS LIKE * Customers successfully adopt and scale Databricks solutions. * Complex technical challenges are resolved quickly and effectively. * Executive stakeholders view you as a trusted advisor. * Best practices are consistently applied across customer environments. * Customer satisfaction, platform utilization, and business outcomes improve measurably. ---------------------------------------------------------------------------------------------------------------------------------- WHY JOIN ULTRA TENDENCY? * Work with leading enterprise customers across Europe. * Be part of a rapidly growing Data & AI consultancy. * Access to cutting-edge technologies in Data Engineering, Analytics, AI, and GenAI. * Opportunity to shape and expand Ultra Tendency's Databricks practice. * Continuous learning and certification support. * Flexible and remote-friendly working environment. * Competitive compensation package. * Collaborative, entrepreneurial, and international culture. ---------------------------------------------------------------------------------------------------------------------------------- ELIGIBILITY Applicants must currently reside in Portugal and possess the legal right to work in the country. Unfortunately, we are unable to provide relocation assistance or visa sponsorship for this position. ABOUT US Ultra Tendency is an international Data Engineering consultancy specializing in Big Data, Cloud, Streaming, IIoT, and Microservices. Since 2010, we have helped leading organizations—including the European Central Bank, Deutsche Telekom, and Europe’s largest automotive manufacturer—build and operate large-scale, data-driven platforms. With 8 offices across 10 countries and a growing global team, we combine deep technical expertise with a strong commitment to open source. Our consultants actively contribute to projects such as Apache Kafka, Apache NiFi, Terraform, and Ansible, and we are a trusted Databricks partner. At Ultra Tendency, you'll work on challenging projects that push the boundaries of Data and AI while collaborating with talented colleagues in a culture built on learning, knowledge sharing, and mutual support. We evaluate candidates based on skills, experience, and business fit, and welcome applicants from all backgrounds. Data privacy statement: Data Protection for Applicants – Ultra Tendency

Valtech

Why Valtech? We’re the experience innovation company - a trusted partner to the world’s most recognized brands. To our people we offer growth opportunities, a values-driven culture, international careers and the chance to shape the future of experience.  THE OPPORTUNITY At Valtech, you’ll find an environment designed for continuous learning, meaningful impact, and professional growth. Whether you're pioneering new digital solutions, challenging conventional thinking or building the next generation of customer experiences, your work will help transform industries.  We are proud of:  * The work we do and the innovation we drive  * Our values of share, care and dare  * A workplace culture that fosters creativity, diversity and autonomy  * Our borderless, global framework, which enables seamless collaboration  The role   We are looking for an experienced Senior Data Engineer to design, build, and optimize modern, cloud-based data platforms that power analytics, AI, and data products across the organization. Beyond technical delivery, we're looking for someone genuinely curious about the business problems behind the data — someone who can apply common sense thinking, detailed analysis, and experience-based recommendations to help derive and shape business requirements, not just implement them as given. You will work on scalable batch, streaming, and near-real-time pipelines, enabling high-quality, curated datasets while ensuring robust data governance, security, and observability across the data ecosystem. You will also play a key role in supporting AI and GenAI systems, enabling pipelines for machine learning, causal modeling, and LLM-powered applications such as RAG and agent-based systems. Our preferred platforms are Microsoft Azure / Fabric (primary), GCP, AWS, Databricks, and Snowflake, with Azure experience being highly transferable to Fabric. You will collaborate closely with data scientists, ML engineers, and platform teams to ensure the data foundation supports production-grade, decision-oriented AI systems. Role responsibilities Build & Data Platform Engineering Design and implement scalable data platforms and pipelines across cloud environments (Azure/Fabric, AWS, GCP, Databricks, Snowflake). This includes developing reliable batch, streaming, and near-real-time pipelines using technologies such as Spark and Delta Lake, and building ingestion, transformation, and curation workflows for both structured and unstructured data. You will implement modern data architectures including lakehouse patterns and medallion layering (bronze, silver, gold), ensuring systems are reusable, scalable, and aligned with enterprise needs. Enable AI, GenAI & Data Products Deliver high-quality datasets that support analytics, machine learning, causal modeling, and optimization systems. You will enable data pipelines for GenAI use cases (including LLMs, RAG pipelines, and vector-based data flows), as well as agent-based architectures and intelligent workflows, ensuring that data is model-ready and production-grade. Data Modeling, Orchestration & Automation Design scalable logical and physical data models for analytical and operational use cases, ensuring consistency across domains. Orchestrate workflows using tools such as Airflow, dbt, Lakeflow, or equivalents, with strong focus on automation, reliability, and maintainability of end-to-end pipelines. Architecture, Governance & Observability Apply modern architecture patterns including event-driven and streaming architectures, and ensure adherence to best practices in data governance, lineage, quality, and access control (RBAC/ABAC). Establish strong data observability, including monitoring of data freshness, pipeline reliability, and SLA adherence, ensuring systems remain trustworthy and production-ready. Data Serving, Integration & Optimization Enable data serving layers (APIs, feature inputs, analytical endpoints) to support downstream systems, including ML and AI platforms. Continuously monitor and optimize pipelines and infrastructure for performance, scalability, and cost efficiency. Requirements Discovery & Business Partnership Bring genuine curiosity to every engagement — ask the right questions to understand not just what stakeholders are asking for, but why. Apply common sense thinking, detailed analysis, and experience-based recommendations to help derive and refine business requirements, surfacing gaps or better alternatives where they exist rather than simply executing a brief as written. Collaboration Work closely with data scientists, ML engineers, analysts, and business stakeholders to translate requirements into robust data solutions. Support adoption of data products and contribute to best practices across the data and AI ecosystem. Must have qualifications Technical skills Strong hands-on experience with Apache Spark and Delta Lake, and strong programming skills in Python and SQL. Proven experience building batch and streaming data pipelines and production-grade data platforms, with solid understanding of data modeling, data quality, and governance principles. Cloud & Platforms (Key Requirement) Experience with one or more major cloud platforms, with preference for Microsoft Azure / Fabric, as well as AWS or GCP. Familiarity with modern data platforms such as Databricks and Snowflake is expected. Architecture & Systems Thinking Experience with lakehouse architectures and distributed data systems, and strong understanding of scalability, reliability, and performance considerations in data pipelines. Mindset Naturally curious, with strong problem-solving skills focused on scalability and reliability, and a collaborative approach to working in cross-functional teams. Comfortable applying common sense thinking, detailed analysis, and experience-based recommendations to help derive and challenge business requirements rather than taking them at face value. Experience in Agile or consulting environments is beneficial. Nice to have qualifications   Experience with GenAI and AI data systems (e.g., RAG pipelines, vector databases, LLM data preparation), as well as CI/CD for data pipelines and infrastructure-as-code tools such as Terraform, ARM, or CloudFormation.  Additional exposure to streaming technologies (e.g., Kafka), Spark optimization, or advanced analytics and ML workloads (including causal or experimentation platforms) is valuable. Experience building data products or large-scale analytics platforms is also beneficial.  Commitment to reaching all kinds of people  We design experiences that work for all kinds of people - and that starts with our own teams. At Valtech, we’re intentional about building an inclusive culture where everyone feels supported to grow, thrive and achieve their goals. No matter your background, you belong here. Explore our Diversity & Inclusion site to see how we’re creating a more equitable Valtech for all.  THE BENEFITS   This is a position based in Portugal.  Beyond a competitive compensation package, we offer:  * Flexibility, with remote and hybrid work options (country-dependent)  * Career advancement, with international mobility and professional development programs  * Learning and development, with access to cutting-edge tools, training and industry experts  Our benefits are tailored to each location. Your Talent Partner will provide full details during the hiring process.  YOUR APPLICATION PROCESS Once you apply, our Talent Acquisition team will review your application. Your CV should cover key information on relevant experiences and expertise. We do not require information such as age, gender, marital status, or a headshot in your application. We review all candidates based on skills, experience, and potential. ⚠️ Beware of recruitment fraud! We are committed to inclusion and accessibility. If you need reasonable accommodations during the interview process, please either indicate it in your application or let your Talent Partner know.  ABOUT VALTECH Valtech is the experience innovation company that exists to unlock a better way to experience the world. By blending crafts, categories, and cultures, we help brands unlock new value in an increasingly digital world.  At the intersection of data, AI, creativity, and technology, we drive transformation for leading organizations, including L’Oréal, Mars, Audi, P&G, Volkswagen Dolby, and more.  At Valtech, we don’t just talk about transformation. We make it happen. Our people are the heart of our success, and we foster a workplace where everyone has the support to thrive, grow and innovate.  Are you ready to create what’s next? Join us.

GoCardless

About us GoCardless is a global bank payment company. Over 100,000 businesses, from start-ups to household names, use GoCardless to collect and send payments through direct debit, real-time payments and open banking.  GoCardless processes US$130bn+ of payments annually, across 30+ countries; helping customers collect and send both recurring and one-off payments, without the chasing, stress or expensive fees. We use AI-powered solutions to improve payment success and reduce fraud. And, with open banking connectivity to over 2,500 banks, we help our customers make faster, more informed decisions. We are headquartered in the UK with offices in London and Leeds, and additional locations in Australia, France, Ireland, Latvia, Portugal and the United States. At GoCardless, we're all about supporting you! We’re committed to making our hiring process inclusive and accessible. If you need extra support or adjustments, reach out to your Talent Partner — we’re here to help!  And remember: we don’t expect you to meet every single requirement. If you’re excited by this role, we encourage you to apply! GoCardless are here to support you and we’re committed to making the hiring process inclusive and accessible for everyone. If you need any extra support or any adjustments made, please reach out to your Talent Partner. Remember, we don’t expect you to meet every requirement. If you’re excited by this role, we encourage you to apply PLATFORM ENGINEERING AT GOCARDLESS The Platform Engineering team is a unified, globally distributed team. We are currently located in London, Riga, and Lisbon. We work with all other engineering teams to empower them to build, release, run and scale their products. We operate with a strong focus on both strategic project delivery and operational excellence. Our work is a balance of: * Project Delivery: Building new platform components, from initial design to deployment. * Operational Support: Ensuring the health and stability of our systems through on-call rotations and incident management. * Business as Usual (BAU): Continuous maintenance, improvements, and support for audits and compliance.   Tech stack and tools: * Python, Ruby, Golang; * Terraform; * Atlantis  * AWS, GCP; * Kubernetes, GKE; * Github, GitHub Actions, ArgoCD; * Grafana, Prometheus; * Datadog WHAT EXCITES YOU: We use a wide range of technologies, and will never expect you to have experience with all of them. We do hope that you are enthusiastic about the infrastructure space and the impact your work can have on others. To enjoy this work you’ll be excited by: * Building and maintaining automation of new and existing infrastructure; * Appreciate and believe in building easy-to-understand and maintain tools to solve problems; * Automating operational tasks to eliminate toil using your software development skills and experience; * Ensuring that systems are safe and secure against cybersecurity threats; * Working closely with software engineers and data scientists; * Being involved in the technical design of architecture and making technical decisions; * Cloud-first engineering; * Ongoing opportunities to further develop your skills; * Care about working with people who share the same values as you and who will continually push you to grow. WHAT EXCITES US  * Experience with at least one programming language such as Python, Ruby, Golang etc.; * Experience with IaC tooling, such as Terraform; * Previous experience with Terraform automation toolings such as Terragrunt or Atlantis will be considered an advantage; * Experience with cloud computing providers such as AWS or GCP; * Experience with containerized applications; * Previous experience with container orchestration such as Kubernetes and GKE will be considered an advantage; * Experience with CI/CD tooling such as Github, GitHub Actions, ArgoCD, etc.; * Experience working with monitoring tooling such as Grafana, Prometheus, etc.; * Experience with relational databases and other datastores, especially around high availability and performance optimisation; * Awareness of DevOps and Agile principles; * Fluency in English; * Excellent teamwork and communication skills. Base salary range:  Site Reliability Engineer II: €43,200 to €64,800 gross Site Reliability Engineer III: €58,400 to €87,600 gross Senior Site Reliability Engineer: €76,000 to €114,000 gross Base salary ranges are based on role, job level, location, and market data. Please note that whilst we strive to offer competitive compensation, our approach is to pay between the minimum and the mid-point of the pay range until performance can be assessed in role. Offers will take into account level of experience, interview assessment, budgets and parity between you and fellow employees at GoCardless doing similar work. (SOME OF) THE GOOD STUFF * Wellbeing - stay healthy with dedicated support and medical cover * Work away scheme - gives you the option to work away from your country of residence for up to 90 days in any 12 month period * Adaptive Working - allows you to work flexibly, around your lifestyle * Equity - all permanently employed GCs get equity to help you make a valuable contribution * Parental leave - to suit everyone embarking on life's great adventure * Learning Budget - lead your own development with an annual learning budget * Time off - generous holiday allowance, + 3 annual volunteer days, + 4 annual business-wide wellness days (‘GC Fridays’) LIFE AT GOCARDLESS   We're an organisation defined by our values; We start with why before we begin any project, to ensure it’s aligned with our mission. We act with integrity, always. We care deeply about what we do and we know it's essential that we be humble whilst we do it. Working this way creates the GC magic- the reason we all love showing up to work.  DIVERSITY & INCLUSION As of April 2025, we had 806 employees (GeeCees) globally, with 524 based in the UK, 163 based in Latvia and 119 across our other offices. To ensure that we're representative of the world around us - and to be able to review relevant benchmarks - we ask GeeCees to voluntarily disclose diversity data. This year, the proportion of GeeCees providing data increased to 88% (up from 79% in 2024). With regards to diversity within GoCardless, we can see GeeCees identifying as: Asian, Black, Mixed or Other — 25%  Neurodiverse — 9%  LGBTQIA+ — 9%  Disabled — 1%  Average age — 33 Female — 45% Male —  55%  We’re rooting for you during your application and GoCardless aims to provide reasonable adjustments to make our recruitment process as remarkable and accessible as we can. Please speak to your Talent Partner if you need extra support. If you want to learn more, you can read about our Employee Resource Groups and objectives here Sustainability We’re committed to reducing our impact on the environment, leaving a more sustainable world for future generations. Check out our sustainability action plan here. Find out more about Life at GoCardless via Twitter, Instagram and LinkedIn.