Data Engineer

Capital.com

We are a leading trading platform that is ambitiously expanding to the four corners of the globe. Our top-rated products have won prestigious industry awards for their cutting-edge technology and seamless client experience. We deliver only the best, so we are always in search of the best people to join our ever-growing talent team.  As a Data Engineer, you will play a crucial role in our data team, contributing to developing and maintaining data pipelines and systems. You will work closely with data scientists, analysts, and other stakeholders to ensure the availability and reliability of data for decision-making and analytics. Your responsibilities will encompass data ingestion, transformation, and delivery, as well as maintaining and optimizing data infrastructure.   The Data Engineer is expected to contribute to developing and maintaining data infrastructure, ensuring data reliability and availability. You should be able to work independently and as part of a team, adapting to changing data needs and collaborating with data professionals to provide valuable insights to the organization. Staying current with data engineering best practices and emerging technologies is essential for success in this role.

The Dot Collective

ABOUT THE DOT COLLECTIVE We are a new generation consultancy based across UK and EU and founded on the premises of the engineering excellence and empowering people to make an impact.  We work with all modern tech stacks and typically run agile scrum on all our projects. ABOUT YOU Are you passionate about data and its transformational powers? Do you like being able to make a huge difference in a limited period of time? We might be just the right place for you. Your key skills and capabilities: ·      Implementing cloud-native data platforms ·      Engineering scalable and reliable pipelines ·      Good knowledge of distributed computing with Spark ·      Understanding of cloud architecture principles and best practices ·      Hands-on experience in designing, deploying, and managing cloud resources ·      Excellent python and SQL skills ·      Agile ways of working ·      Experience in cloud automation and orchestration using tools such as CloudFormation or Terraform ·      Monitoring and performance tuning of cloud-based applications and services Nice to haves: (MLOps):   * Model Deployment & Serving – Deploy and manage ML models using MLflow, Azure ML, SageMaker, or similar, ensuring scalability and performance.  *  Monitoring & Retraining – Set up model drift detection, performance monitoring, and automated retraining  * ML Pipelines & CI/CD – Automate end-to-end ML workflows  We expect you to have some knowledge about how to architect, design, develop, deploy, and operate a data platform.  OUR PROMISE TO YOU We will always see you as a human being and will do our very best to support your needs and wellbeing – well-designed co-working and collaboration spaces, remote working patterns that work for you, parenting leave, sabbaticals and ability to work on personal projects. We believe that a geled team is worth its weight in gold – we will do everything we can to avoid breaking well-performing teams. Whilst continuity across every project is not always possible, we thoughtfully assemble high-performing, blended teams with the appropriate levels of experience and expertise to deliver the best outcomes for our clients — and teams you’ll enjoy working with. We are committed to prioritising the wellbeing of our employees. To fulfill this promise, we provide a comprehensive employee wellbeing program that includes mental health support, flexible working arrangements, wellness activities, and a positive work culture. We recognise that the world of tech delivery has moved on significantly in the last 15 years and know a thing or two about how to bring projects over the line without experiencing lots of despair and burn-out. In fact, we like to believe that our projects are the opposite of that – they are run smoothly and most of the time are fun to work on.

The Dot Collective

ABOUT THE DOT COLLECTIVE We are a new generation consultancy based across UK and EU and founded on the premises of the engineering excellence and empowering people to make an impact.  We work with all modern tech stacks and typically run agile scrum on all our projects. ABOUT YOU Are you passionate about data and its transformational powers? Do you like being able to make a huge difference in a limited period of time? We might be just the right place for you. Your key skills and capabilities:  * Strong SQL and Python skills   * Data modelling experience (dimensional, relational, or similar)   * Experience building and maintaining backend systems   * Familiarity with Microsoft Azure   * Understanding of APIs, containers, and backend development best practices  * Implementing cloud-native data platforms  * Engineering scalable and reliable pipelines  * Good knowledge of distributed computing with Spark  * Understanding of cloud architecture principles and best practices  * Hands-on experience in designing, deploying, and managing cloud resources  * Agile ways of working  * Experience in cloud automation and orchestration using tools such as CloudFormation or Terraform  * Monitoring and performance tuning of cloud-based applications and services   Nice to haves:   * Experience with Snowflake, dbt, CubeJS  * Experience with Databricks, PySpark, ML workflows   * Experience with containerized deployments (Docker, Kubernetes, Azure Container Apps).   * Frontend development experience (React, Next.js, TypeScript)   * Infrastructure-as-code (Terraform, CloudFormation)  * Model Deployment & Serving – Deploy and manage ML models using MLflow, Azure ML, SageMaker, or similar, ensuring scalability and performance   * Monitoring & Retraining – Set up model drift detection, performance monitoring, and automated retraining    * ML Pipelines & CI/CD – Automate end-to-end ML workflows    Key tasks:     * Develop, maintain, and optimise backend services for our SaaS platform   * Work with SQL and Python daily to build robust data pipelines and transformations   * Model, structure, and query data to support product features and reporting   * Integrate and maintain data ingestion flows (e.g., Fivetran, custom connectors)   * Implement backend APIs (FastAPI) to power our web application   * Work with our cloud environment (Azure - experience with AWS or GCP also valuable)   * Collaborate with teammates to plan, build, and deploy features in an Agile way  * Contribute to CI/CD workflows, monitoring, and infrastructure-as-code    We expect you to have some knowledge about how to architect, design, develop, deploy, and operate a data platform.   OUR PROMISE TO YOU We will always see you as a human being and will do our very best to support your needs and wellbeing – well-designed co-working and collaboration spaces, remote working patterns that work for you, parenting leave, sabbaticals and ability to work on personal projects. We believe that a geled team is worth its weight in gold – we will do everything we can to avoid breaking well-performing teams. Whilst continuity across every project is not always possible, we thoughtfully assemble high-performing, blended teams with the appropriate levels of experience and expertise to deliver the best outcomes for our clients — and teams you’ll enjoy working with. We are committed to prioritising the wellbeing of our employees. To fulfill this promise, we provide a comprehensive employee wellbeing program that includes mental health support, flexible working arrangements, wellness activities, and a positive work culture. We recognise that the world of tech delivery has moved on significantly in the last 15 years and know a thing or two about how to bring projects over the line without experiencing lots of despair and burn-out. In fact, we like to believe that our projects are the opposite of that – they are run smoothly and most of the time are fun to work on.