Senior Data Engineer (eDV)

Aker Systems

Aker Systems was founded in 2017 by a team of experienced technology professionals who recognised an opportunity to provide highly secure enterprise data platforms to large organisations.  We build and operate ground-breaking, ultra-secure, high performance, cloud-based data infrastructure for the enterprise. Our proprietary technology solutions drive performance and reduce costs while helping our clients to improve the management and sharing of data across their organisations. In 2024, Aker Systems won the Breakthrough Culture Awards highlighting growth companies putting culture first. In 2020 Aker Systems was recognised as a ‘One to Watch’ on the Sunday Times Tech Track.  The Company was also recognised at the Thames Valley Tech Awards 2020; winning the Thames Valley Tech Company of the year, the Emerging Tech Company and High Growth Tech Business categories.  We encourage people of all different backgrounds and identities to apply.  We are committed to maintaining an inclusive, and supportive place for you to do your very best work. Due to the nature of the work and the customers, you must hold enhanced DV Security Clearance. As a Lead Data Architect, with a minimum of 6 years of experience, you will play a role in shaping data strategy and ensuring the success of our client’s complex, critical high-profile projects. You will support the design and implementation of secure, scalable, and resilient data architectures on AWS and other cloud platforms, while also serving as a mentor to a team of skilled data professionals. Duties & Responsibilities * Engage with stakeholders, both internal and external, to understand business requirements, provide strategic guidance, and ensure that data solutions meet their objectives * Support the design, development, and implementation of data architectures that meet the needs of our clients, ensuring alignment with security, performance, and scalability requirements * Utilise extensive experience with AWS tooling and other cloud providers to architect and deploy secure, cloud-native solutions for batch and real-time data processing * Provide technical leadership and guidance to cross-functional teams, ensuring best practices in data architecture, security, and cloud computing * Proficiency in data modelling, ETL processes, data warehousing, distributed systems and metadata systems * Utilise Apache Flink and other streaming technologies to build real-time data processing systems that handle large-scale, high-throughput data * Ensure all data solutions comply with industry standards and government regulations, maintaining the highest levels of data security and integrity * Monitor technical deliverables against the designs, manage and report on design divergences * Support the sales and pre-sales teams by providing expert advice and input on proposals, ensuring technical feasibility and alignment with client needs * Advise and support on breaches of data standards and make recommendations about how they should be resolved * Stay up to date with the latest advancements in cloud technologies, data architecture, and security practices, and apply this knowledge to continuously improve our offerings Core Experience and Competencies * 6+ years of experience in data architecture, with a focus on secure, large-scale, and complex projects * Extensive experience with AWS services, including but not limited to EC2, S3, RDS, Lambda, and Redshift. Experience with other cloud providers (e.g., Azure, GCP) is a plus * In-depth knowledge and hands-on experience with Apache Flink for real-time data processing * Proven experience in mentoring and managing teams, with a focus on developing talent and fostering a collaborative work environment * Strong ability to engage with and influence senior stakeholders, understanding their needs and translating them into actionable technical plans * Desirable skills in Scala and Spark to support wider programmes of work * Hands-on Public Cloud experience in either AWS/Azure/Google Cloud Platform, both their ‘services’ and ‘how’ to work in the cloud such as DevOps-centric approach * Having worked in sensitive data environments and ideally have experience facing off to cyber security specialists * Understand and apply recognised data modelling patterns and standards Aker Systems Attributes At Aker we work as a team; we are collaborative, hardworking, open, and delivery obsessed. There is no blame culture here: try things, and take responsibility for the outcomes. You are always part of the wider Aker. We help our colleagues and take pride in successfully achieving difficult tasks. We run towards problems and help to solve them. Communicate always, do so accurately and in a timely fashion. In return, we offer a competitive salary, 25 days holiday plus bank holidays, company paid medical insurance and life assurance, pension scheme, annual training allowance, wellbeing allowance, virtual GP, Employee Assistance plan and more. Equal Opportunities Aker Systems fosters a diverse environment that encourages openness in its communications and is committed to providing equal employment opportunity for all people regardless of race, religion, gender or sexual orientation, age, marital status, national origin, citizenship status, disability, veteran status or other personal characteristics. We embrace differences of opinion and diversity because they help challenge us and find new groundbreaking technical solutions.

Adyen

This is Adyen Adyen provides payments, data, and financial products in a single solution for customers like Meta, Uber, H&M, and Microsoft - making us the financial technology platform of choice. At Adyen, everything we do is engineered for ambition.  For our teams, we create an environment with opportunities for our people to succeed, backed by the culture and support to ensure they are enabled to truly own their careers. We are motivated individuals who tackle unique technical challenges at scale and solve them as a team. Together, we deliver innovative and ethical solutions that help businesses achieve their ambitions faster. Sitting at the intersection of Data Engineering, Backend Engineering, and Systems Engineering, Data Platform Engineers at Adyen build the foundational layer of tooling and processes for our on-premise Big Data Platforms. These tools support 10s of products, 100s of developers, and 1000s of daily jobs that add to Adyen’s strong portfolio of capabilities. You’ll collaborate with data engineers and ML scientists and engineers to build and roll-out these tools. Along with DataOps Engineers, you’ll develop and operate multiple big data platforms, of which the biggest is 500+ nodes, with 25k+ CPU cores, 240+ TBs of RAM, and 23+ PBs of storage capacity, running tens of thousands of spark jobs a day. YOUR FOCUS AREAS We are currently expanding our platform capabilities. Depending on your expertise, your immediate focus will be driving one of these two key ecosystems: * The OLAP Ecosystem: Scaling and optimizing our real-time analytical powerhouses (Druid, FastAPI, Java, Kafka). * The Data Engineering Ecosystem: Designing and building data contracts, validation frameworks, optimization tooling, and robust Kafka ingestion pipelines. WHAT YOU’LL DO You will balance building innovative new tools from scratch with relentlessly improving our existing infrastructure. This role is a perfect fit if you are passionate about: * Scale: Developing and maintaining high-performance, distributed big data platforms. * Distributed Systems: Working deeply with various flavors of databases, filesystems, and compute engines. * Data Quality & Discoverability: Building tools that enhance metadata collection, data lineage, and platform-wide data quality. * CI/CD & Infrastructure: Optimizing continuous release/deployment environments within a large-scale private cloud system. * Streaming: Developing stream processing applications and frameworks to reduce time-to-insight for analysts and data scientists. WHO YOU ARE * Python or Java Expert: 6+ years of experience with object-oriented programming. * Collaborative Enabler: A strong communicator who thrives on building bridges between the teams you enable (analysts, data scientists) and the teams you depend on (infrastructure, security). * Distributed Systems Architect: Proven experience developing and maintaining: * Distributed compute/data systems (e.g., Spark, Trino, Druid, ClickHouse). * Real-time and batch pipelines (Kafka, Spark Streaming) with a focus on user-friendliness and reliability. DevOps pipelines and data modeling tooling. Our Diversity, Equity and Inclusion commitments  Our unique approach is a product of our diverse perspectives. This diversity of backgrounds and cultures is essential in helping us maintain our momentum. Our business and technical challenges are unique, and we need as many different voices as possible to join us in solving them - voices like yours. No matter who you are or where you’re from, we welcome you to be your true self at Adyen.  Studies show that women and members of underrepresented communities apply for jobs only if they meet 100% of the qualifications. Does this sound like you? If so, Adyen encourages you to reconsider and apply. We look forward to your application! What’s next? Ensuring a smooth and enjoyable candidate experience is critical for us. We aim to get back to you regarding your application within 5 business days. Our interview process tends to take about 4 weeks to complete, but may fluctuate depending on the role. Learn more about our hiring process here. Don’t be afraid to let us know if you need more flexibility. This role is based out of our Amsterdam office. We are an office-first company and value in-person collaboration; we do not offer remote-only roles.

Adyen

This is Adyen Adyen provides payments, data, and financial products in a single solution for customers like Meta, Uber, H&M, and Microsoft - making us the financial technology platform of choice. At Adyen, everything we do is engineered for ambition.  For our teams, we create an environment with opportunities for our people to succeed, backed by the culture and support to ensure they are enabled to truly own their careers. We are motivated individuals who tackle unique technical challenges at scale and solve them as a team. Together, we deliver innovative and ethical solutions that help businesses achieve their ambitions faster. Sitting at the intersection of Data Engineering, Backend Engineering, and Systems Engineering, Data Platform Engineers at Adyen build the foundational layer of tooling and processes for our on-premise Big Data Platforms. These tools support 10s of products, 100s of developers, and 1000s of daily jobs that add to Adyen’s strong portfolio of capabilities. You’ll collaborate with data engineers and ML scientists and engineers to build and roll-out these tools. Along with DataOps Engineers, you’ll develop and operate multiple big data platforms, of which the biggest is 500+ nodes, with 25k+ CPU cores, 240+ TBs of RAM, and 23+ PBs of storage capacity, running tens of thousands of spark jobs a day. What you’ll do You’ll be asked to both build new tools and improve the existing tooling. This role is perfect for you if you're passionate about few of the following: * Develop and maintain scalable and high performance big data platforms. * Work with distributed systems in all shapes and flavors (databases, filesystems, compute, etc.) * Identify opportunities to improve continuous release and deployment environments * Build or deploy tools to enhance data discoverability through the collection and presentation of metadata * Introduce and extend tools to enhance the quality of our data, platform-wide * Explore and introduce technologies and practices to reduce the time to insight for analysts and data scientists * Develop streaming processing applications and frameworks * Experience in infrastructure and large-scale private cloud systems Who you are * At least 6+ years experience with Python object oriented programming.  * Team player with strong communication skills * Ability to work closely with diverse stakeholders you enable (analysts, data scientists, data engineers, etc.) and depend upon (infrastructure, security, etc). * Experience developing and maintaining: * Distributed data and compute systems like Spark, Trino, Druid, etc * Data modelling tooling  * DevOps pipelines and development ecosystems. * Real-time and batch data pipelines (via Kafka, Spark streaming) with an eye for frameworks, and emphasis on user friendliness and quality. * Kubernetes ecosystem (k8s, docker), and/or Hadoop ecosystems (Hive, Yarn, HDFS, Kerberos). Our Diversity, Equity and Inclusion commitments  Our unique approach is a product of our diverse perspectives. This diversity of backgrounds and cultures is essential in helping us maintain our momentum. Our business and technical challenges are unique, and we need as many different voices as possible to join us in solving them - voices like yours. No matter who you are or where you’re from, we welcome you to be your true self at Adyen.  Studies show that women and members of underrepresented communities apply for jobs only if they meet 100% of the qualifications. Does this sound like you? If so, Adyen encourages you to reconsider and apply. We look forward to your application! What’s next? Ensuring a smooth and enjoyable candidate experience is critical for us. We aim to get back to you regarding your application within 5 business days. Our interview process tends to take about 4 weeks to complete, but may fluctuate depending on the role. Learn more about our hiring process here. Don’t be afraid to let us know if you need more flexibility. This role is based out of our Amsterdam office. We are an office-first company and value in-person collaboration; we do not offer remote-only roles.