Data Platform Engineer/Lakehouse Architecture

We are seeking a Copilot Agent & SDLC Context Platform Engineer who will design and build the technical foundation for GitHub Copilot Custom Agents that support developers in achieving SDLC, compliance, security, and quality standards. This role focuses on constructing the data systems, context layers, and workflows that allow Copilot agents in VS Code to operate with a deep understanding of our engineering environment. You will build and maintain MCP servers, lightweight RAG pipelines, and structured developer context databases that provide agents with rich knowledge about code, requirements, architecture, traceability, and compliance. You will further integrate these systems into the SDLC through automations, events, orchestrations, and workflow logic, enabling full visibility and actionable insights across engineering and tooling ecosystems. This is not an AI model development position. This is a systems, data, and workflow engineering role focused on assembling the context and automation backbone required for intelligent Copilot agents to significantly enhance developer productivity and SDLC adherence. ---------------------------------------------------------------------------------------------------------------------------------- ✅ Key Responsibilities Copilot Agent Development * Build and maintain GitHub Copilot Custom Agents, including: * custom instructions/personas * skills, tools, hooks, event handlers * integrations with internal APIs, databases, and SDLC systems * agent workflows to support SDLC, compliance, security scanning, and quality gates MCP & Context Infrastructure * Develop Model Context Protocol (MCP) servers to expose structured engineering data and insights into Copilot: * metadata from codebases * requirements and test links * security signals * architecture dependencies * SDLC rules and compliance data * Establish structured developer context databases for the agent environment: * SQL repositories * graph databases * metadata catalogs * vector indexes for lightweight RAG (pragmatic, not research-heavy) Workflow & SDLC Automation * Implement automated workflows around: * DevSecOps * code quality and static analysis * architecture governance * security/compliance scanning * dependency and traceability validation * Integrate agent capabilities into: * VS Code (primary environment) * GitHub repositories and PR flows * CI/CD pipelines * engineering and security tools ---------------------------------------------------------------------------------------------------------------------------------- ✅ Required Experience Core Skills * 10+ years in data engineering, workflow automation, or platform engineering * Strong experience building data-centric engineering or DevOps platforms * Proven track record delivering production-grade pipelines, APIs, and context systems * Hands-on experience with: * GitHub Copilot (including Custom Agents, Skills, and enterprise workflows) * VS Code extension environment or deep platform-level knowledge * workflow orchestration (Airflow, Prefect, Dagster, Step Functions) * SQL, data modeling, and medallion/layered architectures * Python/Node/Scala for tooling, pipelines, MCP servers, and integrations * Terraform / CloudFormation / Pulumi Preferred Skills * Experience building MCP servers (Node, Python, Go) * Experience with: * OpenSearch / Elasticsearch * Neo4j / Amazon Neptune * Vector search frameworks * Background in automotive, regulated software, or SDLC frameworks: * ISO 26262 * ASPICE * MISRA * ISO 21434 ---------------------------------------------------------------------------------------------------------------------------------- ✅ Professional Skills * Ability to communicate technical decisions, complexity, and trade-offs * Strong reasoning about data organization, developer workflows, and compliance logic * Ability to operate independently in ambiguous environments * Collaboration with DevOps, security, compliance, and engineering teams * Ownership mindset: build, test, validate, iterate

🚀 CLOUD DATA ENGINEER (AWS / TERRAFORM / PYTHON)  Location: Poland (Remote)  Contract: B2B, Full-Time Join the Future of Digital Tech with Kolomolo At Kolomolo, we don’t just follow trends - we set them. As a global supplier of IT services and digital modernization solutions, we help businesses embrace cutting-edge technology to optimize their operations. Now, we are growing and looking for fresh talent to grow with us. Are you proactive, tech-savvy, and eager to build your career in IT? This role could be your perfect fit. ABOUT THE ROLE We are seeking an experienced Cloud Data Engineer (3+ years) to join our engineering team for a long-term project focused on building and optimizing cloud-based data infrastructure. This position is not about data science or analytics, it is about designing, implementing, and automating data platforms and pipelines that ensure reliability, scalability, and performance in AWS environments.  WHAT YOU’LL BE DOING You will play a key role in designing and deploying the data infrastructure supporting Kolomolo’s modernization stack. Your work will focus on building Terraform-based AWS deployments, ensuring smooth data ingestion, transformation, enrichment, and validation. Responsibilities include: 1. Designing and implementing Infrastructure as Code (IaC) using Terraform for AWS services. 2. Building data processing pipelines and automating workflows for ingestion, transformation, and validation. 3. Handling data enrichment and data integrity checks across multiple formats (e.g., Parquet, JSON, CSV). 4. Integrating data intake from relational databases (SQL, PostgreSQL, etc.) and graph-based data sources (e.g., Neo4j, Amazon Neptune). 5. Developing and maintaining Python-based data orchestration tools and scripts. 6. Working with containerized environments (Docker, Kubernetes) to enable scalable deployments. 7. Supporting continuous improvement and optimization of cloud infrastructure performance and cost.  WHAT WE ARE LOOKING FOR: Proven experience as a Data Engineer or Cloud Engineer in AWS environments. Strong knowledge of Terraform and IaC practices. Hands-on experience with AWS core services (S3, Lambda, Glue, ECS/EKS, Redshift, etc.). Proficiency in Python for automation, scripting, and data workflows. Understanding of ETL/ELT processes, data enrichment, and validation frameworks. Experience working with containerization tools (Docker, Kubernetes). Familiarity with multiple data formats, including Parquet. Exposure to both relational and graph data models. Good communication skills and experience collaborating in Agile/Scrum teams. Experience with Databricks, Snowflake, or data lake architectures. Knowledge of monitoring and observability tools (e.g., CloudWatch, Grafana, Prometheus). Experience with CI/CD pipelines for data workflows. What is in It for You:  Competitive salary and benefits.  Career development opportunities in a growing tech company.  Continuous learning culture: mentorship, internal training, and certifications.  Flexible, agile work environment (remote, hybrid, or on-site in Kraków.  Office perks: great coffee, tea, fresh fruit, snacks, and a fun atmosphere.  Flat management structure, where your voice matters.  Regular team events and a social, supportive work culture.  B2B contract or Contract of Mandate (Umowa Zlecenie). 🌟 WHY JOIN KOLOMOLO? At Kolomolo, we prioritize innovation, agility, and autonomy. Our teams have the freedom to own their work, share ideas, and make meaningful contributions. Inspired by Scandinavian values, we believe in work-life harmony and creating an inclusive culture where everyone thrives. You will be part of a passionate, skilled, and friendly team that works hard and celebrates together. Here, you can build your career on your own terms, with opportunities to grow, learn, and make a real impact. OUR FLAT STRUCTURE & THE CULTURE OF INCLUSION  At Kolomolo, we break the corporate mold. We offer: * Agile Teams & Autonomy: No micromanagement. You’ll own your projects and enjoy the freedom to innovate. * Work-Life Harmony: Inspired by Scandinavian values, we prioritize balance and flexibility, where remote work and asynchronous collaboration are in our DNA. * Learning & Growth: Continuous learning is at our core. We reward hard work, value smart ideas, and foster an environment of mutual respect and trust. * Inclusive Culture: We believe in DEI: diversity, equity and inclusion. We are committed to creating an environment where every individual, regardless of background, identity, or experience feels valued, respected, and empowered to thrive. Join Kolomolo and elevate your career with cutting-edge technology, a supportive team, and a company that truly values your input. Ready for the next step? Apply now and start an exciting journey of growth and innovation with us!