Senior Data Engineer - Databricks

Ultra Tendency

Ultra Tendencyは、欧州、アジア、南北アメリカにチームを擁するグローバルなデータ／AIコンサルティング企業です。日本での事業拡大に伴い、成長中の東京チームに加わり、海外クライアント向けのスケーラブルなデータプラットフォーム開発に携わっていただくシニアデータエンジニア（Senior Data Engineer）– Databricksを募集しています。  このポジションでは、エンジニア、データサイエンティスト、アーキテクトと密に連携し、最新のクラウド／データ技術を用いた堅牢なデータソリューションの設計・実装を担当していただきます。  給与は、日本のテクノロジー市場水準を踏まえ、経験・スキルを考慮のうえ、競争力のある条件をご提示します。     業務内容  * Databricks Lakehouse Platform（Apache Spark、Delta Lakeを含む）を用いた、スケーラブルなデータパイプラインの設計、実装、保守を行っていただきます。  * 分析、機械学習、ビジネスインテリジェンスの各アプリケーションを支える、バッチおよびストリーミングのデータワークフローを開発・最適化していただきます。  * 部門横断のチームと連携し、ビジネス要件およびデータ要件を、信頼性が高く本番運用可能なデータソリューションへ落とし込んでいただきます。  * Databricks環境におけるデータ処理ワークロードのパフォーマンスとコスト効率を改善していただきます。  * データ品質、ガバナンス、セキュリティに関するベストプラクティスの導入を支援していただきます。  * チーム内のナレッジ共有に貢献し、ジュニアエンジニアの育成を支援していただきます。     応募資格  * DatabricksおよびApache Spark（PySparkまたはScala）の実務経験  * AWS、Azure、GCPなど主要クラウドプロバイダー上でのデータプラットフォーム構築経験  * 分散データ処理、データモデリング、パフォーマンス最適化に関する確かな理解  * Gitなどのバージョン管理ツールおよびCI/CDパイプラインの利用経験  * AirflowやDatabricks Workflowsなどのオーケストレーションフレームワークに関する知識  * 国際的な環境での協業に必要な英語・日本語の高いコミュニケーション能力  * 信頼性と拡張性の高いデータシステムの構築に関心を持ち、協調的に業務へ取り組める姿勢     待遇・福利厚生  * 日本市場の水準に沿った競争力のある給与  * ハイブリッド勤務制度（出社とリモートワークの併用。応募には日本在住が必要）  * 国際的なエンジニアリング環境における、経験豊富なメンバーとの協業機会  * グローバル企業向けの大規模データ／AIプロジェクトへの参画機会  * 資格取得支援やUdemy Businessを含む継続学習リソースなどのプロフェッショナル育成支援  * キャリア開発を支える定期的なフィードバックサイクルと体系的な評価制度  * ナレッジ共有と長期的なプロフェッショナルとしての成長を重視する協働的な企業文化  * チームイベントおよびグローバルな同僚と交流できる機会     ご興味をお持ちの方へ  ご興味をお持ちいただけましたら、ぜひご応募ください。ポジションや日本チームについて詳しくお知りになりたい場合も、お気軽にご連絡ください。  ABOUT US Ultra Tendency is an international Data Engineering consultancy specializing in Big Data, Cloud, Streaming, IIoT, and Microservices. Since 2010, we have helped leading organizations—including the European Central Bank, Deutsche Telekom, and Europe’s largest automotive manufacturer—build and operate large-scale, data-driven platforms. With 8 offices across 10 countries and a growing global team, we combine deep technical expertise with a strong commitment to open source. Our consultants actively contribute to projects such as Apache Kafka, Apache NiFi, Terraform, and Ansible, and we are a trusted Databricks partner. At Ultra Tendency, you'll work on challenging projects that push the boundaries of Data and AI while collaborating with talented colleagues in a culture built on learning, knowledge sharing, and mutual support. We evaluate candidates based on skills, experience, and business fit, and welcome applicants from all backgrounds. Data privacy statement: Data Protection for Applicants – Ultra Tendency

Ultra Tendency

ABOUT ULTRA TENDENCY Ultra Tendency is a leading data and AI consultancy helping organizations accelerate digital transformation through modern data platforms, advanced analytics, and AI-driven solutions. As a trusted partner to enterprise customers across Europe, we specialize in delivering cloud-native data architectures and scalable solutions that unlock business value. We are expanding our Databricks practice and are looking for an experienced Senior Databricks Consulting Engineer to work closely with our clients and delivery teams across APJ & EMEA. ---------------------------------------------------------------------------------------------------------------------------------- THE ROLE As a Senior Databricks Consulting Engineer, you will serve as a trusted technical advisor and strategic partner to enterprise customers. You will guide organizations through their data and AI transformation journeys, helping them design, implement, and optimize modern data platforms built on Databricks. You will combine deep technical expertise with strong stakeholder management skills to ensure customers realize measurable value from their Databricks investments. Working alongside client teams, executives, engineers, and Ultra Tendency consultants, you will lead architecture decisions, promote best practices, and drive successful adoption of the Databricks Lakehouse Platform. This is a highly customer-facing role requiring both hands-on technical capability and executive-level communication skills. ---------------------------------------------------------------------------------------------------------------------------------- KEY RESPONSIBILITIES CUSTOMER ADVISORY & ARCHITECTURE * Act as the primary technical advisor for strategic Databricks customers. * Design and review scalable data, analytics, and AI architectures leveraging the Databricks Lakehouse Platform. * Lead architecture workshops, solution design sessions, and technical roadmap discussions. * Translate business requirements into technical solutions and implementation plans. * Advise customers on platform modernization, cloud migration, data governance, and AI initiatives. SOLUTION DELIVERY & OPTIMIZATION * Support the successful implementation and adoption of Databricks solutions. * Review data engineering, analytics, machine learning, and GenAI workloads for scalability, performance, security, and cost optimization. * Identify and resolve technical blockers during customer engagements. * Drive architectural best practices for data pipelines, Lakehouse design, Unity Catalog, governance, and platform operations. TECHNICAL LEADERSHIP * Serve as a subject matter expert on Databricks capabilities and emerging data & AI technologies. * Mentor customer teams and Ultra Tendency consultants on architecture patterns and best practices. * Deliver executive presentations, technical workshops, and enablement sessions. * Contribute to reusable assets, reference architectures, and practice development initiatives. BUSINESS DEVELOPMENT SUPPORT * Partner with sales and account teams during strategic customer engagements. * Support technical discovery, solution positioning, and proposal development. * Provide architecture guidance during pre-sales and proof-of-concept activities. * Identify opportunities for platform expansion and increased customer value. ---------------------------------------------------------------------------------------------------------------------------------- REQUIRED QUALIFICATIONS * 7+ years of experience in data engineering, cloud architecture, analytics, or related fields. * 3+ years working with Databricks in enterprise environments. * Strong expertise in modern data platform architecture and cloud-native solutions. * Hands-on experience designing and implementing Lakehouse architectures. * Strong knowledge of: * Databricks Data Intelligence Platform * Apache Spark * Delta Lake * Unity Catalog * Data Governance & Security * Data Warehousing and Lakehouse Design * ETL/ELT Architectures * Data Modeling * Experience with at least one major cloud platform: * Microsoft Azure (preferred) * AWS * Google Cloud Platform * Proficiency in: * Python * SQL * Spark * Experience engaging with executive stakeholders and technical leadership teams. * Excellent communication and presentation skills in English & Japanese. PREFERRED QUALIFICATIONS * Databricks certifications such as: * Databricks Certified Data Engineer Professional * Databricks Certified Solutions Architect * Databricks Certified Machine Learning Professional * Experience with: * Generative AI and LLM solutions * MLflow * MLOps * Data Governance frameworks * Data Mesh architectures * Real-time and streaming data platforms * Experience in consulting or professional services environments. * Additional language skills in German, Spanish, Portuguese, Korean or Chinese are highly desirable. ---------------------------------------------------------------------------------------------------------------------------------- WHAT SUCCESS LOOKS LIKE * Customers successfully adopt and scale Databricks solutions. * Complex technical challenges are resolved quickly and effectively. * Executive stakeholders view you as a trusted advisor. * Best practices are consistently applied across customer environments. * Customer satisfaction, platform utilization, and business outcomes improve measurably. ---------------------------------------------------------------------------------------------------------------------------------- WHY JOIN ULTRA TENDENCY? * Work with leading enterprise customers across APJ & EMEA. * Be part of a rapidly growing Data & AI consultancy. * Access to cutting-edge technologies in Data Engineering, Analytics, AI, and GenAI. * Opportunity to shape and expand Ultra Tendency's Databricks practice. * Continuous learning and certification support. * Flexible and remote-friendly working environment. * Competitive compensation package. * Collaborative, entrepreneurial, and international culture. ---------------------------------------------------------------------------------------------------------------------------------- ELIGIBILITY Applicants must currently reside in Japan and possess the legal right to work in the country. Unfortunately, we are unable to provide relocation assistance or visa sponsorship for this position. ABOUT US Ultra Tendency is an international Data Engineering consultancy specializing in Big Data, Cloud, Streaming, IIoT, and Microservices. Since 2010, we have helped leading organizations—including the European Central Bank, Deutsche Telekom, and Europe’s largest automotive manufacturer—build and operate large-scale, data-driven platforms. With 8 offices across 10 countries and a growing global team, we combine deep technical expertise with a strong commitment to open source. Our consultants actively contribute to projects such as Apache Kafka, Apache NiFi, Terraform, and Ansible, and we are a trusted Databricks partner. At Ultra Tendency, you'll work on challenging projects that push the boundaries of Data and AI while collaborating with talented colleagues in a culture built on learning, knowledge sharing, and mutual support. We evaluate candidates based on skills, experience, and business fit, and welcome applicants from all backgrounds. Data privacy statement: Data Protection for Applicants – Ultra Tendency

Databricks

P-1502   At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers — and customer obsessed — we leap at every opportunity to solve technical challenges, from designing next-gen UI/UX for interfacing with data to scaling our services and infrastructure across millions of virtual machines. And we're only getting started. As a Sr. Software Engineer on the AI OSS Ecosystem Team, you will play a key role in building and maintaining our open-source AI/ML platforms to enable users to train, deploy and monitor models and GenAI agents at scale. Additionally, you will collaborate with the larger AI/ML community to contribute to open-source projects and advance AIOps capabilities in the industry. THE IMPACT YOU'LL HAVE: * Design and implement platform capabilities to support the AI/ML development and productionization lifecycle including training, evaluation, deployment, monitoring, and management of models and agents * Design and implement platform integrations with various frameworks in the AI/ML ecosystem * Collaborate with the AI/ML community across the world to advance the state-of-the-art in AIOps. * Ensure the latest AI/ML tooling advancements are available to Databricks’ customers, thereby enabling organizations around the world to get more value from their data. * Mentor and guide junior engineers on the team by helping with project planning, technical decisions, and code and document review. WHAT WE LOOK FOR: * BS (or higher) in Computer Science, or a related field * 5+ years of hands-on experience in building production systems using at least one of the following programming languages: Python (Preferred), Scala and Java. * Experience building and maintaining software tools and frameworks for AI/ML, ideally in an open-source environment. * Familiarity with AI/ML and AIOps concepts and technologies, such as model training, deployment, and monitoring. * [Preferred] Deep understanding and experience in working with agent frameworks such as LangChain, LlamaIndex, DSPy, or other similar projects. * [Preferred] Significant contributions to open-source projects in the AI/ML domain, such as SparkML, TensorFlow, PyTorch, MLflow, or other similar projects. About Databricks Databricks is the data and AI company. More than 10,000 organizations worldwide — including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region click here. Our Commitment to Diversity and Inclusion At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics. Compliance If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.