Principal Data Platform Engineer for Databricks

Talent Complete is looking for a motivated Principal Data Platform Engineer for Databricks for an international Professional Services company.

Form of cooperation – B2B

Location – Remote/Poland

Industry – Professional Services

Engagement: Full-time

Main responsibilities: 

• Databricks Platform Engineering Leadership Leading the evolution and expansion of enterprise lakehouse platforms focused on scalable data product delivery.
• Developer Platform Enablement Designing frameworks, abstraction layers, and tooling to simplify developer workflows and improve engineering productivity.
• Streaming Architecture Development Supporting streaming-first and event-driven architectures for modern real-time data processing.
• Modern Data Platform Design Guiding teams transitioning from traditional batch processing toward scalable streaming and lakehouse solutions.
• DevOps and Infrastructure Management Applying DevOps and DataOps practices including CI/CD, infrastructure-as-code, and operational governance.
• Cloud Platform and Cost Optimization Managing infrastructure decisions, monitoring platform usage, and optimizing cloud consumption and costs.
• Technology Integration Coordination Driving integrations between data platforms, BI tools, and downstream data consumption technologies.
• Technical Leadership and Team Mentoring Acting as technical lead for platform-focused engineering teams while mentoring developers and engineers.

• Enterprise IT Project Experience 12+ years of experience delivering IT projects in global and complex enterprise environments.
• Software Engineering Background Strong software engineering expertise with hands-on development experience in scalable systems.
• Databricks and Lakehouse Expertise Experience working with lakehouse architectures and enterprise data platforms, especially Databricks.
• Streaming and Real-Time Data Processing Skills Experience with streaming architectures and near-real-time data processing technologies.
• Cloud Platform Knowledge Strong experience with cloud platforms, serverless services, messaging systems, and distributed databases.
• DevOps and Infrastructure Automation Experience Experience with CI/CD pipelines, Infrastructure as Code, and operational automation practices.
• Data Engineering and Platform Architecture Knowledge Strong understanding of modern data engineering concepts beyond traditional batch ETL.
• AI-Assisted Development Tool Experience Hands-on experience using AI-powered development tools and engineering productivity platforms.