Role: Consultant Data Engineer6 months ContractDaily Rate: €550 - €620 (DOE)Hybrid, Dublin

We’re looking for an experienced Consultant Data Engineer to join a high-performing data engineering team supporting the design, development, and evolution of data solutions within the U.S. healthcare sector.

This is an exciting opportunity for a senior data engineering professional who enjoys working across data engineering, analytics, cloud technology, and business strategy. You’ll play a key role in building scalable and trusted data solutions that enable advanced analytics, data science, and AI capabilities.You’ll work closely with engineering, product, architecture, security, governance, and business stakeholders, helping turn complex requirements into practical, high-quality technical solutions.

• What you’ll be doing:Act as a hands-on Data Engineering SME, contributing to technical direction and the design and delivery of critical data capabilities.
• Design and build scalable, reliable data products and platform components using modern cloud, Lakehouse, and software engineering practices.
• Contribute to a large-scale migration from Databricks Cluster to an Enterprise Managed Databricks environment.
• Develop and optimise high-volume data pipelines and analytical workloads within a public cloud environment.
• Work closely with product, business, architecture, security, governance, and engineering teams to translate complex or ambiguous requirements into pragmatic technical solutions.
• Make and communicate technical design decisions across security, reliability, performance, scalability, cost, and maintainability.
• Provide technical mentorship, design guidance, and constructive code/design reviews to junior and mid-level engineers.
• Help establish and maintain best practices around data quality, modelling, metadata, lineage, observability, testing, and operational support.
• Contribute to modern CI/CD and infrastructure-as-code practices.
• Support the development of data capabilities that enable advanced analytics, data science, and AI initiatives.
• Communicate complex technical concepts clearly to both technical and non-technical stakeholders.

• What we’re looking for:8+ years’ experience designing and delivering complex data products, platforms, or solutions.
• 8+ years’ experience designing and building scalable data solutions, including pipeline infrastructure and analytical operations.
• 5+ years’ hands-on experience with Databricks and Apache Spark.
• 2+ years’ experience with dbt.
• Strong, advanced SQL skills.
• Strong experience with Python or Scala.
• Experience building and managing high-volume batch data pipelines in a public cloud environment, ideally Azure.
• Experience with data pipeline orchestration tools such as Apache Airflow or native Databricks orchestration.
• Experience working with cloud security, identity and access management, tenant isolation, and privacy principles, particularly when working with sensitive data.
• Proven ability to work across technical and business teams and translate complex requirements into actionable technical strategies.
• Excellent communication skills, with the ability to explain complex technical concepts to a range of audiences.
• Bachelor’s degree or higher in Computer Science, Engineering, or a related discipline, or equivalent professional experience.

• Desirable experienceIt would be advantageous if you also have experience with:Azure data services and the wider Azure ecosystem
• GitHub Actions / GitHub Actions Workflows
• Snowflake
• Terraform or similar Infrastructure-as-Code technologies
• Data cataloguing, governance, and security controls for sensitive or regulated data
• Data engineering within the healthcare industry
• Experience supporting or enabling AI and advanced analytics initiatives

• For more details please reach out to me on a.sousa@brightwater.ie

Requirements added by the job poster • 5+ years of work experience with Python (Programming Language) • 4+ years of work experience with Azure Databricks • 4+ years of work experience with Apache Spark