Software Engineer, Ingestion & Streaming at Datavant Ireland
Dublin, Dublin County, Ireland -
Full Time


Start Date

Immediate

Expiry Date

30 Nov, 26

Salary

0.0

Posted On

01 Sep, 26

Experience

0 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

No

Skills

Industry

Information Technology & Services

Description

 

What You Will Do: 

  • Design, build, and operate the ingestion frameworks that pull data from operational databases, vendor APIs, document streams, and third-party feeds into Snowflake, Iceberg, and Databricks
  • Own and evolve the ingestion stack (AWS DMS, MWAA / Airflow, Fivetran, and the homegrown tooling on top) and design new patterns for API sources that don’t fit a managed connector
  • Build self-service tooling so product engineers can onboard new sources without becoming experts in our infrastructure
  • Write and review the Terraform behind our ingestion infrastructure: AWS networking, IAM, compute, and data services
  • Partner with product, data, and analytics teams to pick the right ingestion pattern for each source (CDC, batch, API, streaming) and stand it up end-to-end
  • Lead production troubleshooting and incident response, and turn each incident into a durable platform fix
  • Raise the bar on engineering quality, observability, cost discipline, and security in everything the team ships
  • Mentor mid-career engineers and pull peers along through code review, pairing, and design feedback

 

What you will bring to the table: 

  • 2+ years in data engineering, platform engineering, or data-focused software engineering
  • 2+ years of hands-on AWS with real strength in networking (VPC, subnets, routing, PrivateLink, security groups), IAM (roles, policies, permission boundaries), and the data services this role touches, plus the judgment to know when to reach for what
  • 1+ years writing production Terraform or equivalent IaC, with experience owning modules, reasoning about state and blast radius, and shipping infrastructure changes safely
  • 1+ years building self-service tooling, internal platforms, or paved-path frameworks consumed by other engineers
  • Strong SQL skills and the ability to reason about how data physically lives in a warehouse or lake
  • Production experience with Snowflake (or an equivalent cloud data warehouse) and a workflow orchestrator (Airflow / MWAA preferred)
  • Hands-on experience with at least one ingestion approach: CDC tooling (e.g., DMS, Debezium), managed connectors (e.g., Fivetran, Airbyte), or rolling your own pipelines for API sources
  • Solid CI/CD discipline in GitHub or equivalent: branching, code review, automated checks, repeatable deployment
  • AI-native working style: daily use of Claude Code, Cursor, Copilot, or equivalent, with views on how they make a team faster
  • Working knowledge of Python is expected; mastery isn’t the bar
  • Clear written and verbal communication, especially in async, remote settings

 

Bonus points for:

  • Direct production experience with Iceberg or another open table format, especially bridging Snowflake and Databricks
  • Hands-on Databricks or Spark
  • Kubernetes experience
  • Snowflake certification(s)
  • Azure experience (we’re primarily AWS, but our customers and acquisitions aren’t always)
  • In-depth experience integrating data systems with managed identity platforms, particularly via SCIM (SailPoint a plus)
  • Prior experience in healthcare or another highly regulated industry like Finance
  • Prior DBA, SRE, or DRE work operating production data systems under pressure


Responsibilities
Loading...