Data Engineer
at Midnite
Remote, Scotland, United Kingdom -
Start Date | Expiry Date | Salary | Posted On | Experience | Skills | Telecommute | Sponsor Visa |
---|---|---|---|---|---|---|---|
Immediate | 22 Dec, 2024 | GBP 65000 Annual | 25 Sep, 2024 | 3 year(s) or above | Looker,Airflow,Glue,Git,Sql,Python,Data Products,Unit Testing | No | No |
Required Visa Status:
Citizen | GC |
US Citizen | Student Visa |
H1B | CPT |
OPT | H4 Spouse of H1B |
GC Green Card |
Employment Type:
Full Time | Part Time |
Permanent | Independent - 1099 |
Contract – W2 | C2H Independent |
C2H W2 | Contract – Corp 2 Corp |
Contract to Hire – Corp 2 Corp |
Description:
ESSENTIAL EXPERIENCE
- A minimum of 3 years of experience in a comparable role
- Expertise in Python and SQL
- Solid understanding of general engineering best practices (unit testing, writing DRY code etc)
- Hands-on experience with a modern data orchestrator (Airflow, Dagster, Prefect etc)
- Comprehensive knowledge of data modelling concepts and methodologies (Kimball dimensional modelling, data vault etc)
- Proficient with dbt
- Experience with, or a willingness to learn, Looker
- Comfortable with git
- Must be based in the UK
DESIRABLE EXPERIENCE
- Experience with AWS’s data ecosystem (Glue, Athena, Redshift, S3)
- Experience with delivery of full end-to-end of data products, including data visualisation and BI
- Experience with CI/CD pipelines
- Understanding of marketing data and common terminology (e.g. attribution models, Google Ads etc.)
Responsibilities:
WHAT WILL YOU DO?
We’re looking for a data engineer who is interested in having a big impact by being deeply involved in the full spectrum of data engineering. You’ll work on end-to-end projects that include everything from ingesting raw data into Apache Iceberg all the way through to creating end user dashboards.
RESPONSIBILITIES
- Collaborate on end-to-end data projects, spanning from raw data ingestion to dashboard creation
- Build, maintain, and optimise data pipelines using Dagster, Python and SQL
- Write, optimise and debug SQL transformations in dbt
- Develop and maintain data models that adhere to modern best practices
- Contribute to BI and dashboard development when required
- Uphold code quality by adhering to engineering best practices
- Participate in code reviews, providing and receiving constructive feedback to maintain a high standard of code quality across the team
REQUIREMENT SUMMARY
Min:3.0Max:8.0 year(s)
Information Technology/IT
IT Software - Application Programming / Maintenance
Software Engineering
Graduate
Proficient
1
Remote, United Kingdom