Data Engineer
at Aqovia
London W1G, England, United Kingdom -
Start Date | Expiry Date | Salary | Posted On | Experience | Skills | Telecommute | Sponsor Visa |
---|---|---|---|---|---|---|---|
Immediate | 21 Dec, 2024 | Not Specified | 22 Sep, 2024 | N/A | Storage Solutions,Sustainability,Physical Design,Testing,Data Privacy,Sql,Python,Git,Data Governance,Transformation,Cloud Computing,Structures,Software Development,Physical Data Modeling | No | No |
Required Visa Status:
Citizen | GC |
US Citizen | Student Visa |
H1B | CPT |
OPT | H4 Spouse of H1B |
GC Green Card |
Employment Type:
Full Time | Part Time |
Permanent | Independent - 1099 |
Contract – W2 | C2H Independent |
C2H W2 | Contract – Corp 2 Corp |
Contract to Hire – Corp 2 Corp |
Description:
TECH SKILLS
- Expertise in building, testing, and deploying data pipelines on the Azure platform.
- Proficient in Databricks, Parquet, on-prem to cloud migrations, and both SQL and NoSQL data stores.
- Experience in data deduplication, transformation, and conformance from source to target structures.
- Strong knowledge of building and supporting batch and real-time data pipelines.
- Ability to implement solutions to improve observability, findability, data privacy, and other data governance and architectural concerns.
- Proficient in logical and physical data modeling and the detailed physical design of data storage solutions.
- Experience in implementing data transformation rules for batch and streaming data in SQL and Python.
- Familiarity with CI/CD processes from Git to the Azure platform.
- Ability to work autonomously and adopt new technologies quickly.
ADDITIONAL SKILLS:
- Knowledge of sustainability and CSRD (Corporate Sustainability Reporting Directive) is highly desirable.
- Experience in software development and cloud computing.
- Strong communication and collaboration skills.
- Sales support acumen.
Responsibilities:
THE ROLE:
NeuerEnergy is seeking a talented Data Engineer to join our consulting projects team. You will be primarily responsible for building ETL data pipelines, loading customer data into the platform, and developing real-time and batch data pipelines. This role requires a blend of technical expertise and a passion for sustainability.
KEY RESPONSIBILITIES:
- Design, build, and maintain ETL data pipelines to load customer data into the platform.
- Develop and manage both real-time and batch data pipelines to meet evolving business needs.
- Provide technical support and mentorship to other team members on standards, problem-solving, and best practices.
- Implement data management solutions using APIs.
- Write complex SQL queries and high-quality Python code.
- Ensure data solutions are reusable and maintainable.
- Collaborate with other teams to provide technical support as needed.
REQUIREMENT SUMMARY
Min:N/AMax:5.0 year(s)
Information Technology/IT
IT Software - DBA / Datawarehousing
Software Engineering
Graduate
Proficient
1
London W1G, United Kingdom