Data Engineer

at  Aqovia

London W1G, England, United Kingdom -

Start DateExpiry DateSalaryPosted OnExperienceSkillsTelecommuteSponsor Visa
Immediate21 Dec, 2024Not Specified22 Sep, 2024N/AStorage Solutions,Sustainability,Physical Design,Testing,Data Privacy,Sql,Python,Git,Data Governance,Transformation,Cloud Computing,Structures,Software Development,Physical Data ModelingNoNo
Add to Wishlist Apply All Jobs
Required Visa Status:
CitizenGC
US CitizenStudent Visa
H1BCPT
OPTH4 Spouse of H1B
GC Green Card
Employment Type:
Full TimePart Time
PermanentIndependent - 1099
Contract – W2C2H Independent
C2H W2Contract – Corp 2 Corp
Contract to Hire – Corp 2 Corp

Description:

TECH SKILLS

  • Expertise in building, testing, and deploying data pipelines on the Azure platform.
  • Proficient in Databricks, Parquet, on-prem to cloud migrations, and both SQL and NoSQL data stores.
  • Experience in data deduplication, transformation, and conformance from source to target structures.
  • Strong knowledge of building and supporting batch and real-time data pipelines.
  • Ability to implement solutions to improve observability, findability, data privacy, and other data governance and architectural concerns.
  • Proficient in logical and physical data modeling and the detailed physical design of data storage solutions.
  • Experience in implementing data transformation rules for batch and streaming data in SQL and Python.
  • Familiarity with CI/CD processes from Git to the Azure platform.
  • Ability to work autonomously and adopt new technologies quickly.

ADDITIONAL SKILLS:

  • Knowledge of sustainability and CSRD (Corporate Sustainability Reporting Directive) is highly desirable.
  • Experience in software development and cloud computing.
  • Strong communication and collaboration skills.
  • Sales support acumen.

Responsibilities:

THE ROLE:

NeuerEnergy is seeking a talented Data Engineer to join our consulting projects team. You will be primarily responsible for building ETL data pipelines, loading customer data into the platform, and developing real-time and batch data pipelines. This role requires a blend of technical expertise and a passion for sustainability.

KEY RESPONSIBILITIES:

  • Design, build, and maintain ETL data pipelines to load customer data into the platform.
  • Develop and manage both real-time and batch data pipelines to meet evolving business needs.
  • Provide technical support and mentorship to other team members on standards, problem-solving, and best practices.
  • Implement data management solutions using APIs.
  • Write complex SQL queries and high-quality Python code.
  • Ensure data solutions are reusable and maintainable.
  • Collaborate with other teams to provide technical support as needed.


REQUIREMENT SUMMARY

Min:N/AMax:5.0 year(s)

Information Technology/IT

IT Software - DBA / Datawarehousing

Software Engineering

Graduate

Proficient

1

London W1G, United Kingdom