Sign up with

Already have an account? Log in here

Need some help?
Talk to us at +91 7670800001

Data Engineer at Oscar Technology

england, Durham - England, United Kingdom -

Full Time

Start Date

Immediate

Expiry Date

11 Feb, 27

Salary

60000.0

Posted On

13 Nov, 26

Experience

2 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Industry

Information Services

Description

Key ResponsibilitiesBuilding and evolving cloud-based data platforms to support new and existing applications.
Developing robust data pipelines to process information from multiple internal and external sources.
Designing efficient data models and structures to support complex analytical and operational requirements.
Developing APIs and integrations to connect data platforms with software applications and external systems.
Exploring the use of LLMs and generative AI to introduce new functionality into existing products.
Building solutions involving intelligent search, automated information processing and AI-driven recommendations.
Establishing engineering standards around testing, deployment, monitoring and data quality.
Taking technical ownership of projects and supporting the development of less experienced engineers.

Skills & ExperienceStrong commercial experience in data engineering within cloud-based environments.
Advanced Python and SQL development skills.
Hands-on experience with Azure Databricks, Apache Spark and PySpark.
Good understanding of Delta Lake, lakehouse architecture and modern data modelling.
Experience building and managing production data pipelines, including batch and streaming processes.
Knowledge of Azure services, including ADLS Gen2, Azure Key Vault and Azure DevOps.
Experience developing APIs, integrations and data services.
Exposure to generative AI, LLMs and AI development frameworks.
Familiarity with RAG, vector search, embeddings or other approaches to building AI-enabled applications.

Responsibilities