Databricks Engineer at VRTek Consulting
London SE24 0AQ, , United Kingdom -
Full Time


Start Date

Immediate

Expiry Date

13 Nov, 25

Salary

400.0

Posted On

13 Aug, 25

Experience

12 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

No

Skills

Python, Azure, Databases, Big Data, Etl, Oracle, Teamwork, Modeling, Data Quality, Relational Databases, Sql Server, Sql, Cloud, Data Processing

Industry

Information Technology/IT

Description

SKILLS AND EXPERIENCE

  • 12+ years of experience in data ingestion, data processing, and analytical pipelines for big data and relational databases.
  • Over 4 years of hands-on experience with Microsoft Azure services, including Azure Data Lake Storage (ADLS), Azure Databricks, Azure Data Factory, Azure Synapse Analytics, and Azure SQL Database.
  • Extensive hands-on experience in SQL, Python, Data Integration/Ingestion and associated patterns - ETL tooling – Informatica IICS, ADF, Notebooks, Databricks, Delta Lake, Warehousing technologies and associated patterns, Cloud platforms – Azure preferred.
  • Proven experience in integrating, Modeling, and transforming Insurance domain data, ideally within Lloyd’s, specialty or insurance/reinsurance market.
  • Experience with on-prem and cloud versions of databases such as Oracle and SQL Server.
  • Experience with Agile delivery frameworks/methodologies (e.g. Scrum, SAFe) and tools (i.e. Jira, AzureDevOps).
  • Experience with mass ingestion capabilities and cloud process flows, data quality and master data management
  • Understanding data related security challenges and tooling with specific technologies (e.g. Databricks)
  • Experience and in-depth knowledge of data delivery and associated architecture principles, data modelling concepts, and all steps of data production process
  • Advanced verbal and written communications skills, as well as active listening, along with teamwork.
  • Professional certifications in public cloud and tooling – Databricks and Azure are highly desired.
    Job Type: Fixed term contract
    Pay: £350.00-£400.00 per day
    Work Location: Hybrid remote in London SE24 0A

How To Apply:

Incase you would like to apply to this job directly from the source, please click here

Responsibilities
  • Strong hands-on skills that can be leveraged directly in the deliverable and/or ensuring that their team is effectively working.
  • Design, build and maintain data pipelines and ELT workflows on Databricks platform with Medalion architecture
  • Analyses data requirements and provides data analysis techniques, and applies data Modeling (including data vault) and data quality techniques to establish, modify or maintain data structures and their associated components in complex environments
  • Partner with data architects ,data analysts, product manager, and testers to deliver reliable data sets.
  • Document data flows, transformation logic and processes for knowledge sharing and ongoing support.
  • Passionate about solving problems, enjoy connecting the dots between data, strategy, and analytics, obsess with generating tangible benefits and high performance.
  • Collaborate in agile teams ,participate in code reviews, solution design and platform evolution
Loading...