Data Platform Lead
at Corsearch
London EC2V 8AE, England, United Kingdom -
Start Date | Expiry Date | Salary | Posted On | Experience | Skills | Telecommute | Sponsor Visa |
---|---|---|---|---|---|---|---|
Immediate | 18 Feb, 2025 | Not Specified | 19 Nov, 2024 | N/A | Platforms,Discrimination,Aws,Sql,Migration Projects,Dbt,Git,Data Quality,Jira,Data Governance,Apache Spark,Languages,Python | No | No |
Required Visa Status:
Citizen | GC |
US Citizen | Student Visa |
H1B | CPT |
OPT | H4 Spouse of H1B |
GC Green Card |
Employment Type:
Full Time | Part Time |
Permanent | Independent - 1099 |
Contract – W2 | C2H Independent |
C2H W2 | Contract – Corp 2 Corp |
Contract to Hire – Corp 2 Corp |
Description:
Do you get excited when hearing about trademarks and brand protection news? YES?! So do we! At Corsearch, there’s no pushing trademark solutions and brand protection from our thoughts. We’re thinking about coined trademarks in the car, a detailed design search over lunch, counterfeits while sitting with the in-laws, and anti-piracy while working out
We are a mission-led company, driven by a passion for making the world better and safer for our brand customers and their consumers. It’s what we do. And people come to Corsearch to be challenged, developed, supported, and valued
PREFERRED EXPERIENCE
- Databricks certifications (e.g., Databricks Certified Associate Developer)
- Knowledge of dbt, Airflow, or similar modern data tools
- Familiarity with CI/CD practices for data pipelines
- Experience with Microsoft SQL Server migration projects
- Understanding of data mesh and data fabric architectures
TECHNICAL SKILLS
- Languages: SQL, Python
- Platforms: Databricks, AWS
- Technologies: Apache Spark, Delta Lake
- Tools: Git, JIRA, GitHub/GitLab
- Concepts: Data Modelling, ETL/ELT, Data Quality, Data Governance
Corsearch is an equal opportunity and inclusive employer and does not tolerate discrimination of any kind. We are committed to creating a diverse and inclusive workplace where all employees feel valued, respected, and supported.
We welcome applications from all individuals regardless of race, nationality, religion, gender, gender identity or expression, sexual orientation, age, disability, or any other protected characteristic.
Together, we are working proactively to build a workplace where everyone can belong and be at their best selves. Together, we make an Impact
Responsibilities:
THE ROLE
Technology at Corsearch currently consists of Engineering and Data Science functions, with nearly 150 people globally, aligned to Trademark Solutions or Online Brand Protection Business Units.
Trademark Solutions acquires data from 200 jurisdictions globally by means of data feeds, web crawling and publications/gazettes. The master data system ingests, enriches and stores data in order to support a complex ecosystem of platforms which underpin Corsearch’s managed search, screening & watch services.
The current master data system (“DMS”) is based on C#, MS SQL and MySQL. Corsearch is looking to recruit a new team to build out & transition to a replacement platform using managed services in the cloud.
The ideal candidate will have had prior experience with traditional database-driven software in .Net and Microsoft SQL and more recent experience with modern cloud Lakehouse systems such as Databricks.
RESPONSIBILITIES AND DUTIES
- Lead the design and implementation of data migration strategies from Microsoft SQL Server to Databricks
- Architect and build scalable data pipelines using Delta Lake and Databricks’ Lakehouse platform
- Optimize existing ETL/ELT processes and transform them into modern, cloud-native solutions
- Implement data quality frameworks and testing methodologies
- Collaborate with stakeholders to understand business requirements and translate them into technical specifications
- Establish best practices for data modelling, governance, and security in the new Lakehouse environment
- Mentor team members on Databricks best practices and modern data engineering principles
REQUIREMENT SUMMARY
Min:N/AMax:5.0 year(s)
Information Technology/IT
IT Software - DBA / Datawarehousing
Software Engineering
Graduate
Proficient
1
London EC2V 8AE, United Kingdom