Senior Data Engineer (Databricks Platform) at Live Nation
New York, New York, USA -
Full Time


Start Date

Immediate

Expiry Date

25 May, 25

Salary

0.0

Posted On

26 Feb, 25

Experience

0 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

No

Skills

Avro, Cloud Services, Clarity, Microsoft Azure, Jira, Kafka, Design, Data Solutions, Storage Systems, Working Experience, Yaml, Orchestration, Confluence, Hadoop, Software Development, Ansi Sql, Git

Industry

Information Technology/IT

Description

THE TEAM

Core Data Services team is at the center of Data and Analytics initiatives. We are building a modern data platform to support enterprise data needs. Our mission and yours too should you choose to, is to empower and enable our data community of data engineers, data scientists, analysts, product teams and decision makers to create value.
The Core Data Services team consists of Platform Engineering, Data Engineering, Data Enablement and Operations teams. We are building a highly functional, performant modern enterprise Data Lake while supporting our current data platforms, so the focus is on maximizing functionality, creating value and content/data assets, cost optimizations and usability of the data delivery and services and all this is our measure of our success and defines us The Core Data Services Team! We are looking for a Data Engineer - Platform, You!

TECHNICAL SKILLS/COMPETENCIES

  • Good understanding of Data Lakes, Data Warehouses is MUST to have
  • Software development, coding expertise in the Data engineering field using any of the Python/PySpark is MUST to have
  • Hands on experience using version control systems such as Git and CI/CD workflows and practice
  • Design and Develop data ingestion services that are highly performant, reliable and scalable
  • Decent expertise using ANSI SQL and Spark SQL is key to have
  • Workflow automation, orchestration using Airflow or equivalent tools stack
  • Hands on working knowledge on at least in one of these : Databricks, Hadoop and related stacks
  • Working experience
  • in at least one of cloud services from any of the Amazon AWS, Google GCP or Microsoft Azure, preferably AWS
  • streaming (Kafka) and batch based data sources
  • diverse data sources and data formats (xml, json, yaml, parquet, avro, delta) and respective use cases
  • Any visualization experience is an advantage so you can bring clarity to prod incidents by using them is a nice to have
  • An excellent understanding of the nuances that add complexities around time zones, geo, various data formats, data types across different storage systems is nice to have
  • Agile development methodologies using the Atlassian suite: Jira, Confluence
  • Collaborate with cross-functional teams to deliver data solutions and provide technical support and guidance to team members.
  • Stay up-to-date with the latest data engineering technologies and trends.

HIRING PRACTICES

The preceding job description has been designed to indicate the general nature and level of work performed by employees within this classification. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities, and qualifications required of employees assigned to this job.
Live Nation recruitment policies are designed to place the most highly qualified persons available in a timely and efficient manner. Live Nation may pursue all avenues available, including promotion from within, employee referrals, outside advertising, employment agencies, internet recruiting, job fairs, college recruiting and search firms.

LI-EF1

#LI-RemoteUnitedStates
-
The expected compensation for this position is:

Responsibilities

THE ROLE

This is a hands-on Data Engineering role that will require strong Python/PySpark coding skills.

WHAT THIS ROLE WILL DO

  • Contribute to the enhancements and continuous improvement of performance and reliability of the existing Data Platform Services to meet the requirements from Data Engineering/Product team
  • Design and build self servicing onboarding and automation capabilities in Core Data Platform services in a scalable, reliable and secure way.
  • Design and build platform capabilities to support onboarding and operation effectiveness
  • Design and develop scalable data platform and integration solutions for various data sources leveraging Databricks Unified Platform
  • Ensure data quality and integrity across all data systems.
  • Ensure data security and compliance with relevant regulations.
  • Implement best practices for data management and governance.
  • Develop and maintain documentation for data systems and processes.
  • Monitor and troubleshoot data platform issues.
  • Participate in on-call rotations/Pagerduty for data platform support.
Loading...