ABOUT YOU:

• Previous working experience with PySpark, data pipelines, and tools like Databricks and Snowflake is a must.
• Excellent problem-solving skills and ability to learn through scattered resources.
• Thorough understanding of the responsibilities and duties of a data engineer, as well as established industry standards/best practices and documentation guidelines.
• Outstanding communication skills, and the ability to stay self-motivated and work with teams globally.
• Experience with cloud-based data technologies.
• 3-5 years of experience with distributed systems utilizing tools such as Spark or Kafka.
• Working experience in Agile Scrum environments.
• Experience with source control tools such as Git.
  

  LI-Remote

ROLE OVERVIEW:

We are looking for a skilled Data Engineer to join our team of experts. As a Data Engineer at McAfee, you will be responsible for developing, maintaining, and optimizing our data warehouse, data pipeline, and data products. The data engineer will support multiple stakeholders, including software engineers, database architectures, data analysts, and data scientists, to ensure an optimal data delivery architecture. The ideal candidate should possess strong technical abilities to solve complex problems with data, a willingness to learn new technologies and tools if necessary, and be comfortable supporting the data needs of multiple teams, stakeholders, and products.
This is a remote position in Ireland. We will only consider candidates currently in Ireland and are not offering relocation assistance at this time.

ABOUT THE ROLE:

• Design and implement data solutions using industry best practices.
• Design, build and maintain batch or real-time data pipelines in production.
• Maintain and optimize the data infrastructure required for accurate extraction, transformation, and loading of data from a wide variety of data sources.
• Performs ETL, ELT operations and administration of data and systems securely and in accordance with enterprise data governance standards.
• Monitor and maintain data pipelines proactively to ensure high service availability.
• Apply subject matter expertise in PySpark and big data in developing and maintaining scalable pipelines.
• Works with Data Scientists and ML Engineers to understand mathematical models and optimize data solutions accordingly.
• Scale up existing pipelines to work with larger datasets and optimize resource usage.
• Build and maintain infrastructure as code (IaC) in the cloud, that is resilient and can scale when needed.
• Continuous development through training and mentorship programs.
• Create scripts and programs to automate data operations.
• Automate data workflows such as data ingestion, aggregation, and ETL processing.
• Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.
• Monitor data systems performance and implement optimization strategies.
• Leverage data controls to maintain data privacy, security, compliance, and quality for allocated areas of ownership.