JOB DESCRIPTION:

• Programming Languages: Proficient in Python and PySpark with a strong understanding software engineering best practices.
• Cloud Computing: Utilize Azure cloud-based data platforms, specifically leveraging Databricks and Delta Live Tables for data engineering tasks, while effectively utilizing services related to storage, compute, and security.
• Data Pipelines: Design, build, and maintain robust and scalable and automated data pipelines for batch and streaming data ingestion of data and processing.
• Data Quality: Implement data quality checks and balances throughout the data pipeline, including profiling, validation, and root cause analysis, to ensure data accuracy, completeness, and consistency.
• Data Architecture and ModelingDesign and implement robust data models and architectures that align with business requirements and support efficient data processing, analysis, and reporting.
• Orchestration: Utilize workflow orchestration tools to automate data pipeline execution and dependency management.
• CI/CD: Implement continuous integration and continuous delivery (CI/CD) practices for automated testing and deployment of data pipelines.
• Monitoring and Alerting: Integrate monitoring and alerting mechanisms to track pipeline health, identify performance bottlenecks, and proactively address issues.
• Strong Agile principles: Utilize Agile development methodologies, actively participating in sprint planning, daily stand-ups, sprint reviews, and retrospectives. Be flexible and adaptable to changing requirements and priorities throughout the project lifecycle.
  ADVANCED CONVERSATIONAL ENGLISH ESSENTIAL (Will be evaluated).
  Job type: Remote.
  Salary: $90,000 gross.
  Benefits: Excellent superior benefits.
  Postúlate por este medio y comparte tu CV.
  Enviar CV a talento ARROBA GSB punto lat
  Tipo de puesto: Tiempo completo

Idioma:

• Inglés (Obligatorio)

Lugar de trabajo: Empleo remot

Please refer the Job description for details