Data Engineering Lead

at  Apriori

JOB SUMMARY:

We are seeking a Data Engineering Lead to oversee the development and maintenance of scalable data products and ensure the reliability of data architecture. The ideal candidate will have a strong background in data engineering, software development and data management.

QUALIFICATIONS:

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• Proven experience as a Data Engineer or in a similar leadership role.
• Strong understanding of data structures, algorithms, and software engineering principles.
• Expertise in SQL and NoSQL databases, and workflow management tools such as Apache Airflow.
• Experience with Data Catalogs, Data Governance and Data lineage (e.g. DataPlex, DataHub)
• Proficient in programming languages such as Python, Java, or Scala.

PREFERRED SKILLS:

• Experience with cloud services like Google Cloud, AWS.
• Familiarity with big data tools (e.g., BigQuery, Spark, Kafka).
• Strong project management and organizational skills.
• Excellent communication and interpersonal abilities.

• Lead a team of data engineers in the design, implementation, and maintenance of data products and data platform capabilities.
• Develop comprehensive data solutions that serve business needs across various departments.
• Oversee the design and operation of robust data processing systems.
• Mentor team members, fostering a collaborative and growth-oriented environment.
• Collaborate with data scientists, software development teams, and other stakeholders to support data-centric initiatives
• Ensure data integrity, quality, and efficiency by implementing best practices and tools.
• Drive innovation by exploring new tools and techniques in data architecture and processing.