Senior Databricks Data Engineer

at  Luxoft

PROJECT DESCRIPTION

We are hiring for projects in the Middle East. There are many opportunities in the region. Our team consists of frontend and backend developers, data analysts and data scientists, architects, analysts and project managers, and Databricks Data engineers. As a Senior Databricks Data Engineer, you will play a crucial role within our data platform team, focusing on our central data platform’s design, development, optimization, and maintenance. Leveraging your expertise in Databricks, big data technologies, and software engineering, you will be focusing on our data platform’s design, enhancement, and support to ensure its scalability, reliability, and performance.

SKILLS

Must have

• Proficiency in programming languages such as Python, Scala, or Java.
• Strong understanding of big data technologies and distributed computing principles.
• Experience with cloud platforms such as Azure and AWS.
• Strong understanding of SQL and relational databases.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.

Nice to have
-

1. Platform Design: Collaborate with cross-functional teams to refine and design the architecture of our data platform.
2. Platform Optimization: Continuously enhance the performance, scalability, and reliability of the data platform to meet evolving business requirements.
3. Platform Maintenance: Implement monitoring, alerting, and maintenance processes to ensure the availability and health of the data platform.
4. Data Governance: Establish and enforce data governance best practices to uphold data quality, security, and compliance standards.
5. Platform Integration: Integrate new technologies seamlessly into the data platform ecosystem, ensuring compatibility and interoperability.
6. Collaboration: Work closely with data engineers, data scientists, analysts, and business stakeholders to comprehend requirements and offer technical expertise and support.
7. Documentation: Create and maintain comprehensive documentation for the data platform architecture, processes, and workflows.
8. Mentorship: Provide guidance and mentorship to junior members of the data engineering team, nurturing their growth and development.