Data Platform Developer

at  b2bnetwork

PROJECT DESCRIPTION

The EDP team is building an internal platform for Elia Group software product developers to accelerate the development and delivery of software products to tackle the massive challenges facing the energy sector. The EDP Platform is a service oriented, cloud-native platform that is being built to provide application teams with self-service capabilities to develop, run and operate their software products. EDP Platform provides services for application infrastructure, data, service lifecycle management, application build and delivery as well as services to operate their software products. The EDP Platform is deployed as a hybrid cloud, encompassing both private cloud and select public clouds. We are looking for talented, experienced, and motivated individuals in the following role to join the EDP team to take EDP to its next level.

POSITION DESCRIPTION

The role of a Developer in the Data team within EDP will be focusing on providing Data Platform Services like Data Catalog and key components to realize a Data Mesh on the EDP platform. This includes increasing level of maturity for well as expanding list of provided services. This role is crucial in aiding the deployment of established and standard data architectures across diverse application teams, which are poised to evolve into specialized Data Domain teams. We are looking for a talented and dedicated Software or Data Engineer to join our team, focusing on the developments of capabilities to enable Data Mesh, and offering expertise in leveraging contemporary technologies. This involves advising on the utilization of services available on public clouds or developing in[1]house services on our internal Kubernetes-based platform. In this role, you will be responsible for the development and management of data products, ensuring robust data governance, and establishing comprehensive data cataloging processes. This includes the creation, maintenance, and enhancement of cross-cloud managed data services, which are essential for enabling seamless data accessibility and interoperability across different cloud environments. The Data Engineer will also work closely with various teams to implement and enforce data governance policies, ensuring data quality, security, and compliance.

SKILL REQUIREMENTS MUST-HAVE COMPETENCIES / MUST-HAVE SKILLS

Proven hands-on software development experience Proficiency in data processing languages such as SQL, Java, Python or Scala Knowledge and experience with at least some of the Data technologies/frameworks: - RDBMS (PostgreSQL/MySql etc.)

• NoSQL Storages (MongoDB, Cassandra, Neo4j etc.)
• Timeseries (InfluxDB, OpenTSDB, TimescaleDB, Prometheus etc.)
• Workflow orchestration (AirFlow/Oozie etc.)
• Data integration/Ingestion (Flume etc) .
• Messaging/Data Streaming (Kafka/RabbitMQ etc.)
• Data Processing (Spark, Flink etc.) And/Or with their Cloud provided counterparts, i.e., Cloud Data/Analytics services (GCP, Azure, AWS) Familiarity with reference Big Data architectures (Warehouse, Data Lake, Data Lakehouse) and their implementation. Experience in implementing and operating data intensive applications Strong focus on DataOps/DevOps Good k8s knowledge and experience

Must-have language skills
Proficiency in both speech and writing in English (at least C1)
Preferred Competencies and skills
Deeper K8s skills and experience, e.g. k8s operators’ development experience and/or k8s operators for Big Data technologies) In-depth knowledge of best practices in data privacy and data protection Proven experience with DataMesh principles in practice Data platform development and/or operations experience Knowledge and experience in lifecycle management in Data (e.g. CD4ML, MLOps, …) Proficiency in Germa

Please refer the Job description for details