Data Engineer at Priogen
Amsterdam, , Netherlands -
Full Time


Start Date

Immediate

Expiry Date

19 Oct, 25

Salary

0.0

Posted On

20 Jul, 25

Experience

1 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

No

Skills

Good communication skills

Industry

Information Technology/IT

Description

Priogen is an innovative Energy Trading company, based in Amsterdam. We are a member of EPEX, EEX & Nordpool and trade across the curve, with emphasis on short term power trading.
Our traders, analysts and models have an unstoppable appetite for data. The data department is making sure that all data needs are met, and correct data is available at any time. Since there is more work than people, we are looking for a data engineer to complete our team.

Responsibilities

WHAT YOU WILL DO:

As a Data Engineer at Priogen you will be responsible for defining, building, and maintaining data flows. This is done on Dataiku as well as through as the creation of tools (mostly python-based) to allow the business to use a self-service data platform.
Data acquisition is primarily done with API and Web based clients, then validated and ingested. These processes will require modern development standards such as Test-Driven Development, use of microservices and consideration of data governance.
The role will involve the creation and management of CI/CD pipelines so prior experience with GIT and version management is required. Experience is also required with the ingestion of data to and from Data Warehouses and Data Lakes. Prior experience with cloud services is required, particularly AWS.

TO BE SUCCESSFUL IN THIS ROLE YOU WILL HAVE:

  • Experience with python including commonly used libraries as well as testing frameworks and use of object-oriented functionality such as classes
  • Experience with SQL, particularly on large datasets
  • Experience with the bash scripting language
  • Experience with Big Data and knowledge of data management techniques
  • Experience with ingestion, processing and storage of continuous data feeds
  • Experience with cloud platforms, preferably AWS
  • Use of Git version management such as Gitlab
  • Understanding of DevOps concepts and when to apply them to data transformation
  • Familiarity with agile methodology, particularly the use of Jira and Confluence, particularly when working across several projects
  • Effective communication and stakeholder management skills
Loading...