Data Engineer-Azure
at Expleo Group
Lisboa, Área Metropolitana de Lisboa, Portugal -
Start Date | Expiry Date | Salary | Posted On | Experience | Skills | Telecommute | Sponsor Visa |
---|---|---|---|---|---|---|---|
Immediate | 15 Feb, 2025 | Not Specified | 18 Nov, 2024 | 5 year(s) or above | Kafka,Hadoop,Spark,Hive,Data Integration,English,Talend,Scala,Programming Languages,Etl Tools,Java,Python | No | No |
Required Visa Status:
Citizen | GC |
US Citizen | Student Visa |
H1B | CPT |
OPT | H4 Spouse of H1B |
GC Green Card |
Employment Type:
Full Time | Part Time |
Permanent | Independent - 1099 |
Contract – W2 | C2H Independent |
C2H W2 | Contract – Corp 2 Corp |
Contract to Hire – Corp 2 Corp |
Description:
Overview:
Expleo is a trusted partner for your innovation journey. As a global engineering, technology and consulting service provider, we are ideally positioned to help you achieve your ambitions and future-proof your business. With a smart blend of bold thinking and reliable execution, we’re able to fast-track innovation through each step of your value chain.
We are strategically positioned to build value, with a global footprint across 30 countries.
We are as global and local as you need us to be, with strong best-in-class pan-European technological centres and unique best-shoring capabilities.
We leverage a network of high value-adding affiliates in consulting and industrial excellence, and leading partners across multiple sectors to provide you with the most comprehensive services and solutions in an ever-changing environment.
Responsibilities:
- Design, build, and maintain scalable data platforms;
- Collect, process, and analyze large and complex data sets from various sources;
- Develop and implement data processing workflows using data processing framework technologies such as Spark, and Apache Beam;
- Collaborate with cross-functional teams to ensure data accuracy and integrity;
- Ensure data security and privacy through proper implementation of access controls and data encryption;
- Extraction of data from various sources, including databases, file systems, and APIs;
- Monitor system performance and optimize for high availability and scalability.
Essential skills:
- At least 5 years experience in a similar role;
- Experience with Azure cloud platforms and services;
- Proficiency in programming languages such as Python, Java or Scala;
- Good knowledge of Big Data tools (Spark, Kafka, Hadoop, Hive);
- Knowledge of data integration and ETL tools (e.g. Apache, Talend);
- Strong SQL skills;
- Familiarity with Azure Data Factory;
- Good knowledge of English.
LI-SC
Responsibilities:
- Design, build, and maintain scalable data platforms;
- Collect, process, and analyze large and complex data sets from various sources;
- Develop and implement data processing workflows using data processing framework technologies such as Spark, and Apache Beam;
- Collaborate with cross-functional teams to ensure data accuracy and integrity;
- Ensure data security and privacy through proper implementation of access controls and data encryption;
- Extraction of data from various sources, including databases, file systems, and APIs;
- Monitor system performance and optimize for high availability and scalability
REQUIREMENT SUMMARY
Min:5.0Max:10.0 year(s)
Information Technology/IT
IT Software - Other
Software Engineering
Graduate
Proficient
1
Lisboa, Portugal