Data Engineer

at  STX Next Sp zoo

61-854 Poznań, województwo wielkopolskie, Poland -

Start DateExpiry DateSalaryPosted OnExperienceSkillsTelecommuteSponsor Visa
Immediate26 Nov, 2024Not Specified30 Aug, 2024N/AAzure,Aws,Sql,Communication Skills,Hbase,Data Processing,Postgresql,Elasticsearch,Mongodb,Solr,Soft Skills,Management System,Graphql,English,Mysql,Apache Kafka,Statistics,Hive,Apache Spark,Presto,Machine Learning,HadoopNoNo
Add to Wishlist Apply All Jobs
Required Visa Status:
CitizenGC
US CitizenStudent Visa
H1BCPT
OPTH4 Spouse of H1B
GC Green Card
Employment Type:
Full TimePart Time
PermanentIndependent - 1099
Contract – W2C2H Independent
C2H W2Contract – Corp 2 Corp
Contract to Hire – Corp 2 Corp

Description:

WE EXPECT KNOWLEDGE OF:

  • Best practices for designing scalable data processing systems, including data pipelines, advanced ETL processes, data warehouses and data lakes.
  • At least one cloud platform (AWS, Azure, GCP) and its solutions related to data processing.
  • SQL and at least one relational database management system like MySQL or PostgreSQL.
  • At least one NoSQL database like HBase, DynamoDB or MongoDB.
  • Working principles of distributed data processing systems (Apache Spark, Apache Flink or similar).

SOFT SKILLS:

  • Good communication skills in English (minimum B2).
  • Eagerness to develop yourself and learn new technologies.
  • Problem solving and analytical thinking.

YOUR EXPERIENCE RATING WILL ALSO BE AFFECTED BY YOUR OTHER SKILLS SUCH AS:

  • Understanding and knowing message broker systems like Apache Kafka or AWS Kinesis.
  • Experience in using orchestration tools like Apache Airflow or Dagster.
  • Knowledge of search systems like ElasticSearch or Solr.
  • Experience in using CI/CD tools like Github Actions.
  • Experience in implementing solutions using frameworks like Hadoop, Hive or Presto.
  • Experience in machine learning or statistics.
  • Other development skills like REST API or GraphQL.
  • Data scraping experience.

Responsibilities:

Please refer the Job description for details


REQUIREMENT SUMMARY

Min:N/AMax:5.0 year(s)

Information Technology/IT

IT Software - Application Programming / Maintenance

Software Engineering

Graduate

Proficient

1

61-854 Poznań, Poland