Sign up with

Already have an account? Log in here

Need some help?
Talk to us at +91 7670800001

Data Engineer (AWS+Pyspark) at ZENSAR TECHNOLOGIES SINGAPORE PTE LTD

Hyderabad, Telangana, India -

Full Time

Start Date

Immediate

Expiry Date

23 Sep, 26

Salary

0.0

Posted On

25 Jun, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Python, PySpark, AWS EMR, Amazon Athena, AWS Glue, Amazon Lambda, Amazon EC2, Amazon S3, Amazon SNS, Git, Data Warehousing, Parquet, Snappy, Gzip, AWS Databases

Industry

IT Services and IT Consulting

Description

Data Engineer (AWS + pySpark) * Having 5+ years of relevant experience, which includes hands on experience in Big Data technologies. * Mandatory - Hands on experience in Python and PySpark. * Build pySpark applications using Spark Dataframes in Python. * Worked on optimizing spark jobs that processes huge volumes of data. * Hands on experience in version control tools like Git. * Worked on Amazon’s Analytics services like Amazon EMR, Amazon Athena, AWS Glue. * Worked on Amazon’s Compute services like Amazon Lambda, Amazon EC2 and Amazon’s Storage service like S3 and few other services like SNS. * Good to have knowledge of datawarehousing concepts – dimensions, facts, schemas- snowflake, star etc. * Have worked with columnar storage formats - Parquet etc. Well versed with compression techniques – Snappy, Gzip. * Good to have knowledge of AWS databases (atleast one) Aurora, RDS, Redshift, ElastiCache, DynamoDB.am

How To Apply:

Incase you would like to apply to this job directly from the source, please click here

Responsibilities

Develop and optimize PySpark applications using Spark Dataframes to process large volumes of data. Utilize AWS analytics and compute services to build scalable data pipelines.