Sr Data Engineer (Life and Annuity) at NTT DATA
Bengaluru, karnataka, India -
Full Time


Start Date

Immediate

Expiry Date

16 Jan, 26

Salary

0.0

Posted On

18 Oct, 25

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

No

Skills

Data Engineering, Big Data, Spark, Scala, AWS Glue, Lambda, SNS, SQS, Cloudwatch, SQL, Python, ETL, ELT, Hadoop, Financial Services, Machine Learning

Industry

IT Services and IT Consulting

Description
At least 6+ years of relevant experience in design, development, complete end-end design of enterprise-wide big data solution. Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda, SNS/SQS, Cloudwatch is a must. Complete development, configuration, test cases and unit testing Perform code reviews and ensure standards are applied to each solution component. Resolve complex defects during testing phases and identify root causes. Support and execute performance testing. Familiar with Git repo and CI/CD deployment process Production Support: Assist in troubleshooting production environment and tuning environments. Ensure best practices are followed from a technical perspective during all phases of the project. * Experience in Snowflake is an added advantage. Experience with ETL/ELT process and frameworks is a must. Create integration and application technical design documentation. Strong background in AWS cloud services like lambda, glue, s3, emr, sns, sqs, cloudwatch, redshift Expertise in SQL and experience with relational databases like Oracle, MySql, PostgreSQL Proficient in Python programming for data engineering tasks, automations Experience with shell scripting in Linux/Unix environments. Experience with Big Data - Hadoop, Spark Financial Services experience required Nice to have - knowledge in Machine Learning models, regression, validation
Responsibilities
Design and develop enterprise-wide big data solutions, ensuring best practices are followed throughout the project lifecycle. Perform code reviews, resolve defects, and support performance testing.
Loading...