Key Responsibilities:
End-to-end software solution design to development to implementation for any big projects
/ change request
Support user query or address any performance issue either with Business users query
response or system performance
Key Requirements:
Expertise in developing / implementing framework to build various data pipeline using
(Pyspark, Scala, Java)
Expertise in implementing Hadoop based Data mart using Spark based framework (Java,
Scala, Pyspark)
Good Working experience in core technical area using Python, Java, PySpark and Scala
Expertise in Cloudera CDH / CDP components
Good knowledge in developing Spark based ingestion framework (Java, Scala, Pyspark)
Experience in building and operationalising feature pipeline to support AI/ML model
execution, data pipelines for supporting large scale data warehouse/data marts

Added advantage:

• Scripting knowledge in Bash, Python and Perl, to automate and avoid repetitive tasks.
• Possess good technical knowledge of RHEL/Linux, and Unix hardware, operating system and

system service

Please refer the Job description for details