DATA ANALYST (Hadoop)

at  Dezire Technologies Pte Ltd

Responsibilities:

• Design, develop, and maintain Hadoop-based data processing applications, workflows, and pipelines.
• Leverage Hadoop technologies such as HDFS, MapReduce, Spark, Hive, and HBase for batch and real-time data processing.
• Develop and optimize data ingestion processes, ensuring data is collected, transformed, and loaded into the Hadoop cluster efficiently.
• Monitor and optimize the performance of Hadoop jobs and data pipelines to ensure scalability and efficiency.
• Work closely with data engineers, data scientists, and other cross-functional teams to understand data requirements and deliver effective solutions.

Requirements

• Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
• Minimum 3 years experience as a Hadoop Developer with strong knowledge of Hadoop ecosystem components like Spark, Hive, HBase, etc.
• Hands-on experience with data ingestion, transformation, and ETL processes using Hadoop.
• Strong knowledge of SQL and experience with relational databases.
• Experience with performance tuning and optimization of Hadoop applications.
• Good understanding of data warehousing concepts and methodologies.

• Design, develop, and maintain Hadoop-based data processing applications, workflows, and pipelines.
• Leverage Hadoop technologies such as HDFS, MapReduce, Spark, Hive, and HBase for batch and real-time data processing.
• Develop and optimize data ingestion processes, ensuring data is collected, transformed, and loaded into the Hadoop cluster efficiently.
• Monitor and optimize the performance of Hadoop jobs and data pipelines to ensure scalability and efficiency.
• Work closely with data engineers, data scientists, and other cross-functional teams to understand data requirements and deliver effective solutions