Sign up with

Already have an account? Log in here

Need some help?
Talk to us at +91 7670800001

Systems Integration Advisor at NTT DATA

Bengaluru, karnataka, India -

Full Time

Start Date

Immediate

Expiry Date

09 Mar, 26

Salary

0.0

Posted On

09 Dec, 25

Experience

2 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Python, PySpark, ETL, ELT, Cloudera, Hadoop, Snowflake, SQL, Ansible, Bash, Spark, Kafka, NiFi, Grafana, Data Modeling, Cloud Platforms

Industry

IT Services and IT Consulting

Description

Data Pipeline Development: Design, develop, test, deploy, and maintain robust, scalable ETL/ELT data pipelines using Python/PySpark across Cloudera and Databricks platforms. Cloudera & Hadoop Management: Administer and maintain Cloudera clusters, managing core components such as HDFS, YARN, Hive, Impala, Spark, Kafka, and NiFi, ensuring high availability and performance. Snowflake Data Warehousing: Lead the implementation of Snowflake solutions, including data ingestion, storage, transformation (using SQL and Snowpark), and performance optimization. Automation & DevOps: Develop infrastructure as code (IaC) and automation scripts using Ansible, Bash, or Python to streamline deployment, configuration management, and routine administrative tasks. Collaboration: Work closely with data scientists, analysts, and business stakeholders to gather requirements, design data models (e.g., Medallion architecture), and deliver high-quality, analytics-ready data. Monitoring & Troubleshooting: Monitor application and cluster performance using relevant tools (e.g., Cloudera Manager, Grafana) and troubleshoot complex issues in distributed environments. Experience: Proven experience in a data engineering or big data administrator role with a minimum of 3+ years in a specific Databricks or Snowflake environment. Big Data Technologies: Expertise in the Hadoop ecosystem with a strong understanding of the Cloudera distribution. Cloud Data Platforms: Hands-on experience with Databricks (Spark, Delta Lake) and Snowflake. Programming & Scripting: Strong proficiency in Python/PySpark and SQL. Experience with Scala is a plus. Automation Tools: Strong understanding and practical experience with Ansible for automation and configuration management. Cloud Knowledge: Familiarity with cloud platforms such as AWS or Azure is highly preferred.

Responsibilities

The Systems Integration Advisor will design, develop, test, deploy, and maintain ETL/ELT data pipelines, while also administering Cloudera clusters and leading Snowflake implementations. The role involves collaboration with data scientists and analysts to deliver high-quality data and troubleshooting complex issues in distributed environments.