Sign up with

Already have an account? Log in here

Need some help?
Talk to us at +91 7670800001

BIBA Practice - Big Data Architect at HEXAWARE

, , New Zealand -

Full Time

Start Date

Immediate

Expiry Date

28 Jun, 26

Salary

0.0

Posted On

30 Mar, 26

Experience

10 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Data Engineering, Data Warehousing, ETL, Snowflake, Snowpark, Pyspark, Python, Hadoop, Hive, Spark, SQL, Kafka, CI/CD, DevOps, Data Quality, Data Lineage

Industry

IT Services and IT Consulting

Description

Qualifications: - Total 14+ years of experience across Data Engineering, Data Warehousing, ETL, Snowflake, Snowpark, pyspark/python - 6+ years of experience in Snowflake development, Hadoop , Hive & Spark framework. Good Knowledge of Snowpark - Strong Python, Snowpark Development and SQL knowledge. - Certification in Snowflake or Big Data is preferred. - Good to have experience in SAS. Responsibilities: • Experience with big data processing and distributed computing systems like Spark. • Implement ETL pipelines and data transformation processes. • Ensure data quality and integrity in all data processing workflows. • Troubleshoot and resolve issues related to Snowpark and PySpark applications and workflows. • Understand source, dependencies and data flow from converted Snowpark/PySpark code. • Strong programming skills in Python and SQL. • Experience with big data technologies like Hadoop, Hive, and Kafka. • Understanding of data warehousing concepts and relational databases like SQL. • Demonstrate and document code lineage. • Ensure compliance with data security, privacy regulations, and organizational standards. • Knowledge of CI/CD pipelines and DevOps practices. • Strong problem-solving and analytical skills. • Excellent communication and leadership abilities.

Responsibilities

The role involves implementing ETL pipelines and data transformation processes using big data technologies like Spark, ensuring data quality, and troubleshooting issues related to Snowpark and PySpark applications. Responsibilities also include understanding data flow, documenting code lineage, and ensuring compliance with data security standards.