Technical Specialist at Datavail Career Site

Mumbai, maharashtra, India -

Full Time

Start Date

Immediate

Expiry Date

24 Jun, 26

Salary

0.0

Posted On

26 Mar, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

AWS, S3, Glue, Lambda, Athena, Redshift, EMR, DynamoDB, IAM, Python, SQL, PySpark, ETL/ELT, Data Architecture, Data Engineering, Data Governance

Industry

IT Services and IT Consulting

Description

Title: Technical Specialist Location: Mumbai Exp Level: 8+ Education: Any Degree Key Skills: • Strong expertise with AWS services such as: • S3, Glue, Lambda, Athena, Redshift, EMR, DynamoDB, IAM. • Proficiency in Python, SQL, and PySpark Required Skills: * Total 8+ years of experience * 3+ years of experience as a Data Engineer (or similar role). Data Architecture & Engineering * Design, develop, and maintain scalable ETL/ELT pipelines using AWS services (Glue, Lambda, Step Functions, EMR, etc.). * Build and optimize data lakes and data warehouses using S3, Redshift, Lake Formation. * Develop, manage, and optimize SQL/NoSQL data models. * Implement real-time and batch data processing solutions using Kinesis, Kafka, or similar streaming platforms. Cloud Engineering * Ensure data pipelines are reliable, scalable, secure, and cost optimized. * Implement monitoring and logging using CloudWatch, SNS, and related services. Data Quality & Governance * Ensure data accuracy, consistency, and completeness across all systems. * Implement data governance, lineage, and cataloging using Glue Data Catalog or similar tools. * Work closely with data analysts, scientists, and business stakeholders to deliver trusted datasets. Collaboration * Work with cross functional teams to gather data requirements. * Support BI/reporting teams with optimized datasets. * Participate in code reviews and contribute to engineering best practices. Datavail is a leading provider of data management, application development, analytics, and cloud services, with more than 1,000 professionals helping clients build and manage applications and data via a world-class tech-enabled delivery platform and software solutions across all leading technologies. For more than 17 years, Datavail has worked with thousands of companies spanning different industries and sizes, and is an AWS Advanced Tier Consulting Partner, a Microsoft Solutions Partner for Data & AI and Digital & App Innovation (Azure), an Oracle Partner, and a MySQL Partner.

Responsibilities

The role involves designing, developing, and maintaining scalable ETL/ELT pipelines using various AWS services like Glue, Lambda, and EMR, while also building and optimizing data lakes and warehouses using S3 and Redshift. Responsibilities also include implementing real-time and batch data processing solutions and ensuring data pipelines are reliable, secure, and cost-optimized.