Data Engineer at Indus Net Technologies Ltd

, , Panama -

Full Time

Start Date

Immediate

Expiry Date

19 Jan, 26

Salary

0.0

Posted On

21 Oct, 25

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Databricks, Apache Spark, Azure Cloud Services, Python, Delta Lake, SQL, JSON, Git, CI/CD, IoT, Data Quality, Data Engineering, OOP, Pandas, Machine Data, Time-Series Data

Industry

IT Services and IT Consulting

Description

Job Title: Data Engineer Experience: 5–10 Years Location: Pan India Joining Time: Immediate to 15 Days Maximum About the Role: Indus Net Technologies is looking for an experienced Data Engineer to design, build, and maintain robust data pipelines leveraging Databricks and Azure Cloud Services. The ideal candidate will have hands-on expertise in processing large-scale IoT sensor data from manufacturing equipment, ensuring data quality, integrity, and high performance across multi-plant operations. Key Responsibilities: Design and implement ETL/ELT pipelines using Databricks and PySpark. Process and transform real-time IoT sensor data from multiple manufacturing plants. Manage data storage, versioning, and optimization using Delta Lake. Integrate data from diverse sources (SQL Server, JSON, CSV, APIs, etc.). Write and optimize complex SQL queries and stored procedures for performance. Implement data quality monitoring, testing, and CI/CD pipelines using Azure DevOps. Collaborate closely with manufacturing and analytics teams to deliver actionable IoT data insights. Top 4 Mandatory Skills: Databricks & Apache Spark (PySpark) – Minimum 3 years of hands-on experience Azure Cloud Services – Experience with ADF, Blob Storage, and DevOps Python – Advanced proficiency with OOP concepts, pandas, and robust error handling Delta Lake – Strong knowledge of data versioning, time travel, and optimization Good-to-Have Skills: Advanced SQL and stored procedure development Experience in JSON data processing and schema handling Git-based version control and CI/CD integration using Azure DevOps Exposure to manufacturing or industrial IoT data patterns Preferred Domain Knowledge: Industrial IoT and time-series data management Machine data and equipment performance monitoring Multi-plant data integration and central data architecture Data quality frameworks, downtime, and defect analytics Qualifications: Bachelor’s degree in Computer Science, Engineering, or a related field 4–6 years of proven experience in Data Engineering 2+ years of strong exposure to Databricks/Spark ecosystem Azure Data Engineer Associate or Databricks certification is preferred Soft Skills: Excellent communication skills in English (written and verbal) Strong analytical and problem-solving mindset Collaborative and proactive approach with cross-functional teams High attention to detail and commitment to data accuracy

Responsibilities

The Data Engineer will design, build, and maintain data pipelines using Databricks and Azure Cloud Services. They will process and transform real-time IoT sensor data from multiple manufacturing plants while ensuring data quality and integrity.