Data Engineer II at Microsoft

Hyderabad, Telangana, India -

Full Time

Start Date

Immediate

Expiry Date

18 Feb, 26

Salary

0.0

Posted On

20 Nov, 25

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Data Engineering, Software Development, Data Modeling, C#, Java, SQL, KQL, Python, ETL, Azure Data Lake, Azure Data Factory, Azure Synapse, Azure Logic Apps, Azure Functions, Azure Data Explorer, Power BI

Industry

Software Development

Description

* You will design, develop, and maintain data pipelines, including solutions for data collection, cleansing, transformation, and usage, ensuring accurate data ingestion and readiness for downstream analysis, visualization, and AI model training. * You will build frameworks to validate data quality and completeness, detect anomalies, enhance data pipeline resiliency, and support unit and integration testing. * You will design and implement end-to-end software life cycles, encompassing design, development, CI/CD, service reliability, recoverability, and participation in agile development practices, including on-call rotation. * You will write code to implement performance monitoring protocols across data pipelines, building visualizations and aggregations to monitor pipeline health. You'll also implement solutions and self-healing processes that minimize points of failure across multiple product features. * You will anticipate data governance needs, designing data modeling and handling procedures to ensure compliance with all applicable laws and policies. * You will implement and enforce security and access control measures to protect sensitive resources and data. * You will Perform database administration tasks, including maintenance, and performance monitoring. Required/Minimum Qualifications * Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years' experience in data engineering, software development, or data modeling work. o OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years' experience in data engineering, software development, or data modeling work.OR equivalent experience. * 2+ years of experience in software or data engineering, with proven proficiency in C#, Java, or equivalent. * 2+ years in one scripting language for data retrieval and manipulation (e.g., SQL or KQL). * 2+ years of experience in big data scripting languages like Python, SCOPE, SQL or equivalent. * 2+ years of experience with ETL and data cloud computing technologies, including Azure Data Lake, Azure Data Factory, Azure Synapse, Azure Logic Apps, Azure Functions, Azure Data Explorer, and Power BI or equivalent platforms. Preferred/Additional Qualifications * 1+ years of demonstrated experience implementing data governance practices, including data access, security and privacy controls and monitoring to comply with regulatory standards. * Experience with big data technologies such as: Hadoop, Hive, Spark. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations, and ordinances. #azdat #azuredata #fabricdata #dataintegration #azure #synapse #databases #bigdata This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled. *

Responsibilities

You will design, develop, and maintain data pipelines, ensuring accurate data ingestion and readiness for downstream analysis. You will implement solutions for data quality, security, and compliance while participating in agile development practices.