Sign up with

Already have an account? Log in here

Need some help?
Talk to us at +91 7670800001

Data Engineer II at Microsoft

Hyderabad, Telangana, India -

Full Time

Start Date

Immediate

Expiry Date

02 Mar, 26

Salary

0.0

Posted On

02 Dec, 25

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Big Data, ETL, SCOPE, Scala, SQL, Python, C, Data Extraction, Data Cleaning, Data Validation, Data Cloud Computing, Azure Synapse, Apache Spark, Data Modeling, Coding, Debugging

Industry

Software Development

Description

Authoring and design of Big Data ETL platforms and pipelines in SCOPE, Scala, SQL, Python, or C Data extraction across a wide variety of data sources Data cleaning, preprocessing, and transformation for further analysis by data analysts Data Validation framework from source to endpoints ensuring data quality and integrity Enable the Data Scientists and Analysts to do more with data across all aspects of the development lifecycle. Contribute to a data-driven culture as well as a culture of experimentation across the organization. Provide new and improve upon existing data platform offerings with a fundamental understanding of the end-to-end scenarios. Enable Data Scientists and other partners to do more with data across all aspects of the development lifecycle by helping democratize data. Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering * OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience. Proven coding and debugging skills in C#, C++, Java, or SQL. Ability to work and communicate effectively across disciplines and teams. Familiarity with distributed data processing and analysis, such as Map-Reduce or Apache Spark. 4+ years of experience in engineering. 2+ years of experience in data engineering. Understanding and experience with data cloud computing technologies such as - Azure Synapse, Azure Data Factory, SQL, Azure Data Explorer, Power BI, PowerApps, Hadoop, YARN, Apache Spark.

Responsibilities

The role involves authoring and designing Big Data ETL platforms and pipelines, ensuring data quality and integrity throughout the development lifecycle. Additionally, it focuses on enabling Data Scientists and Analysts to leverage data effectively across the organization.