Senior Data Engineer at Microsoft

Vancouver, British Columbia, Canada -

Full Time

Start Date

Immediate

Expiry Date

19 Mar, 26

Salary

203900.0

Posted On

19 Dec, 25

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Data Engineering, Spark SQL, PySpark, Scala, Data Modeling, Business Analytics, Software Development, Data Governance, Data Compliance, Data Security, Microsoft Fabric, Azure Data Factory, Azure Synapse, Azure Databricks, GIT Operations, CICD Flows, Azure DevOps

Industry

Software Development

Description

Overview Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further. This is a world of more possibilities, more innovation, more openness, and the sky is the limit thinking in a cloud-enabled world. Microsoft’s Azure Data engineering team is leading the transformation of analytics in the world of data with products like databases, data integration, big data analytics, messaging & real-time analytics, and business intelligence. The products our portfolio include Microsoft Fabric, Azure SQL DB, Azure Cosmos DB, Azure PostgreSQL, Azure Data Factory, Azure Synapse Analytics, Azure Service Bus, Azure Event Grid, and Power BI. Our mission is to build the data platform for the age of AI, powering a new class of data-first applications and driving a data culture. Within Azure Data, the Insights and Analytics team is dedicated to building and maintaining internal analytics and reporting platform hosted on Microsoft Fabric. This platform delivers insights to Azure Data Engineering team leaders, Product Managers, Marketing, Finance and Sales. Additionally, the team serves as the initial customer of newly developed products and features, running them in a production environment and collaborating closely with product managers and engineers to provide invaluable feedback. The Data Engineering team within the Azure Data Insights and Analytics organization is primarily tasked with maintaining and advancing our data platform. This platform encompasses Spark development, with a significant emphasis on PySpark and Spark SQL within Microsoft Fabric notebooks. Our team places high importance on code optimization, metadata-driven orchestration, and implementing best practices in DevOps. We are seeking a skilled Senior Data Engineer who can enhance our platform using modern technologies while ensuring reliable and high-performance operations. You will have the autonomy to define your area of expertise and cultivate skills that will propel your career forward. Your daily routine will include participating in standup meetings, managing work items based on your capacity, collaborating with the team’s Program Managers to define new projects or initiatives, and, most importantly, engaging in development activities. In addition to traditional Data Engineering tasks, you will directly interact with the teams developing the tools we utilize, enabling you to provide direct product feedback and witness your input driving changes in the products over time. Our team is dedicated to reporting on the health of Azure Data products and contributing to their overall effectiveness and utility. We do not just value differences or different perspectives. We seek them out and invite them in so we can tap into the collective power of everyone in the company. As a result, our customers are better served. Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. Responsibilities Extract and transform disparate data into actionable insights that will drive business decisions. Applying industry best practice transformation and modeling techniques – validating the output to ensure reliable and accurate results for consumption by downstream data teams, and end users. Drive development projects to evolve our platform and operations, leveraging the newest Microsoft technologies available to us. Contribute to the success of Azure Data by trying out and testing new products and features, contributing to the design of major feature enhancements, and dedicating time to provide direct feedback to the Product Group. Work directly with business stakeholders to refine requirements, iterate and finalize design, deliver working proofs of concept, and develop final data solution. Live site and on call DRI duty for maintaining high availability of our analytics solutions Collaborate with your peers and maintain flexibility on domain ownership as business priorities evolve. Work with other data teams within Microsoft on understanding their data products and onboarding them. Embody our culture and values Qualifications Required/Minimum Qualifications •Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience. •5+ years experience as a Data Engineer manipulating and transforming data in Spark SQL, PySpark, or Scala. •5+ years experience translating business requirements to technical requirements. Other Requirements Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter. Preferred/Additional Qualifications Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in business analytics, data science, software development, data modeling, or data engineering OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 8+ years experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience. 2+ years experience with data governance, data compliance and/or data security. Advanced knowledge and experience with Microsoft data tools including Microsoft Fabric, Azure Data Factory, Azure Synapse, and Azure Databricks Advanced knowledge and experience with GIT operations and CICD flows Advanced experience using a work management tool such as Azure DevOps Advanced experience in time management and prioritization Excellent written & verbal communication skills Passion for data and the desire to learn & adopt new technologies. #azdat #azuredata Data Engineering IC4 - The typical base pay range for this role across Canada is CAD $114,400 - CAD $203,900 per year. Find additional pay information here: https://careers.microsoft.com/v2/global/en/canada-pay-information.html Data Engineering IC4 - L'échelle salariale de base typique pour ce rôle dans l'ensemble du Canada est de 114,400 $ CAD à 203,900 $ CAD par année. Pour plus d'information au sujet de la rémunération, veuillez cliquer ici: https://careers.microsoft.com/v2/global/en/canada-pay-information.html Ce poste sera ouvert pendant au moins cinq jours et les candidatures seront acceptées de façon continue jusqu’à ce que le poste soit pourvu. This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled. Microsoft est un employeur offrant l’égalité d’accès à l’emploi. Tous les candidats qualifiés seront pris en considération pour l’emploi, sans égard à l’âge, à l’ascendance, à la citoyenneté, à la couleur, aux congés médicaux ou familiaux, à l’identité ou à l’expression de genre, aux renseignements génétiques, à l’état d’immigration, à l’état matrimonial, à l’état de santé, à l’origine nationale, à un éventuel handicap physique ou mental, à l’affiliation politique, au statut de vétéran protégé ou au statut militaire, à la race, à l’ethnie, à la religion, au sexe (y compris la grossesse), à l’orientation sexuelle ou à toute autre caractéristique protégée par les lois, ordonnances et règlements locaux applicables. Si vous avez besoin d’aide avec des accommodements religieux et/ou d’un accommodement raisonnable en raison d’un handicap pendant le processus de candidature, apprenez-en plus sur la demande d’accommodement. Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Responsibilities

The Senior Data Engineer will extract and transform data into actionable insights and drive development projects to enhance the platform. They will also collaborate with business stakeholders to refine requirements and maintain high availability of analytics solutions.