Principal Data Engineer

Share job

Microsoft Silicon, Cloud Hardware, and Infrastructure Engineering (SCHIE) is the team behind Microsoft’s expanding Cloud Infrastructure and responsible for powering Microsoft’s “Intelligent Cloud” mission. SCHIE delivers the core infrastructure and foundational technologies for Microsoft's over 200 online businesses including Bing, MSN, Office 365, Xbox Live, Teams, OneDrive and the Microsoft Azure platform globally with our server and data center infrastructure, security and compliance, operations, globalization, and manageability solutions. Our focus is on smart growth, high efficiency, and delivering a trusted experience to customers and partners worldwide and we are looking for passionate, high energy engineers to help achieve that mission.

The Cloud Hardware Analytics & Tools (CHAT) Team within SCHIE develops advanced analytical and tooling solutions to support and improve the quality of Microsoft Azure. We collect and analyze data across the full Azure stack, HW & SW components, Silicon development processes, and much more. CHAT Data Science, a branch of CHAT, provides data science support, machine learning and artificial intelligence solutions, and advanced visualizations to cloud engineering and management partners.

We are looking for a Prinicpal Data Engineer to support our custom data analytics and visualizations platform. This high-impact role focuses on the pillars of data engineering of compliance, data management and transformation as well as modeling, and will have direct contributions to Azure-level projects, including working with highly visible platforms through data-driven approaches. This role closely collaborates with BI and Data Science, Software Engineers, other Data Engineers, Program Managers, and HW Engineering teams.

Required/Minimum Qualifications

• 5 years of engineering experience in Data Engineering (Azure, SQL, PySpark, C#).

• 5 years of experience with querying large volumes of data in SQL or Kusto databases

• Experience in analytics for one of the technical domains (IoT, telemetry, fleet/inventory management, repairs & reliability analysis) or project/program analytics is preferred

• 3 years of experience in monitoring & managing data pipelines, capacity & usage analytics, Azure subscriptions or similar technical infrastructures

• Strong C#, SQL and Python language skills for scripting and automation

• CS Degree or equivalent experience

• Excellent communications skills, both verbal and written

#SCHIEINDIA

Additional or Preferred Qualifications

• 3 years of experience with ADO Repo & CI/CD Pipelines management and automation

• Analyze large-scale Azure data to address critical business problems

• Work on complex, mission-critical solutions that involve multiple Azure Services

• Design and develop production-level code for data engineering efforts

• Work in collaborative environment