Senior Data Engineer-Maps
Apple
Data Science
Cupertino, CA, USA
Posted on Oct 7, 2024
Summary
Posted:
Weekly Hours: 40
Role Number:200559127
Apple Maps is seeking a Senior Geospatial Data Engineer to join our Data Evaluation team. The ideal candidate will possess substantial professional experience in data analysis, quality assurance/control, data engineering, and experience working with large-scale, scalable data solutions. Join a team that is focused on spatial data evaluation, automation, and data quality measurement, comprised of diverse skills and backgrounds, all with the same goal: helping to build the world’s best map. We believe that every engineer brings unique skills and perspectives to the table. Far more than any specific experience or skill, we are looking for engineers who are driven to build robust and reliable software, eager to learn and hone their skills, and enthusiastic about facilitating growth and mentorship among team members.
Description
Our Data Evaluation team collaborates with various groups within Apple Maps to enhance the efficiency and accuracy of Maps data evaluation and analysis. You will be working with us to help automate the measurement of data quality and change over time, working in coordination with our Evaluation Engineering and Data Engineering teams. Ongoing projects necessitate the design and implementation of novel automated systems that seamlessly integrate with the Maps data production processes, enabling continuous evaluations and the extraction of valuable insights. The successful candidate will closely collaborate with other data engineers, software engineers, data scientists, evaluation and SRE teams to deliver business objectives associated with this project, ensuring alignment to budget and time constraints. Designing and implementing geospatial databases, data models, and ETL processes using tools like Postgres/PostGIS, and working with serialized data formats such as protobuf/avro. - Developing quality checks and metrics on large scale spatial data - Collaborating closely with data scientists, analysts, and partners to understand data requirements and provide geospatial solutions. - Integrating geospatial data with other systems and applications using AWS/GCC services like EKS, EMR, and working with big data technologies like Spark. - Optimizing spatial queries for performance and scalability across multiple toolsets - Ensuring data quality, consistency, and accuracy through automated testing and validation processes. - Documenting processes, systems, and datasets for future reference and replication. - Providing technical support and solving for geospatial data systems.
Minimum Qualifications
- Bachelor’s degree or equivalent experience in Geography, Geomatics, Computer Science, or a related field and 8+ years of experience.
- 4+ years of experience developing tools and frameworks to improve developer and QA productivity.
- 3+ years of hands on experience designing and developing large software or data systems.
- 3+ years of recent experience developing Spark applications on bigData systems such as Hadoop or Kubernetes.
- Strong experience developing and deploying applications on Cloud infrastructure such as AWS.
- Passion for good software practices and building extensible and reusable software modules.
- Experience developing automation to write and read data from relational, no-SQL databases, from cloud storage like Snowflake and external tables such as Iceberg.
- Experience and comfortable working in a shared and collaborative code base.
- Experience leading development initiatives within the team and across the organization.
Key Qualifications
Preferred Qualifications
- Strong proficiency in Python, Scala, SQL, and shell scripting for data manipulation and ETL processes.
- Work closely with multiple cross functional teams to effectively coordinate and manage user expectations
- Proven ability to self-start, learn, plan, prioritize, and deliver ontime
- Excellent communication skills
Education & Experience
Additional Requirements
Pay & Benefits
Apple is an equal opportunity employer that is committed to inclusion and diversity. We take affirmative action to ensure equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant.