Staff Software Engineer, Quantitative Evaluation
Waymo
Waymo is an autonomous driving technology company with the mission to be the most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo One, a fully autonomous ride-hailing service, and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over one million rider-only trips, enabled by its experience autonomously driving tens of millions of miles on public roads and tens of billions in simulation across 13+ U.S. states.
The ability to rapidly develop workflows to evaluate safety, compliance, and service quality in new cities, novel situations, and issues identified in the field is critical to scaling Waymo’s business and is one of the top priorities in the company. The Behavior Sets team is focused on accelerating the development of driving sets and evaluation workflows used to evaluate the Waymo Driver. We develop ML-based tooling for data mining, identification of interesting behaviors, sampling, and optimization for evaluation workflows based on simulations of logged and synthetically generated driving scenarios.
In this hybrid role, you will report to our Senior Manager of Evaluation Engineering.
In this Software Engineering role, you will:
- Understand and refine product requirements for tools and measurements to understand and control the quality of Waymo’s driving evaluation tools (aka “eval of eval”)
- Translate product requirements into engineering and data science tasks, and execute on these as the primary individual contributor
- Critically examine and improve the data and statistical methods used to evaluate our eval tools
- Extend and improve our underlying infrastructure to meet product needs and ensure consistency across our various tools
- Work with stakeholders on integrating eval of eval tools into workflows and processes
- Lead coworkers on various teams to execute on high priority projects
You have:
- MSc level statistics or equivalent work experience
- 5+ years industry experience with
- Data processing pipelines
- SQL and databases
- C++ and/or Python
- Data visualization methods
We prefer:
- Experience developing evaluation tools, metrics, statistical algorithms, and related data
- Experience iterating on product vision together with Product Managers and leadership
The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process.
Waymo employees are also eligible to participate in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.