Data Engineer II, Content Understanding
Spotify
Data Engineer
Content Understanding
Link copied to clipboard.
Engineering
Data
Location
- New York
Job type
Permanent
What You'll Do
- Build large-scale batch and real-time data pipelines with data processing frameworks such as Scio, Spark on Google Cloud Platform
- Leverage best practices in continuous integration and delivery
- Help drive optimisation, testing and tooling to improve data quality
- Collaborate with other Software Engineers, ML Engineers, Data Scientists and other stakeholders, taking on learning and leadership opportunities that will arise every single day
- Create and maintain metrics datasets as well as dashboards that power data driven decisionsWork in an agile team to continuously experiment, iterate and deliver on new product objectives
- Work on machine learning projects powering the experience that suits each user individually
Who You Are
- You have professional data engineering experience and you know how to work with high volume, heterogeneous data, preferably with distributed systems such as Hadoop, BigTable, Cassandra, GCP, AWS or Azure
- You know Scala language well, and are interested in spreading this knowledge in the team
- You have experience with one or more higher-level JVM-based data processing frameworks such as Beam, Dataflow, Crunch, Scalding, Storm, Spark, Flink etc
- You might have worked with Docker as well as Luigi, Airflow, or similar tools
- You are passionate about crafting clean code and have experience in coding and building data pipelines
- You care about agile software processes, data-driven development, reliability, and responsible experimentation
- You understand the value of collaboration and partnership within teams
Where You Will Be
- For this role you will be based in New York City, USA
Link copied to clipboard.
Our global benefits
Extensive learning opportunities, through our dedicated team, GreenHouse.
Flexible share incentives letting you choose how you share in our success.
Global parental leave, six months off - fully paid - for all new parents.
All The Feels, our employee assistance program and self-care hub.
Flexible public holidays, swap days off according to your values and beliefs.
Learn about life at Spotify
Similar jobs
New York
Permanent
Engineering
Machine Learning