Nelson Arapé is a software developer with a MS in Computer Science and over 20 years of working experience. He works at Spotify on the Event Delivery System. His team is responsible for moving a ton of data in a timely manner. Nelson prefers coding in Java but also works with Python, Bash and some data pipelines in Scala. In the past, Nelson worked as consultant and a lecturer in his home country Venezuela.
The events must flow: lessons learnt from evolving the Spotify’s event delivery system
Spotify is currently one of the most popular music streaming services in the world with over 170 million monthly active users. Those users generate billions of events per day that need to be collected and delivered to our developers in a timely manner. These events are used to compute royalties payments but also fuels many features like Discover Weekly.
Handling this amount of scale have not been always easy. On two occasions the event delivery system have been redesigned from scratch and we have to replace the system running with the new one without interfering with the flow of events. In this talk will be focus on the evolution of this system and the lessons learned along the way.
Date: October 11, 2018