Streaming algorithms for a data-driven age.
Fleet implements several streaming algorithms in Scala, and wraps up the algorithms in a service that exposes a REST API. These two parts are independent.
A streaming algorithm is an algorithm that makes a single pass over data. That is, it can only visit a data point once and much summarise that point in some way and then throw it away. Streaming algorithms typically have memory usage that is sublinear, low CPU usage, and by their nature give real-time results.
We stand on the shoulder of giants.
- Alex Smola's course section on data streams
- Andrew McGregor's 2012 course on streaming algorithms