STREAMLINE is the research project of TU Berlin, SICS Stockholm and SZTAKI Budapest for reducing system and human latencies in the analytics of high speed data streams. On top of Apache Flink, we
- Develop automatic optimization, parallelization, and system adaptation technologies that reduce the programming expertise required by data scientists, thereby enabling them to more freely focus on domain specific matters.
- Overcome the complexity of the so-called ‘lambda architecture’ by delivering simplified operations that jointly support “data at rest” and “data in motion” in a single system that is compatible with the Hadoop ecosystem.
- Develop new machine learning technologies capable of very fast reacting to changes in the stream.
In the presentation we show results of our experiments over telecommunication and recommendation use cases.