- Apache Kafka https://kafka.apache.org/ , a open source project from LinkedIn
- My forked version https://bitbucket.org/trieunt/kafka/overview
- Original paper: http://sites.computer.org/debull/A12june/pipeline.pdf
What I can do:
- upgrade & compile OK with latest version Scala 2.10.3
- notify when Kafka's producer writer is finished, means it should be faster
- real-time indexing & search Kafka message & offset using Apache Lucene http://lucene.apache.org/core/
- real-time monitoring & alert using Redis http://redis.io/