Free Software Projects Powered by ZooKeeper: AdroitLogic UltraESB Akka Eclipse Communication Framework Eclipse Gyrex GoldenOrb Juju Katta KeptCollections Mesos Neo4j Norbert Talend ESB redis_failover Apache Projects Powered by ZooKeeper: Apache Accumulo Apache BookKeeper Apache CXF DOSGi Apache Flume Apache Hadoop MapReduce Apache HBase Apache Hedwig Apache Kafka Apache S4 Apache Solr Source: https://cwiki.apache.org/confluence/display/ZOOKEEPER/PoweredBy
OK, this is a very old question, which I’m first seeing now. You’ll need to differentiate between sequence numbers and unique IDs that are (optionally) loosely sortable by a specific criteria (typically generation time). True sequence numbers imply knowledge of what all other workers have done, and as such require shared state. There is no … Read more
Yes, Zookeeper is required for running Kafka. From the Kafka Getting Started documentation: Step 2: Start the server Kafka uses zookeeper so you need to first start a zookeeper server if you don’t already have one. You can use the convenience script packaged with kafka to get a quick-and-dirty single-node zookeeper instance. As to why, … Read more
When structuring your data for Kafka it really depends on how it´s meant to be consumed. In my mind, a topic is a grouping of messages of a similar type that will be consumed by the same type of consumer so in the example above, I would just have a single topic and if you´ll … Read more
In a nutshell, ZooKeeper helps you build distributed applications. How it works You may describe ZooKeeper as a replicated synchronization service with eventual consistency. It is robust, since the persisted data is distributed between multiple nodes (this set of nodes is called an “ensemble”) and one client connects to any of them (i.e., a specific … Read more