How to Guarantee Message delivery with Celery?
A lot has changed since the OP! There is now an option for high-availability aka “mirrored” queues. This goes pretty far toward solving the problem you described. See http://www.rabbitmq.com/ha.html.
Redis Team has very good documentation on this Core Steps: Setup your new Redis instance as a slave for your current Redis instance. In order to do so you need a different server, or a server that has enough RAM to keep two instances of Redis running at the same time. If you use a … Read more
I used the Raft consensus protocol to replicate my SQLite database. You can find the system here: https://github.com/rqlite/rqlite
I have found this article on the subject: http://www.tenereillo.com/GSLBPageOfShame.htm Basically if you do not require long lasting sticky sessions you can configure your DNS servers to return multiple A records (IP addresses) for your website. Web browsers are smart enough to try all the addresses until they find one that works.
I’ve looked extensively at Zookeeper/Curator, Eureka, etcd, and consul. Zookeeper/Curator and Eureka are in many ways the most polished and easiest to integrate if you are in the Java world. Etcd is pretty cool and very flexible, but It is really just a HA key store so you would have to write a lot of … Read more