I would not use Redis for such a task. Other products will be a better fit IMO. Redis is an in-memory data store. If you want to store 10-20 TB of data, you will need 10-20 TB of RAM, which is expensive. Furthermore, the memory allocator is optimized for small objects, not big ones. You … Read more
Regarding question 1, Redis is an in-memory store with some persistency capabilities. All your dataset should fit in memory. A single instance is therefore limited by the maximum memory of your server. Now, you can also shard the data to several Redis instances, running on multiple servers. Provided you have the budget for it, it … Read more
It is possible without Hive: scan ‘filemetadata’, { COLUMNS => ‘colFam:colQualifier’, LIMIT => 10, FILTER => “ValueFilter( =, ‘binaryprefix:<someValue.e.g. test1 AsDefinedInQuestion>’ )” } Note: in order to find all rows that contain test1 as value as specified in the question, use binaryprefix:test1 in the filter (see this answer for more examples)
The strengths and weaknesses of the NoSQL databases (and also SQL databases) is highly dependent on your use case. For very large projects, performance is king; but for brand new projects, or projects where time and money are limited, simplicity and time-to-market are probably the most important. For teaching yourself (broadening your perspective, becoming a … Read more
I think there are some essential differences between CouchDB and Couchbase Server that need to be pointed out. I will not write about the advantages of switching from CouchDB to the Couchbase Server because those are described pretty much everywhere (see The Future of CouchDB by Damien Katz or Couchbase vs. Apache CouchDB by Couchbase). … Read more
Data Warehouses have very little in common with NoSQL – the main similarity is that any two data warehouses can have very different philosopohies or conventions just like any two NoSQL systems can be nearly unrelated. The only concept they share is that they are both used to analyze large amounts of data. NoSQL solutions … Read more
Try this. It’s kind of ugly, but it works for me. import org.apache.hadoop.hbase.filter.CompareFilter import org.apache.hadoop.hbase.filter.SingleColumnValueFilter import org.apache.hadoop.hbase.filter.SubstringComparator import org.apache.hadoop.hbase.util.Bytes scan ‘t1’, { COLUMNS => ‘family:qualifier’, FILTER => SingleColumnValueFilter.new (Bytes.toBytes(‘family’), Bytes.toBytes(‘qualifier’), CompareFilter::CompareOp.valueOf(‘EQUAL’), SubstringComparator.new(‘somevalue’)) } The HBase shell will include whatever you have in ~/.irbrc, so you can put something like this in there (I’m no Ruby … Read more
I only add this because in both of the previous answers I don’t see this (important) distinction made… Redis: Is a database server. You communicate with it via a custom binary protocol (via client library typically). LevelDB: Is a library that implements a key-value store. You communicate with it by calling the C++ API directly. … Read more