Updates: 2016-07-04 Since the last update MongoDB Spark Connector matured quite a lot. It provides up-to-date binaries and data source based API but it is using SparkConf configuration so it is subjectively less flexible than the Stratio/Spark-MongoDB. 2016-03-30 Since the original answer I found two different ways to connect to MongoDB from Spark: mongodb/mongo-spark Stratio/Spark-MongoDB … Read more
Sample code in Pymongo with comment as explanation: from pymongo import MongoClient connection = MongoClient(‘localhost’, 27017) #Connect to mongodb print(connection.database_names()) #Return a list of db, equal to: > show dbs db = connection[‘testdb1’] #equal to: > use testdb1 print(db.list_collection_names()) #Return a list of collections in ‘testdb1’ print(“posts” in db.list_collection_names()) #Check if collection “posts” # exists … Read more
Comprehend the cursor you got from the MongoDB before passing it to DataFrame import pandas as pd df = pd.DataFrame(list(tweets.find()))
This is an old question but stumbling across it, I don’t think the accepted answer answers the question. The question wasn’t “What is MongoEngine?” – it was “Why should I use MongoEngine?” And the advantages of such an approach. This goes beyond Django to Python/Mongo in general. My two cents: While both PyMongo and MongoEngine … Read more
The behavior you describe is a bug. The best possible course of action is to make sure there is a bug logged for it and link to it from your question. Since the question is almost a year old, I am expecting the bug to be closed (check jira.mongodb.org/browse/SERVER-4405 to see if it applies). If … Read more
To exclude the _id field in a find query in pymongo, you can use: db.collection.find({}, {‘_id’: False}) The documentation is somewhat missleading on this as it says the _id field is always included. But you can exclude it like shown above.
Use the create_index method where you pass in the keys as an array and TEXT as the index direction : collection.create_index([(‘field_i_want_to_index’, pymongo.TEXT)], name=”search_index”, default_language=”english”)
Note: This answer is outdated. More recent versions of MongoDB can use the far more efficient method db.collection.countDocuments. See the answer by Xavier Guihot for a better solution. find doesn’t return a boolean value, it returns a cursor. To check if that cursor contains any documents, use the cursor’s count method: if db.mycollection.find({‘UserIDS’: { “$in”: … Read more
All you need is to actually install pymongo (currently you just have mongo and python, but they do not know how to speak with each other). This page is telling you exactly what to do: go to pymongo page download and run installer.
PyMongo 2.4 up to at least 3.11.4 from pymongo import MongoClient client = MongoClient(‘<HOST>’, <PORT>) client.drop_database(‘<DBNAME>’) PyMongo Stable documentation PyMongo 3.2.1 documentation PyMongo 2.3 and earlier from pymongo import Connection connection = Connection(‘<HOST>’, <PORT>) connection.drop_database(‘<DBNAME>’) PyMongo 2.3 documentation PyMongo 1.0 documentation