Initial commit: Mongo to JSON dumper

Repository contains just one simple script for the moment to dump the "tweets" collection of a Mongo database to a JSON file in a "pymongodump" directory that is created at the moment and place of execution. Faster than mongoexport, although the format of the resulting JSONs is somewhat different (adapted to Python's syntax).

Initial commit: Mongo to JSON dumper
d1923e7e · serpucga · d1923e7e · d1923e7e
Commit d1923e7e authored Jul 10, 2019 by serpucga
Hide whitespace changes
Inline Side-by-side

Showing with 24 additions and 0 deletions

pymongoexport.py pymongoexport.py +23 -0

requirements.txt requirements.txt +1 -0

No files found.
--- a/pymongoexport.py
+++ b/pymongoexport.py
+#!/usr/bin/env python
+
+import pymongo
+import os
+import argparse
+
+parser = argparse.ArgumentParser(
+    description="Dump the tweets of a database to a JSON file")
+parser.add_argument("-H", "--host", type=str, default="localhost")
+parser.add_argument("-p", "--port", type=int, default=27017)
+parser.add_argument("database", type=str)
+args = parser.parse_args()
+
+client = pymongo.MongoClient(args.host, args.port)
+database_tweets = client[args.database]["tweets"]
+
+output_dir = os.path.join(os.path.dirname(__file__), "pymongodump")
+if not os.path.exists(output_dir):
+    os.mkdir(output_dir)
+
+with open(os.path.join(output_dir, args.database + ".json"), "a+") as f:
+    for tweet in database_tweets.find():
+        f.write(str(tweet) + "\n")
--- a/requirements.txt
+++ b/requirements.txt
+pymongo==3.4.0