A tool to migrate an old news database from sqlite -> mongo
Nuntium was initially started as a news scraping project. Created and run mainly during 2019, the databse grew to over 150,000 articles from Canadian news outlets. As my idea for the project changed so to did nuntium.
- An sqlite database. A sample is provided.
- A mongodb server. Built around a docker container.
- Only tested on Arch Linux using Python 3.9
- Please let me know if you test it on anything else :).
git clone https://github.com/jessefogarty/nuntium.git && cd nuntium
pip install -r requirements.txt
Download sample database from Kaggle (TODO)
Please refer to code in test/nuntium_dev.py
likely to be added as issues to hold myself accountable
- Test entire DB migration
- Create sample dataset from raw_articles.db
- upload to kaggle; update readme with link
- Create archived backup of MongoDB container
- Setup.py? Meh.
Idk why you would want. But, in the event someone does please fell free to submit a PR with a few brief bullet poins explaining any changes.
The code is free. Do whatever you please and remember to give credit where credit is due.