v1.2

• Replacing a third party robots.txt parser with own robots.txt parser
• Replacing a one url in arguments for crawler with txt file
• Add threads to crawler
• Add responsive web design
• Add chart to website(/node/info)
• Add follow_location to http.cpp and crawler
• Add generating banner to website
• Code cleanup

v1.1

Recursive->Queue(BFS)
Add lru cache
Update config
Fix memory leaks
...