Update documentation and ChangeLog

2017-05-25 21:09:02 +02:00
parent 68a67adecc
commit 83227cfad2
2 changed files with 12 additions and 1 deletions
--- a/10
+++ b/10
@@ -1,3 +1,13 @@
+v0.5 (25/05/2017)
+** User **
+	Add --dry-run (-D) argument
+** Dev **
+	Use cPickle instead of pickle
+	Don't save all robots requests (only first pass is kept) which allow to save a large amount of memory/disk space
+	Add one more rule to robot detection : more than ten 404 pages viewed
+** Bugs **
+
+
 v0.4 (29/01/2017)
 ** User **
 	Remove crawlers from feed parsers