Commit Graph
100 Commits
Author SHA1 Message Date
Gregory Soutade 4466d9ac1d Fix iwla_convert.pl : skip empty key in hashs. Checks for empty lists 2017-09-05 08:07:23 +02:00
Gregory Soutade 9f9bfebe7a ip_to_geo : reset connection after 50 requests 2017-09-05 07:34:27 +02:00
Gregory Soutade b2f37d83f4 Sync data with awstats 7.6 2017-09-05 07:33:42 +02:00
Gregory Soutade 007be71ad6 New format for (not_)viewed pages/hits and bandwidth that are now recorded by day (in a dictionnary were only element 0 is initialized). Element 0 is the total. WARNING : not backward compatible with previous databases. 2017-08-24 07:55:53 +02:00
Gregory Soutade fffab335fa Handle URLs with empty referer 2017-08-23 20:11:17 +02:00
Gregory Soutade 3b3ae1ea3e Fix KeyError : geo attribute can not exists 2017-08-23 20:10:15 +02:00
Gregory Soutade 83227cfad2 Update documentation and ChangeLog 2017-05-25 21:09:02 +02:00
Gregory Soutade 68a67adecc Add one more rule to robot detection : more than ten 404 pages viewed 2017-05-25 21:04:18 +02:00
Gregory Soutade 4bc2c1ad4b Add --dry-run (-D) argument 2017-05-25 21:03:46 +02:00
Gregory Soutade d08085faf0 Don't save all robots requests (only first pass is kept) which allow to save a large amount of memory/disk space 2017-05-07 16:56:12 +02:00
Gregory Soutade 3ce35b7b47 Use cPickle instead of pickle 2017-05-07 16:55:05 +02:00
Gregory Soutade 906fd5be11 Add -p switch documentation 2017-05-07 16:54:24 +02:00
Gregory Soutade ffdc3bac4f Update iwla version to 0.5-dev 2017-01-29 09:43:05 +01:00
Gregory Soutade b253caab0d Add -p switch to main.md 2017-01-29 09:42:47 +01:00
Gregory Soutade cc7bca7c86 Update default conf 2017-01-29 09:32:20 +01:00
Gregory Soutade de47da84bd Update IWLA version to 0.4 2017-01-29 09:25:18 +01:00
Gregory Soutade fd7359f02e Update own search engines 2017-01-29 09:24:03 +01:00
Gregory Soutade 0e66e1d384 Update documentation 2017-01-29 09:23:42 +01:00
Gregory Soutade 68b02d2732 Update awstats_data.py 2017-01-29 09:22:07 +01:00
Gregory Soutade d767fe22e3 Update Changelog 2017-01-29 09:19:18 +01:00
Gregory Soutade a07fd14a35 Database compression could lead to altered files. Use fsync before compressing to resolve this problem 2017-01-29 09:13:32 +01:00
Gregory Soutade 038e485081 Prevent from error when decoding key phrases 2017-01-29 09:12:47 +01:00
Gregory Soutade 4b5fee00e4 Update ChangeLog 2016-09-25 20:39:31 +02:00
Gregory Soutade dc4695f539 Add robot bandwidth display plugin 2016-09-25 20:38:49 +02:00
Gregory Soutade b425edfa9a Add isRobot() method to iwla 2016-09-25 20:36:51 +02:00
Gregory Soutade 16cf4471dc Merge branch 'dev' of soutade.fr:iwla into dev 2016-08-29 08:59:14 +02:00
Gregory Soutade 4759207f7c Merge branch 'dev' of soutade.fr:iwla into dev 2016-08-20 13:15:43 +02:00
Gregory Soutade b0652824bb Merge branch 'dev' of soutade.fr:iwla into dev 2016-05-02 07:59:50 +02:00
Gregory Soutade 10d087ad70 Merge branch 'dev' of soutade.fr:iwla into dev
Conflicts:
	iwla.py
2016-05-02 07:58:11 +02:00
Gregory Soutade 6505246ba4 Update ChangeLog 2016-05-02 07:56:40 +02:00
Gregory Soutade ce1bbb9823 Merge branch 'master' of soutade.fr:iwla into dev 2016-05-02 07:56:16 +02:00
Gregory Soutade fdda7a527e Bug fix : for robots, we have to use not_viewed_pages (feeds plugin) 2016-05-02 07:54:53 +02:00
Gregory Soutade 4e257c7154 Merge branch 'dev' of soutade.fr:iwla into dev 2016-04-13 17:57:18 +02:00
Gregory Soutade ddb4bae2e2 Update ChangeLog 2016-04-13 08:13:18 +02:00
Gregory Soutade 44f8b61582 Merge branch 'dev' of soutade.fr:iwla into dev 2016-04-12 09:41:39 +02:00
Gregory Soutade 9a593713d1 Add real names to icons/flags instead of generic ones 2016-04-12 09:35:03 +02:00
Gregory Soutade bc2556fbc1 Revert commit 19e9b9d4fb, multiple top visitors included 2016-04-12 09:23:07 +02:00
Gregory Soutade 2c07b57baf Update OS icons 2016-04-12 08:45:05 +02:00
Gregory Soutade c86961921c Update translations 2016-04-12 08:41:48 +02:00
Gregory Soutade e3b0f914bd Update documentation 2016-04-12 08:34:18 +02:00
Gregory Soutade 4baa0e6f5c Add alternative text for icons/flags 2016-04-12 08:17:34 +02:00
Gregory Soutade e9c2509006 Update iptogeo.py class 2016-04-12 07:56:10 +02:00
Gregory Soutade 9bb188b6fc Check for presence of country_code field to avoid key error exception 2016-02-07 10:17:32 +01:00
Gregory Soutade 19e9b9d4fb Forgot to append block in all_visits plugin 2016-02-07 10:16:33 +01:00
Gregory Soutade 4dbcef661f Update ChangeLog 2016-02-06 14:47:47 +01:00
Gregory Soutade b9759579ea Merge branch 'dev' of soutade.fr:iwla into dev 2016-02-06 14:45:21 +01:00
Gregory Soutade 12cc80208d Do merge 2016-02-06 14:45:09 +01:00
Gregory Soutade 7a655616ec Add IPToGeo plugin 2016-02-06 14:41:41 +01:00
Gregory Soutade bb189425f1 Add filter mechanism for plugins 2016-02-04 20:46:12 +01:00
Gregory Soutade 79da471398 Fix typo error in getCurrentVisits() method name 2016-02-04 20:44:36 +01:00
Gregory Soutade 992c3cee93 Merge branch 'dev' of soutade.fr:iwla into dev 2016-01-18 07:34:13 +01:00
Gregory Soutade 519033e474 Do reverse DNS on feeds parsers 2016-01-18 07:33:48 +01:00
Gregory Soutade 283c2fbce3 Merge branch 'dev' of soutade.fr:iwla into dev 2016-01-16 08:45:00 +01:00
Gregory Soutade 3d927543f7 Syntax error 2016-01-16 08:44:57 +01:00
Gregory Soutade 5c750e8b0c Remove final slashes for referers 2016-01-16 08:43:29 +01:00
Gregory Soutade ec0a3a52a8 Fix _normalizeURI substitution. Fix _normalizeParameters. Fix -r argument 2016-01-03 09:28:19 +01:00
Gregory Soutade 73e4b0d8a6 Dont count 'uri' and 'uri/' as differents uri 2016-01-02 11:50:31 +01:00
Gregory Soutade 0bc832f87c Add DuckDuckGo as search engine 2015-08-14 07:50:32 +02:00
Gregory Soutade 914232483f Add SVG as multimedia files 2015-08-14 07:49:53 +02:00
Gregory Soutade 538012a107 Update version 2015-08-08 17:40:28 +02:00
Gregory Soutade 2de395c3dd Fix version 2015-07-13 13:30:52 +02:00
Gregory Soutade ac954d73ea Merge branch 'dev' 2015-07-13 13:20:18 +02:00
Gregory Soutade ee74324085 Update help 2015-07-13 13:09:32 +02:00
Gregory Soutade 6605fc7e49 Update documentation 2015-07-13 13:07:39 +02:00
Gregory Soutade e8e3951018 Update documentation 2015-07-13 13:03:41 +02:00
Gregory Soutade 47cd9264c5 Update tools to sort documentation 2015-07-13 11:43:13 +02:00
Gregory Soutade b72563af8d WIP 2015-07-08 08:20:22 +02:00
Gregory Soutade 743e6d8cc1 Merge branch 'dev' of soutade.fr:iwla into dev 2015-07-08 08:12:31 +02:00
Gregory Soutade d4210de7f4 Add Google via SFR search engine 2015-07-06 08:08:09 +02:00
Gregory Soutade 2d46dfc513 Merge branch 'dev' of soutade.fr:iwla into dev 2015-06-12 17:56:53 +02:00
Gregory Soutade 4e71380293 Add own search engines file 2015-06-12 17:56:27 +02:00
Gregory Soutade 2733a15aa6 Merge branch 'dev' of soutade.fr:iwla into dev 2015-05-23 16:39:50 +02:00
Gregory Soutade 79b58f2e1c Add -z option (don't compress) 2015-05-23 16:38:39 +02:00
Gregory Soutade a9073cf49c Merge branch 'dev' of soutade.fr:iwla into dev 2015-05-23 08:57:35 +02:00
Gregory Soutade ce1cee986e Merge branch 'dev' of soutade.fr:iwla into dev 2015-05-22 08:16:15 +02:00
Gregory Soutade b74d4c868b Update awstats_data 2015-05-22 08:15:47 +02:00
Gregory Soutade 4cb3b21ca5 Add reset feature
Allow to open .gz file transparently
Import debug in robots.py
2015-05-22 07:51:11 +02:00
Gregory Soutade c7daad23c8 Merge branch 'dev' of soutade.fr:iwla into dev 2015-05-14 09:55:29 +02:00
Gregory Soutade 86fc5f2189 Add FileIter to iwla, allowing to specify multiple files to analyse 2015-05-14 09:54:25 +02:00
Gregory Soutade 62be78845a Add debug traces in robots plugin 2015-05-13 18:13:18 +02:00
Gregory Soutade 8e86e6946b Merge branch 'dev' of soutade.fr:iwla into dev 2015-04-08 14:06:18 +02:00
Gregory Soutade 389679cdb4 Conf.py 2015-04-08 14:06:03 +02:00
Gregory Soutade 157868dc3e Update istats_diff, the key used in hashtable can be changed (using uri() for example) 2015-04-08 14:04:59 +02:00
Gregory Soutade 651a7b9566 Add display/top_downloads_diff plugin 2015-04-06 17:55:11 +02:00
Gregory Soutade ee184f86b5 Add has_subclasses checks for iplugins (prevent for loading parent class) 2015-04-06 17:54:44 +02:00
Gregory Soutade df78a3f4cb [pre_analysis/robots] Don't checks for /robots.txt request, but endswith /robots.txt for robot detection 2015-04-06 17:52:31 +02:00
Gregory Soutade 2ed7551049 Add GET/POST checks before accepting request 2015-03-15 10:31:28 +01:00
Gregory Soutade ad3f3467f4 Update conf.py 2015-02-19 20:23:13 +01:00
Gregory Soutade b63421642c Fix a little mistake in previous commit 2015-02-19 20:19:42 +01:00
Gregory Soutade bca4b8661e We can now use _append suffix un conf.py to append a value to a default configuration instead of reapeating whole configuration 2015-02-19 20:15:03 +01:00
Gregory Soutade f5b0c35bad Add a star for merged feeds parsers 2015-02-18 20:56:03 +01:00
Gregory Soutade cfbd35d818 Merge one hit only parsers in feeds parsers detection 2015-02-18 20:32:04 +01:00
Gregory Soutade e0f9260802 Add Feeds plugin 2015-02-17 19:11:04 +01:00
Gregory Soutade bcdb68b0d4 Bad indentation in browsers display plugin 2015-02-08 10:07:50 +01:00
Gregory Soutade f3fbf8b727 Add pages and hits to track_users 2015-02-07 15:28:24 +01:00
Gregory Soutade e67723e58e Fix some bugs in track_users 2015-01-14 20:19:19 +01:00
Gregory Soutade 49d21cf4b4 Update .gitignore 2015-01-13 18:57:51 +01:00
Gregory Soutade 511ca49397 Add track users plugin 2015-01-13 18:57:26 +01:00
Gregory Soutade 616b0d8052 Add computeRatio method to display. Enable it in browsers display plugin 2015-01-13 18:55:46 +01:00
Gregory Soutade 1d9bf71b4b Set arguments of page_to_hit facultative 2015-01-13 18:54:57 +01:00