soutade/iwla
1
0
Fork 0
Code Issues Pull Requests Releases 2 Activity
304 Commits 2 Branches 7 Tags
954b4972a9980f957156d984dbc45fba6b0b9997
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Gregory Soutade e71f1de7dc Update data from awstats (develop branch) 2020-04-09 12:10:07 +02:00
Gregory Soutade 7bc1375042 Update default conf 2020-04-09 09:36:32 +02:00
Gregory Soutade 55983df1bc Add IP exclusion feature 2020-04-09 09:33:59 +02:00
Gregory Soutade bb268114b2 Make backup before compressing (low memory servers) 
Fix error : Call post hook plugins even in display only mode
Don't compute unordered hits (remove pasts if they are found after current)
Remove tags in stats diff
Don't do geolocalisation is visitor is not valid
Don't try to find search engine on robots
Update robot check rules
Add top_pages_diff plugin
 2019-08-30 07:50:54 +02:00
Gregory Soutade ed6ed68706 Remove iwla_get.sh 2017-09-07 08:12:49 +02:00
Gregory Soutade 8ea1e6f0ff Remove Windows Search and vi-view from own search engines 2017-09-06 07:45:52 +02:00
Gregory Soutade 9345cf7984 AWStats data 7.6 has malformed hashes, fix it for converted data 2017-09-06 07:45:12 +02:00
Gregory Soutade f8a8cb26fb iwla_convert : Skip empty values or empty keys in hashes 2017-09-06 07:44:43 +02:00
Gregory Soutade 8255be7ec8 Get GEO code for all visits (not only valid ones) 2017-09-06 07:43:55 +02:00
Gregory Soutade dadd0c9029 Update awstats data with fixed iwla_convert.pl 2017-09-05 08:08:13 +02:00
Gregory Soutade 4466d9ac1d Fix iwla_convert.pl : skip empty key in hashs. Checks for empty lists 2017-09-05 08:07:23 +02:00
Gregory Soutade 9f9bfebe7a ip_to_geo : reset connection after 50 requests 2017-09-05 07:34:27 +02:00
Gregory Soutade b2f37d83f4 Sync data with awstats 7.6 2017-09-05 07:33:42 +02:00
Gregory Soutade 007be71ad6 New format for (not_)viewed pages/hits and bandwidth that are now recorded by day (in a dictionnary were only element 0 is initialized). Element 0 is the total. WARNING : not backward compatible with previous databases. 2017-08-24 07:55:53 +02:00
Gregory Soutade fffab335fa Handle URLs with empty referer 2017-08-23 20:11:17 +02:00
Gregory Soutade 3b3ae1ea3e Fix KeyError : geo attribute can not exists 2017-08-23 20:10:15 +02:00
Gregory Soutade 83227cfad2 Update documentation and ChangeLog 2017-05-25 21:09:02 +02:00
Gregory Soutade 68a67adecc Add one more rule to robot detection : more than ten 404 pages viewed 2017-05-25 21:04:18 +02:00
Gregory Soutade 4bc2c1ad4b Add --dry-run (-D) argument 2017-05-25 21:03:46 +02:00
Gregory Soutade d08085faf0 Don't save all robots requests (only first pass is kept) which allow to save a large amount of memory/disk space 2017-05-07 16:56:12 +02:00
Gregory Soutade 3ce35b7b47 Use cPickle instead of pickle 2017-05-07 16:55:05 +02:00
Gregory Soutade 906fd5be11 Add -p switch documentation 2017-05-07 16:54:24 +02:00
Gregory Soutade ffdc3bac4f Update iwla version to 0.5-dev 2017-01-29 09:43:05 +01:00
Gregory Soutade b253caab0d Add -p switch to main.md 2017-01-29 09:42:47 +01:00
Gregory Soutade cc7bca7c86 Update default conf 2017-01-29 09:32:20 +01:00
Gregory Soutade de47da84bd Update IWLA version to 0.4 2017-01-29 09:25:18 +01:00
Gregory Soutade fd7359f02e Update own search engines 2017-01-29 09:24:03 +01:00
Gregory Soutade 0e66e1d384 Update documentation 2017-01-29 09:23:42 +01:00
Gregory Soutade 68b02d2732 Update awstats_data.py 2017-01-29 09:22:07 +01:00
Gregory Soutade d767fe22e3 Update Changelog 2017-01-29 09:19:18 +01:00
Gregory Soutade a07fd14a35 Database compression could lead to altered files. Use fsync before compressing to resolve this problem 2017-01-29 09:13:32 +01:00
Gregory Soutade 038e485081 Prevent from error when decoding key phrases 2017-01-29 09:12:47 +01:00
Gregory Soutade 4b5fee00e4 Update ChangeLog 2016-09-25 20:39:31 +02:00
Gregory Soutade dc4695f539 Add robot bandwidth display plugin 2016-09-25 20:38:49 +02:00
Gregory Soutade b425edfa9a Add isRobot() method to iwla 2016-09-25 20:36:51 +02:00
Gregory Soutade 16cf4471dc Merge branch 'dev' of soutade.fr:iwla into dev 2016-08-29 08:59:14 +02:00
Gregory Soutade 4759207f7c Merge branch 'dev' of soutade.fr:iwla into dev 2016-08-20 13:15:43 +02:00
Gregory Soutade b0652824bb Merge branch 'dev' of soutade.fr:iwla into dev 2016-05-02 07:59:50 +02:00
Gregory Soutade 10d087ad70 Merge branch 'dev' of soutade.fr:iwla into dev 
Conflicts:
	iwla.py
 2016-05-02 07:58:11 +02:00
Gregory Soutade 6505246ba4 Update ChangeLog 2016-05-02 07:56:40 +02:00
Gregory Soutade ce1bbb9823 Merge branch 'master' of soutade.fr:iwla into dev 2016-05-02 07:56:16 +02:00
Gregory Soutade fdda7a527e Bug fix : for robots, we have to use not_viewed_pages (feeds plugin) 2016-05-02 07:54:53 +02:00
Gregory Soutade 4e257c7154 Merge branch 'dev' of soutade.fr:iwla into dev 2016-04-13 17:57:18 +02:00
Gregory Soutade ddb4bae2e2 Update ChangeLog 2016-04-13 08:13:18 +02:00
Gregory Soutade 44f8b61582 Merge branch 'dev' of soutade.fr:iwla into dev 2016-04-12 09:41:39 +02:00
Gregory Soutade 9a593713d1 Add real names to icons/flags instead of generic ones 2016-04-12 09:35:03 +02:00
Gregory Soutade bc2556fbc1 Revert commit 19e9b9d4fb, multiple top visitors included 2016-04-12 09:23:07 +02:00
Gregory Soutade 2c07b57baf Update OS icons 2016-04-12 08:45:05 +02:00
Gregory Soutade c86961921c Update translations 2016-04-12 08:41:48 +02:00
Gregory Soutade e3b0f914bd Update documentation 2016-04-12 08:34:18 +02:00
Gregory Soutade 4baa0e6f5c Add alternative text for icons/flags 2016-04-12 08:17:34 +02:00
Gregory Soutade e9c2509006 Update iptogeo.py class 2016-04-12 07:56:10 +02:00
Gregory Soutade 9bb188b6fc Check for presence of country_code field to avoid key error exception 2016-02-07 10:17:32 +01:00
Gregory Soutade 19e9b9d4fb Forgot to append block in all_visits plugin 2016-02-07 10:16:33 +01:00
Gregory Soutade 4dbcef661f Update ChangeLog 2016-02-06 14:47:47 +01:00
Gregory Soutade b9759579ea Merge branch 'dev' of soutade.fr:iwla into dev 2016-02-06 14:45:21 +01:00
Gregory Soutade 12cc80208d Do merge 2016-02-06 14:45:09 +01:00
Gregory Soutade 7a655616ec Add IPToGeo plugin 2016-02-06 14:41:41 +01:00
Gregory Soutade bb189425f1 Add filter mechanism for plugins 2016-02-04 20:46:12 +01:00
Gregory Soutade 79da471398 Fix typo error in getCurrentVisits() method name 2016-02-04 20:44:36 +01:00
Gregory Soutade 992c3cee93 Merge branch 'dev' of soutade.fr:iwla into dev 2016-01-18 07:34:13 +01:00
Gregory Soutade 519033e474 Do reverse DNS on feeds parsers 2016-01-18 07:33:48 +01:00
Gregory Soutade 283c2fbce3 Merge branch 'dev' of soutade.fr:iwla into dev 2016-01-16 08:45:00 +01:00
Gregory Soutade 3d927543f7 Syntax error 2016-01-16 08:44:57 +01:00
Gregory Soutade 5c750e8b0c Remove final slashes for referers 2016-01-16 08:43:29 +01:00
Gregory Soutade ec0a3a52a8 Fix _normalizeURI substitution. Fix _normalizeParameters. Fix -r argument 2016-01-03 09:28:19 +01:00
Gregory Soutade 73e4b0d8a6 Dont count 'uri' and 'uri/' as differents uri 2016-01-02 11:50:31 +01:00
Gregory Soutade 0bc832f87c Add DuckDuckGo as search engine 2015-08-14 07:50:32 +02:00
Gregory Soutade 914232483f Add SVG as multimedia files 2015-08-14 07:49:53 +02:00
Gregory Soutade 538012a107 Update version 2015-08-08 17:40:28 +02:00
Gregory Soutade 2de395c3dd Fix version 2015-07-13 13:30:52 +02:00
Gregory Soutade ac954d73ea Merge branch 'dev' 2015-07-13 13:20:18 +02:00
Gregory Soutade ee74324085 Update help 2015-07-13 13:09:32 +02:00
Gregory Soutade 6605fc7e49 Update documentation 2015-07-13 13:07:39 +02:00
Gregory Soutade e8e3951018 Update documentation 2015-07-13 13:03:41 +02:00
Gregory Soutade 47cd9264c5 Update tools to sort documentation 2015-07-13 11:43:13 +02:00
Gregory Soutade b72563af8d WIP 2015-07-08 08:20:22 +02:00
Gregory Soutade 743e6d8cc1 Merge branch 'dev' of soutade.fr:iwla into dev 2015-07-08 08:12:31 +02:00
Gregory Soutade d4210de7f4 Add Google via SFR search engine 2015-07-06 08:08:09 +02:00
Gregory Soutade 2d46dfc513 Merge branch 'dev' of soutade.fr:iwla into dev 2015-06-12 17:56:53 +02:00
Gregory Soutade 4e71380293 Add own search engines file 2015-06-12 17:56:27 +02:00
Gregory Soutade 2733a15aa6 Merge branch 'dev' of soutade.fr:iwla into dev 2015-05-23 16:39:50 +02:00
Gregory Soutade 79b58f2e1c Add -z option (don't compress) 2015-05-23 16:38:39 +02:00
Gregory Soutade a9073cf49c Merge branch 'dev' of soutade.fr:iwla into dev 2015-05-23 08:57:35 +02:00
Gregory Soutade ce1cee986e Merge branch 'dev' of soutade.fr:iwla into dev 2015-05-22 08:16:15 +02:00
Gregory Soutade b74d4c868b Update awstats_data 2015-05-22 08:15:47 +02:00
Gregory Soutade 4cb3b21ca5 Add reset feature 
Allow to open .gz file transparently
Import debug in robots.py
 2015-05-22 07:51:11 +02:00
Gregory Soutade c7daad23c8 Merge branch 'dev' of soutade.fr:iwla into dev 2015-05-14 09:55:29 +02:00
Gregory Soutade 86fc5f2189 Add FileIter to iwla, allowing to specify multiple files to analyse 2015-05-14 09:54:25 +02:00
Gregory Soutade 62be78845a Add debug traces in robots plugin 2015-05-13 18:13:18 +02:00
Gregory Soutade 8e86e6946b Merge branch 'dev' of soutade.fr:iwla into dev 2015-04-08 14:06:18 +02:00
Gregory Soutade 389679cdb4 Conf.py 2015-04-08 14:06:03 +02:00
Gregory Soutade 157868dc3e Update istats_diff, the key used in hashtable can be changed (using uri() for example) 2015-04-08 14:04:59 +02:00
Gregory Soutade 651a7b9566 Add display/top_downloads_diff plugin 2015-04-06 17:55:11 +02:00
Gregory Soutade ee184f86b5 Add has_subclasses checks for iplugins (prevent for loading parent class) 2015-04-06 17:54:44 +02:00
Gregory Soutade df78a3f4cb [pre_analysis/robots] Don't checks for /robots.txt request, but endswith /robots.txt for robot detection 2015-04-06 17:52:31 +02:00
Gregory Soutade 2ed7551049 Add GET/POST checks before accepting request 2015-03-15 10:31:28 +01:00
Gregory Soutade ad3f3467f4 Update conf.py 2015-02-19 20:23:13 +01:00
Gregory Soutade b63421642c Fix a little mistake in previous commit 2015-02-19 20:19:42 +01:00
Gregory Soutade bca4b8661e We can now use _append suffix un conf.py to append a value to a default configuration instead of reapeating whole configuration 2015-02-19 20:15:03 +01:00