Commit Graph

139 Commits

Author SHA1 Message Date
Gregory Soutade 0464a3d8e7 Generate HTML part in dry run mode (but don't write it to disk) 2024-02-15 10:55:04 +01:00
Gregory Soutade d78739157b Remove all trailing slashs of URL before starting analyze 2024-02-03 09:02:55 +01:00
Gregory Soutade d6d216db4d Improve page detection : check if . is present in last part 2024-01-30 11:27:03 +01:00
Gregory Soutade f1ffbe40d8 --display-only switch now takes an argument (month/year), analyze is not yet necessary 2023-08-06 13:25:42 +02:00
Gregory Soutade 9d3ff8b3b7 Add excluded domain option 2023-06-14 09:21:11 +02:00
Gregory Soutade 7ef0911fa7 Main key for visits is now remote_ip and not remote_addr 2023-05-21 11:04:40 +02:00
Gregory Soutade adc04bf753 Update iwla :
* Rework arg variable management
  * Manage dry run at top level
  * 'robot' property is now None by default (allow to do analysis only once)
  * Add --disable-display option
2023-03-11 20:51:44 +01:00
Gregory Soutade 16b0619f19 Fix error : total of not viewed bandwidth not displayed 2023-02-18 08:49:27 +01:00
Gregory Soutade cb18cf928e New way to display global statistics : with links in months names instead of "Details" button
Fix Months name not translated in "By Day" corner
2023-02-04 08:40:36 +01:00
Gregory Soutade c6ce5cfc6f Increment IWLA version 2023-01-28 09:45:13 +01:00
Gregory Soutade fef9c783f6 Skip redirected pages/hit at analysis level 2023-01-28 09:42:12 +01:00
Gregory Soutade ff57e5a90a Call pre analysis hook on display only mode 2022-11-16 21:12:19 +01:00
Gregory Soutade c9bc21a506 Check for multimedia files using lower case 2022-11-12 18:59:54 +01:00
Gregory Soutade 4d3c2107f0 Don't save all visitors requests into database (save space and computing). Can be changed in deufalt_conf.py with keep_requests value 2022-06-23 21:16:30 +02:00
Gregory Soutade d36676ca38 Normalize URL before counting in stats 2022-06-23 21:11:43 +02:00
Gregory Soutade 37a33f1291 Replace -c argument by config file. Now clean output is -C 2022-06-23 21:10:56 +02:00
Gregory Soutade f149baed70 Fix error: open log file in text mode to avoid doing str conversion and get some bytes result 2021-06-04 09:10:50 +02:00
Gregory Soutade 2545ca5e52 Fix iwla crash due to bad line type 2021-06-03 08:49:43 +02:00
Grégory Soutadé a6f8c71bf2 Add parameter to do strToBytes in BlockTable and fix some errors with string and int 2020-12-11 09:18:50 +01:00
Grégory Soutadé c0e3e0a801 Update code for Python3 2020-12-09 13:24:29 +01:00
Grégory Soutadé f457f4e390 Update code for Python3 2020-10-30 14:42:56 +01:00
Gregory Soutade 32d09637c8 Bugfix: error in check for compress file creation 2020-05-01 09:57:24 +02:00
Grégory Soutadé 954b4972a9 Update ChangeLog and Documentation 2020-04-15 14:44:11 +02:00
Gregory Soutade 55983df1bc Add IP exclusion feature 2020-04-09 09:33:59 +02:00
Gregory Soutade bb268114b2 Make backup before compressing (low memory servers)
Fix error : Call post hook plugins even in display only mode
Don't compute unordered hits (remove pasts if they are found after current)
Remove tags in stats diff
Don't do geolocalisation is visitor is not valid
Don't try to find search engine on robots
Update robot check rules
Add top_pages_diff plugin
2019-08-30 07:50:54 +02:00
Gregory Soutade 007be71ad6 New format for (not_)viewed pages/hits and bandwidth that are now recorded by day (in a dictionnary were only element 0 is initialized). Element 0 is the total. WARNING : not backward compatible with previous databases. 2017-08-24 07:55:53 +02:00
Gregory Soutade fffab335fa Handle URLs with empty referer 2017-08-23 20:11:17 +02:00
Gregory Soutade 4bc2c1ad4b Add --dry-run (-D) argument 2017-05-25 21:03:46 +02:00
Gregory Soutade d08085faf0 Don't save all robots requests (only first pass is kept) which allow to save a large amount of memory/disk space 2017-05-07 16:56:12 +02:00
Gregory Soutade 3ce35b7b47 Use cPickle instead of pickle 2017-05-07 16:55:05 +02:00
Gregory Soutade ffdc3bac4f Update iwla version to 0.5-dev 2017-01-29 09:43:05 +01:00
Gregory Soutade de47da84bd Update IWLA version to 0.4 2017-01-29 09:25:18 +01:00
Gregory Soutade a07fd14a35 Database compression could lead to altered files. Use fsync before compressing to resolve this problem 2017-01-29 09:13:32 +01:00
Gregory Soutade b425edfa9a Add isRobot() method to iwla 2016-09-25 20:36:51 +02:00
Grégory Soutadé 935a18561b Previous patch needs >= to works properly, not juste > (for build time comparison) 2016-08-29 08:58:16 +02:00
Grégory Soutadé a76d8e8b69 Add display only switch (-p) 2016-08-20 13:12:25 +02:00
Grégory Soutadé be67d39fb2 Fix a bug : gz files were not generated due to bad time comparison 2016-08-20 13:09:44 +02:00
Grégory Soutadé 230d9bb3ab Update IWLA version to 0.4-dev 2016-04-13 17:50:23 +02:00
Gregory Soutade bb189425f1 Add filter mechanism for plugins 2016-02-04 20:46:12 +01:00
Gregory Soutade 79da471398 Fix typo error in getCurrentVisits() method name 2016-02-04 20:44:36 +01:00
Gregory Soutade 992c3cee93 Merge branch 'dev' of soutade.fr:iwla into dev 2016-01-18 07:34:13 +01:00
Gregory Soutade 519033e474 Do reverse DNS on feeds parsers 2016-01-18 07:33:48 +01:00
Gregory Soutade 283c2fbce3 Merge branch 'dev' of soutade.fr:iwla into dev 2016-01-16 08:45:00 +01:00
Gregory Soutade 3d927543f7 Syntax error 2016-01-16 08:44:57 +01:00
Gregory Soutade 5c750e8b0c Remove final slashes for referers 2016-01-16 08:43:29 +01:00
Gregory Soutade ec0a3a52a8 Fix _normalizeURI substitution. Fix _normalizeParameters. Fix -r argument 2016-01-03 09:28:19 +01:00
Gregory Soutade 73e4b0d8a6 Dont count 'uri' and 'uri/' as differents uri 2016-01-02 11:50:31 +01:00
Gregory Soutade 538012a107 Update version 2015-08-08 17:40:28 +02:00
Gregory Soutade ee74324085 Update help 2015-07-13 13:09:32 +02:00
Gregory Soutade 79b58f2e1c Add -z option (don't compress) 2015-05-23 16:38:39 +02:00