soutade/iwla
1
0
Fork 0
Code Issues Pull Requests Releases 2 Activity
408 Commits 2 Branches 7 Tags
e2210f3eab1d4b71be931a14fde91329ff23a129
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Gregory Soutade e2210f3eab Update geo ip misc plugin 2024-02-15 10:55:59 +01:00
Gregory Soutade 9db72f41fd Don't analyze referer for non viewed hits/pages 2024-02-15 10:55:38 +01:00
Gregory Soutade 0464a3d8e7 Generate HTML part in dry run mode (but don't write it to disk) 2024-02-15 10:55:04 +01:00
Gregory Soutade b9566beb80 Set lang value in generated HTML page 2024-02-15 10:54:52 +01:00
Gregory Soutade d78739157b Remove all trailing slashs of URL before starting analyze 2024-02-03 09:02:55 +01:00
Gregory Soutade d6d216db4d Improve page detection : check if . is present in last part 2024-01-30 11:27:03 +01:00
Gregory Soutade 974d355dd4 Add no_referrer_domains list to defaut_conf for website that defines this policy 2024-01-30 11:24:52 +01:00
Gregory Soutade f1ffbe40d8 --display-only switch now takes an argument (month/year), analyze is not yet necessary 2023-08-06 13:25:42 +02:00
Gregory Soutade 83275a8db4 Rework filtered_users output to have full location in a column 2023-08-06 13:25:42 +02:00
Gregory Soutade 07eb919837 Add excluded_domain_name to default_conf 2023-07-14 09:24:47 +02:00
Gregory Soutade 16cd817fec Increase not modified page threshold for robot detection 2023-07-05 09:15:48 +02:00
Gregory Soutade d32b2440ee Bugfix: flags management for feeds display 2023-06-14 09:21:51 +02:00
Gregory Soutade 9d3ff8b3b7 Add excluded domain option 2023-06-14 09:21:11 +02:00
Gregory Soutade 9c688e1545 Display visitor IP is now a filter 2023-05-21 11:06:16 +02:00
Gregory Soutade 7ef0911fa7 Main key for visits is now remote_ip and not remote_addr 2023-05-21 11:04:40 +02:00
Gregory Soutade 7507b8e77f WIP 2023-04-28 16:17:47 +02:00
Gregory Soutade de79f526dd Add IP type plugin 2023-04-18 20:34:45 +02:00
Gregory Soutade 4b58048198 Update browsers with msie and Opera 2023-04-18 20:33:09 +02:00
Gregory Soutade 71d8ee2113 Forgot Firefox icon 2023-03-25 08:11:57 +01:00
Gregory Soutade 440f51ddd1 Remove robot rule 1 page for phones 2023-03-23 21:17:52 +01:00
Gregory Soutade cad3467c25 Remove detection from awstats dataset for browser 2023-03-23 21:16:54 +01:00
Gregory Soutade 44c76007cd Remove .*bot.* and .*crawl.* from awstats_data 2023-03-11 20:56:18 +01:00
Gregory Soutade adc04bf753 Update iwla : 
* Rework arg variable management
  * Manage dry run at top level
  * 'robot' property is now None by default (allow to do analysis only once)
  * Add --disable-display option
 2023-03-11 20:51:44 +01:00
Gregory Soutade 6500d98bdd Do not manage dry run inside display part, but directly in iwla 2023-03-11 20:49:28 +01:00
Gregory Soutade a0a1f42df4 Update robot detection plugin : 
* Do analyze only one time by month
  * Reactivate rule : no page view if count_hit_only_visitors is False
  * Add exception for "Less than 1 hit per page" rule if a phone is used
  * Check for all error codes in 400..499, not only 403 and 404
  * Referer '-' now counted as null
 2023-03-11 20:48:17 +01:00
Gregory Soutade 31bc67ceba Replace feed referers by feed user agent 2023-03-11 20:42:56 +01:00
Gregory Soutade 3fdbc282c8 Remove feed parser detection by referer 2023-03-11 20:42:37 +01:00
Gregory Soutade 5f96c44edf Set count_hit_only_visitors to False by default 2023-03-11 20:40:31 +01:00
Gregory Soutade 58d31d842a Merge branch 'master' of soutade.fr:iwla 2023-02-18 08:51:15 +01:00
Gregory Soutade 16b0619f19 Fix error : total of not viewed bandwidth not displayed 2023-02-18 08:49:27 +01:00
Gregory Soutade c8dfdd17f7 Add "compatible" as a criteria for robot 2023-02-18 08:49:14 +01:00
Gregory Soutade a5bef4ece6 Search for "compatible" in all requests, not only the first one 2023-02-18 08:48:57 +01:00
Gregory Soutade b29765dda9 Update data with AWStats 7.9 2023-02-04 08:42:26 +01:00
Gregory Soutade cb18cf928e New way to display global statistics : with links in months names instead of "Details" button 
Fix Months name not translated in "By Day" corner
 2023-02-04 08:40:36 +01:00
Gregory Soutade 21a21cd68f Add a new rule for robots : 1 page and 1 hit, but not from the same source 2023-02-04 08:40:04 +01:00
Gregory Soutade c6ce5cfc6f Increment IWLA version 2023-01-28 09:45:13 +01:00
Gregory Soutade 185664850d Add subdomains plugin 2023-01-28 09:44:43 +01:00
Gregory Soutade fef9c783f6 Skip redirected pages/hit at analysis level 2023-01-28 09:42:12 +01:00
Gregory Soutade 6a4fd4e9c8 New rule for robot : more than 10 not modified pages in a row 2023-01-28 09:40:26 +01:00
Gregory Soutade ac246eabe2 Find robot name in 'compatible' string and group them 2023-01-28 09:38:59 +01:00
Gregory Soutade 9c57ad3ece Feeds : display last access date for merged feed parsers 2023-01-28 09:36:48 +01:00
Gregory Soutade 3a8c667fdc Feeds display: Add "*" after a space in order to have flags 2023-01-28 09:35:48 +01:00
Gregory Soutade 7e2991aa50 Update ChangeLog 2022-11-20 10:15:23 +01:00
Gregory Soutade 3117aebac0 Add all_visits_enlight display plugin 2022-11-20 10:15:13 +01:00
Gregory Soutade 82993afbce Show last access information for feeds parsers 2022-11-20 10:12:16 +01:00
Gregory Soutade ff57e5a90a Call pre analysis hook on display only mode 2022-11-16 21:12:19 +01:00
Gregory Soutade 975cc66bd5 Don't launch robot analysis rules for feed parsers 2022-11-16 21:10:11 +01:00
Gregory Soutade f8b37a625c Rework feed merge algorithm. Allow to merge feeds based on name regular expression with merge_feeds_parsers_list conf value 2022-11-16 21:09:50 +01:00
Gregory Soutade 242bb6cabe Fix error in None handling of unknown city/country in filtered users 2022-11-16 21:09:36 +01:00
Gregory Soutade cce8c75118 Display viewed and no viewed data for feeds (can be set as a robot too late) 2022-11-16 21:09:23 +01:00
Gregory Soutade ad01b48898 Change merge_one_hit_only_feeds_parsers by merge_feeds_parsers and set it to False by default 2022-11-12 19:00:14 +01:00
Gregory Soutade c9bc21a506 Check for multimedia files using lower case 2022-11-12 18:59:54 +01:00
Gregory Soutade 41432046a1 Add Anonymize IP plugin 2022-11-10 20:06:00 +01:00
Gregory Soutade b93c4bf470 Remove browser condition for filter users Geo IP 2022-11-10 20:04:56 +01:00
Gregory Soutade 2aad389e2b Fix message for all visits and top countries 2022-11-10 20:04:45 +01:00
Gregory Soutade b5361b6036 Add .html, .css and .js in default compressed files 2022-11-08 20:41:56 +01:00
Gregory Soutade 6ce0374fe7 Display external referers in filter_users plugin 2022-11-07 21:13:49 +01:00
Gregory Soutade c0fc5a0131 Add user agent in filter users display and limit filtered users to 10 in index 2022-11-04 20:04:08 +01:00
Gregory Soutade 7ec7e0d644 Add Geo IP location in filter users 2022-11-04 20:03:52 +01:00
Gregory Soutade c84373b2d7 Filter users filter can now be a function defined in conf 2022-11-04 20:03:33 +01:00
Gregory Soutade 0e7b6c9131 Add Geo IP web service function in misc 2022-11-04 18:30:28 +01:00
Gregory Soutade b92a017dba Update documentation 2022-06-23 21:21:18 +02:00
Gregory Soutade 4d3c2107f0 Don't save all visitors requests into database (save space and computing). Can be changed in deufalt_conf.py with keep_requests value 2022-06-23 21:16:30 +02:00
Gregory Soutade 99639b65a4 Add conf.py to .gitignore 2022-06-23 21:16:04 +02:00
Gregory Soutade 9cee1fa71c Move Filter Users plugin into pre_analysis (and keep display part) 2022-06-23 21:14:58 +02:00
Gregory Soutade d36676ca38 Normalize URL before counting in stats 2022-06-23 21:11:43 +02:00
Gregory Soutade 37a33f1291 Replace -c argument by config file. Now clean output is -C 2022-06-23 21:10:56 +02:00
Gregory Soutade b1f1158589 Update search engines 2022-06-23 21:09:15 +02:00
Gregory Soutade 4e7b2d34d1 Add favicon 2022-06-23 21:08:38 +02:00
Gregory Soutade f149baed70 Fix error: open log file in text mode to avoid doing str conversion and get some bytes result 2021-06-04 09:10:50 +02:00
Gregory Soutade 937706d88d Fix typo 2021-06-04 07:51:15 +02:00
Gregory Soutade 229e80a9a5 Update documentation 2021-06-03 09:00:45 +02:00
Gregory Soutade c29c07a69e Update default config 2021-06-03 08:58:47 +02:00
Gregory Soutade 0c2ac431d1 Be more strict with robots : requires at least 1 hit per viewed page 2021-06-03 08:52:04 +02:00
Gregory Soutade 4cd7712201 Fix feeds re and add 'feeds_referers' configuration 2021-06-03 08:50:46 +02:00
Gregory Soutade 2545ca5e52 Fix iwla crash due to bad line type 2021-06-03 08:49:43 +02:00
Gregory Soutade 0bae79ff74 Update awstats data (v7.8) 2021-06-03 08:48:48 +02:00
Gregory Soutade 8697be26ad Update feed detector : check 'feed', 'rss' or 'atom' string in user agent 2021-04-01 08:22:52 +02:00
Gregory Soutade 0602d3ce4b Fix little errors 2020-12-11 12:18:21 +01:00
Gregory Soutade 93e3ec9193 Add android icon 2020-07-04 09:38:49 +02:00
Gregory Soutade 32d09637c8 Bugfix: error in check for compress file creation 2020-05-01 09:57:24 +02:00
Gregory Soutade 363bd68281 Fix default conf.py 2020-05-01 09:55:42 +02:00
Gregory Soutade e71f1de7dc Update data from awstats (develop branch) 2020-04-09 12:10:07 +02:00
Gregory Soutade 7bc1375042 Update default conf 2020-04-09 09:36:32 +02:00
Gregory Soutade 55983df1bc Add IP exclusion feature 2020-04-09 09:33:59 +02:00
Gregory Soutade bb268114b2 Make backup before compressing (low memory servers) 
Fix error : Call post hook plugins even in display only mode
Don't compute unordered hits (remove pasts if they are found after current)
Remove tags in stats diff
Don't do geolocalisation is visitor is not valid
Don't try to find search engine on robots
Update robot check rules
Add top_pages_diff plugin
 2019-08-30 07:50:54 +02:00
Gregory Soutade ed6ed68706 Remove iwla_get.sh 2017-09-07 08:12:49 +02:00
Gregory Soutade 8ea1e6f0ff Remove Windows Search and vi-view from own search engines 2017-09-06 07:45:52 +02:00
Gregory Soutade 9345cf7984 AWStats data 7.6 has malformed hashes, fix it for converted data 2017-09-06 07:45:12 +02:00
Gregory Soutade f8a8cb26fb iwla_convert : Skip empty values or empty keys in hashes 2017-09-06 07:44:43 +02:00
Gregory Soutade 8255be7ec8 Get GEO code for all visits (not only valid ones) 2017-09-06 07:43:55 +02:00
Gregory Soutade dadd0c9029 Update awstats data with fixed iwla_convert.pl 2017-09-05 08:08:13 +02:00
Gregory Soutade 4466d9ac1d Fix iwla_convert.pl : skip empty key in hashs. Checks for empty lists 2017-09-05 08:07:23 +02:00
Gregory Soutade 9f9bfebe7a ip_to_geo : reset connection after 50 requests 2017-09-05 07:34:27 +02:00
Gregory Soutade b2f37d83f4 Sync data with awstats 7.6 2017-09-05 07:33:42 +02:00
Gregory Soutade 007be71ad6 New format for (not_)viewed pages/hits and bandwidth that are now recorded by day (in a dictionnary were only element 0 is initialized). Element 0 is the total. WARNING : not backward compatible with previous databases. 2017-08-24 07:55:53 +02:00
Gregory Soutade fffab335fa Handle URLs with empty referer 2017-08-23 20:11:17 +02:00
Gregory Soutade 3b3ae1ea3e Fix KeyError : geo attribute can not exists 2017-08-23 20:10:15 +02:00
Gregory Soutade 83227cfad2 Update documentation and ChangeLog 2017-05-25 21:09:02 +02:00
Gregory Soutade 68a67adecc Add one more rule to robot detection : more than ten 404 pages viewed 2017-05-25 21:04:18 +02:00