Koozali.org: home of the SME Server

[Announce]: Dansguardian-stats - Statistics overview of web filter

Offline Knuddi

  • *
  • 540
  • +0/-0
    • http://www.scanmailx.com
I installed Dansguardian a while ago to protect my kids from unwanted content but even more from getting malware and virus though browsing. I realized that no proper statistics interface was existing (well I didn't find one) so I made my own variant. I have make a wiki for this on:

http://wiki.contribs.org/Dansguardian-stats

I have not had access to a lot of log files so if you see some unexpected stats then please let me know and please also provide the log file.

Enjoy,
Jesper
« Last Edit: April 24, 2009, 10:27:37 PM by Knuddi »

Offline Franco

  • *
  • 1,171
  • +0/-0
    • http://contribs.org
Re: [Announce]: Dansguardian-stats - Statsistics overview of web filter
« Reply #1 on: April 24, 2009, 03:46:26 AM »
Hi Knuddi,
I'm currently using Sarg http://wiki.contribs.org/Sarg to read and keep the historical view of all accesses. The logformat for sarg needs to be in squid format.
I wanted to try your tool anyway, but unfortunatelly I can't access the package, the page is timing out.

Thanks,

Offline Knuddi

  • *
  • 540
  • +0/-0
    • http://www.scanmailx.com
Re: [Announce]: Dansguardian-stats - Statsistics overview of web filter
« Reply #2 on: April 24, 2009, 06:55:00 AM »
The server was down this night due to power out, therefore the problem with access.

Sarg, as I understand it, "just" provides multiple summaries, I tried to also add some overview :-)

« Last Edit: April 24, 2009, 06:57:38 AM by Knuddi »

Offline Franco

  • *
  • 1,171
  • +0/-0
    • http://contribs.org
Re: [Announce]: Dansguardian-stats - Statistics overview of web filter
« Reply #3 on: April 25, 2009, 02:13:14 PM »
I'm getting an error:
Code: [Select]
JPgraph error
font /usr/local/unjunkmgr/msttcorefonts/arialbd.ttf not readeable or does not exist.

Does it require your other contrib?

Thanks,

Offline Knuddi

  • *
  • 540
  • +0/-0
    • http://www.scanmailx.com
Re: [Announce]: Dansguardian-stats - Statistics overview of web filter
« Reply #4 on: April 25, 2009, 06:41:01 PM »
My mistake - I had not tested enough on a clean box. :-( There should be no dependencies except from Dansguardian.

Upgrade to the new 1.0.2 version where I have fixed this - Wiki is also updated.

http://distro.ibiblio.org/pub/linux/distributions/smeserver/contribs/swerts-knudsen/SME7/Dansguardian-stats/smeserver-dansguardian-stats-1.0.2-1.noarch.rpm
« Last Edit: April 30, 2009, 08:00:02 AM by Knuddi »

Offline maykelsoft

  • *
  • 57
  • +0/-0
    • http://www.esi.com.ph
Re: [Announce]: Dansguardian-stats - Statistics overview of web filter
« Reply #5 on: April 28, 2009, 07:47:34 AM »
Hi,

I tried to install this contrib but graph is not showing. Did i miss something.

Version Installed: smeserver-dansguardian-stats-1.0.1-1.noarch.rpm

Anyhow, this is such a great contrib.

Thank you.

Offline Knuddi

  • *
  • 540
  • +0/-0
    • http://www.scanmailx.com
Re: [Announce]: Dansguardian-stats - Statistics overview of web filter
« Reply #6 on: April 28, 2009, 09:22:25 AM »
Do you mean it show an error or are all the numbers just zero (0)? The system requires you to you use logfileformat=4 in the Dansguardian configuration. This could be the reason.

You can see whether its working by manually running the statistic system:

Code: [Select]
/usr/local/dansguardian-stats/dansguardian-stats.pl -duration=hour
if you output looks like this and you have been browsing then you have a problem and the graphs will be zero

---Overall result ----------------
Start time    = Tue 28 Apr 2009, 08:15:56
End time      = Tue 28 Apr 2009, 09:15:59
Scanned URLs  = 0 (0 Bytes)
Infected      = 0 (0 Bytes)
URL mod       = 0
Content mod   = 0
Denied        = 0 (0 Bytes)

Also check the the dansguardian log to see whether its active and scanning:
Code: [Select]
tail -f /var/log/dansguardian/access.log

Offline Franco

  • *
  • 1,171
  • +0/-0
    • http://contribs.org
Re: [Announce]: Dansguardian-stats - Statistics overview of web filter
« Reply #7 on: April 28, 2009, 02:08:55 PM »
Knuddi,
Like maykelsoft stated, it's not working.
It just shows the two boxes in white.
My logformat is at 4:
Quote
cat /etc/dansguardian/dansguardian.conf | grep logfileformat
logfileformat = 4
logfileformat = 1
Thanks,

Offline Knuddi

  • *
  • 540
  • +0/-0
    • http://www.scanmailx.com
Re: [Announce]: Dansguardian-stats - Statistics overview of web filter
« Reply #8 on: April 28, 2009, 02:27:37 PM »
Why do you have 2 logfileformat statements in dansguardia.conf? I would imagine that the second entry takes precedence and forces logfileformat=1 rather that the desired "4"


Offline maykelsoft

  • *
  • 57
  • +0/-0
    • http://www.esi.com.ph
Re: [Announce]: Dansguardian-stats - Statistics overview of web filter
« Reply #9 on: April 29, 2009, 02:10:39 PM »
hi,

my logfileformat was set to 4.

but the graph is still 2 white blank page.

my dansguardian access.log is active...

cat /etc/dansguardian/dansguardian.conf | grep logfileformat
logfileformat = 4

Start time    = Wed 29 Apr 2009, 19:07:15
End time      = Wed 29 Apr 2009, 20:09:20
Scanned URLs  = 0 (0 Bytes)
Infected      = 0 (0 Bytes)
URL mod       = 0
Content mod   = 0
Denied        = 1368 (0 Bytes)

thanks

Offline Knuddi

  • *
  • 540
  • +0/-0
    • http://www.scanmailx.com
Re: [Announce]: Dansguardian-stats - Statistics overview of web filter
« Reply #10 on: April 29, 2009, 02:34:13 PM »
I can see that it thinks nothing is scanned (*SCANNED* tag not present in access.log) but some URLs are denied. if you could email me the log file then I can easier figure out what is wrong.

send to contribs@swerts-knudsen.dk

/Jesper

Offline maykelsoft

  • *
  • 57
  • +0/-0
    • http://www.esi.com.ph
Re: [Announce]: Dansguardian-stats - Statistics overview of web filter
« Reply #11 on: April 29, 2009, 02:56:37 PM »
hi jesper,

i already emailed the partial logs... as the original access logs are about 130mb.

thank you.

mike

Offline Franco

  • *
  • 1,171
  • +0/-0
    • http://contribs.org
Re: [Announce]: Dansguardian-stats - Statistics overview of web filter
« Reply #12 on: April 30, 2009, 02:35:54 AM »
Why do you have 2 logfileformat statements in dansguardia.conf? I would imagine that the second entry takes precedence and forces logfileformat=1 rather that the desired "4"
That's what I always had, I removed the last entry reloaded, but still nothing. Same white squares as maykelsoft states.

Offline Knuddi

  • *
  • 540
  • +0/-0
    • http://www.scanmailx.com
Re: [Announce]: Dansguardian-stats - Statistics overview of web filter
« Reply #13 on: April 30, 2009, 07:47:52 AM »
Its important that you restart dansguardian after you change the logfileformat to 4 - otherwise it has no effect. This fixed maykelsoft's problems.

Offline Knuddi

  • *
  • 540
  • +0/-0
    • http://www.scanmailx.com
Re: [Announce]: Dansguardian-stats - Statistics overview of web filter
« Reply #14 on: April 30, 2009, 08:48:59 PM »
Updated the contrib to 1.0.2 where I have changed pie charts to bars to give better overview and updated log parser to see some of the undocumented results from DG.

See wiki for download details:
http://wiki.contribs.org/Dansguardian-stats

Obviously I recommend all to upgrade...