Topic: Problems updating the Blacklist within SquidGuard

[ghorst352]

Hello  ,


I am currently running SME Server 7.5.1 and I am trying to update the Blacklist within SquidGuad something the previous network admin did not care to do.  I browse the SME gui to 'Security' - 'Content Filtering' - 'Blacklist Controls' and this is where you input a url for the blacklist control that you have decided to use.  As advised by Squidguards documentation, I decided on Shalla's list which is at location: http://www.shallalist.de/Downloads/shallalist.tar.gz.  After placing the url in the url location box and then clicking 'Submit data' I get the following message:




The blacklist setting is now a DB value - config show squidguard

The default squidguard blacklist is:
http://ftp.ost.eltele.no/pub/www/proxy/squidGuard/contrib/blacklists.tar.gz
which doesn't seem to be being updated.  There is another list that is being maintained,
here, http://squidguard.shalla.de/Downloads/shallalist.tar.gz, but you must adhere to their
Copyright terms if you want to use it in a commercial setting.
You can get more details here, squidguard.org




I verified there was no change with the additional categories or with the untrusted domain list and I also chose one domain out of the entire list to see if I was able to get to it and I was.  Once I verified that this did work I decided to research on the net of possible fixes and I don't find anything that's concrete in the way of a clear answer.  I personally use squidguard on my personal server at my house although it's on a Debian distro so there are many differences as I can see.  Squidguard does not take a rocket scientist to use so I am either missing some much needed command line or maybe this is a bug, not sure.  Anyways any help is much appreciated. 

[Stefano]

just a question: did you search the forums with "shalla" key?
and, for you, another one: did you take a look to the logs to check what's going wrong?

please, forget debian, here it's just a different world..

[ghorst352]

I did search Shalla but I did not see anything with relevancy in regards to my particular issue, but here again I have not searched the entire internet for an answer as I am currently at work.  The logs as far as squid and squidguard show absolutely nothing of value in realtionship to the time in which I click submit data.  In addition, squidguard does work it just cannot be updated for whatever reason. 

[ghorst352]

After further investigation here is where I am at.  By manually calling the command as follows:

 sudo echo "http://facebook.net 192.168.1.20/ - - GET" | squidGuard -d -c /etc/squid/squidguard.conf


1-11-29 13:11:04 [18160] squidGuard ready for requests (1322590264.700)
http://192.168.1.20/cgi-bin/blocked.cgi?clientaddr=192.168.1.20&clientname=&clientident=&clientgroup=default&targetclass=untrusted&url=http://facebook.net 192.168.1.20/- - -
2011-11-29 13:11:04 [18160] squidGuard stopped (1322590264.704)


This clearly works as you can see it blocks facebook.net but when I review my logs I have the following errors: (I don't understand how I can call it manually but not automatically????)

2011-11-29 13:08:56 [18098] init iplist /var/lib/squidguard/fullaccess
2011-11-29 13:08:56 [18098] sourceblock fullaccess_user missing active content, set inactive
2011-11-29 13:08:56 [18098] init iplist /var/lib/squidguard/noaccess
2011-11-29 13:08:56 [18098] sourceblock noaccess_user missing active content, set inactive
2011-11-29 13:08:56 [18098] init domainlist /var/lib/squidguard//trusted/domains
2011-11-29 13:08:56 [18098] loading dbfile /var/lib/squidguard//trusted/domains.db
2011-11-29 13:08:56 [18098] Error db_open: Permission denied
2011-11-29 13:08:56 [18098] going into emergency mode
2011-11-29 13:08:56 [18094] init iplist /var/lib/squidguard/fullaccess
2011-11-29 13:08:56 [18094] sourceblock fullaccess_user missing active content, set inactive
2011-11-29 13:08:56 [18094] init iplist /var/lib/squidguard/noaccess
2011-11-29 13:08:56 [18094] sourceblock noaccess_user missing active content, set inactive
2011-11-29 13:08:56 [18094] init domainlist /var/lib/squidguard//trusted/domains
2011-11-29 13:08:56 [18094] loading dbfile /var/lib/squidguard//trusted/domains.db
2011-11-29 13:08:56 [18094] Error db_open: Permission denied
2011-11-29 13:08:56 [18094] going into emergency mode
2011-11-29 13:08:56 [18097] init iplist /var/lib/squidguard/fullaccess
2011-11-29 13:08:56 [18097] sourceblock fullaccess_user missing active content, set inactive
2011-11-29 13:08:56 [18097] init iplist /var/lib/squidguard/noaccess
2011-11-29 13:08:56 [18097] sourceblock noaccess_user missing active content, set inactive
2011-11-29 13:08:56 [18097] init domainlist /var/lib/squidguard//trusted/domains
2011-11-29 13:08:56 [18097] loading dbfile /var/lib/squidguard//trusted/domains.db
2011-11-29 13:08:56 [18097] Error db_open: Permission denied
2011-11-29 13:08:56 [18097] going into emergency mode
2011-11-29 13:08:56 [18100] init iplist /var/lib/squidguard/fullaccess
2011-11-29 13:08:56 [18100] sourceblock fullaccess_user missing active content, set inactive
2011-11-29 13:08:56 [18100] init iplist /var/lib/squidguard/noaccess
2011-11-29 13:08:56 [18100] sourceblock noaccess_user missing active content, set inactive
2011-11-29 13:08:56 [18100] init domainlist /var/lib/squidguard//trusted/domains
2011-11-29 13:08:56 [18100] loading dbfile /var/lib/squidguard//trusted/domains.db
2011-11-29 13:08:56 [18100] Error db_open: Permission denied
2011-11-29 13:08:56 [18100] going into emergency mode
2011-11-29 13:08:56 [18099] init iplist /var/lib/squidguard/fullaccess
2011-11-29 13:08:56 [18099] sourceblock fullaccess_user missing active content, set inactive
2011-11-29 13:08:56 [18099] init iplist /var/lib/squidguard/noaccess

[Stefano]

please post the output of

Code: [Select]

ls -la /var/lib/squidguard/*

then try to search the forums with the error.. ok, read here

[ghorst352]

Here is the output

lrwxrwxrwx  1 squid squid   41 Nov 10  2008 /var/lib/squidguard/fullaccess -> /home/e-smith/files/squidguard/fullaccess
lrwxrwxrwx  1 squid squid   17 Nov 10  2008 /var/lib/squidguard/local -> /etc/squid/local/
lrwxrwxrwx  1 squid squid   39 Nov 10  2008 /var/lib/squidguard/noaccess -> /home/e-smith/files/squidguard/noaccess
lrwxrwxrwx  1 squid squid   38 Nov 10  2008 /var/lib/squidguard/trusted -> /home/e-smith/files/squidguard/trusted
lrwxrwxrwx  1 squid squid   40 Nov 10  2008 /var/lib/squidguard/untrusted -> /home/e-smith/files/squidguard/untrusted

/var/lib/squidguard/ads:
total 152
drwxrwx---   2 squid squid  4096 Nov 10  2008 .
drwxrwxrwx  17 root  root   4096 Nov 10  2008 ..
-rwxrwx---   1 squid squid 27148 May 31  2005 domains
-rwxrwx---   1 squid squid 77824 May 31  2005 domains.db
-rwxrwx---   1 squid squid    68 May 31  2005 expressions
-rwxrwx---   1 squid squid  7445 May 31  2005 urls
-rwxrwx---   1 squid squid 24576 May 31  2005 urls.db

/var/lib/squidguard/adult:
total 39420
drwxrwx---   2 squid squid     4096 Nov 10  2008 .
drwxrwxrwx  17 root  root      4096 Nov 10  2008 ..
-rwxrwx---   1 squid squid  9263101 May 31  2005 domains
-rwxrwx---   1 squid squid 23166976 Nov 29 12:39 domains.db
-rwxrwx---   1 squid squid      799 May 31  2005 expressions
-rwxrwx---   1 squid squid  3250614 May 31  2005 urls
-rwxrwx---   1 squid squid  4608000 Nov 29 12:40 urls.db

/var/lib/squidguard/aggressive:
total 52
drwxrwx---   2 squid squid  4096 Nov 10  2008 .
drwxrwxrwx  17 root  root   4096 Nov 10  2008 ..
-rwxrwx---   1 squid squid  5359 May 31  2005 domains
-rwxrwx---   1 squid squid 24576 Nov 29 12:40 domains.db
-rwxrwx---   1 squid squid     0 May 31  2005 expressions
-rwxrwx---   1 squid squid  1577 May 31  2005 urls
-rwxrwx---   1 squid squid  8192 Nov 29 12:40 urls.db

/var/lib/squidguard/audio-video:
total 60
drwxrwx---   2 squid squid  4096 Nov 10  2008 .
drwxrwxrwx  17 root  root   4096 Nov 10  2008 ..
-rwxrwx---   1 squid squid  4632 May 31  2005 domains
-rwxrwx---   1 squid squid 20480 May 31  2005 domains.db
-rwxrwx---   1 squid squid     0 May 31  2005 expressions
-rwxrwx---   1 squid squid  6042 May 31  2005 urls
-rwxrwx---   1 squid squid 16384 May 31  2005 urls.db

/var/lib/squidguard/drugs:
total 196
drwxrwx---   2 squid squid  4096 Nov 10  2008 .
drwxrwxrwx  17 root  root   4096 Nov 10  2008 ..
-rwxrwx---   1 squid squid  9577 May 31  2005 domains
-rwxrwx---   1 squid squid 36864 Nov 29 12:40 domains.db
-rwxrwx---   1 squid squid     0 May 31  2005 expressions
-rwxrwx---   1 squid squid 53026 May 31  2005 urls
-rwxrwx---   1 squid squid 81920 Nov 29 12:40 urls.db

/var/lib/squidguard/forums:
total 28
drwxrwx---   2 squid squid 4096 Nov 10  2008 .
drwxrwxrwx  17 root  root  4096 Nov 10  2008 ..
-rwxrwx---   1 squid squid  432 May 31  2005 domains
-rwxrwx---   1 squid squid 8192 May 31  2005 domains.db
-rwxrwx---   1 squid squid    0 May 31  2005 expressions
-rwxrwx---   1 squid squid    0 May 31  2005 urls
-rwxrwx---   1 squid squid 8192 May 31  2005 urls.db

/var/lib/squidguard/gambling:
total 32
drwxrwx---   2 squid squid 4096 Nov 10  2008 .
drwxrwxrwx  17 root  root  4096 Nov 10  2008 ..
-rwxrwx---   1 squid squid 1842 May 31  2005 domains
-rwxrwx---   1 squid squid 8192 Nov 29 12:40 domains.db
-rwxrwx---   1 squid squid    0 May 31  2005 expressions
-rwxrwx---   1 squid squid  675 May 31  2005 urls
-rwxrwx---   1 squid squid 8192 Nov 29 12:40 urls.db

/var/lib/squidguard/hacking:
total 48
drwxrwx---   2 squid squid  4096 Nov 10  2008 .
drwxrwxrwx  17 root  root   4096 Nov 10  2008 ..
-rwxrwx---   1 squid squid  5346 May 31  2005 domains
-rwxrwx---   1 squid squid 20480 Nov 29 12:40 domains.db
-rwxrwx---   1 squid squid     0 May 31  2005 expressions
-rwxrwx---   1 squid squid  1677 May 31  2005 urls
-rwxrwx---   1 squid squid  8192 Nov 29 12:40 urls.db

/var/lib/squidguard/mail:
total 48
drwxrwx---   2 squid squid  4096 Nov 10  2008 .
drwxrwxrwx  17 root  root   4096 Nov 10  2008 ..
-rwxrwx---   1 squid squid  6055 May 31  2005 domains
-rwxrwx---   1 squid squid 24576 May 31  2005 domains.db
-rwxrwx---   1 squid squid     0 May 31  2005 expressions
-rwxrwx---   1 squid squid     0 May 31  2005 urls
-rwxrwx---   1 squid squid  8192 May 31  2005 urls.db

/var/lib/squidguard/porn:
total 21736
drwxrwx---   2 squid squid     4096 Nov 28 12:58 .
drwxrwxrwx  17 root  root      4096 Nov 10  2008 ..
-rwxrwx---   1 squid squid  1215256 Nov 13  2008 domains
-rwxrwx---   1 squid squid  2859008 Nov 29 12:40 domains.db
-rwxrwx---   1 squid squid 12635582 Nov 11  2008 domainsnew
-rwxrwx---   1 squid squid  1215256 Nov 11  2008 domainsold
-rwxrwx---   1 squid squid      791 Jan 17  2002 expressions
-rwxrwx---   1 squid squid   644077 Nov 13  2008 urls
-rwxrwx---   1 squid squid   966656 Nov 29 11:12 urls.db
-rwxrwx---   1 squid squid  2008014 Nov 11  2008 urlsnew
-rwxrwx---   1 squid squid   644077 Nov 11  2008 urlsold

/var/lib/squidguard/proxy:
total 36
drwxrwx---   2 squid squid 4096 Nov 10  2008 .
drwxrwxrwx  17 root  root  4096 Nov 10  2008 ..
-rwxrwx---   1 squid squid 1902 May 31  2005 domains
-rwxrwx---   1 squid squid 8192 Nov 29 11:12 domains.db
-rwxrwx---   1 squid squid   55 May 31  2005 expressions
-rwxrwx---   1 squid squid  822 May 31  2005 urls
-rwxrwx---   1 squid squid 8192 Nov 29 11:12 urls.db

/var/lib/squidguard/scripts:
total 24
drwxrwx---   3 squid squid 4096 Nov 10  2008 .
drwxrwxrwx  17 root  root  4096 Nov 10  2008 ..
-rwxrwx---   1 squid squid   56 Jan 14  2007 blacklist_loc
drwxrwx---   2 squid squid 4096 Jan  6  2007 downloads
-rwxrwx---   1 squid squid   62 Jan 14  2007 squid-reset
-rwxrwx---   1 squid squid 1481 Aug 31  2007 supdate

/var/lib/squidguard/violence:
total 32
drwxrwx---   2 squid squid 4096 Nov 10  2008 .
drwxrwxrwx  17 root  root  4096 Nov 10  2008 ..
-rwxrwx---   1 squid squid  690 May 31  2005 domains
-rwxrwx---   1 squid squid 8192 Nov 29 11:12 domains.db
-rwxrwx---   1 squid squid    0 May 31  2005 expressions
-rwxrwx---   1 squid squid  500 May 31  2005 urls
-rwxrwx---   1 squid squid 8192 Nov 29 11:12 urls.db

/var/lib/squidguard/warez:
total 40
drwxrwx---   2 squid squid  4096 Nov 10  2008 .
drwxrwxrwx  17 root  root   4096 Nov 10  2008 ..
-rwxrwx---   1 squid squid  3379 May 31  2005 domains
-rwxrwx---   1 squid squid 16384 Nov 29 11:12 domains.db
-rwxrwx---   1 squid squid     0 May 31  2005 expressions
-rwxrwx---   1 squid squid  1533 May 31  2005 urls
-rwxrwx---   1 squid squid  8192 Nov 29 11:12 urls.db

/var/lib/squidguard/www:
total 36
drwxrwx---   2 squid squid 4096 Nov 28 13:10 .
drwxrwxrwx  17 root  root  4096 Nov 10  2008 ..
-rwxrwx---   1 squid squid  986 Jan 16  2007 blacklist.php
-rwxrwx---   1 squid squid 3492 Jan  6  2007 help.html
-rwxrwx---   1 squid squid 6855 Nov 28 13:10 index.php
-rwxrwx---   1 squid squid 1878 Jan 15  2007 squidguard.php
-rwxrwx---   1 squid squid 3354 Jan 15  2007 squid-ip.php
-rwxrwx---   1 squid squid  565 Jan  8  2007 viewlog.php

[Stefano]

it seems something is broken..

please, log in as root and

Code: [Select]

config setprop squidguard Blacklist http://squidguard.shalla.de/Downloads/shallalist.tar.gz
/var/lib/squidguard/scripts/supdate

you should verify which lists you are using with

Code: [Select]

config show squidguard

and eventually modify them accordingly to your needs

[ghorst352]

Stefano,


Thanks so much, as the /var/lib/squidguard/scripts/supdate script was want I was missing.  Once I used this script then everything pretty much fell into place.  My eyes were burning on this issue and your answer made my day.  I have been tinkering around all day on my network with the content filtering.  Thanks Again......