Koozali.org: home of the SME Server

Losing access to websites?

Offline kevinb

  • *
  • 237
  • +0/-0
Losing access to websites?
« on: September 18, 2010, 07:48:51 PM »
Over the last couple of days we are progressively lossing access to certain websites. The issue may have started with the lastest update.
 
When I access http://www.newegg.com the bowser times out with:
 
•Internet connectivity has been lost.
•The website is temporarily unavailable.
•The Domain Name Server (DNS) is not reachable.
•The Domain Name Server (DNS) does not have a listing for the website's domain.
•There might be a typing error in the address.
 
The list of unaccessible websites is growing with time.
 
If I connect to the network exteral to SME it works fine. The SME server is configured with a dedicated static IP and no specific DNS server was entered.
 
The issue is there whether or not squid is enabled.
 
 
Here are the logs:
 
code:
 
echo "" > /var/log/messages
sv d /service/squid
sleep 35
echo "" > /var/spool/squid/swap.state
sv u /service/squid
 
messages:
 
Sep 18 09:54:19 email squid[17311]: Preparing for shutdown after 52 requests
Sep 18 09:54:19 email squid[17311]: Waiting 30 seconds for active connections to finish
Sep 18 09:54:19 email squid[17311]: FD 12 Closing HTTP connection
Sep 18 09:54:19 email squid[17311]: FD 13 Closing HTTP connection
Sep 18 09:54:19 email squid[17311]: FD 14 Closing ICP connection
Sep 18 09:54:50 email squid[17311]: Shutting down...
Sep 18 09:54:50 email squid[17311]: FD 15 Closing ICP connection
Sep 18 09:54:50 email squid[17311]: WARNING: Closing client 192.168.1.4 connection due to lifetime timeout
Sep 18 09:54:50 email squid[17311]:     http://www.newegg.com/
Sep 18 09:54:50 email squid[17311]: WARNING: Closing client 192.168.1.4 connection due to lifetime timeout
Sep 18 09:54:50 email squid[17311]:     http://www.newegg.com/
Sep 18 09:54:50 email squid[17311]: Closing unlinkd pipe on FD 10
Sep 18 09:54:50 email squid[17311]: storeDirWriteCleanLogs: Starting...
Sep 18 09:54:50 email squid[17311]:   Finished.  Wrote 400 entries.
Sep 18 09:54:50 email squid[17311]:   Took 0.0 seconds (673400.7 entries/sec).
Sep 18 09:54:50 email squid[17311]: Squid Cache (Version 2.5.STABLE14): Exiting normally.
# echo "" > /var/spool/squid/swap.state
Sep 18 09:54:52 email squid[17893]: Starting Squid Cache version 2.5.STABLE14 for i686-redhat-linux-gnu...
Sep 18 09:54:52 email squid[17893]: Process ID 17893
Sep 18 09:54:52 email squid[17893]: With 1024 file descriptors available
Sep 18 09:54:52 email squid[17893]: DNS Socket created at 0.0.0.0, port 34425, FD 5
Sep 18 09:54:52 email squid[17893]: Adding nameserver 192.168.1.1 from /etc/resolv.conf
Sep 18 09:54:52 email squid[17893]: User-Agent logging is disabled.
Sep 18 09:54:52 email squid[17893]: Referer logging is disabled.
Sep 18 09:54:53 email squid[17893]: Unlinkd pipe opened on FD 10
Sep 18 09:54:53 email squid[17893]: Swap maxSize 102400 KB, estimated 34133 objects
Sep 18 09:54:53 email squid[17893]: Target number of buckets: 1706
Sep 18 09:54:53 email squid[17893]: Using 8192 Store buckets
Sep 18 09:54:53 email squid[17893]: Max Mem  size: 8192 KB
Sep 18 09:54:53 email squid[17893]: Max Swap size: 102400 KB
Sep 18 09:54:53 email squid[17893]: Rebuilding storage in /var/spool/squid (DIRTY)
Sep 18 09:54:53 email squid[17893]: Using Least Load store dir selection
Sep 18 09:54:53 email squid[17893]: Current Directory is /var/service/squid
Sep 18 09:54:53 email squid[17893]: Loaded Icons.
Sep 18 09:54:53 email squid[17893]: Accepting HTTP connections at 192.168.1.1, port 3128, FD 12.
Sep 18 09:54:53 email squid[17893]: Accepting HTTP connections at 127.0.0.1, port 3128, FD 13.
Sep 18 09:54:53 email squid[17893]: Accepting ICP messages at 192.168.1.1, port 3130, FD 14.
Sep 18 09:54:53 email squid[17893]: Outgoing ICP messages on port 3130, FD 15.
Sep 18 09:54:53 email squid[17893]: WCCP Disabled.
Sep 18 09:54:53 email squid[17893]: Ready to serve requests.
Sep 18 09:54:53 email squid[17893]: Done reading /var/spool/squid swaplog (0 entries)
Sep 18 09:54:53 email squid[17893]: Finished rebuilding storage from disk.
Sep 18 09:54:53 email squid[17893]:         0 Entries scanned
Sep 18 09:54:53 email squid[17893]:         0 Invalid entries.
Sep 18 09:54:53 email squid[17893]:         0 With invalid flags.
Sep 18 09:54:53 email squid[17893]:         0 Objects loaded.
Sep 18 09:54:53 email squid[17893]:         0 Objects expired.
Sep 18 09:54:53 email squid[17893]:         0 Objects cancelled.
Sep 18 09:54:53 email squid[17893]:         0 Duplicate URLs purged.
Sep 18 09:54:53 email squid[17893]:         0 Swapfile clashes avoided.
Sep 18 09:54:53 email squid[17893]:   Took 0.3 seconds (   0.0 objects/sec).
Sep 18 09:54:53 email squid[17893]: Beginning Validation Procedure
Sep 18 09:54:53 email squid[17893]:   Completed Validation Procedure
Sep 18 09:54:53 email squid[17893]:   Validated 0 Entries
Sep 18 09:54:53 email squid[17893]:   store_swap_size = 0k
Sep 18 09:54:54 email squid[17893]: storeLateRelease: released 0 objects
 

code:
 
echo "" > /var/log/messages
signal-event dns-update
nano messages
 
messages:
 
Sep 18 09:47:17 email esmith::event[17083]: Processing event: dns-update
Sep 18 09:47:17 email esmith::event[17083]: Running event handler: /etc/e-smith/events/dns-update/S00initialize-default-databases
Sep 18 09:47:17 email esmith::event[17083]: Migrating existing database networks
Sep 18 09:47:17 email esmith::event[17083]: Migrating existing database configuration
Sep 18 09:47:18 email esmith::event[17083]: Migrating existing database domains
Sep 18 09:47:18 email esmith::event[17083]: Migrating existing database yum_installed
Sep 18 09:47:18 email esmith::event[17083]: Migrating existing database yum_updates
Sep 18 09:47:18 email esmith::event[17083]: Migrating existing database yum_available
Sep 18 09:47:18 email esmith::event[17083]: Migrating existing database spamassassin
Sep 18 09:47:18 email esmith::event[17083]: Migrating existing database accounts
Sep 18 09:47:19 email esmith::event[17083]: Migrating existing database hosts
Sep 18 09:47:19 email esmith::event[17083]: Migrating existing database yum_repositories
Sep 18 09:47:19 email esmith::event[17083]: Migrating existing database wbl
Sep 18 09:47:19 email esmith::event[17083]: Migrating existing database backups
Sep 18 09:47:19 email esmith::event[17083]: Migrating existing database mailpatterns
Sep 18 09:47:19 email esmith::event[17083]: S00initialize-default-databases=action|Event|dns-update|Action|S00initialize-default-databases|Start|1284828437 652406|End|1284828439 310334|Elapsed|1.657928
Sep 18 09:47:19 email esmith::event[17083]: Running event handler: /etc/e-smith/events/actions/generic_template_expand
Sep 18 09:47:19 email esmith::event[17083]: expanding /var/service/dnscache/root/servers/@
Sep 18 09:47:19 email esmith::event[17083]: expanding /var/service/dnscache.forwarder/config
Sep 18 09:47:19 email esmith::event[17083]: expanding /var/service/dnscache.forwarder/root/servers/@
Sep 18 09:47:19 email esmith::event[17083]: generic_template_expand=action|Event|dns-update|Action|generic_template_expand|Start|1284828439 310744|End|1284828439 580833|Elapsed|0.270089
Sep 18 09:47:19 email esmith::event[17083]: Running event handler: /etc/e-smith/events/actions/adjust-services
Sep 18 09:47:19 email esmith::event[17083]: adjusting supervised dnscache (restart)
Sep 18 09:47:19 email esmith::event[17083]: adjusting supervised dnscache (up)
Sep 18 09:47:19 email esmith::event[17083]: adjusting supervised dnscache.forwarder (restart)
Sep 18 09:47:19 email esmith::event[17083]: adjusting supervised dnscache.forwarder (up)
Sep 18 09:47:19 email esmith::event[17083]: adjust-services=action|Event|dns-update|Action|adjust-services|Start|1284828439 581224|End|1284828439 731120|Elapsed|0.149896
 

code:
 
grep -Hirs newegg /var/log/*
 
response:
 
dnscache/current:@400000004c94df680927fc8c query 17 c0a80104:dca1:840f 1 www.newegg.com.
dnscache/current:@400000004c94df680928d74c tx 0 1 www.newegg.com. . 7f000002
dnscache/current:@400000004c94df690860ef84 query 18 c0a80104:dca1:840f 1 www.newegg.com.
dnscache/current:@400000004c94df6908617454 tx 0 1 www.newegg.com. . 7f000002
dnscache/current:@400000004c94df6926192a8c rr 7f000002 1800 1 www.newegg.com. d834d0b9
dnscache/current:@400000004c94df6927fce67c query 20 c0a80101:cfc7:6c49 1 www.newegg.com.
dnscache/current:@400000004c94df6927fd28e4 cached 1 www.newegg.com.
dnscache/current:@400000004c94df6935e22e8c rr 7f000002 1800 1 www.newegg.com. d834d0b9
dnscache.forwarder/current:@400000004c94df68092a90b4 query 8 7f000002:5e93:0e5f 1 www.newegg.com.
dnscache.forwarder/current:@400000004c94df68092e076c tx 0 1 www.newegg.com. com. c0210e1e c02bac1e c034b21e c02a5d1e c00c5e1e c036701e c029a21e c037531e c01f501e c01a5c1e c0304f1e c005061e c023331e
dnscache.forwarder/current:@400000004c94df680fffaa3c rr c0210e1e 172800 ns newegg.com. pdns1.ultradns.net.
dnscache.forwarder/current:@400000004c94df6810002b24 rr c0210e1e 172800 ns newegg.com. pdns2.ultradns.net.
dnscache.forwarder/current:@400000004c94df6810003eac rr c0210e1e 172800 ns newegg.com. pdns3.ultradns.org.
dnscache.forwarder/current:@400000004c94df6810005234 rr c0210e1e 172800 ns newegg.com. pdns4.ultradns.org.
dnscache.forwarder/current:@400000004c94df68100065bc rr c0210e1e 172800 ns newegg.com. pdns5.ultradns.info.
dnscache.forwarder/current:@400000004c94df6810007944 rr c0210e1e 172800 ns newegg.com. pdns6.ultradns.co.uk.
dnscache.forwarder/current:@400000004c94df6908630e7c query 9 7f000002:52a9:f911 1 www.newegg.com.
dnscache.forwarder/current:@400000004c94df6908636854 cached ns newegg.com. pdns1.ultradns.net.
dnscache.forwarder/current:@400000004c94df6908637bdc cached ns newegg.com. pdns2.ultradns.net.
dnscache.forwarder/current:@400000004c94df6908638f64 cached ns newegg.com. pdns3.ultradns.org.
dnscache.forwarder/current:@400000004c94df690863dd84 cached ns newegg.com. pdns4.ultradns.org.
dnscache.forwarder/current:@400000004c94df690863f10c cached ns newegg.com. pdns5.ultradns.info.
dnscache.forwarder/current:@400000004c94df6908640494 cached ns newegg.com. pdns6.ultradns.co.uk.
dnscache.forwarder/current:@400000004c94df691d8cc7fc tx 0 1 www.newegg.com. newegg.com. cc4a6c01 cc4a7301 cc4a7201 c7074401 c7074501 cc4a6d01
dnscache.forwarder/current:@400000004c94df6921ff1e0c rr cc4a6c01 30000 1 ns13b.newegg.com. d834d095
dnscache.forwarder/current:@400000004c94df6921ff839c rr cc4a6c01 30000 1 ns14b.newegg.com. cc0ed595
dnscache.forwarder/current:@400000004c94df6921ff9724 rr cc4a6c01 30000 ns www.newegg.com. ns14b.newegg.com.
dnscache.forwarder/current:@400000004c94df6921ffaaac rr cc4a6c01 30000 ns www.newegg.com. ns13b.newegg.com.
dnscache.forwarder/current:@400000004c94df692200086c cached 1 ns14b.newegg.com.
dnscache.forwarder/current:@400000004c94df69220052a4 cached 1 ns13b.newegg.com.
dnscache.forwarder/current:@400000004c94df6922006244 tx 0 1 www.newegg.com. www.newegg.com. d834d095 cc0ed595
dnscache.forwarder/current:@400000004c94df6926174a14 rr d834d095 1800 1 www.newegg.com. d834d0b9
dnscache.forwarder/current:@400000004c94df692995f924 tx 0 1 www.newegg.com. newegg.com. c7074501 c7074401 cc4a6c01 cc4a7201 cc4a7301 cc4a6d01
dnscache.forwarder/current:@400000004c94df692e31ad0c rr c7074501 30000 1 ns13b.newegg.com. d834d095
dnscache.forwarder/current:@400000004c94df692e322df4 rr c7074501 30000 1 ns14b.newegg.com. cc0ed595
dnscache.forwarder/current:@400000004c94df692e32494c rr c7074501 30000 ns www.newegg.com. ns14b.newegg.com.
dnscache.forwarder/current:@400000004c94df692e3258ec rr c7074501 30000 ns www.newegg.com. ns13b.newegg.com.
dnscache.forwarder/current:@400000004c94df692e32b6ac cached 1 ns14b.newegg.com.
dnscache.forwarder/current:@400000004c94df692e32ca34 cached 1 ns13b.newegg.com.
dnscache.forwarder/current:@400000004c94df692e332bdc tx 0 1 www.newegg.com. www.newegg.com. cc0ed595 d834d095
dnscache.forwarder/current:@400000004c94df6935e0bf5c rr cc0ed595 1800 1 www.newegg.com. d834d0b9

 
I opened a bug: http://bugs.contribs.org/show_bug.cgi?id=6205
 
If anyone can help it would appreciated.
 
Thanks,
 
Kevin

Offline CharlieBrady

  • *
  • 6,918
  • +3/-0
Re: Losing access to websites?
« Reply #1 on: September 18, 2010, 09:01:50 PM »
echo "" > /var/log/messages

That's a silly thing to do. You just lost the content of your messages logfile. Why did you do that?

Offline kevinb

  • *
  • 237
  • +0/-0
Re: Losing access to websites?
« Reply #2 on: September 18, 2010, 09:12:16 PM »
Yes .... what I did not show you was that I copied it first. I just wanted a "clean" log.

Offline cactus

  • *
  • 4,880
  • +3/-0
    • http://www.snetram.nl
Re: Losing access to websites?
« Reply #3 on: September 19, 2010, 10:35:38 AM »
Yes .... what I did not show you was that I copied it first. I just wanted a "clean" log.
There are easier ways to read the more recent part of a long file, for instance using tail.
Be careful whose advice you buy, but be patient with those who supply it. Advice is a form of nostalgia, dispensing it is a way of fishing the past from the disposal, wiping it off, painting over the ugly parts and recycling it for more than its worth ~ Baz Luhrmann - Everybody's Free (To Wear Sunscreen)

Offline kevinb

  • *
  • 237
  • +0/-0
Re: Losing access to websites?
« Reply #4 on: September 19, 2010, 03:53:11 PM »
Thanks for your advice guys.
 
Any ideas on what to do about the problem?
 
Kevin

Offline CharlieBrady

  • *
  • 6,918
  • +3/-0
Re: Losing access to websites?
« Reply #5 on: September 19, 2010, 03:55:18 PM »
Any ideas on what to do about the problem?

All followup to the bug tracker please. When you answer the questions which have been asked there, we will be closer to diagnosing the problem. The problem can't be fixed until it is diagnosed.

Offline CharlieBrady

  • *
  • 6,918
  • +3/-0
Re: Losing access to websites?
« Reply #6 on: September 19, 2010, 03:56:32 PM »
Yes .... what I did not show you was that I copied it first. I just wanted a "clean" log.

You will have lost any log messages which were created in the time between your copying of the log file and you emptying the log.