Koozali.org: home of the SME Server

Googlebot is not able to spider ibays?

Offline linuxhelp

  • *
  • 173
  • +0/-0
    • Linux PC & Server Support
Googlebot is not able to spider ibays?
« on: September 18, 2008, 05:55:03 PM »
Hallo @ ALL

after a lot of tries and nenew setups of my smeservers i have got feedback of google webmaster tools
that my domains are not spidered successful.

Example:
i use www.linuxonlinehelp.de as framed domain
behind is my linuxonlinehelp.dyndns.org server with my site,
the site is online perfectly, and www.linuxonlinehelp.de/sitemap.xml is fully readable via Browser
but google don't see it..??
what's wrong ?

but a verify to www.www.linuxonlinehelp.dyndns.org/sitemap.xml works and can be spidered

Thanks for help
Linux PC & Server Support
http://www.linuxonlinehelp.de
.. i Love SME..

Offline Reinhold

  • *
  • 517
  • +0/-0
    • http://127.0.0.1
Re: Googlebot is not able to spider ibays?
« Reply #1 on: September 19, 2008, 08:01:40 PM »
Thomas,

There is nothing that prevents the googlebot from entering ibays "per se" (afaik = works_for_me).

Your page isn't liked by the likes of: http://www.smart-it-consulting.com/internet/google/googlebot-spoofer/
Usually there are 2 places to look once a site browses ok :
- robots.txt seems ok & primed for the google webmaster tools ... http://www.sxw.org.uk/computing/robots/check.html
- .htaccess Have you modified .htaccess  ??? ...  http://de.selfhtml.org/servercgi/server/htaccess.htm

Problem in your case seems the "double redirection in a frame" <bad practice>(?)
Have a (german) look at:
http://de.selfhtml.org/navigation/suche/index.htm?Suchanfrage=forwarding
http://www.at-web.de/grundlagen/robots-txt.htm

BEST ...ask the Googlies why their spidering doesn't work... <g> I am quite confident it's not e-smith :-D
http://groups.google.com/group/Google_Webmaster_Help-de

Regards
Reinhold
............

Offline arne

  • *****
  • 1,116
  • +0/-4