Koozali.org: home of the SME Server

Obsolete Releases => SME Server 7.x => Topic started by: linuxhelp on September 18, 2008, 05:55:03 PM

Title: Googlebot is not able to spider ibays?
Post by: linuxhelp on September 18, 2008, 05:55:03 PM

Hallo @ ALL

after a lot of tries and nenew setups of my smeservers i have got feedback of google webmaster tools
that my domains are not spidered successful.

Example:
i use www.linuxonlinehelp.de as framed domain
behind is my linuxonlinehelp.dyndns.org server with my site,
the site is online perfectly, and www.linuxonlinehelp.de/sitemap.xml is fully readable via Browser
but google don't see it..??
what's wrong ?

but a verify to www.www.linuxonlinehelp.dyndns.org/sitemap.xml works and can be spidered

Thanks for help

Title: Re: Googlebot is not able to spider ibays?
Post by: Reinhold on September 19, 2008, 08:01:40 PM

Thomas,

There is nothing that prevents the googlebot from entering ibays "per se" (afaik = works_for_me).

Your page isn't liked by the likes of: http://www.smart-it-consulting.com/internet/google/googlebot-spoofer/
Usually there are 2 places to look once a site browses ok :
- robots.txt seems ok & primed for the google webmaster tools ... http://www.sxw.org.uk/computing/robots/check.html
- .htaccess Have you modified .htaccess  ??? ...  http://de.selfhtml.org/servercgi/server/htaccess.htm

Problem in your case seems the "double redirection in a frame" <bad practice>(?)
Have a (german) look at:
http://de.selfhtml.org/navigation/suche/index.htm?Suchanfrage=forwarding
http://www.at-web.de/grundlagen/robots-txt.htm

BEST ...ask the Googlies why their spidering doesn't work... <g> I am quite confident it's not e-smith :-D
http://groups.google.com/group/Google_Webmaster_Help-de

Regards
Reinhold

Title: Re: Googlebot is not able to spider ibays?
Post by: arne on September 19, 2008, 11:07:54 PM

http://www.google.com/support/webmasters/bin/answer.py?hl=en&answer=34445