Forum

Weird, google using the search form on my site
 

(Weird, google using the search form on my site)

Well I could ask this on some general webmaster forum on another site, but I don't visit them and I visit this forum all the time so I'll ask here.

So I've got a website. Every single thing is made custom from scratch and likely doesn't resemble any standard site. The search function itself I know nobody is linking to any searches of items. My site only has 291 items to search and when people do search the site, usually it comes up empty and they never ever return.

Well today I see in my logs just a few hours ago...

66.249.71.107 - - [14/Feb/2009:05:58:26 +0000] "GET /search.listings.php?i=sitemap&s=Search HTTP/1.1" 200 2171 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.107 - - [14/Feb/2009:05:58:28 +0000] "GET /search.listings.php?i=passwords&s=Search HTTP/1.1" 200 2176 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.106 - - [14/Feb/2009:05:58:41 +0000] "GET /search.listings.php?i=seller&s=Search HTTP/1.1" 200 4326 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.106 - - [14/Feb/2009:05:58:54 +0000] "GET /search.listings.php?i=optionally&s=Search HTTP/1.1" 200 2176 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.108 - - [14/Feb/2009:06:00:40 +0000] "GET /search.listings.php?i=accepted&s=Search HTTP/1.1" 200 4265 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.107 - - [14/Feb/2009:06:00:56 +0000] "GET /search.listings.php?i=buyer&s=Search HTTP/1.1" 200 2174 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.108 - - [14/Feb/2009:06:41:51 +0000] "GET /search.listings.php?i=customizable&s=Search HTTP/1.1" 200 2179 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"


This is of course surprising. The bot is intelligent enough to gather random common words from my site, figure out my search system, and then search it using different words. The only bot I've ever heard that could do intelligent stuff on a site is XRummer, which is some AI bot that learns all forms, can read CAPTCHAs better than a human (though a lot of bots can). However,l XRummer is some spambot made for that kind of thing and I wouldn't expect a search engine spider to be able to learn that. But here is just a regular google search engine going and actually figuring out my site and using it like a human. Well almost like a human as some of the words it search for were silly, like "sitemap".

Anyone seen googlebot or other bots be able to do that on their site? It would explain how a lot of time random search results for eBay will appear in google results.

It's bots for sure, I get a lot of injection attempts, I"m not so sure about Google doing searches though, I haven't really noticed that.

I get all the injection attempt bots, but this was different. It wasn't injection and it was google's user agent and google's IPs.

Google is known to get every nook and cranny a website indexed, you didn't do any of these search results yourself and Google comes along and finds it?

Your site is coming along nicely by the way.