Wagging the Dog(Bark)
sniffing around the Internet

Google, in their effort to index the universe, is currently experimenting with breaking past forms to get deeper content.

There are a number of details in the blog post below, but here are the basics:

• Google is working with an experimental version of their normal bot.
• They avoid forms that have a password field (make sure your password fields are correctly indicated), or other obviously personal data (usernames, IDs)
• They will still adhere to robots.txt, nofollow and noindex
• However, the bot will try to auto-fill preference requests, searches, etc.

This entry was posted on Wednesday, April 16th, 2008 at 3:55 pm and is filed under Tech Tips. You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.