Tuesday, September 23, 2008

Search Engine Spider Simulators

Check out these sites. They'll show you what your site looks like to a Search Engine spider, like Googlebot or Yahoo! Slurp. A spider is an automated program that "crawls" the web looking for sites to include in search engines (or other databases). They typically only look for text and links in a site, although different spiders can catalog different components of a site and have different algorithms for how they index the information they find. But this is a good way to get a general idea of what information a spider will see when it comes to your site.

Search Engine Spider Simulator - webconfs.com
Enter URL to Spider



Or this one:

Search Engine Spider Simulator - To The Web
Enter URL to Spider


No comments: