You can test Googlebot on "Google Webmaster Central"

For Google website administrator "Google Webmaster CentralAlthough it opened a new name, interesting thing is that it can test that "Googlebot" as a function for robots.txt. In addition to regular Googlebot, you can also test 'Adsbot-Google' which is a bot for reviewing the quality of AdWords pages.

That's why I actually tried using it.
This is the top page


First let's try using "Site Status Wizard".

First enter the domain


An overview of index registration etc. is displayed like this. You can take over to Google Sitemap as it is


And finally I decided to use the main subject, "webmaster's tool". I already use Google Sitemaps, so I will log in using that account.


It is google sitemap


The content of the operation tool is like this. Spam reporting and re-registration request are possible.


Click the name of each sitemap to go to the administration screen


There seems to be no crawl error


You can also analyze errors for mobile websites


Analysis of this robots.txt is quite interesting


You can now check if you are playing Googlebot other than the default. Even so, there are a lot of things ... "Googlebot-Mobile" indexing mobile sites, "Googlebot-Image" to crawl pages of image search index, "Mediapartners-Google" to crawl pages and check AdSense content, AdWords page "Adsbot-Google" to examine the quality of others.


In addition, because GIGAZINE played Google's review bot in. Htaccess in the past, it fell to the judgment. Dangerous, dangerous ....

This is management of site confirmation. It is a thing to show that it is the owner of the site.


It is quite interesting to see the results of search queries like this. You can see that there is a difference between what comes to the top of the search results and the actual click. I can grasp it on the right side with the access log, but it is very helpful to check on the left side is difficult to check. Especially for people who are doing SEO etc. It should be extremely useful.


Information on crawling


Page analysis


Information on the index


I also understand the collection situation of the site map