Googlebot(Google Bot) is a Google Web crawling robot, a series of programs and processes for downloading and collecting new pages and updated pages one after another in Google's search index , Also known as a crawler because Googlebot gets (crawling) billions of pages on the Internet.
It is a professional software developer living in Vancouver, Canada, famous for VPN software "HamachiIt is also one of developersSwapped.ccWhat Alex Pankratov found.
According to Alex Pankratov 's blog, one day he seems to have found something like the following in the Apache log.
184.108.40.206 ... "GET / ajax / xr / ready? X = clcgvsgizgxhfzvf HTTP / 1.1" ...
Further analysis, we also found the following logs.
220.127.116.11 ... "GET /content/halloc/index.html?&x=clcgvsgizgxhfzvf ...
This is due to AJAX when you click on a menu item, what you mean is that Googlebot emulates the behavior the user actually clicks and crawls the site, That means that you can crawl pages as well.
This helps Googlebot teach the AJAX page that Google recommended so farEscaped_fragmentIt is no longer necessary to generate a URL for Googlebot using.
Although this update is modest, it means that the behavior of Googlebot is finally becoming a real person, a real user, and it will improve the freedom of future website creation.