Google search still emphasizes 'metadata' over AI analysis



Many people think that search engines such as Google use artificial intelligence (AI) to display optimal search results, but in reality, various 'metadata' are emphasized rather than AI analysis. I will.

Software developer Cal Paterson explains why Google search uses metadata.

We were promised Strong AI, but instead we got metadata analysis
https://calpaterson.com/metadata.html

In the late 1990s, it was hoped that future search engines would be able to use AI to search and understand all web pages and display optimal search results. However, even at the time of article creation, Google does not analyze all pages using AI, but reflects the metadata provided by the website administrator in the algorithm.

Although Google constantly crawls the entire web to collect information, there are many websites that cannot be found if they rely solely on common crawls. That's why Paterson points out that Google knows which URLs to crawl by using a 'sitemap ', which is a list of pages created by website administrators.

Sitemaps for search engines are written in XML and contain information such as each page in the site, its relative importance, how often the page is updated, and the video files on the site. When Google crawls, it seems that it is carrying out more advanced crawls according to this site map.



In order for search engines to display the best search results, they need to understand what is on the web pages they find on crawls and prioritize their display. You might expect AI to be used to understand the content of a huge page, but again, it's actually using the metadata provided by the website.

Google also does in-page text analysis, but Google's advantage over other search engines isn't because of its superior natural language processing. Google is the algorithm used to determine the importance of a web page

page rank is, academic papers were inspired to the point to be evaluated based on the number of citations ' the link (back link) using the factor of order decision Is used.

Backlink is a term that means that the page is linked from another website, and the more backlinks you get, the more useful the site is. In addition, there is also an evaluation axis that 'the more important the link is from the site, the higher the value', reducing the adverse effect of earning links by self-performing. However, these algorithms also focus on the metadata of links to pages, not the content of the page itself.

Additional, Google is either for determining the which of the two duplicate page legitimate meta data and shows the product information for online shopping metadata , such as a variety of metadata the administrator of the website is to provide using.

Paterson personally argues that sites that tend to appear at the top of the search results screen aren't really good, and are often superficial by administrators who are good at setting metadata correctly. .. If you want to improve this problem, add 'reddit', 'site: reddit.com', etc. to the search word, and even state that you should see the posting on the bulletin board that is not aware of metadata.



The phenomenon that metadata gives better results than AI is not limited to search engines, and manually added metadata will outperform AI in many areas as it matures. Google tends to argue that AI plays many roles in delivering services, but Paterson argued that metadata is still important.

in Software,   Web Service, Posted by log1h_ik