ROBOT (1) 썸네일형 리스트형 Robots.txt Most web browsers use crawling to index web pages to easily find the pages and show them in the search result. robots.txt is a text file that defines the list of sites that can access or cannot access the page to prevent possible overload or malicious attacks (However, there are other ways to access the page even if the page is listed in tobots.txt such as when the page is linked to another page.. 이전 1 다음
