Tag: Robots

What’s the difference between robots.txt and Meta Tags?

There are several types of Meta Tags, including Title, Description, Keywords. You place Meta Tags in the “head” section of your Web pages HTML to provide information that helps control robots and crawlers searching your website. The information in Meta Tags is not viewable by site visitors unless they view the page’s source. A robots.txt file tells search engine crawlers which pages or files the crawler can or can’t request from your site. This is used mainly to avoid overloading your site with requests; it is not a mechanism for keeping a web page out of Google. To keep a web page out of… Read More