Robots.txt is often a file that exists on the basis directory of each Internet site and can be utilized to instruct serps on which directories/files of the website they can crawl and incorporate within their index. The usability of the web-site, which considers web page speed, mobile friendliness, together with https://news.rafeeg.ae