New to the community? Start here

Robots.TXT file on Hosting

Hi,

Where can I find the Robots.txt file in the hosting / ftp file tree? It is recommended by SmartCrawl to add sitemap, but I can’t find it to add my sitemap.

Thanks

Mon, 1 Jul 2019 15:58:20
  • Ash
    • Code Norris

    Hello Chris

    There is no default robotx.txt file, you have to manually create it.

    Please login via FTP or SSH and go to the website root. And there create a file called robots.txt and then add your required code there :slight_smile:

    Hope it helps! Please feel free to ask more questions if you have any.

    Have a nice day!

    Cheers,

    Ash

  • Chris
    • Flash Drive

    Thanks, Ash. That was what I thought. The odd thing was that SmartCrawl returned a report that it was present and working and that I should add the sitemap. It was nowhere to be found. So after a little search and a quick chat with support, I created and uploaded one to the html directory.

    Chris