Friday, 28 November 2014 00:00


When we say "Robots" file we don't literally mean a robot. "Robots" is a term reserved for a file that resides in the root of your website and effectively tells search engines which files to look at. Or more accurately, which files NOT to look at.

For example, if you have a folder on your web called "Clients" and you do not want these pages to be indexed, or spidered, you can use the robots file effectively to hide these pages from prospective browsers.

The structure and content of this file is not discussed in any detail here as although it should be borne in mind it does not directly relate to optimising a page for a search engine's index.

More in this category: « Images Languages »

Leave a comment

Make sure you enter all the required information, indicated by an asterisk (*). HTML code is not allowed.

Our Most Popular Blog Articles

  • Default
  • Title
  • Date
  • Random
load more hold SHIFT key to load all load all

Turning Ideas Into Reality

We work with companies all over the world helping them realise their ideas and optimise ideas already working well for them.

Need Help With Your SEO ? We don't just monitor, we don't just make changes, we train you to manage your own SEO !

Contact us to find out how we can help you make more profit with less effort.


Contact Us

+44 (0)845 527 3596 (UK)
+34 602 155205 (ES)
This email address is being protected from spambots. You need JavaScript enabled to view it.

See how you too can achieve an increase in online revenue.

Review Us...

What Others Have To Say...

  • Michael managed with attention to detail and monitors the status of accounts like a hawk without losing sight of the
    Timothy Barreiro Coral Hotel Group
  • What No Website offers a great and valuable service which is absolutely perfect for any new start business or entrepreneur
    Christopher Pennington Capecan Group
  • That is amazing thank you soooooo so much. Honestly, this is going to change the way we work here.
    Suzanne Lovell Age UK
  • We had an excellent level of communication with What No Website who completed all the tasks in a timely manner…
    CTO Paradise Park Hotel
  • 1

Recent Blog Articles