Home Articles FAQs XREF Games Software Instant Books BBS About FOLDOC RFCs Feedback Sitemap
irt.Org

BBS: robots.txt - September 14, 1998 at 16:16:23

You are here: irt.org | BBS | robots.txt [This BBS is closed]

Posted by Michael B on September 14, 1998 at 16:16:23:

I'd like certain files on a site to be excluded by search engines. I realise this involves a robots.txt file - can someone please teach me how to create one and where it should go?
Thanks,

Michael
Follow-ups:

You are here: irt.org | BBS | robots.txt [This BBS is closed]

©2018 Martin Webb