Results 1 to 3 of 3

Thread: Robots.txt [RESOLVED]

  1. May 25th, 2004, 06:00 PM #1
    Darkwraith
    Darkwraith is offline

    Thread Starter
    Fanatic Member
    Join Date
    Jan 2003
    Posts
    1,004

    Robots.txt [RESOLVED]

    Do you know of a site or tutorial that would allow me to create a Robots.txt file?
    Last edited by Darkwraith; May 26th, 2004 at 10:48 AM.
    "Can't" and "shouldn't" are two totally separate things.

    All questions should be answered. All answers should be true. That is why I post.
    Reply With Quote Reply With Quote
  2. May 26th, 2004, 12:22 AM #2
    mendhak
    mendhak is offline
    I'm about to be a PowerPoster! mendhak's Avatar
    Join Date
    Feb 2002
    Location
    Ulaan Baator GooGoo: Frog
    Posts
    38,170
    http://www.searchengineworld.com/rob...s_tutorial.htm

    http://www.robotstxt.org/wc/robots.html
    Reply With Quote Reply With Quote
  3. May 26th, 2004, 10:47 AM #3
    Darkwraith
    Darkwraith is offline

    Thread Starter
    Fanatic Member
    Join Date
    Jan 2003
    Posts
    1,004
    Thx for your help.

    I found this one from w3:

    http://www.w3.org/TR/REC-html40/appe...tes.html#h-B.4
    "Can't" and "shouldn't" are two totally separate things.

    All questions should be answered. All answers should be true. That is why I post.
    Reply With Quote Reply With Quote
« Previous Thread | Next Thread »

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

Forum Rules


Click Here to Expand Forum to Full Width