############################### # # sample robots.txt file for this website # # addresses all robots by using wild card * # User-agent: * # list folders robots are not allowed to index Disallow: /cgi-bin/ Disallow: /extras/ Disallow: /graphics/ Disallow: /images/ Disallow: /search/ Disallow: /Legal Info/ Disallow: /lyrics/ Disallow: /magpierss/ Disallow: /wap/ Disallow: /videos/ Disallow: /webcam/ V /Wimpy/ # # End of robots.txt file # ###############################