### ####################################################################### ### robots.txt for http://www.socwel.ku.edu ### ####################################################################### ### ####################################################################### ### Syntax notes: ### To tell a specific robot what not to look at, first type which robot you are ### contacting with the line "User-agent: *" where the * is the robot you would ### like to deal with. Star is a wild card in this case, and is used for all robots. ### Now you type in what you would like to disallow for the search engine. ### Simply type in "Disallow: *" where star is the part of the file or directory you would ### like to not be listed. ### ####################################################################### User-agent: * Disallow: /SSI/news Disallow: /chat ### ####################################################################### ### if you wanted only the KU robot to search all of the site, you would then place ### this bit of syntax. # "User-agen: Kubot" # "Disallow:" ### Note: Kubot may not be the actual name of the KU robot, I just made that up ### #######################################################################