# # robots.txt for http://www.omsi.edu/ # # This file tells visiting robots where it can or cannot go # to collect information about our site. # If you have any area in the www public directories which you # do not want pinned to a widely available index, put it in a # Disallow rule below. Of course this file is a voluntary standard # the "good" robots use, so don't assume a rule here will keep # everybody out. # # Rob Vincent (rjv@omsi.edu) # September 1995 # updated: June 9, 1999 (Mark Chen) # updated: June 14, 2005 (Scott Weinrobe) # Anders added stuff to hopefully stop Google indexing obsolete pages, 3/3/2009 # Anders made to block everything 9/4/2009 User-agent: * Disallow: / # Disallow: /users/ # user folders # Disallow: /info/ # Disallow: /afterdark/ # Disallow: /visit/ # Disallow: /community/ # Disallow: /sciencestore/ # Disallow: /education/ # Disallow: /teachers/