# /robots.txt for http://www.asctech.com. User-agent: * Disallow: # reference: http://www.robotstxt.org/wc/faq.html # using the asterisk means "all others" # leaving disalow empty means index all # some robots read this, some read the meta tags: # # that document won't be indexed. # # the links in that document will not be parsed by the robot