User-Agent: *# Disallow all crawlers access to certain pages. Disallow: /*ref=* Disallow: /liste.asp* Allow: /