# Crawlers Setup User-agent: * # Block Paths (not clean URLs) Disallow: /*?q=* Disallow: /*pag=* Disallow: /*pagcount=* Disallow: /*pagsort=* Disallow: /*disp=*