# /robots.txt file for http://webcrawler.com/ # ------------------------------------------- User-agent: * http://www.vide.eu/ Disallow: /html_elts Disallow: /SWFObject Disallow: /media Disallow: /im_presse Disallow: /esple Disallow: /site.swf Disallow: /textes Disallow: *.php