# /robots.txt file for http://ljiii.com/ # Allows only major search engines and known friendly spiders # Major Search Engines and Known Friendly Spiders (allowed) User-agent: Googlebot Disallow: User-agent: MSNBot Disallow: User-agent: Slurp Disallow: User-agent: Teoma Disallow: User-agent: Gigabot Disallow: User-agent: Scrubby Disallow: User-agent: Robozilla Disallow: # Everyone Else (NOT allowed) User-agent: * Disallow: /aegis_old/ Disallow: /cgi-bin/ Disallow: /misc/ Disallow: /pics/ Disallow: /pictures/ Disallow: /resume/ Disallow: /scgi-bin/ Disallow: /scubalinks/ Disallow: /search/ Disallow: /scubalinksbyljiii/search/ Sitemap: http://www.ljiii.com/sitemap.gz