User-agent: ArchitextSpider Disallow: User-agent: * Disallow: /data/ Disallow: /temp/ Disallow: /logfiles/ Disallow: /web/deleteship.cfm Disallow: /web/admin.cfm