# All robots will spider the domain User-agent: * Disallow: SemaToolz.html User-agent: turnitinbot Disallow: / User-agent: psbot Disallow: / User-agent: IconSurf Disallow: / User-agent: SurveyBot/2.3 Disallow: /