User-agent: * Disallow: /addon-modules/ Disallow: /Downloads/ Disallow: /bitch/ Disallow: /images/ Disallow: /js/ Disallow: /php/ Disallow: /gifs/ Disallow: /college/ Disallow: /cgi-bin/ User-agent: TurnitinBot Disallow: / #Will disallow all urls on your site