Block The IIS SEO Toolkit Through ASP

I was just reading more about the IIS SEO Toolkit when I came across the following interesting tutorial on how to block competitors from running the IIS SEO Toolkit on your servers.

If you have an asp-based website then this is a mandatory update in my opinion unless you want your competitors to have easy access to your site’s information. That said, a lot of the information that the IIS SEO Toolkit provides is likely available through other tools but at least if you block the Toolkit you will make it that much harder on the competition.

Here is the tutorial:

All HTTP requests made by IIS Site Analysis Web Crawler have an HTTP header “user-agent” set to:

“iisbot/1.0 (+”IIS Site Analysis Web Crawler is fully compliant with the robots exclusion protocol. This means that you can use robots.txt file to prevent IIS Site Analysis Web Crawler from crawling your web site. For example you may want to do it to prevent other people from running IIS Site Analysis against your web sites.

In order to prevent IIS Site Analysis Crawler from crawling a web site, add the following lines at the end of the robots.txt file located at the site’s root directory:

User-Agent: iisbot
Disallow: /

NOTE: Thanks to SMX Advanced for giving a great show, I wouldn’t have had access to so much breaking info without this great show. Kudos!


Ross Dunn
About Ross Dunn
Ross Dunn is the CEO and founder of StepForth Web Marketing Inc., an SEO firm that has been providing expert services since 1997. Ross´s considerable experience in the world of search has made him a respected writer for countless publications and an SEO consultant for small business and Fortune 500 web properties.

Leave a Reply

Your email address will not be published. Required fields are marked *