Information about Seekport Robot

Name

The Seekport Robot is called Seekbot. The User-Agent is:

Seekbot/1.X (http://www.seekbot.net/bot.html)

Control via Meta Data

Seekbot uses the meta tag robots. Meta tags are included within the <head> section of HTML. As a preset value, Seekbot usually parses all documents and follows all links even if the preset information is not given:

If the robot is not wanted to parse a document the following must be included:

If the robot should not parse a document and should not follow any links, the following command should be included:

There are some documents which should not be indexed. For example if you have built your web page as frameset you should tell the robot not to parse the navigation frame. Forms are another example of pages not to be parsed.

Control with robots.txt

Another way to tell our Seekbot to exclude sites from indexing is by using a file named "robots.txt". This file has to be saved in your server's root directory (not in any subdirectory). It is a pure text file and must not contain web page keywords or even HTML (which in fact invalidates the file) but only commands for robots.

If you do not want Seekbot to crawl your site, please implement the following:

User-agent: seekbot
Disallow: /

For more information please have look at robotstxt.org.