URL Spider Pro
The actual developer of the program is Innerprise. Spider.exe is the most frequent filename for this program's installer. The most popular version of the program 1.8. URL Spider Pro lies within Development Tools, more precisely Web Development.
From the developer:
URL Spider Pro allows you to create your own Altavistastyle search engine or a Yahoo! style directory. It has the ability to follow links it finds and now supports the robots exclusion. Many features allow you to index only the types of web pages you want. Useful for creating your own mini search engine for any subject you're interested in.
You may want to check out more software, such as GSA URL Redirect PRO, Web Emails Spider or BLUE SPIDER, which might be similar to URL Spider Pro.