1)   FetchBot 1.0.0
Gather Intelligence Data for a List of Domains
Spider, Bot, Robot, Free, Tool, Internet, Web, Download, Probe, Intelligence,

 2)   HttpDetect (EffeTech HTTP Sniffer) 3.6
A HTTP protocol network sniffer, packet analyzer and file rebuilder. Unlike most other sniffers, it is dedicated to capture IP packets containing HTTP protocol, rebuild and save the HTTP communications and files sent through HTTP protocol.
EffeTech, sniffer, http sniffer, web sniffer, web monitor, image, gif, jpg, packet sniffer, http analyzer,

 3)   Web Bot Programming Library 1.0.0
Crawl the web with this free ActiveX web bot component. Advanced features include caching, "avoid" patterns, and robots.txt compliance.
Spider, ActiveX, Component, Bot, Robot, Freeware, Internet, Web, Download, Probe,

 4)   Delicious Submit 1.0.0
Batch Submit URLs to del.icio.us
Submit, Submission, Bookmarking, Bookmark, Spider, Bot, Robot, Free, Tool, Internet,

 5)   Site Spider 1.0.0
Spiders a site and creates output files containing (1) a list of URLs in the site, (2) a Google sitemap, (3) an XML summary file with title, description, and keywords for each page, and (4) links to URLs external to the spidered domain.
Spider, Bot, Robot, Free, Tool, Internet, Web, Download, Probe, Intelligence,

 6)   Domain Discovery 1.0.0
Probe the Internet to Collect Domain Names with Operating Websites. This program probes the Internet to discover and collect domain names with operating websites. It can discover sites that are not indexed by any search engine or linked from any other website.
Spider, Bot, Robot, Free, Tool, Internet, Web, Download, Probe, Intelligence,

 7)   Chilkat Spider ActiveX 1.0.0
Crawl a website with this free ActiveX spidering component. Advanced features include caching, "avoid" patterns, and robots.txt compliance.
Spider, ActiveX, Component, Bot, Robot, Freeware, Internet, Web, Download, Probe,