Niche Spider - what is it? Simple - it's a spider, a piece of software which grabs specific webpage data. It can grab data from tens of thousands of sites, and then present the data collected in nice, neat pages WITHOUT THE NEED OF ANY DATABASE. Yes NO database programming required!
When visiting a website, Niche Spider also leaves it's calling card in the site's visitor logs (the 'Referer' and 'User-Agent', which you can set), just like Googlebot or any other spider or web crawler. That, in itself, is a great way to announce yourself to the world, and to generate some curiosity/traffic at the same time.
However, Niche Spider is NOT Googlebot, or Yahoo's Slurp, or MSN's MSNBot. Google, Yahoo and MSN have access to computers, servers and databases us lesser mortals can only dream about. And the spiders they use crawl the web, looking for and following links to pages, which are then added to their respective databases. Such is their power they can traverse the entire web in a month or two, or less, adding and updating billions of pages in the process.
Niche Spider does NOT crawl the web, but targets a small piece of the web instead (a niche area). You decide what that niche is.
Requirements
256 MB RAM and Broadband connection
Please contact Niche Spider publisher, John Donaldson if you have questions or issues regarding this product.
Software USB port sniffer, monitor tool with protocol analyzer and data logger. This Universal Serial Bus monitoring utility can spy, capture, view, log, analyze, test usb device activity performing connection traffic analysis with data acquisition
