SiteScripts
SiteScripts - PHP Scripts, CGI Scripts, Free Javascript & ASP Scripts.
Search in 6,514 resources in 345 categories
Search on SiteScripts:
Building A Web Spider
Building A Web Spider
Web spiders are probably one of the most useful tools ever developed for the internet. After all, with millions of separate and different sites out there today, how else can you gather all that information?
A spider does one thing - it goes out on the web and collects information. The way a typical spider (like Yahoo) works is by looking at one page and finding the relevant information. It then follows all the links in that page, collecting relevant information in each following page, and so on. Pretty soon, you'll end up with thousands of pages and bits of information in your database. This web of paths is where the term 'spider' comes from.
Read more...
A spider does one thing - it goes out on the web and collects information. The way a typical spider (like Yahoo) works is by looking at one page and finding the relevant information. It then follows all the links in that page, collecting relevant information in each following page, and so on. Pretty soon, you'll end up with thousands of pages and bits of information in your database. This web of paths is where the term 'spider' comes from.
Read more...
- Price: Free
- Updated: 10/12/03
- Visits: 137
- Rating:
