InvestorsHub Logo
icon url

RonnieD

02/10/10 10:55 AM

#2017 RE: MattMan87 #2016

website spidering.

http://www.google.com/search?hl=en&source=hp&q=generation+zero+group&aq=f&aqi=&oq=


A program that automatically fetches Web pages. Spiders are used to feed pages to search engines. It's called a spider because it crawls over the Web. Another term for these programs is webcrawler.
Because most Web pages contain links to other pages, a spider can start almost anywhere. As soon as it sees a link to another page, it goes off and fetches it. Large search engines, like Alta Vista, have many spiders working in parallel.
icon url

MattMan87

02/10/10 11:38 AM

#2018 RE: MattMan87 #2016

Nice block just went through.... maybe getting close to information flow imo