|
-
Aug 24th, 2009, 12:41 PM
#1
Thread Starter
Hyperactive Member
developing web crawler
Hi guys,
I have a design question. I'm trying to build a webcrawler that has the ability to look for all companies about page. Then reference them in a list of the company and a link to the about page.
Have any ideas on how I should go about doing this? I mean I could start with lists of the companies on the NASDAQ and NYSE and all the other exchanges but that leaves out the non publicly trade companies which is kinda wrong.
The companies aren't connected to each other so for like going from one site to another and will probably not work.
The way I see it, The only way to get this to work is to have a list from somewhere. I'd like to figure out a smarter way than that.
Last edited by jakkjakk; Aug 24th, 2009 at 12:43 PM.
Reason: update
Posting Permissions
- You may not post new threads
- You may not post replies
- You may not post attachments
- You may not edit your posts
-
Forum Rules
|
Click Here to Expand Forum to Full Width
|
Reply With Quote