|
-
Jul 19th, 2009, 08:11 PM
#1
Thread Starter
New Member
How do I do this?
Hello all,
How can I add a function to a program that could search a specific website/database and send me all the words out of that database or website?
Thanks
-
Jul 19th, 2009, 08:44 PM
#2
Re: How do I do this?
I can't imagne you can directly access a websites database as it would be protected from malicious intentions.
You could use a WebBrowser control and use the sites search feature to find what you're looking for... but a lo of sites, like this one, use a Captcha system to prevent that.
What exactly are you searching for and for what purpose? And how do you want to search for the information?
This information may help us provide better information for you.
CodeBank contributions: Process Manager, Temp File Cleaner
 Originally Posted by SJWhiteley
"game trainer" is the same as calling the act of robbing a bank "wealth redistribution"....
-
Jul 19th, 2009, 08:45 PM
#3
Re: How do I do this?
You're going to have to be more specific. A web site and a database are two different things, so there's no single answer that covers both. A web site can be database-driven, but you may only have access to the web pages themselves and not the actual database. Please provide a FULL and CLEAR description of exactly what you want to do and also any other relevant information, like what web site it is and what format it displays its data in.
-
Jul 19th, 2009, 09:00 PM
#4
Thread Starter
New Member
Re: How do I do this?
 Originally Posted by jmcilhinney
You're going to have to be more specific. A web site and a database are two different things, so there's no single answer that covers both. A web site can be database-driven, but you may only have access to the web pages themselves and not the actual database. Please provide a FULL and CLEAR description of exactly what you want to do and also any other relevant information, like what web site it is and what format it displays its data in.
basically what I want to do is have a function where I can click a button and it will scan the entire website and send me back all of the words that is on that website.
But I don't just want it to do just 1 page, I want it to scan every public available page for that website.
ie., www._____.com/1
www._____.com/12
www._____.com/121
www._____.com/122
I know that isnt actually how website works (with the whole /1, 12, 121, 122 thing) that was just an example that I want the function to take words from the website and give them to me.
kind of like a search engine for a website I guess. or how you can CTRL+F sites to find the word you are looking for, but I want that to CTRL+F every word from that site and give it to me.
-
Jul 20th, 2009, 02:26 AM
#5
Re: How do I do this?
You would need a recursive function that processes a specific page (in terms of grabbing the words and adding them to your index/db) and then get all of the links on the page, determine whether they are ones you want to process (ie if they link to an external site you won't want to do them), and if they are then call your function with each of the links.
One of the problems you will face though is that if you are going to add every word on each page to your index then you are likely to have a lot of words, many of which will be irrelevant.
Posting Permissions
- You may not post new threads
- You may not post replies
- You may not post attachments
- You may not edit your posts
-
Forum Rules
|
Click Here to Expand Forum to Full Width
|