Results 1 to 5 of 5

Thread: How do I do this?

  1. #1

    Thread Starter
    New Member
    Join Date
    Jul 2009
    Posts
    14

    How do I do this?

    Hello all,

    How can I add a function to a program that could search a specific website/database and send me all the words out of that database or website?

    Thanks

  2. #2
    Wait... what? weirddemon's Avatar
    Join Date
    Jan 2009
    Location
    USA
    Posts
    3,826

    Re: How do I do this?

    I can't imagne you can directly access a websites database as it would be protected from malicious intentions.

    You could use a WebBrowser control and use the sites search feature to find what you're looking for... but a lo of sites, like this one, use a Captcha system to prevent that.

    What exactly are you searching for and for what purpose? And how do you want to search for the information?

    This information may help us provide better information for you.
    CodeBank contributions: Process Manager, Temp File Cleaner

    Quote Originally Posted by SJWhiteley
    "game trainer" is the same as calling the act of robbing a bank "wealth redistribution"....

  3. #3
    Super Moderator jmcilhinney's Avatar
    Join Date
    May 2005
    Location
    Sydney, Australia
    Posts
    111,221

    Re: How do I do this?

    You're going to have to be more specific. A web site and a database are two different things, so there's no single answer that covers both. A web site can be database-driven, but you may only have access to the web pages themselves and not the actual database. Please provide a FULL and CLEAR description of exactly what you want to do and also any other relevant information, like what web site it is and what format it displays its data in.
    Why is my data not saved to my database? | MSDN Data Walkthroughs
    VBForums Database Development FAQ
    My CodeBank Submissions: VB | C#
    My Blog: Data Among Multiple Forms (3 parts)
    Beginner Tutorials: VB | C# | SQL

  4. #4

    Thread Starter
    New Member
    Join Date
    Jul 2009
    Posts
    14

    Re: How do I do this?

    Quote Originally Posted by jmcilhinney View Post
    You're going to have to be more specific. A web site and a database are two different things, so there's no single answer that covers both. A web site can be database-driven, but you may only have access to the web pages themselves and not the actual database. Please provide a FULL and CLEAR description of exactly what you want to do and also any other relevant information, like what web site it is and what format it displays its data in.
    basically what I want to do is have a function where I can click a button and it will scan the entire website and send me back all of the words that is on that website.

    But I don't just want it to do just 1 page, I want it to scan every public available page for that website.

    ie., www._____.com/1
    www._____.com/12
    www._____.com/121
    www._____.com/122

    I know that isnt actually how website works (with the whole /1, 12, 121, 122 thing) that was just an example that I want the function to take words from the website and give them to me.

    kind of like a search engine for a website I guess. or how you can CTRL+F sites to find the word you are looking for, but I want that to CTRL+F every word from that site and give it to me.

  5. #5
    PowerPoster keystone_paul's Avatar
    Join Date
    Nov 2008
    Location
    UK
    Posts
    3,327

    Re: How do I do this?

    You would need a recursive function that processes a specific page (in terms of grabbing the words and adding them to your index/db) and then get all of the links on the page, determine whether they are ones you want to process (ie if they link to an external site you won't want to do them), and if they are then call your function with each of the links.

    One of the problems you will face though is that if you are going to add every word on each page to your index then you are likely to have a lot of words, many of which will be irrelevant.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  



Click Here to Expand Forum to Full Width