Results 1 to 9 of 9

Thread: [2008] Web parsing with username and password

  1. #1

    Thread Starter
    New Member
    Join Date
    Apr 2008
    Posts
    6

    Question [2008] Web parsing with username and password

    Hey guys, first time posting here, so go easy on me

    I'm pretty familiar with parsing information from websites (downloading source, extracting information) inside of a vb.net app, but I have run into a problem that I'm not sure how to solve.

    I have a client that needs an application to parse information from a website, but the website requires a login. He knows the login information, so is there anyway to set up the program to access the website, enter a password, hit submit, and the parse the information?

  2. #2
    Registered User nmadd's Avatar
    Join Date
    Jun 2007
    Location
    U.S.A.
    Posts
    1,676

    Re: [2008] Web parsing with username and password

    You are probably looking for this:

    http://msdn2.microsoft.com/en-us/lib...redential.aspx

    Good luck.

  3. #3

    Thread Starter
    New Member
    Join Date
    Apr 2008
    Posts
    6

    Re: [2008] Web parsing with username and password

    Thanks for that info, it looks interesting. I had found a half assed way of doing it through DOM, but it seemed very hacky and I wanted to use webrequests. However, perhaps I am doing something wrong, but will this work with form based authentication?

    If so, how do I find out what authentication method it uses (basic, kerberos, etc)

    Thanks again

  4. #4
    Addicted Member
    Join Date
    Mar 2005
    Posts
    157

    Re: [2008] Web parsing with username and password

    Is it a popup login form, or an HTML login form on the website?

  5. #5

    Thread Starter
    New Member
    Join Date
    Apr 2008
    Posts
    6

    Re: [2008] Web parsing with username and password

    It is an HTML form

  6. #6

    Thread Starter
    New Member
    Join Date
    Apr 2008
    Posts
    6

    Re: [2008] Web parsing with username and password

    Any ideas for this anyone?

  7. #7
    Junior Member
    Join Date
    Mar 2007
    Posts
    28

    Re: [2008] Web parsing with username and password

    Is it possible for you to share the site URL? Does the form use a post / get parameter?

  8. #8

    Thread Starter
    New Member
    Join Date
    Apr 2008
    Posts
    6

    Re: [2008] Web parsing with username and password

    Unfortunately I cannot share the URL.

    The form is using a post:

    Code:
    <form name="Login" method="POST" action="/siteminderagent/forms/login.fcc>

  9. #9

    Thread Starter
    New Member
    Join Date
    Apr 2008
    Posts
    6

    Re: [2008] Web parsing with username and password

    I still have not found a solution for this. Anyone?

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  



Click Here to Expand Forum to Full Width