Manipulate/Change/Form Fill data in webpages using the Webbrowser control

when you run into this type of situation, try to figure out what action you are trying to simulate versus the result you want (sometimes the opposite is true). In this case, you want to simulate clicking on an image. It just so happens that the result is submitting the form.

Try this code to simulate clicking the image, which in turn should fire any code attached to that image.

Code:

---

DirectCast(GetCurrentWebDoc.images.item("ctl00$Main$postComment$postcommentImageButton"), mshtml.HTMLImg).click()

---

if that name value doesn't work, try the ID instead ("ctl00_Main_postComment_postcommentImageButton")


I do hope you are making some sort of "utility", and not anything that could be used maliciously to spam comments all over myspace. ;)

Sorry, I misread it as just an image (as in <img> tag) and not an input element of type image.

For some reason, I can't seem to access the specific element when its type image via the forms item collection. However this code seems to work:

Code:

---

        Dim MyImageElement As mshtml.HTMLInputElement = DirectCast(GetCurrentWebDoc.all.item("ctl00_Main_postComment_postcommentImageButton"), mshtml.HTMLInputElement)
        MyImageElement.click()

---

It told me "Unable to cast object of type 'System.Windows.Forms.HtmlDocument' to type 'mshtml.HTMLDocument'." for the following line of code

Code:

---

Return DirectCast(WebBrowser1.Document, mshtml.HTMLDocument)

---

in the GetCurrentWebDoc function.


It is causing null errors when I try to set a value. (I took out the exception stuff to figure out where the null value was comming from).

I think it is because I am trying to use it with a .dll page... but it is written in HTML. Is there a way I can use this same method for a .dll page?

I'm creating a program that you can enter info into and it will use that info to fill out the eBay Sell an item page, because I like to enter everything in when I'm in the car on my laptop, then when I have an internet connection, I can just plug it in and use it to list the items.

Quote:

---

Originally Posted by VistaVB

A .dll page? ***.....

Are you using the Web Browser control or the .net 1.1 ActiveX Control? Thanks.

---

web browser control in .net

eBay uses .dll pages... "http://my.ebay.com/ws/eBayISAPI.dll?MyEbay"


(That url only works if you are logged in)

Yes, until I actually finish up my 1.1+2.0 browser control that will have all the functionality of both ;)

Hi, I am also trying to code using VB6 to pass values from my application and fill the values in the web pages and submit the page. But the web pages are in frames. I am new to all these...:confused:

hi kleinma, my office blocked downloading of zip file. Can you email me the sample codes? My email is [email protected]. Thanks.

I have a vb program using webbrowser control. I wonder is there a way for me from vb to click an anchor tag thru code.

VB6 or VB.NET?

Quote:

---

Originally Posted by kleinma

Sorry, I misread it as just an image (as in <img> tag) and not an input element of type image.

For some reason, I can't seem to access the specific element when its type image via the forms item collection. However this code seems to work:

---

kleinma, first Id like to say a big thanks for this thread, it has been invaluable to me.

However, I had a page input button I wanted to click with no ID or Name along with several other input buttons on the page that I didnt want to click. To get round this I identified the button by its .src

heres the code..

Code:

---

            Dim thisObj As Object
            Dim butInput As mshtml.HTMLInputElement
            thisObj = AxWebBrowser1.Document.getElementsByTagName("input")
            For Each butInput In thisObj
                If butInput.src = "TheNameOfTheImage.gif" Then
                    butInput.click()
                End If
            Next

---

If you or anyone has a better way of doing it Id be interested to know, but this worked for me and maybe it'll help someone else too.

Off the top of my head I can't think of any other way of doing it. It does become a bit trickier when you have to deal with HTML that doesn't provide all the tags that it should (like a name or ID tag).

So what you are doing is fine.

cant we simply click on a form's submit button with the original webbrowser???

yes of course you can, but this thread is about automating input and interaction on webpages via VB code.

noo.. i mean automatically click on a submit button... because i'm having a problem while using the navigate2 function of axshdocvw...and i'm getting the same error when i use the InvokeMember("click") function of the original webbrowser provided in VB2005 expresss ed. here is the error screenshot:

the VB2005 managed webbrowser control and the COM webbrowser control act a bit different.

If you downloaded my sample application, there is a "submit form" example included.

yeah i tried to to make it for my application but it show me the error when i use Navigate2 function...

Well I am not sure why you are using the navigate2 method...

usually when you are on a page, and you want to submit it, you just simulate the submit button being clicked. This is what my example code does.

It sounds like you are trying to do something different.

noo...i've no page loaded yet..i'm loading it when the app starts...

look..i got a webform, which requires some dates and to be submitted...and i want the resulted html code...now i want it to be done multiple time with different dates..like
for i as integer = 0 to 100
' fill the date in the webform
' submit the form
' get the resulted html
' parse the html code
next

you can't quite do it in a loop like that, because the webbrowser is event driven. It fires events when it is doing things so you know what state it is in, and you know when you should proceed.

So to accomplish a repetitive task like that, you would need to do something like the following:

Lets say you have page1.htm (which is the page that has the fields that need to be filled in), and page2.htm (which is the page the form submits to and has the resulting HTML code you want)

Code:

---

-Navigate to page1.htm
-When the DocumentCompleted event of the webbrowser fires the page has fully loaded
    check the current URL of the WB control
        if its page1.htm, fill in the values you want and submit form
        if its page2.htm, then page1 was just submitted, so get the resulting HTML code.

---

yeah i have done the same thing in the original browser but i have to click to button each time... the code is something like this:

Code:

---

dim counter as integer = 0
prv sub form_onload(...)
webbrowser1.documenttext = mycode
' press submit button code should be here
end sub

prv sub webbrowser1_documentcomplete(...)
if webbrowser1.documenttitle = submitted_page_title then
  parse(webbrowser1.documenttext)
  if counter <> 101 then
    webbrowser1.documenttext = mycode
    ' press submit button code should be here
  end if
end if
end sub

prv sub parse(html as string)
' parse html
counter += 1
end sub

---

i just want the button to be clicked automatically without making a BIG change..i think you understand

Hi kleinma,
I have been following this post for couple of days. I would like to mention that I have never seen anyone so HELPFUL.. You rock!!:thumb:

well, i got a problem in doing the same thing. I am using Vb.net 2005 express edition, wherein i am creating an application, that would send in data to the web form fields and get the results. It's actually a ASP.NET webpage, that calculates based on the values entered in the fields.

I don't know why Mmhtml code, didn't work for me, so i am working with the web browser control 2.0, with the following code:

WebBrowser1.Document.All.Item("IDTextBox").InnerText() = "202"
WebBrowser1.Document.All.Item("PasswordTextBox").InnerText() = "123"
WebBrowser1.Document.All.Item("SelectButton").InvokeMember("click")

PROBLEM: after I execute this code, the web browser loops it, making the page to reload, input the variables and again click it.. it forms a vicious circle..:confused:

any suggestions..

What event did you put that code in?

ohh great!!
:D salutations to you...

you are online..

well i posted this code as follows:


Private Sub WebBrowser1_DocumentCompleted(ByVal sender As Object, ByVal e As System.Windows.Forms.WebBrowserDocumentCompletedEventArgs) Handles WebBrowser1.DocumentCompleted

WebBrowser1.Document.All.Item("IDTextBox").InnerText() = "202"
WebBrowser1.Document.All.Item("PasswordTextBox").InnerText() = "123"
WebBrowser1.Document.All.Item("SelectButton").InvokeMember("click")
End Sub

I am really new to this field, any help would work a long way for me..

Are you able to provide me the URL that you are trying to work with? That makes it easier for me to be able to give you a 100% working answer.

The problem most likely lies somewhere in the fact that an ASP.NET page posts back to itself, not a different page, which could cause the loop you describe.

well.. its only for you..

[REMOVED]

if you have it saved, i can remove it from the public access.. This forms a part of high profile research group..i hope you understand my situation..:)

yeah I saved it.

You need a mechanism, either in your VB app, or in the ASP.NET page, to let you know the current state of the ASP.NET page.

For example, the only visual indicator I see on that page to let me know if an ID/Password were submitted, is the label that says "Select a building" which then changes to "You selected: oh god in Atlanta, Georgia" when I put in the ID/Password.

If you have access to the ASP.NET source code, I would either add a hidden field to indicate if an ID/Password has been submitted. The VB app could then read the value of that hidden field to decide if it should refill the boxes and submit, or not.

If you don't have access to the source code, you could try parsing out the HTML text to find the words "Select a building:" to indicate if you should autofill and submit, however that is more error prone and subject to break if the text on the page ever changes.

i tried stopping the navigation after i was able to invoke the submit button. But, i was not able to invoke "Click" button the next time in the same page.. :ehh:

OOps... that would hit hard on me..

If you have seen, there are multiple button on the webpage, i don't know if i could save the page temporarily, and hit the next button to execute the complex calculation....:mad:

Any other way out of this mess..

It actually selects the building on the first button, then we are allowed to change parameters, then the next button would be for saving the changed parameters for that selected building.. Few more buttons that would lead you to next page, where we got to do the same for other calculation.. ..:cry:

well do you have access to the ASP.NET source code?

Yeah, but i ain't know much about ASP.NET, but i know it is in complete mess.
So i was trying to work other way out..

I have the aspx file attached.. If you could have a look at it..

Any solutions... :confused:

I don't need the aspx file really.

My suggestion would be that you add a hidden field to the aspx page. Call that field hdnStatus

In the code behind for the aspx page, in the button click code for each button have that button set the hdnStatus field. Then your VB app that hosts the WB control can query that field to get the current status:

For example

When user puts in ID/Password and clicks the button to get the building, the ASPX page fires the codebehind code for the button click event of that button. In that code you verify ID/Password and if its correct you display the building they selected. You should also there set the hdnStatus field with some value to indicate there has been a successful login. Lets say you set the hidden field text to "BUILDING_RETRIEVED"

Then in your VB code, in the documentcompleted event of the WB control, look at the value of hdnStatus in the webpage. If its blank, then that should indicate nothing has been done, and the ID/Password should be automatically entered and the button should be clicked. If it says "BUILDING_RETRIEVED" then it should not autofill and click the button again.

You could use this same approach for all the buttons on the page. Just set different values in the hidden field, and that value can be looked at by your VB app so it can take the proper action.

Hope this makes sense.

well makes a lot sense..:blush: i would try to work on it..

One more dumb question :rolleyes:
Is there a way to trigger "code behind code" that leads me to the solution without clicking the button? If yes, it would make my life a lot easier..

not really, in order for the ASP.NET page to behave properly, you need to fire the button click in the HTML. This is because ASP.NET pages employ built in javascript to do certain things when a button is clicked and the page posts back to the web server. If you were to simply submit the form without clicking the button, you would get unknown/undesired results.

Just try the method I described to you before, I think once you get it going, you will find it very easy to implement.

ohh.. i didnt notice that there was a new page...

Though i have access to aspx files.. i don't think my professor would allow me to add anything to it. What i am developing is an add in (windows application) feature. They would like the asp page to function as it was. How about solution 2: parsing out HTML for the button? I'm sure, the webpage contents will never be changed..

how should i parse the webpage to get to the button..

you dont need to get the button, since the only thing that visibly changes on the page is the text telling you to either enter an ID/Password, or it tells you what building you selected, you should look at the HTML source in the browser control, and look for the specific strings that will indicate to you if the fields were already filled out and the button was clicked.

Alrighto...
You are amazing..
Thank you so much.. would work on it..

:eek2: it didn't work either, do you think HTTPwebreqest might be helpful, for my problem..

I need to click a submit button, based off of this information...

Type - "Submit"
TabIndex - "1"
AccessKey - "s"
Value - "Save Signature"
Class - "button"


there is no name or id... so how do I go about doing that (without focusing the control that comes before it when you tab through, and then using sendkeys.send("{TAB}{ENTER}")



Here is the actual code for the button

Code:

---

<input type="submit" class="button" value="Save Signature" accesskey="s" tabindex="1" />

---

if the button has no ID or Name value, then you can do one of 2 things

1) Submit the form directly by calling the forms .Submit() method (which is shown in my sample code)

2) Loop the elements of the form until you find one thats value is equal to "Save Signature" and then you know you are on the right input element, and you can invoke a click on it.

I think #1 is the better method.

Quote:

---

Originally Posted by kleinma

if the button has no ID or Name value, then you can do one of 2 things

1) Submit the form directly by calling the forms .Submit() method (which is shown in my sample code)

2) Loop the elements of the form until you find one thats value is equal to "Save Signature" and then you know you are on the right input element, and you can invoke a click on it.

I think #1 is the better method.

---

How about this, instead of doing that...

Code:

---

<form action="profile.php?do=updatesignature" enctype="multipart/form-data" method="post" name="vbform" onsubmit="return vB_Editor['vB_Editor_001'].prepare_submit(0, 0)">

---

What if I use the line WebBrowser1.Document.all.item("vbform").invokemember("post")

I can't try it because I don't have VB on this computer. So, I'm wondering if that would work with a normal web browser for the form? I'd rather use a regular web browser if I can, plus it would be just 1 line of code, rather than several functions.

I dont think that will work, but i suppose you could try it.

I still think you should just call the forms .Submit method.

Hi This is one of the best examples I've seen. I'm just starting with some aspect of dotnet applications. I've scanned the thread but I cant see an answer to (what is probably very obvious once you know how) where the reference for the browser (used) comes from. Creating a new project from scratch where is the library for the browser version used here? The only refence in the distributed (zipped) project is to some dlls in bin/debug. What do I reference on an otherwise blank machine. What to I include in the setup for an exe based on this solution? Could you please expain this aspect of the solution please?

appologies oif this is answered somewhere, but I did not see it.

Many thanks

Ian

sure.

to get this setup you need to do the following

1) create a new Windows Application in Visual Studio
2) select "add reference" from the project menu, and under the .NET tab try to locate microsoft.mshtml (which is microsoft.mshtml.dll)

If you don't see it there then try to search your compute rfor microsoft.mshtml.dll. if you don't have it at all, then you can download it from post #88 in this thread (it is also included in the download of the sample project in post #1)

mshtml.dll is the HTML parsing engine. It is what allows you to parse and manipulate individual HTML elements in the browser control.

So once you have that done its on to step 3

3) right click in your toolbox (where all the controls are) and select "Choose Items" Then select the "COM components" tab when the dialog comes up.

Scroll down and find "Microsoft Web Browser" and click the checkbox and then click OK. This will add the COM based webbrowser control to your toolbox so you can drag it to a form.

That is all there is to it. From there you can use my example code to see how you actually do the manipulations of the webpage.

thank you very much

I had cracked 1&2 and was stubling over 3.

Very helpful, much appreciated.

Hi,

Thanks for the the example code, its excellent.

I hope you can help me with this.

Im using your example to set the value of a drop down list, then i'm calling the postback javascript to populate a second drop down on the page which is based on the value of the first.

So I have

Code:

---

DirectCast(GetCurrentWebForm.item("MakeAndModelSearch1:m_make"), MSHTML.HTMLSelectElement).value = "Subaru".ToUpper
        GetCurrentWebDoc.parentWindow.execScript("__doPostBack('MakeAndModelSearch1$m_make','')", "javascript")

---

Then I want to set the value of the second dropdown - BUT, my code is trying to set it before the postback has occurred and it has been populated with values.

Code:

---

            DirectCast(GetCurrentWebForm.item("MakeAndModelSearch1:m_model"), MSHTML.HTMLSelectElement).value = "Impreza".ToUpper
        GetCurrentWebDoc.parentWindow.execScript("__doPostBack('MakeAndModelSearch1$m_model','')", "javascript")

---

I've tried to use a Thread.Sleep(2000) between the two bits of code, but although the thread sleeps it stops the first postback happening.

How can I get around this? I need to hold off executing the second statement until the post postback has completed.

Thanks

you need to use the DocumentComplete event of the webbrowser control. This event fires when a page has fully loaded. So when you do the first postback, the DocumentComplete event will fire when the page has posted back and reloaded in the browser.

Great! Thanks.

Another question, i'm working with this page

https://www.bosbusinesscars.co.uk/Default.aspx

How to I get the image on the left marked CAR SEARCH to click.

I have this,

DirectCast(GetCurrentWebForm.item("MakeAndModelSearch1:m_search"), MSHTML.HTMLImg).click()

But I get a NullReferenceException, did I get the element name wrong?

Thanks

here

Code:

---

DirectCast(GetCurrentWebDoc.getElementById("MakeAndModelSearch1_m_search"), mshtml.HTMLInputElementClass).click()

---

Hi

I have two problems which I'm trying to resolve and which I hope you can help:

1. I'd like to pick up the ellement attibutes that the mouse is currently hovering over: name, id etc

2. I have a test login page, which (I presume supports cookies) once I have logged in, the browser retains the information and automatically logs in when I visit the page. I would like to prevent this behaviour. (this is mainly for testing)

You are very helpful but is there any source of information on this control from MS?

I have read through the entire string and I saw a couple people ask how to use this with a web page that has frames. Has that been posted here or in another string yet.

Hi
i'm trying to fill in a textbox on a page for a login

I've tried this code:

WebBrowser1.Document.GetElementsByTagName("input").Item(22).SetAttribute("value", txtUser.text)

but it says "Specified cast is not valid" on this line.

how can I fix this?


thanks to anyone who helps :)

edit: btw, this is for the ebay login page, here

https://signin.ebay.co.uk/ws/eBayISA...k/&_trksid=m37