[RESOLVED] WebBrowser - Html: Get values.

I want with the click on the Button to get values from the site.

The site has a code example:

1.

Code:

---

Name: <b>Daniel</b><BR>

---

Daniel is the value I want to get into TextBox1.text

2.Same as the first:

Code:

---

<a onclick=" infowin(478488) " href="#"> ' It's not the full code

---

in the code:
Green: variable
Red: Text that I want to get what inside the brackets (variable)

If those values are static, you can download the page, and then just find the strings...
Look to this thread. You can see how to get all the contents of the page, then you just need to search the values that you need in the string, you can use RegularExpressions to do the search.

Quote:

---

Originally Posted by mickey_pt

If those values are static, you can download the page, and then just find the strings...
Look to this thread. You can see how to get all the contents of the page, then you just need to search the values that you need in the string, you can use RegularExpressions to do the search.

---

I do not want to download the page, I want to use it through webbrowser

like:

Code:

TextBox1.Text = WebBrowser1.Document.GetElementById("ID").InnerText

loop through the <b> elements, if the OuterText.Contains "Name:" then that's the one you want. Get the InnerText of the <b> element that matches that condition.

for the other, loop through the anchor elements (<a>) and get the InnerHtml. Use a regular expression to get the "infowin(.*)" text. or try GetAttribute("onclick") to see if that returns what you want.

or view my blog in my sig to see other HTML scraping stuff...

You can show me the code? Did not really understand

replace webpage_source_code_string with a string of the source code

Code:

---

Imports System
Imports System.Text.RegularExpressions
Public Class Form1

    Private Sub Button1_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Button1.Click
        Dim mCollect As MatchCollection = Regex.Matches("webpage_source_code_string", "(?<=<b>).*?(?=</br>)", RegexOptions.IgnoreCase)

        For Each m As Match In mCollect
            MsgBox(m.Value)
        Next
    End Sub
End Class

---

It is not good (it brings me a different kind of source code site.) Only this way can help me:

Quote:

---

Originally Posted by stateofidleness

loop through the <b> elements, if the OuterText.Contains "Name:" then that's the one you want. Get the InnerText of the <b> element that matches that condition.

for the other, loop through the anchor elements (<a>) and get the InnerHtml. Use a regular expression to get the "infowin(.*)" text. or try GetAttribute("onclick") to see if that returns what you want.

or view my blog in my sig to see other HTML scraping stuff...

---

Just i did not understood how to do it right.

Up...

help pliz..

maybe if you make your question simple and short me or the other forum users can solve it

EH I DIGIVOLVED INTO Hyperactive Member

Hi mamrom,

I had very similar problem recently.

I got a solution and I hope it will work for you as well.

Please bear in mind that some characters are not accepted in my solution.

this code is for your variable "Daniel"

Code:

---

Try
            Dim theElementCollection As HtmlElementCollection
            'this finds all HTML tags type b as in html tag for bold text
            theElementCollection = WebBrowser1.Document.GetElementsByTagName("b")
            For Each curElement As HtmlElement In theElementCollection
                'now we look for the item we are interested in providing some code that is static within the html tag - in this example before and after the variable
                If curElement.GetAttribute("OuterHtml").Contains("Name: <b>") AndAlso curElement.GetAttribute("OuterHtml").Contains("</b><BR>") Then
                    'if we got it we put it into a textbox - the entire html tag
                    TextBox1.Text = curElement.GetAttribute("OuterHtml").ToString
                End If
            Next
            'now we are trying for find the variable between static parts of the html tag
            'you may see the static parts there. the variable is represented by .*?
            Dim mCollect As MatchCollection = Regex.Matches(TextBox1.Text.ToString, "(?<=Name: <b>).*?(?=</b><BR>)", RegexOptions.IgnoreCase)

            For Each m As Match In mCollect
                'and we are displaying the variable in a message box. This should return Daniel as the variable
                MsgBox(m.Value)

            Next

        Catch exc As Exception
            MsgBox(exc.Message)
        End Try

---

basically what you are doing is that you are converting entire html tag into a normal text and you are looking for a stuff that is between specified pieces on other bits of text.

you provided just an example of the real code. I had a problem with such approach. I realised that some stuff (characters) is not accepted in this line:

Dim mCollect As MatchCollection = Regex.Matches(TextBox1.Text.ToString, "(?<=Name: <b>).*?(?=</b><BR>)", RegexOptions.IgnoreCase)

so stuff like "" or '' or ;; etc may is some cases be not accepted. I did not figured out the exact reasons for it yet.

please refer to my thread to get more info: http://www.vbforums.com/showthread.php?t=642625

hope this helps.

regards

First of all thanks for trying but it did not help: (

I made example of what I want:

Code:

---

<HTML>
<HEAD>
</HEAD>
<BODY>
        Name: <b>Daniel</b><BR>
        gender:  <b>Male</b><BR>
</BODY>
</HTML>

---

1. Get the value "Daniel" into the text box (Daniel as variable)

am i being punked, dude post #6 is your solution c'mon man.
just raplace "webpage_source_code_string" with the source code which you can get with a webbrowser control, with it's intellisense navigate to the url, and get the source code (<html>...)

Download the source code and then find it does not solve the problem, it gives me a different source code.

mamrom post your current code.
moti's code will work perfectly, so i'm assuming an implementation problem at keyboard ;)

post your code so we can see/fix it.

It works but the source code wrong. This brings me to the source code of another site and not his.

I use this code To download source code:

Code:

Dim Cliant As New WebClient
        Dim Url As String
        Url = WebBrowser1.Url.ToString
        Dim html As String = Cliant.DownloadString(New Uri(Url))
        RichTextBox1.Text = html

Do you have any idea what could be the problem?

Maybe if i sign in server it will work? (How do I do this?)

Quote:

---

Originally Posted by mamrom

It works but the source code wrong. This brings me to the source code of another site and not his.

I use this code To download source code:

Code:

Dim Cliant As New WebClient
        Dim Url As String
        Url = WebBrowser1.Url.ToString
        Dim html As String = Cliant.DownloadString(New Uri(Url))
        RichTextBox1.Text = html

Do you have any idea what could be the problem?

Maybe if i sign in server it will work? (How do I do this?)

---

I forgot to say, the site only supports Internet Explorer

help.

Since you are loading the webpage in an WebBrowser Control(say "WebBrowser1") then you can use WebBrowser1.DocumentText to the Source Code of the WebPage

combining moti's code and aashish's last comment:

vb Code:

Imports System
Imports System.Text.RegularExpressions
Public Class Form1
 
    Private Sub Button1_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Button1.Click
        Dim mCollect As MatchCollection = Regex.Matches(WebBrowser1.DocumentText, "(?<=<b>).*?(?=</br>)", RegexOptions.IgnoreCase)
 
        For Each m As Match In mCollect
            MsgBox(m.Value)
        Next
    End Sub
End Class

Quote:

---

Originally Posted by stateofidleness

combining moti's code and aashish's last comment:

vb Code:

Imports System
Imports System.Text.RegularExpressions
Public Class Form1
 
    Private Sub Button1_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Button1.Click
        Dim mCollect As MatchCollection = Regex.Matches(WebBrowser1.DocumentText, "(?<=<b>).*?(?=</br>)", RegexOptions.IgnoreCase)
 
        For Each m As Match In mCollect
            MsgBox(m.Value)
        Next
    End Sub
End Class

---

thx!

its not work (but the source code and code from marl yes)

Thank you very much

gonna assume that means it's working? lol

There's one little problem with the encoding
Source code looks like this:
http://img46.imageshack.us/img46/6301/29041057.png
"�"
(This Hebrew language)

we need to be clear here going forward.. when you use the phrase "Source code", indicate if you're talking about HTML code or the VB Source code you're using. It's a bit confusing.

Is the web page itself in Hebrew? Are you able to provide a link to the page you're trying this on?

Quote:

---

Originally Posted by stateofidleness

we need to be clear here going forward.. when you use the phrase "Source code", indicate if you're talking about HTML code or the VB Source code you're using. It's a bit confusing.

Is the web page itself in Hebrew? Are you able to provide a link to the page you're trying this on?

---

About html.

u give me the code: "WebBrowser1.DocumentText" to get Source code of site and is v. good, but Encoding is not good (in Hebrew letters it displays question marks[?])

Site

And the last question (really lol):

Moti's code works very well (i just checked wrong before)

Code:

---

onclick='infowin(15555)'>

---

I want to take the variable (marked in red) from website

Now I take the variable but it takes me to the closing in addition to

this is what i do:

Code:

---

Dim mCollect As MatchCollection = Regex.Matches(WebBrowser1.DocumentText, "(?<='infowin).*?(?='>)")

---

this what is give me:
(15555)
Just I need only the number without closing

Once again, thanks for the help and i'm sorry for i not so clear...

well you can do it with the regular expression, but I'm not good at those so.. once you have the (15555) you can use substring to get the number

.Substring(1,numberVariable.Length-1)

"numberVariable" show error

and wht about encoding?

Maybe if I change encoding on Richtextbox this help? (How is that possible?)

you need to store the "(15555)" in a variable. then, you use that variable where I put "numberVariable". You can name it whatever you want.

Quote:

---

Originally Posted by stateofidleness

you need to store the "(15555)" in a variable. then, you use that variable where I put "numberVariable". You can name it whatever you want.

---

thx
wht about encoding? :(

I can't view the site at work (it gets blocked), but I'm still not sure what the question/problem is? is the HTML source code returned in the HEBREW language? Does it even matter? if you're just trying to click that button, it should work no?

the Site have Hebrew, now I take/Download the source code from site and the Hebrew becomes a question mark

http://img46.imageshack.us/img46/6301/29041057.png


Create a new html file and paste the following code:

HTML Code:

---

<HTML>
<HEAD>
</HEAD>
<BODY id="bbody" background="/i/bg.jpg"  bgcolor="#282828" onload="mess();">
        שם: <b>דניאל</b><BR>
        מין:  <b>זכר</b><BR>
</BODY>

---

open new from and paste the following code:
*with: Button1, Textbox1 and WebBrowser1

Code:

---

  Private Sub Button1_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Button1.Click

WebBrowser1.Navigate(Patch)

Textbox.text = WebBrowser1.DocumentText
    End Sub

---

Now instead of getting the Hebrew language you get the following sign: "�"

If you can not see Hebrew on your computer Here is a picture to will understand:
http://img819.imageshack.us/img819/3932/57966555.png

try:

vb.net Code:

Imports System
Import System.Web 'New
Imports System.Text.RegularExpressions
Public Class Form1
 
    Private Sub Button1_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Button1.Click
        Dim NewSource As String = Nothing
        Dim html As New System.Web.HttpUtility()
        NewSource = html.HtmlDecode(WebBrowser1.DocumentText)
 
        Dim mCollect As MatchCollection = Regex.Matches(NewSource, "(?<=<b>).*?(?=</br>)", RegexOptions.IgnoreCase)
 
        For Each m As Match In mCollect
            MsgBox(m.Value)
        Next
    End Sub
End Class

There is an error:
http://img339.imageshack.us/img339/7181/sdffdsfdd.png

yep, change

Imports System.Web

to

Imports System.Net.WebUtility

http://img222.imageshack.us/img222/6048/36815121.png

i try:

VB.net Code:

Imports System
Imports System.Text.RegularExpressions
 
 
Public Class Form1
 
    Private Sub Button1_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Button1.Click
        Dim NewSource As String = Nothing
 
        NewSource = Net.WebUtility.HtmlDecode(WebBrowser1.DocumentText)
 
        Dim mCollect As MatchCollection = Regex.Matches(NewSource, "(?<=<b>).*?(?=</br>)", RegexOptions.IgnoreCase)
 
        For Each m As Match In mCollect
            MsgBox(m.Value)
        Next
    End Sub
End Class

But the problem with Hebrew is not changed.

דניאל אתה צריך להתקין עברית מהדיסק של הווינדוס שהדפדפן אומר זאת

או שתתקין את ה -
LANGUAGE PACK בעברית

i told him to install hebrew

you can also add a richtextbox and paste the html source code in it
then in the code:

Code:

---

Imports System
Imports System.Text.RegularExpressions
Public Class Form1

    Private Sub Button1_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Button1.Click
        Dim mCollect As MatchCollection = Regex.Matches(richtextbox1.text, "(?<=<b>).*?(?=</br>)", RegexOptions.IgnoreCase)

        For Each m As Match In mCollect
            MsgBox(m.Value)
        Next
    End Sub
End Class

---

Quote:

---

Originally Posted by moti barski

you can also add a richtextbox and paste the html source code in it
then in the code:

Code:

---

Imports System
Imports System.Text.RegularExpressions
Public Class Form1

    Private Sub Button1_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Button1.Click
        Dim mCollect As MatchCollection = Regex.Matches(richtextbox1.text, "(?<=<b>).*?(?=</br>)", RegexOptions.IgnoreCase)

        For Each m As Match In mCollect
            MsgBox(m.Value)
        Next
    End Sub
End Class

---

---

http://img714.imageshack.us/img714/2485/imagele.png

אגב, תודה רבה על העזרה שלך. פתרת לי בעיה אחת ואני מודה לך על כך מאוד (:
---------------------------------------------------------------------------

Ignore this comment

Moti in last comment did not help me unfortunately

maybe if we have the sites link

Quote:

---

Originally Posted by moti barski

maybe if we have the sites link

---

I wrote above :)

ClickOnMe

i also get jibrish in the source code with maxthone browser maybe with google chrome browser in hebrew it could work

The site supports only in Internet Explorer (WebBrowser based on IE)

Hi,

I'm gonna give it another go.

First of all - I noticed the page http://battle.co.il/news/ is in encoding WINDOWS-1255

Most probably this causes issues reported in previous posts.

But when you have it in encoding UTF-8 my code will work.

It should work with windows-1255 encoding as well, but then searching for appropriate HTML strings will became a nightmare.

VB Code:

Code:

---

Imports System
Imports System.Text.RegularExpressions
Public Class Form1
    Private Sub Form1_Load(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles MyBase.Load
        WebBrowser1.Navigate("file:///C:\mamrom_test_page.html")
    End Sub
    Private Sub Button1_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Button1.Click
        Dim theElementCollection As HtmlElementCollection
        theElementCollection = WebBrowser1.Document.GetElementsByTagName("body")
        For Each curElement As HtmlElement In theElementCollection
            TextBox1.Text = (curElement.GetAttribute("OuterHtml").ToString)
        Next
    End Sub
    Private Sub Button2_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Button2.Click
        Try
            Dim mCollect As MatchCollection = Regex.Matches(TextBox1.Text.ToString, "(?<=שם: <B>).*?(?=</B><BR>מין:)", RegexOptions.IgnoreCase)
            For Each m As Match In mCollect
                MsgBox(m.Value)
            Next
        Catch ex As Exception
        End Try
    End Sub
End Class

---

HTML Code:

Code:

---

<HTML>
<HEAD>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<!--<META HTTP-EQUIV="CONTENT-TYPE" CONTENT="TEXT/HTML; CHARSET=WINDOWS-1255">-->

</HEAD>
<BODY>
        שם: <b>דניאל</b><BR>
        מין:  <b>זכר</b><BR>
</BODY>

---

I also recorded a video demonstrating how this code works - you may watch it here : SORRY - VIDEO NO LONGER AVAILABLE

Just one important thing to notice. I've got all possible language packs installed on my computer - honestly - anything you can think of, so hebrew displays fine on my machine, but I have no idea if it will display fine on other computers.


EDITED:
what is good about my code. When you are displaying your html code in a textbox you see it the same way the webbrowser sees it, so you know what you suppose to look for to get your variable. Once you know how it reads the HTML code, you may simply skip this part with textbox. I hope this makes sense ;)

regards

Quote:

---

Originally Posted by marl

Hi,

I'm gonna give it another go.

First of all - I noticed the page http://battle.co.il/news/ is in encoding WINDOWS-1255

Most probably this causes issues reported in previous posts.

But when you have it in encoding UTF-8 my code will work.

It should work with windows-1255 encoding as well, but then searching for appropriate HTML strings will became a nightmare.

VB Code:

Code:

---

Imports System
Imports System.Text.RegularExpressions
Public Class Form1
    Private Sub Form1_Load(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles MyBase.Load
        WebBrowser1.Navigate("file:///C:\mamrom_test_page.html")
    End Sub
    Private Sub Button1_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Button1.Click
        Dim theElementCollection As HtmlElementCollection
        theElementCollection = WebBrowser1.Document.GetElementsByTagName("body")
        For Each curElement As HtmlElement In theElementCollection
            TextBox1.Text = (curElement.GetAttribute("OuterHtml").ToString)
        Next
    End Sub
    Private Sub Button2_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Button2.Click
        Try
            Dim mCollect As MatchCollection = Regex.Matches(TextBox1.Text.ToString, "(?<=שם: <B>).*?(?=</B><BR>מין:)", RegexOptions.IgnoreCase)
            For Each m As Match In mCollect
                MsgBox(m.Value)
            Next
        Catch ex As Exception
        End Try
    End Sub
End Class

---

HTML Code:

Code:

---

<HTML>
<HEAD>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<!--<META HTTP-EQUIV="CONTENT-TYPE" CONTENT="TEXT/HTML; CHARSET=WINDOWS-1255">-->

</HEAD>
<BODY>
        שם: <b>דניאל</b><BR>
        מין:  <b>זכר</b><BR>
</BODY>

---

I also recorded a video demonstrating how this code works - you may watch it here : http://www.youtube.com/watch?v=EQexY8G5q10

Just one important thing to notice. I've got all possible language packs installed on my computer - honestly - anything you can think of, so hebrew displays fine on my machine, but I have no idea if it will display fine on other computers.


EDITED:
what is good about my code. When you are displaying your html code in a textbox you see it the same way the webbrowser sees it, so you know what you suppose to look for to get your variable. Once you know how it reads the HTML code, you may simply skip this part with textbox. I hope this makes sense ;)

regards

---

-----------------------
http://www.vbforums.com/images/ieimages/2011/03/1.gifhttp://www.vbforums.com/images/ieimages/2011/03/1.gifhttp://www.vbforums.com/images/ieimages/2011/03/1.gif

marl very good video,thx :)
Marl,Moti and stateofidleness thx a lot.