& #39; is an HTML character code, not an encoding issue... you'll probably need a regular expression, like so:
Code:
Dim re As New System.Text.RegularExpressions.Regex("&#(\d+);", System.Text.RegularExpressions.RegexOptions.SingleLine)
Then you can match it with each string you're outputting and access the code:
Code:
For Each m As System.Text.RegularExpressions.Match In re.Match(my string)
     Dim cc As Integer = Integer.Parse(re.Groups(1).Value)
     Dim chr As Char = AscW(cc)
     (my string) = (my string).Remove(m.Index,m.Length).Insert(m.Index,chr)
Next
You've got to take into account things like ' too, though.