"Charles Appel" <charlesap***@mindspring.com> wrote in message
news:OavoYMSeGHA.5016@TK2MSFTNGP04.phx.gbl...
> "kenny" <ke***@discussions.microsoft.com> wrote in message
> news:35EB27F2-0D07-4EC0-8853-316EC813B7AA@microsoft.com...
>>I have a String outputhex which consists of unicodetext translated into
>>hex.
>> example: test = 7400650073007400
>>
>> now i translate each two characters of the hexstring (outputhex) into
>> byte
>> and then into chars. but this is the point where something is wrong...
>> (having the byteorder mark removed would also be very good)
>>
>> "Schließen" gets to "Schlie???" and so on...
>
> Correct me if I'm wrong, but aren't characters in VB.NET
> two bytes in length rather than one?
>
> --
> Charles Appel
> http://charlesappel.home.mindspring.com/
> Home of Chuck's Poker Libraries for Delphi,
> Chuck's Video Poker and Chuck's Toys
>

> Hi, thanks for the clarifications, its now working.
> Mattias Sjögren wrote:
>>>     Dim DBytes(vData.Length) As Byte, i As Integer
>>                    ^^^^^^^^^^^^
>> Should be vData.Length - 1, or your buffer will be one byte too long
>> which I guess affects the computed hash.
>
> I have a book which says that
> Dim a(30) as Integer
> has 30 objects from a(0) to a(29).
>
> However, I tested it and found that
> Dim a(30) as Integer
> has _31_ objects from a(0) to a(30)
>
> Is there some kind of system-level setting or is it a mistake in the
> book?
> Or am I missing something obvious?

>>>     For i = 0 To HBytes.Length - 1
>>>         retstr &= Hex(HBytes(i))
>>>     Next
>> You probably want to zero pad the returned string to ensure that each
>> byte gets represented by two characters.
> Yes, I had to zero pad the hex strings.
>
> Regards,
> JS
>

> Hi, thanks for the clarifications, its now working.
> Mattias Sjögren wrote:
>
>>>    Dim DBytes(vData.Length) As Byte, i As Integer
>>
>>                   ^^^^^^^^^^^^
>>Should be vData.Length - 1, or your buffer will be one byte too long
>>which I guess affects the computed hash.
>
>
> I have a book which says that
> Dim a(30) as Integer
> has 30 objects from a(0) to a(29).
>
> However, I tested it and found that
> Dim a(30) as Integer
> has _31_ objects from a(0) to a(30)
>
> Is there some kind of system-level setting or is it a mistake in the
> book?
> Or am I missing something obvious?
>
>
>>>    For i = 0 To HBytes.Length - 1
>>>        retstr &= Hex(HBytes(i))
>>>    Next
>>
>>You probably want to zero pad the returned string to ensure that each
>>byte gets represented by two characters.
>
> Yes, I had to zero pad the hex strings.
>
> Regards,
> JS
>

"kenny" <ke***@discussions.microsoft.com> escribió en el mensaje news:35EB27F2-0D07-4EC0-8853-316EC813B7AA@microsoft.com...
|I have a String outputhex which consists of unicodetext translated into hex.
| example: test = 7400650073007400
|
| now i translate each two characters of the hexstring (outputhex) into byte
| and then into chars. but this is the point where something is wrong...
| (having the byteorder mark removed would also be very good)
|
| "Schließen" gets to "Schlie鿃攀渀" and so on...
|
|
|
| Here is the code:
|
|            Dim intIndex As Short
|            Dim j As Integer
|            Dim ch As Char
|
|            Dim file As System.IO.StreamWriter
|            file = My.Computer.FileSystem.OpenTextFileWriter("test.uni", True)
|
|            For intIndex = 1 To Len(outputhex) Step 2
|                j = CByte("&H" & Mid(outputhex, intIndex, 2))
|                ch = Convert.ToChar(j)
|                file.Write(ch)
|            Next
|
|            file.Close()
|
|
|
|
| Thanks for the help, its urgent

> Hello kenny,
>
> Your string seems to represent UTF-16 encoded characters, but you are converting somehow as if it was UTF-8.
> Your code should look like this:
>
>             Dim intIndex As Integer
>             Dim b() As Byte
>             Dim s As String
>             Dim file As System.IO.StreamWriter
>
>             ReDim b(Len(outputhex) \ 2)
>             For intIndex = 1 To Len(outputhex) Step 2
>                 b(intIndex \ 2) = Convert.ToByte(Mid(outputhex, intIndex, 2), 16)
>             Next
>             s = System.Text.Encoding.Unicode.GetString(b)
>
>             file = My.Computer.FileSystem.OpenTextFileWriter("test.uni", True)
>             file.Write(s)
>             file.Close()
>
> Regards.
>
>
> "kenny" <ke***@discussions.microsoft.com> escribió en el mensaje news:35EB27F2-0D07-4EC0-8853-316EC813B7AA@microsoft.com...
> |I have a String outputhex which consists of unicodetext translated into hex.
> | example: test = 7400650073007400
> |
> | now i translate each two characters of the hexstring (outputhex) into byte
> | and then into chars. but this is the point where something is wrong...
> | (having the byteorder mark removed would also be very good)
> |
> | "Schließen" gets to "Schlie鿃攀渀" and so on...
> |
> |
> |
> | Here is the code:
> |
> |            Dim intIndex As Short
> |            Dim j As Integer
> |            Dim ch As Char
> |
> |            Dim file As System.IO.StreamWriter
> |            file = My.Computer.FileSystem.OpenTextFileWriter("test.uni", True)
> |
> |            For intIndex = 1 To Len(outputhex) Step 2
> |                j = CByte("&H" & Mid(outputhex, intIndex, 2))
> |                ch = Convert.ToChar(j)
> |                file.Write(ch)
> |            Next
> |
> |            file.Close()
> |
> |
> |
> |
> | Thanks for the help, its urgent
>

"kenny" <ke***@discussions.microsoft.com> escribió en el mensaje news:0FBB0147-B4A0-49B7-BD95-37A2EA2551BA@microsoft.com...
| No, it is UTF-8...but there are also other characters...not only unicode. Is
| there a way to write them to a file independent from the encoding?? I tried
| BinaryWriter but it seems also to need an encoding specified to write
| correctly. I just want to write any data to a file....
|
| "José Manuel Agüero" schrieb:
|
| > Hello kenny,
| >
| > Your string seems to represent UTF-16 encoded characters, but you are converting somehow as if it was UTF-8.
| > Your code should look like this:
| >
| >             Dim intIndex As Integer
| >             Dim b() As Byte
| >             Dim s As String
| >             Dim file As System.IO.StreamWriter
| >
| >             ReDim b(Len(outputhex) \ 2)
| >             For intIndex = 1 To Len(outputhex) Step 2
| >                 b(intIndex \ 2) = Convert.ToByte(Mid(outputhex, intIndex, 2), 16)
| >             Next
| >             s = System.Text.Encoding.Unicode.GetString(b)
| >
| >             file = My.Computer.FileSystem.OpenTextFileWriter("test.uni", True)
| >             file.Write(s)
| >             file.Close()
| >
| > Regards.
| >
| >
| > "kenny" <ke***@discussions.microsoft.com> escribió en el mensaje news:35EB27F2-0D07-4EC0-8853-316EC813B7AA@microsoft.com...
| > |I have a String outputhex which consists of unicodetext translated into hex.
| > | example: test = 7400650073007400
| > |
| > | now i translate each two characters of the hexstring (outputhex) into byte
| > | and then into chars. but this is the point where something is wrong...
| > | (having the byteorder mark removed would also be very good)
| > |
| > | "Schließen" gets to "Schlie鿃攀渀" and so on...
| > |
| > |
| > |
| > | Here is the code:
| > |
| > |            Dim intIndex As Short
| > |            Dim j As Integer
| > |            Dim ch As Char
| > |
| > |            Dim file As System.IO.StreamWriter
| > |            file = My.Computer.FileSystem.OpenTextFileWriter("test.uni", True)
| > |
| > |            For intIndex = 1 To Len(outputhex) Step 2
| > |                j = CByte("&H" & Mid(outputhex, intIndex, 2))
| > |                ch = Convert.ToChar(j)
| > |                file.Write(ch)
| > |            Next
| > |
| > |            file.Close()
| > |
| > |
| > |
| > |
| > | Thanks for the help, its urgent

"José Manuel Agüero" wrote:

> It doesn't exist such thing as writing a file with independence from the encoding. A file holds binary data. How that data represents text characters or other things depends on the encoding you select.
> What exactly do you want to do? Write and read text in a file? Serialize objects? Write and read binary data?
>
> By the way, OpenTextFileWriter defaults to ASCII encoding. You may use OpenTextFileWriter("test.uni", True, System.Text.Encoding.Unicode) to be able to store all characters.
>
> Regards.
>
>
> "kenny" <ke***@discussions.microsoft.com> escribió en el mensaje news:0FBB0147-B4A0-49B7-BD95-37A2EA2551BA@microsoft.com...
> | No, it is UTF-8...but there are also other characters...not only unicode. Is
> | there a way to write them to a file independent from the encoding?? I tried
> | BinaryWriter but it seems also to need an encoding specified to write
> | correctly. I just want to write any data to a file....
> |
> | "José Manuel Agüero" schrieb:
> |
> | > Hello kenny,
> | >
> | > Your string seems to represent UTF-16 encoded characters, but you are converting somehow as if it was UTF-8.
> | > Your code should look like this:
> | >
> | >             Dim intIndex As Integer
> | >             Dim b() As Byte
> | >             Dim s As String
> | >             Dim file As System.IO.StreamWriter
> | >
> | >             ReDim b(Len(outputhex) \ 2)
> | >             For intIndex = 1 To Len(outputhex) Step 2
> | >                 b(intIndex \ 2) = Convert.ToByte(Mid(outputhex, intIndex, 2), 16)
> | >             Next
> | >             s = System.Text.Encoding.Unicode.GetString(b)
> | >
> | >             file = My.Computer.FileSystem.OpenTextFileWriter("test.uni", True)
> | >             file.Write(s)
> | >             file.Close()
> | >
> | > Regards.
> | >
> | >
> | > "kenny" <ke***@discussions.microsoft.com> escribió en el mensaje news:35EB27F2-0D07-4EC0-8853-316EC813B7AA@microsoft.com...
> | > |I have a String outputhex which consists of unicodetext translated into hex.
> | > | example: test = 7400650073007400
> | > |
> | > | now i translate each two characters of the hexstring (outputhex) into byte
> | > | and then into chars. but this is the point where something is wrong...
> | > | (having the byteorder mark removed would also be very good)
> | > |
> | > | "Schließen" gets to "Schlie鿃攀渀" and so on...
> | > |
> | > |
> | > |
> | > | Here is the code:
> | > |
> | > |            Dim intIndex As Short
> | > |            Dim j As Integer
> | > |            Dim ch As Char
> | > |
> | > |            Dim file As System.IO.StreamWriter
> | > |            file = My.Computer.FileSystem.OpenTextFileWriter("test.uni", True)
> | > |
> | > |            For intIndex = 1 To Len(outputhex) Step 2
> | > |                j = CByte("&H" & Mid(outputhex, intIndex, 2))
> | > |                ch = Convert.ToChar(j)
> | > |                file.Write(ch)
> | > |            Next
> | > |
> | > |            file.Close()
> | > |
> | > |
> | > |
> | > |
> | > | Thanks for the help, its urgent
>
>

> If I use unicode encoding then all characters are displayed correcty but
> there are too much null bytes between them.
> Example:
> normal: S c h l i e ß e n
>
> modified: S   c   h   l   i   e   ß   e   n
>
> "José Manuel Agüero" wrote:
>
>> It doesn't exist such thing as writing a file with independence from the encoding. A file holds binary data. How that data represents text characters or other things depends on the encoding you select.
>> What exactly do you want to do? Write and read text in a file? Serialize objects? Write and read binary data?
>>
>> By the way, OpenTextFileWriter defaults to ASCII encoding. You may use OpenTextFileWriter("test.uni", True, System.Text.Encoding.Unicode) to be able to store all characters.
>>
>> Regards.
>>
>>
>> "kenny" <ke***@discussions.microsoft.com> escribió en el mensaje news:0FBB0147-B4A0-49B7-BD95-37A2EA2551BA@microsoft.com...
>> | No, it is UTF-8...but there are also other characters...not only unicode. Is
>> | there a way to write them to a file independent from the encoding?? I tried
>> | BinaryWriter but it seems also to need an encoding specified to write
>> | correctly. I just want to write any data to a file....
>> |
>> | "José Manuel Agüero" schrieb:
>> |
>> | > Hello kenny,
>> | >
>> | > Your string seems to represent UTF-16 encoded characters, but you are converting somehow as if it was UTF-8.
>> | > Your code should look like this:
>> | >
>> | >             Dim intIndex As Integer
>> | >             Dim b() As Byte
>> | >             Dim s As String
>> | >             Dim file As System.IO.StreamWriter
>> | >
>> | >             ReDim b(Len(outputhex) \ 2)
>> | >             For intIndex = 1 To Len(outputhex) Step 2
>> | >                 b(intIndex \ 2) = Convert.ToByte(Mid(outputhex, intIndex, 2), 16)
>> | >             Next
>> | >             s = System.Text.Encoding.Unicode.GetString(b)
>> | >
>> | >             file = My.Computer.FileSystem.OpenTextFileWriter("test.uni", True)
>> | >             file.Write(s)
>> | >             file.Close()
>> | >
>> | > Regards.
>> | >
>> | >
>> | > "kenny" <ke***@discussions.microsoft.com> escribió en el mensaje news:35EB27F2-0D07-4EC0-8853-316EC813B7AA@microsoft.com...
>> | > |I have a String outputhex which consists of unicodetext translated into hex.
>> | > | example: test = 7400650073007400
>> | > |
>> | > | now i translate each two characters of the hexstring (outputhex) into byte
>> | > | and then into chars. but this is the point where something is wrong...
>> | > | (having the byteorder mark removed would also be very good)
>> | > |
>> | > | "Schließen" gets to "Schlie鿃攀渀" and so on...
>> | > |
>> | > |
>> | > |
>> | > | Here is the code:
>> | > |
>> | > |            Dim intIndex As Short
>> | > |            Dim j As Integer
>> | > |            Dim ch As Char
>> | > |
>> | > |            Dim file As System.IO.StreamWriter
>> | > |            file = My.Computer.FileSystem.OpenTextFileWriter("test.uni", True)
>> | > |
>> | > |            For intIndex = 1 To Len(outputhex) Step 2
>> | > |                j = CByte("&H" & Mid(outputhex, intIndex, 2))
>> | > |                ch = Convert.ToChar(j)
>> | > |                file.Write(ch)
>> | > |            Next
>> | > |
>> | > |            file.Close()
>> | > |
>> | > |
>> | > |
>> | > |
>> | > | Thanks for the help, its urgent
>>
>>

"Göran Andersson" wrote:

> Are you really sure that the bytes represent text that is encoded as
> UTF8? The example you show is clearly UTF16.

> Hmmm, yes...you are right! But i still don't know how to get dir of all these
> null bytes...
>
> "Göran Andersson" wrote:
>
>> Are you really sure that the bytes represent text that is encoded as
>> UTF8? The example you show is clearly UTF16.

"kenny" <ke***@discussions.microsoft.com> escribió en el mensaje news:EF77522D-4C18-4B8A-A1A9-FD44AE7A626F@microsoft.com...
| If I use unicode encoding then all characters are displayed correcty but
| there are too much null bytes between them.
| Example:
| normal: S c h l i e ß e n
|
| modified: S   c   h   l   i   e   ß   e   n
|
| "José Manuel Agüero" wrote:
|
| > It doesn't exist such thing as writing a file with independence from the encoding. A file holds binary data. How that data represents text characters or other things depends on the encoding you select.
| > What exactly do you want to do? Write and read text in a file? Serialize objects? Write and read binary data?
| >
| > By the way, OpenTextFileWriter defaults to ASCII encoding. You may use OpenTextFileWriter("test.uni", True, System.Text.Encoding.Unicode) to be able to store all characters.
| >
| > Regards.
| >
| >
| > "kenny" <ke***@discussions.microsoft.com> escribió en el mensaje news:0FBB0147-B4A0-49B7-BD95-37A2EA2551BA@microsoft.com...
| > | No, it is UTF-8...but there are also other characters...not only unicode. Is
| > | there a way to write them to a file independent from the encoding?? I tried
| > | BinaryWriter but it seems also to need an encoding specified to write
| > | correctly. I just want to write any data to a file....
| > |
| > | "José Manuel Agüero" schrieb:
| > |
| > | > Hello kenny,
| > | >
| > | > Your string seems to represent UTF-16 encoded characters, but you are converting somehow as if it was UTF-8.
| > | > Your code should look like this:
| > | >
| > | >             Dim intIndex As Integer
| > | >             Dim b() As Byte
| > | >             Dim s As String
| > | >             Dim file As System.IO.StreamWriter
| > | >
| > | >             ReDim b(Len(outputhex) \ 2)
| > | >             For intIndex = 1 To Len(outputhex) Step 2
| > | >                 b(intIndex \ 2) = Convert.ToByte(Mid(outputhex, intIndex, 2), 16)
| > | >             Next
| > | >             s = System.Text.Encoding.Unicode.GetString(b)
| > | >
| > | >             file = My.Computer.FileSystem.OpenTextFileWriter("test.uni", True)
| > | >             file.Write(s)
| > | >             file.Close()
| > | >
| > | > Regards.
| > | >
| > | >
| > | > "kenny" <ke***@discussions.microsoft.com> escribió en el mensaje news:35EB27F2-0D07-4EC0-8853-316EC813B7AA@microsoft.com...
| > | > |I have a String outputhex which consists of unicodetext translated into hex.
| > | > | example: test = 7400650073007400
| > | > |
| > | > | now i translate each two characters of the hexstring (outputhex) into byte
| > | > | and then into chars. but this is the point where something is wrong...
| > | > | (having the byteorder mark removed would also be very good)
| > | > |
| > | > | "Schließen" gets to "Schlie鿃攀渀" and so on...
| > | > |
| > | > |
| > | > |
| > | > | Here is the code:
| > | > |
| > | > |            Dim intIndex As Short
| > | > |            Dim j As Integer
| > | > |            Dim ch As Char
| > | > |
| > | > |            Dim file As System.IO.StreamWriter
| > | > |            file = My.Computer.FileSystem.OpenTextFileWriter("test.uni", True)
| > | > |
| > | > |            For intIndex = 1 To Len(outputhex) Step 2
| > | > |                j = CByte("&H" & Mid(outputhex, intIndex, 2))
| > | > |                ch = Convert.ToChar(j)
| > | > |                file.Write(ch)
| > | > |            Next
| > | > |
| > | > |            file.Close()
| > | > |
| > | > |
| > | > |
| > | > |
| > | > | Thanks for the help, its urgent
| >
| >