I have a problem where some data is being eliminated.



The problem is that the data contains signed numeric fields (the low-order
byte of a negative number uses the first 4 bits as a sign and the last 4
bits as the low-order digit. This produces byte values higher than X'7F'. To
be more specific these values are hexadecimal X'B0' through X'B9'. It
appears the program is eliminating any byte values greater than X'7F', thus
shortening the record.  I am using StreamReader and StreamWriter for the
I/O.



Is it a possibility that the data contained in the file is written in UTF-7
and the code needs to be adjusted to UTF-8???  Here is how I am opening the
input file:



    Public Function ReadInFile() As Integer
        Dim reader As StreamReader
        Dim output As String = String.Empty

        Try
            reader = File.OpenText(inFileName)
            output = String.Format("Input file {0} is opened successfully",
inFileName)
            Logger.Log(output)
            Dim line As String = reader.ReadLine()
            While Not line Is Nothing
                Dim record As CGIRecordIn = New CGIRecordIn(line)
                inRecords.Add(record)
                line = reader.ReadLine()
            End While

        Catch ex As Exception
            output = String.Format("Failed reading {0}", inFileName)
            Logger.Log(output)
        Finally
            reader.Close()

        End Try
        ReadInFile = inRecords.Count
        output = String.Format("Read {0} valid records from input file",
ReadInFile)
        Logger.Log(output)
    End Function

Here is how I am opening the output file:

    Public Sub WriteOutFile()
        Dim recordOut As CGIRecordOut
        Dim writer As StreamWriter
        Dim output As String
        Try
            writer = File.CreateText(outFileName)
            output = String.Format("Output file {0} is opened successfully
for writing", outFileName)
            Logger.Log(output)

            For Each recordOut In outRecords
                recordOut.Build()
                writer.WriteLine(recordOut.Rec)
            Next

        Catch ex As Exception
            output = String.Format("Failed writing to {0}", outFileName)
            Logger.Log(output)
        Finally
            writer.Close()
        End Try

        Logger.Log("Finished writing output file")
    End Sub

I am not too clear as to the parameter that is needed to tell VB.NET that
the file is being opened as UTF-8 and written in the same format.  Any help
would be greatly appreciated.

Thanks!

Might want to look into

' StreamReader(filename, encoding)
Dim reader As New StreamReader(inFilename, System.Text.Encoding.UTF8)

and

' StreamWriter(filename, append?, encoding)
Dim writer As New StreamWriter(outFilename, False,
System.Text.Encoding.UTF8)

That might do the trick.  I apologize for being too darn tired to test right
now...

Thanks, Mike C#.  Looks like it worked.  Thanks again for your help.

Show quoteHide quote

rewriting URL
appsetting in class doesn't work
RaiseEvent
SerlializationException
Please help, about primary key and dataset
xml file format
Speeding up array/file loading
Export function from VB.Net DLL
Dynamically iterating through log files
passing parameter to class from application