C# - Text Encoding (In .Net)
May 3, 2011
I have done very little with encoding of Text. Truthfully, I don't really even know what it means exactly.
For example, if I have something like:
CODE:
Is that 'encoded' in memory in a particular format? Does that format depend on what language I'm using?
If I were in another country, like China, for example, and I had a string of Chinese (mandarin? My apologies if I'm using the wrong words here) would the following code (that I've used fine on English strings) still work the same?
CODE:
Or would it lose all meaning when you convert that .Net string to a UTF8Encoding when that conversion isn't valid?
Finally, I've worked with .Net for a few years now and I've never seen, heard, or had to do anything with Encoding. Am I the exception, or is it not a common thing to do?
View 3 Replies
ADVERTISEMENT
Oct 28, 2009
I am sending a DDE message to a client using System.Text.Encoding.ASCII.GetBytes(item) . However, before the message is actually sent, I would like to get the message coded where if the item="Ask" then item=Ask (string variable) and so on. The code is:
Protected Overrides Function OnRequest(ByVal conversation As DdeConversation, ByVal item As String, ByVal format As Integer) As RequestResult
' Return data to the client only if the format is CF_TEXT
[code]....
View 3 Replies
Aug 21, 2009
I am writing an application that must generate a plain Text file with fixed sized columns.my current code is:
Dim MyFilePath As String = Path & FILE_PREFIX & FileNr & ".TXT"
IO.File.Delete(MyFilePath)
Dim FileStr As New IO.StreamWriter(MyFilePath, False, <ENCODER HERE>)
[code].....
View 3 Replies
Mar 8, 2010
I have an ASP.Net app that allows a user to write text into a Telerik RadEditor control and then send an email.For some reason I'm sometimes getting strange characters showing up in the email that is generated.se if I use the later, the text would show up just fine. If I pull up the saved record within the ASP.Net apps interface it looks just fine. It also appears just fine when I view the text within the recorded of the MS SQL table it was stored in. Continued--->I have tried to add it to the constructor of my email class with/without mybase but that had no effect.
Public Sub New(ByVal EmailDate As DateTime, ByVal LogoPath As String)
MyBase.New()
MyBase.BodyEncoding = Encoding.GetEncoding("iso-8859-1")
[code].....
View 2 Replies
Apr 23, 2012
I am creating xml files that contain chinese posts and it seemed to be working but I started getting an error:
This page contains the following errors:
error on line 4165 at column 25: Input is not proper UTF-8, indicate encoding ! Bytes: 0x0B 0xC3 0xA5 0xC2 Below is a rendering of the page up to the first error.
When trying to open some of the resulting files.The line it references contains chinese characters and this occurs only in some situations and my guess is that the text is sometimes containing some characters that throw it off. How can I ensure that the text for that field will always be properly encoded? I don't even understand why the issue yet.
Public Shared xwriter As XmlTextWriter = New XmlTextWriter(xmlfile, Encoding.UTF8)
I make sure the xmltextwriter is properly declared.
EDIT:
The issue is that I use vb.net and apparantly it encodes everything in utf-16 so I assume this is fine. The problem is that the text I am receiving is probably double encoded or incorrectly encoded and I need to clean it before using it; so that my xml is valid.
EDIT:
so if I need to fix my data, my question is how can I detect what encoding is used for a specific text and how do I convert into utf8 format that can be viewed in an xml file and make the file valid.
View 1 Replies
Nov 1, 2010
I can't use System.Text.Encoding, I get this error when trying to use it:
A first chance exception of type 'System.NullReferenceException' occurred in WindowsApplication3.exe
A first chance exception of type 'System.Reflection.TargetInvocationException' occurred in mscorlib.dll
this is the
Private _TextEncoding As System.Text.Encoding
Private Sub Form1_Load(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles MyBase.Load
Dim _DownloadedBytes() As Byte = _TextEncoding.GetBytes("teststste")
[code]....
and then it exit function.
View 1 Replies
Mar 7, 2011
I used WriteAllText to set the encoding for a text file. When I wrote it, everything worked out fine. However, strange characters or symbols appeared in some ofm y fields without my having typed it. why is this so? The encoding I'm using is UTF8. I used the WriteAllText to write the fields to file but did not use the ReadAllText to bring the data back into the fields or program.
View 2 Replies
Jun 12, 2010
I recently worked on a small-scale EPP Client, which is a communications protocol over TCP/IP using XML packets to exchange commands and responses. The server I'm working with specifically is employing SSL so the code contains references to an SSLStream certificates and passphrases - please don't ask me to post more code than I provide here.We're building the XML EPP Commands in raw System.Strings, then using System.Text.Encoding.UTF8.GetBytes on the string to populate a Byte Array, then writing the Byte Array into the SSLStream. The server would communicate, negotiate certificates, and
View 10 Replies
Apr 1, 2011
I have a VB2010 project where I need to read a tab delimited 50MB file using Microsoft.VisualBasic.FileIO.TextFieldParser. This technique works fine until the reader encounters a Unicode character upon which it inserts the little square thingy. The obvious choice is to change the encoding of the reader to Unicode from the default. This would probably work fine but for most files but this one is fairly large and I get the error TextFieldParser is unable to complete the read operation because maximum buffer size has been exceeded. By the way this file can be read completely without the Unicode option. Making the file smaller or breaking it up really isn't an option. Is is possible to increase the buffer size or is there another way to read this data that places the data in fields like the textparser and allows unicode characters?
View 9 Replies
Apr 30, 2012
I have a problem with combobox. I set the DrawMode into OwnerDrawVariable so I can draw items seperately with styles, but the characters of the items are now displaying blocks. The block characters are none ASCII. It used to display well but not now and I don't know what caused it to happen. I didn't change my system locale. At the same time, other combobox that have Normal DrawMode displays nicely fine.
My custom drawing code:
e.Graphics.DrawString(combo.Items(e.Index), combo.Font, b2, rect.X, rect.Y)
View 6 Replies
Jun 21, 2010
i would like to ask is there anyway to read a txt file with UTF-8 encoding using streamreader or filestream. the txt file is contain some extended ASCII that makes me cannot read the characters properly. I hav tried Encoding.ASCII.GetString(Encoding.UTF8.GetBytes()) but still it return wrong character when it's reading extended ASCII code.
View 2 Replies
Nov 4, 2009
I would like to pass a whitespace character by using the System.Text.Encoding.ASCII.GetBytes(" "), and System.Text.Encoding.Unicode.GetBytes(" ") , where " " is the whitespace Character required. What do I need to type (" ") to get a whitespace character passed.?
View 6 Replies
Mar 11, 2010
url...we get the encoded as alphapet base64..i want to talk as low level programming what will happen or this data how it will represent as binary and send it is it encoded again as ascii to binary or there is another idea.
View 12 Replies
Jun 4, 2010
this is a continuation from the root cause of the problem exposed in this other thread. I'm starting a new thread with a different topic name because I think it is not related to the other thread's topic (which was encryptioto enumerate them.Anyway, we found out that some characters become changed from what their original byte value was, when you put them into a textbox.The specific characters are as follows:Unicode char
View 5 Replies
Feb 18, 2010
I'm using this code to convert string to ISO8859-1
[code..]
But the problem is when an user writes this caracter:
EXAMPLE:
[code...]
I think that my code is wrong. Because if I send the same string encoded "price+80%2BVAT", Why in VB.NET code not runs and in PHP runs fine? Is the same encoded string.
View 2 Replies
Mar 26, 2011
i got a problem when receiving data from networkstream that was converted from bytes to string.. the output would be the same but when i compare the the string generated from Encoding.ASCII.GetString() compared to the actual string, the output is not the same..
This is my code..
Server:
CODE:
Client:
CODE:
just for ping purposes.. :)
my server pings to client..is there any instance that when the string will be converted to bytes, the string will change?
View 2 Replies
Apr 27, 2012
I have a simple question about string. Consider following code:
Dim S1 as String = "abc"
What is the encoding for S1? Is that UTF-8 or depending on user windows local setting?
View 2 Replies
Apr 20, 2012
I am writing a little project to parse a CSS file, and base64 encode all the background images.While I am able to parse the CSS correctly, it seems that everytime I try to convert the image file into a base64Encoded string, the string returned is always exactly the same.Please assume that all image paths are passing correctly to the method. In this instance, all images are fully qualified urls, so the first section of the method is what is doing the conversion.[code]
View 2 Replies
Sep 10, 2009
i have a task to create ,read,update xml file this file have encoding UTF-16. when i create using vb.net ,i am using xmltextwriter. i cannot find encoding UTF-16. it is only have UTF8,UTF7,UTF32. that's don't have UTF16.that's anyone have clue or link to guide me create,read,update file xml with encoding UTF-16??
Imports System.Xml
Public Class Form1
Private Sub Button1_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Button1.Click
Dim writer As New XmlTextWriter("product.xml", System.Text.Encoding.UTF8)
writer.WriteStartDocument(True)
[Code]...
View 2 Replies
Sep 6, 2011
I would like to know the way a stream or a string is encoded before converting it. If a string is not utf-8 it would be converted to utf-8.
View 1 Replies
Mar 20, 2012
We know a tolower function will turn all A to a How to turn all à to a.The purpose is I am creating ids for databases and id need to be unique. Sometimes the same stores are written as à in one place and as a on other places. This will create duplicate id problem.So I need a function that will turn all à and all of it's variation into a. The same way ě should become e.
Basically I would use utf8_unicode collation on my databases. Letters that count as the same letter under that collation should map to the same character under this function.I need to make sure that all other east asian characers are not affected in anyway.
View 1 Replies
Jun 15, 2011
I have a challange to convert the detected Encoding format of Text file to selected Encoding format. Like if the detected file is in Utf-8 and if user want to convert the encoding to Utf-16 or ANCII or Unicode. It will happen on one button click and the file will convert to the desired output encoding format.
Right Now I am able to detect the encoding but conversion not happening.
View 7 Replies
Jun 2, 2009
I have an application that collects a signature on a handheld device, saves the data as a byte array and transmits it to the pc. This came originally from a sample from MS. The sample works fine.In my case I am sending this signature back to the pc where it is received by a VB6 application and stuffed into a database and then there is a dot net program that can or should be able to pull that data and reproduce the image.
Due to certian characters that may appear in the data such as ' " Null and such I run a little replacement routine on the data before I save it on the device and run the reverse before I try to rebuild the image. This also seems to be working.
Now if I save the data as a file on the device and load that file into my viewer the sig shows up just fine. It works with both the file that has had the replacements done as well as the one which has not. However when I transfer the data via my vb 6 application the sig is then distorted when viewed.
I have written the data to file as it comes into the pc and again after it has been parsed and in both cases it does not match what was actually in the file on the device that is being sent and I can not for the life of me figure out what is going on here.
Code:
sBytes = Encoding.Default.GetBytes(DataString)
bSent = wSocket.Send(sBytes)
Code:
Winsock1(Index).GetData strData, vbString
When I compare the file created on the handheld device with the one created ont he pc from the data received it gets odd. In text mode both files look alike even with the terminal font enabled but in binary mode they are different.The first noticable difference in Hex View is a ways into the first line the file from the handheld device has C3 A0 but the file written on the pc has E0 instead from there on all bytes are shifted by 1 yet when I look at it in text view no bytes are shifted and the character displayed where C3 A0 is in one and E0 in the other is the same accented a character.
View 5 Replies
Jun 16, 2010
I have a byte array that I'm encoding to a string:[code]Then I write that to a file via IO.File.AppendAllText.If I open that file in 010 Editor (to view the binary data) it displays as this:47 43 44 53 79 73 74 65 6D 73 3F 0A 01 32 31 36..The original byte array contained 89 at position 11, and the encoded string contains 3F.If I change my encoding to Encoding.Default.GetString, it gives me:47 43 44 53 79 73 74 65 6D 73 E2 80 B0 0A 01 32 31 36.
View 1 Replies
Dec 25, 2010
What I have is a program that is receiving an image from my webcam 4 times each second.. What I am currently doing is just forwarding that image to a picturebox on my main form.. I do not keep the image in memory so as not to clog it up.. When you look at it seems like a video feed. Now what I want to do is to take that image every time it comes.. and put it into a video file, so as to record everything that is being seen by the camera.. Is there any way to encode a video preferably avi or mp4 video..
View 2 Replies
Dec 9, 2010
I have a pretty stupid problem I've done a simple string encoding function but I'm having some trouble to decode it again
Encoding Function
Private Sub Encrypt(ByVal EncString As String, ByVal blnStatus As Boolean)
If blnStatus = True Then
[code]......
View 4 Replies
Sep 2, 2011
I'm using this code, in a thread, to get the output from a process being executed (an external compiler in this case):
Private Sub Readoutput()
Dim OutputBuf(4096) As Byte
Dim state As Object = Nothing, result As System.IAsyncResult, l As Integer
[code]....
View 5 Replies
Jan 6, 2011
I`m working on some XML Https shit things and since i`m getting some Cyrillic characters i need to change the encoding of the HttpWebResponse since i`m only getting "?" i try this:
Dim objResponse As HttpWebResponse = DirectCast(objRequest.GetResponse(), HttpWebResponse)
Try
SR = New StreamReader(objResponse.GetResponseStream())
[code].....
View 1 Replies
Dec 2, 2011
It doesn't appear that the strings are being encoded.
Issue: Dim encodedStr As String = HttpUtility.HtmlEncode("<p>This is a test</p>")
The output produces:<p>This is a test</p>
Expected result:<p>This is a test</p>
View 1 Replies
Jan 16, 2010
I query a Quake3 masterserver via UDP, and get the response as below.As you can see, I had trouble figuring out the encoding of what the server sent...Is there any way to detect or set the receive encoding ?
baBuffer = new byte[1024*100]; // 100 kb should be enough
int recv = sctServerConnection.ReceiveFrom(baBuffer, ref tmpRemote);
Console.WriteLine("Message received from {0}:", tmpRemote.ToString());
[code].....
View 3 Replies
