Transferring Audio Streaming Files With Sockets

I am developing a server-client voice streaming chat application with vb.net, i am recording wav files by a microphone and using .net.Sockets to transfer the files from a client to the server.

The runtime from the client follows as :
Public Sub sendFile(ByVal file As IO.FileInfo)
Dim BufferSize As Integer = 1024
Dim fs As FileStream = New FileStream(file.FullName, FileMode.Open, FileAccess.Read)
Dim NoOfPackets As Integer = Convert.ToInt32(Math.Ceiling(Convert.ToDouble(fs.Length) / Convert.ToDouble(BufferSize)))
[Code] ......

The problem that I am having is that the wav file that arrives to the server sounds really bad like interrupting each half-second. Another strange thing is that if the originally file es 46KB big the one that receives the server is 47KB. How I will manage to build a voice chat with good quality using this technology. How I can start sending streaming audio meanwhile une user is speaking.