VS 2010 HTTPListener Of Large Memory Stream Vs File I/o
Feb 24, 2012
I have a user interface app that allows you to drag/drop in files - and it turns them into HttpListener request POST's to another EXECUTABLE that I have running - let's call it BACKEND1. BACKEND1 will be running on a SERVER when this gets ready for production use. Lots and lots of users running the UI - all dragging in files - all getting POST'ed to BACKEND1 - with the file included as a memory stream in the POST. BACKEND1 responds to the UI with a "sequential" file number assigned to the file centrally on the server.
On the SERVER is also running another EXECUTABLE - let's call it BACKEND2. It's job is to work with the DRAG'd in files. Both BACKEND1 and BACKEND2 sit on the same SERVER. At the moment I am writing the memory stream to DISK in BACKEND1 - and POSTing the FILENAME to BACKEND2 for it to work on. Would it be better to not write the file in BACKEND1 but instead include it in the POST to BACKEND2 - where it can be written to DISK? Is having LARGE HTTP REQUEST's a burden when sent between two EXECUTABLES on the same machine?
My primary goal is to have a really available BACKEND1 talking the the UI instances running out in the world. I'm concerned that doing the file i/o in BACKEND1 is "expensive" - and I don't care about the performance of BACKEND2 as much. just looking for opinions. I guess ultimately I'll have to bench mark this myself in a production environment to get a real answer.
View 1 Replies
ADVERTISEMENT
Sep 28, 2010
I have a user interface app that allows you to drag/drop in files - and it turns them into HttpListener request POST's to another EXECUTABLE that I have running - let's call it BACKEND1.BACKEND1 will be running on a SERVER when this gets ready for production use.Lots and lots of users running the UI - all dragging in files - all getting POST'ed to BACKEND1 - with the file included as a memory stream in the POST. BACKEND1 responds to the UI with a "sequential" file number assigned to the file centrally on the server.
On the SERVER is also running another EXECUTABLE - let's call it BACKEND2. It's job is to work with the DRAG'd in files.Both BACKEND1 and BACKEND2 sit on the same SERVER. At the moment I am writing the memory stream to DISK in BACKEND1 - and POSTing the FILENAME to BACKEND2 for it to work on.Would it be better to not write the file in BACKEND1 but instead include it in the POST to BACKEND2 - where it can be written to DISK?
Is having LARGE HTTP REQUEST's a burden when sent between two EXECUTABLES on the same machine?My primary goal is to have a really available BACKEND1 talking the the UI instances running out in the world. I'm concerned that doing the file i/o in BACKEND1 is "expensive" - and I don't care about the performance of BACKEND2 as much.
View 2 Replies
Dec 15, 2011
im trying to get a memory stream to a textbox, the memory stream is of a .txt or .ini file that is extracted from a archive to a memory stream.Heres what ive got so far:
vb
Dim MSData As New System.IO.MemoryStream() Dim Infile As String = ComboBox10.SelectedValue 'The input archive Dim passww As String = TextBox1.Text 'Archive password Using extr As New SevenZipExtractor(Infile, passww) extr.ExtractFile("02.ini", MSData) End Using Dim sr As StreamReader = New StreamReader(MSData) Dim textSsS As String = sr.ReadToEnd() ini02.Text = textSsS
The problem is that ini02.text stays blank?
View 2 Replies
Jun 22, 2011
I'm trying to upload a large file (over 50Mb) to my webserver but my app hangs when trying to close the stream. If the file uploaded is larger than 50Mb then the .Close() causes it to hang - no error message at all - however a file less than 50Mb succeeds.
What do you suggest to get around the fstream.Close() hanging my app?
Dim target As New Uri(uploadedFilePath)
Dim fRequest As System.Net.FtpWebRequest = System.Net.WebRequest.Create(target)
[code].....
View 2 Replies
Mar 29, 2011
is this possible to do in memory (so i can get rid of any disk IO)?:
If File.Exists("c:MyImage.png") Then
File.Delete("c:MyImage.png")
End If
[Code]....
This above code works great the first time then errors out on any successive attempts after that with the file being used by another process at the File.Delete line. The image is being generated for use as a mail attachment and i've only ever done it via a phyical file on the disk.
View 1 Replies
Jul 28, 2011
Ok I have written this little Class that accepts a tcpclient as part of its constructor.
[Code]...
View 1 Replies
Mar 3, 2009
i need to read a large file stream binary my code is Dim sr As New IO.FileStream(srcFile,
[Code]..
View 10 Replies
Jun 2, 2011
I have a filename(including it's path) in a string. Now i want to load this .csv file into memory stream. ex: Dim filename as string="C:UsersDesktopabc.csv"
View 2 Replies
May 31, 2011
I don't know whether it is simple or not because i am new to programming. my requirement is : In my vb.net winform application, the filenames of the files present in "D:Project" willbe displayed in DataGridView1 control. Now I want to load these files one after another into memory stream buffer and add the headers("ID","Name","Class") to the content in the file. Then I want to save these files in "C:" with "_de" as suufix to the filename i.e.,sample_de.csv.
View 1 Replies
Apr 25, 2011
I recently wrote a program that collects information from the network can displays it in a DGV for the user to see. I tested this on networks where I would end up with several thousand items brought back and all worked fine, very little memory increase and once the search had finished the memory usage went back to pretty much what it was before the search, so I assume I have no major memory leaks that I should be concerned about (I'm careful to always dispose of things and clear large variables where possible).
However, a new company has now started using my application and they have several hundred thousand items that my program will find. They reported that they leave the program running its search for a few hours and most of the time it crashes with an Out Of Memory exception. Now I did have my app do some caching of certain information to avoid querying the network more than was necessary so I thought well maybe this is what is causing it but I added an option to turn that off and they say it still happens. So the only thing I can see it being is simply the amount of data that the program is finding and having to store in memory.once my application has gathered information about the items it stores them in a List(Of MyItemClass) and then when the search is complete the items are added to the DGV. So I'm thinking maybe its just the size of this List(Of MyItemClass) that is simply getting too large. Bear in mind that each instance of MyItemClass in this List can have quite a lot of information in it as it has several properties that are List(Of String) that may contain a few thousand strings in some scenarios.How do you deal with such large amounts of data without running out of memory?I'm assuming the only option I have got is to 'page' some of the data to a temporary file on disk once I get over a certain number of items in the List(Of MyItemClass)?
View 2 Replies
Sep 26, 2011
How to convert memorystream byte array to csv file. I have GetExport method that converts rpt file to excelformatted memorystream and then returns that as a byte array. Is there a way to convert this byte array to a csv file? Due to some reasons I can only pass this byte array back to calling function.
Public Function GetExport(ByVal reportID As ReportID) As Byte()
Dim byteArray As Byte() = Nothing
Using expRptDoc As ReportDocument = New ReportDocument()
Dim rptFileName As String = Server.MapPath(ReportCommand.GetXMLReportPath(reportID))
expRptDoc.Load(rptFileName)
[Code] .....
View 1 Replies
Feb 6, 2012
How do you pass a wav file to a mediaplayer via a memory stream? In other words is it possible to pass a stream instead of a url to play a wav file?
View 9 Replies
Jun 1, 2011
I am working on vb.net win form. My task is display the file names from a folder onto gridview control. when user clicks process button in my UI, all the file names present in gridview, the corresponding file has to be loaded onto memory stream buffer one after another and append the titles to the content of the file and save it in hard drive with _ed as a suffix to the file name.I am very basic programmer. I have done the following attempt and succeeded in displaying filenames onto gridview. But no idea of later part.
'Displaying files from a folder onto a gridview
Dim inqueuePath As String = "C:UsersDesktopINQUEUE"
Dim fileInfo() As String
[code]......
View 2 Replies
Nov 25, 2011
I have a function that accepts a string and generates an email attachment based on that string. It works fine for html pages, text documents, and so forth but I can not get it to generate a PDF file.
Code:
Public Sub SendMail _
( _
ByVal strFrom As String _
[code]......
If I save the file attachment as Whatever.PDF i get the error that it was not encoded properly.I am using datadynamics active reports PDF exporter to generate the PDF
dim pdf as new datadynamics.activereports.export.pdf.pdfexport
sendmail("from@", "to@", "test", "test", pdf.tostring, "pdf.pdf")
I think the problem is I am converting the PDF to a string, and then trying to convert it back to a PDF and attach it to the email but I am not 100% sure.
View 1 Replies
Jun 5, 2012
I am using iTextSharp with VB.Net to stamp images onto PDF documents. (Since this is not language specific I tagged for C#, too.)I have two applications using the process.The first uses the bytes from the memorystream to display the PDF documents online. This piece is working. The second uses the same function but instead saves the PDF to a file. This piece generates an invalid PDF.
I have seen some similar questions, but they are all creating a document initially and have a document object in the code. Their memory streams are corrupt from the outset. My code does not have a document object and my original memory stream opens fine.
Here is the place where I get the error: (I have to put the buffer from m into a new memory stream because the stamper in the fillPDF function defaults to closing the stream unless marked otherwise.)
Dim m As MemoryStream = PDFHelper.fillPDF(filename, Nothing, markers, "")
Dim m2 As New MemoryStream(m.GetBuffer, 0, m.GetBuffer.Length)
Dim f As FileStream = New FileStream("C: emp.pdf", FileMode.Create)
[code]...
View 2 Replies
Nov 22, 2011
I have a problem with the cryptostream, if i write the stream to a memorystream the memory that the stream used is still alocated and i have no way of unalocating it.what am i missingdoing wrong? im using-using on the streams,readers and crypto stuffs so the framework should shut them all down right? i tryed calling .close and .dispose but nothing ,in fact i moved it all over I have provided the sub that im using for the encrytion im in .net 4.5 so there is a lil async stuff but i know thats not the problem coz i moved this code out of my main app(.net 4) for testing to see if i could fix the problem.[code...]
View 12 Replies
Apr 17, 2009
'in form class
Dim PIC_PATH As String
Dim PICTURE As Image
[code].....
View 6 Replies
Dec 5, 2006
I'm using the ShockwaveFlash ActiveX control in a VB.NET Windows Forms application and i'm wondering.Is it possible to load an SWF file into the ShockwaveFlash ActiveX object from a memory stream rather then from a file name?
I've noticed that the ActiveX object has such properties as "InlineData" and "MovieData", possibly these could be used.
I've also noticed someone has used Windows Messaging to send a pointer to a stream to the ActiveX control, has anyone seen this done?
View 1 Replies
May 5, 2010
I have an application that sends Bytes of data through UDP, these bytes are read from an AVI file when the client receives the bytes it builds the AVI file on another computer perfectly but I want to be able to use the received bytes to play the video from the stream. Does anyone know how I can play the video from a stream? I tried using DirectShow but I don't know how to use a stream as video let alone having AVI files play with DirectShow.
My main goal is to have the application slowly "buffer" the movie for the client as they watch.
View 5 Replies
Jul 11, 2011
I have a module which will be responsible for parsing CSV data received from different user via a website interface, and I have to parse that CSV. I was considering to use, TextFieldParser for it.
But before I could implement I was considering what shall be a better approach...
Generating MemoryStream from data received,
or initialising a StringReader from the same input string.
View 1 Replies
Aug 25, 2010
how to convert byte array to memory stream in vb.net.
View 1 Replies
Jun 10, 2010
in VB.NET How can i write a memory stream to browser.My memory stream object has data to build a PDF file.Now i want it to be rendered on browser.How to do that ?
View 1 Replies
Apr 4, 2010
I'm writing some text to a memory stream and need to modify it once in the memory stream The reason I can't modify prior to adding to the memory stream is that it is from some 3rd party component. Here is an example:ms = New MemoryStreamdoc.Save(ms, SaveFormat.Html)I need to do some modification to the resulting text that ends up in ms. Is there a way to convert the contents of ms into a string, and then back into a memory stream once modified?
View 13 Replies
May 5, 2011
Im making a desktop player for a online web radio, and for the program I wanna make it show all the stream info. Like the stream name, and such. However I dont know how to do this? I looked everywhere
The server url is setup like this "[URL]" And it has all the stream info and that there. So is there a way I can get the info from there onto like say a label? Live updates btw.
View 1 Replies
Jun 22, 2010
Ok so i have an jpg image of around 8.10mbs at around 13424 x 11344 pixels, i need to load the whole image in to a scrolling picturebox, is they anyway to do this without using so much memory for example like what google maps does n cuts the image down and some how stitches it all back to gether?
View 1 Replies
Jun 17, 2012
I have a problem with a memory leak in a very large ASP.NET application. After about 24 hours of usage (sometimes a lot more) an OutOfMemory exception is thrown. Therefore I am trying to understand how managed memory works in .NET. When does an ASP.NET application throw an OutOfMemory exception? The server has a lot of RAM and there is always plenty of memory left when an OutOfMemory exception is thrown. I understand the difference between virtual memory and physical memory. How much memory does the W3WP process have to consume before an OutOfMemory exception is thrown? Is there a setting somewhere e.g. in the Machine.Config file? The ASP.NET process is never recycled.
View 2 Replies
Feb 12, 2010
I need to improve memory performance on my application and I could see that I have problems with memory fragmentation.I've read an interesting article on large objects from Andrew Hunter of Red Gate, and one of the solutions he recommends isow do I implement his suggestion in my code?My program has a very complex form (with an object that leaves residual memory every time it opens. I found a complex list that may be the culprit, and I'd like to implement his suggestion to see if it fixes the issue.
View 1 Replies
Dec 31, 2008
I'm loading an image, then getting size and such info from it, and loading the image into a picture box. Now it works and all, but I noticed it uses a large amount of memory. I'm doing: img = Image.FromFile(file)Where I load the image, 'file' being just a string containing path to an image on the hd. After that, I get the size and frame count (if any), and load it into a picture box: The image I've been testing with, is a 6600x5100 3.5MB JPEG, which can be downloaded from url...Watching task manager, when the app loads the image, it takes up about 104MB of memory. I've tried doing img.Dispose after the above line, but it brings up an error. If I put a button on the form with img.Dispose in it, and click it after app has loaded, it drops down to about 6MB of memory used. Loading the image directly into the picture box using .Load or .LoadAsync, after disposing img beforehand, still ends up with a huge amount of memory used.
So I'm wondering if theres a way to check if the picture box has fully loaded the img, so then I can Dispose the img and free up the memory. Or maybe a better way all together of loading an image into a picture box, and/or getting size & frame count, without having to use up that amount of memory before freeing.
View 2 Replies
Feb 18, 2010
I am retrieving a large BLOB and keep getting an Out Of Memory Exception. It occurs when I use a SqlDataReader to either check if the column is NULL, or if I try to read it and assign it to a Byte type of parameter, or if I use Response.BinaryWrite.
View 2 Replies
Aug 8, 2009
In vb2005 how do you simulate a web browser's file download using Net.HttpListener?This current program functions somewhat like a webserver. how when a client from a web browser
asks for a file do i allow them to down load the file? currently the method will tell the browser that there is a file but it will fail after the client oks the file for download.
View 1 Replies
