Saving And Loading Large Amounts Of Data?
Sep 5, 2009Is it possible to create a kinda virtual storage in a vb application so that data created during run time are stored right in the applicaion instead of its environment?
View 11 Replies
ADVERTISEMENT
VS 2010 : Working With Large Amounts Of Data Without Getting Out Of Memory?
Apr 25, 2011I recently wrote a program that collects information from the network can displays it in a DGV for the user to see. I tested this on networks where I would end up with several thousand items brought back and all worked fine, very little memory increase and once the search had finished the memory usage went back to pretty much what it was before the search, so I assume I have no major memory leaks that I should be concerned about (I'm careful to always dispose of things and clear large variables where possible).
However, a new company has now started using my application and they have several hundred thousand items that my program will find. They reported that they leave the program running its search for a few hours and most of the time it crashes with an Out Of Memory exception. Now I did have my app do some caching of certain information to avoid querying the network more than was necessary so I thought well maybe this is what is causing it but I added an option to turn that off and they say it still happens. So the only thing I can see it being is simply the amount of data that the program is finding and having to store in memory.once my application has gathered information about the items it stores them in a List(Of MyItemClass) and then when the search is complete the items are added to the DGV. So I'm thinking maybe its just the size of this List(Of MyItemClass) that is simply getting too large. Bear in mind that each instance of MyItemClass in this List can have quite a lot of information in it as it has several properties that are List(Of String) that may contain a few thousand strings in some scenarios.How do you deal with such large amounts of data without running out of memory?I'm assuming the only option I have got is to 'page' some of the data to a temporary file on disk once I get over a certain number of items in the List(Of MyItemClass)?
Send Large Amounts Of Text With TCP?
Nov 11, 2011How to send large amounts of text with TCP.[code]...
View 6 RepliesHow To Display/store Large Amounts Of Text?
Nov 11, 2009What I want to do is display large amounts of text and a few pictures, ideally with hyperlinks between the pages. A lot like wikipedia really, lots of similarly arranged pages, text in categories with in-line hyperlinks and the occasional picture to illustrate a point.But not online, integrated as part of a larger app.
How would it be best to go about doing that? The display method is sortof dictated by the storage method. My thoughts were:
Lots and lots of labels stored in an Access database
Straight HTML as if it were a webpage embedded in an iFrame or something
Labels populated from XML files?
Program the whole lot in Flash or something else (A language I can't speak)
This is only a mockup for demonstration purposes so the priority is user-friendlyness and ease of programming rather than storage concerns or good programming form.
VS 2008 : Submitting Large Text Amounts With .net?
Oct 11, 2010if I want to submit a large amount of text to my asp web page, do I need to worry about the text itself such as containing "&a=" that would mean another variable is being assigned for submitting data? Any way of not worrying about this? Or do I need to replace the & symbol everywhere in the test first if used?
View 1 RepliesInstantly Render Large Amounts Of Multi-colored Text?
Dec 18, 2009I need to constantly display large amounts of colored text in WPF or Silverlight, and I need the user to percieve it as showing up instantly.
Currently I'm doing this using a canvas and textblocks, one textblock per 80-character line, with multiple runs to a textblock to handle the different colors. There can often be 20+ runs to a line.
In a 45x80 grid of text, this gets a framerate of about 12 in Silverlight, which is sluggish. Oddly enough, it's even slower in WPF... I can only speculate that this has something to do with my dev machine's lousy video card. Maybe it's trying to hardware accelerate and actually slowing down because of it?
Stack Overflows - Filesystemwatcher Unreliable With Large Amounts Of Processing?
Apr 19, 2010I created a program that watches about 10 folders for different excel files. Using the filesystemwatcher with filters in place and correct error handling, it still misses some files once in a while (that's ok I guess).Anyways, I'm writing this because I added another form that has a filesystem watcher, when I tried to load the form I got a stack overflow error - an error that isn't debugged (a greenish line that you can only stop debugging).Am I going about this a wrong way? Is filesystemwatcher unreliable with large amounts of processing?
View 1 RepliesGetting A Binary Search To Work (warning:large Amounts Of Text/code)?
Dec 25, 2009Couldn't think of a better title.(Background on the problem/me)Okay, so, first question/post here, so hi. Now that that's done with, the information pertinent to my problem. I'm fairly new to VB (and programming as well, aside from screwing around with C++ and learning assembler(well, attempting is the better word) god knows how many years ago), and have only seriously been programming for about under half a year, and my skill level is about at that stage. Only been using VB.Net, nothing older. Depending on the time of day and if I'm home or at school, I fluxuate between VB express and Vis Studio 08. Umm, this program I'm having trouble with was on a test that I took yesterday (took the problem home with me cause I really wanted to figure out what was wrong with it).
The stipulations of the test were:
No For->Each Loops
No using Built-In Sorting or Searching Functions
[code].....
Saving And Loading Data Structure Items
Jun 20, 2012I am quite new to VB.NET and I am attempting to create a console application that can write, save, load and edit sets of data. Lets say I have something like this:
[Code]...
However, I have no idea how to load the data so I can manipulate it in the EMPLOYEE structure system. I am not sure if I have made my question clear enough, for as you can see I'm quite new to programming and am not essentially familiar with the terms of speech.
[2005] Saving And Loading Data: IOException?
Jan 18, 2009I keep getting an IOException, because the file is apparently already in use. I'm pretty sure I closed every handle, and I don't know what to do.
High-Score
If haswon Then
Dim strFormat As New StringFormat()
[code]....
.net - Loading And Saving Data In WPF Using The MVVM Pattern And DataGrids
Jan 4, 2011How do i fill my ObservableCollection(of Monitors) with data so that I can save it in an MVVM friendly manner. I normally use a FileNumber to load a DataSet using a DataAdapter and pass the monitors table via monitorDT - should I be loading it differently? How do I save the changes? Right now I have the following for loading data:
[Code]...
.net - Loading And Saving Data In WPF Using The MVVM Pattern And DataGrids?
Jan 13, 2011How do i fill my ObservableCollection(of Monitors) with data so that I can save it in an MVVM friendly manner. I normally use a FileNumber to load a DataSet using a DataAdapter and pass the monitors table via monitorDT - should I be loading it differently? How do I save the changes?Right now I have the following for loading data:
Public Class Monitors
Inherits ObservableCollection(Of Monitor)
Public Shared Function LoadMonitors(ByVal monitorDT As DataTable) As Monitors
[code]....
DataGridView - Loading And Saving Data In Text File
Aug 22, 20101) How can I load data from Text file to DatagridView. I want it because I'm making a listener. And when I load a data from text file, i want to edit rows. And this calling the second question.
2) How can I save data, Datagrid to Text file.
I found a code
Dim obj_oledb_da As System.Data.Odbc.OdbcDataAdapter
Public Function ConnectCSV1(ByVal filetable As String) As DataSet
Dim dataSet As New DataSet
[Code] .....
I can load data with this code but I can't save.
My Text File must be like this:
#IP
127.0.0.1 localhost
VS 2010 Loading Then Saving Xml From Bound Data Source?
Oct 27, 2009no beating around the bush, here's the code.
Private Sub Button1_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Button1.Click
Dim myXMLFile As String = Application.StartupPath & "creditors.xml"
[code].....
Loop To Stop After First Data Loading And Continue On To Second Data Loading After When Button Is Pressed
Jun 2, 2011an application i developed using vb 2008 express, to fill a web form with data from an access database, one after another when a button is clicked hasn't given me what i expected. the loop was suposed to stop after filling web form with the first data on clicking a button and continue to fill the webform with the next(2nd) data from the database on clicking the button again. Below is the code i wrote
Private
Sub STARTButton_Click(ByVal
sender As System.Object,
ByVal e
[Code]....
VS 2008 Loading Large Table In Listbox?
Sep 1, 2011ive a dictionary database with table having 32000 entries... ive bound it to the listbox(using binding source and dataset)... but when the program starts it hangs for 1-2 minutes in the beginning..
View 4 RepliesParsing/Loading A Large File With Unique Characters?
Feb 17, 2012I am attempting to make an application that can load in a large file that has some unique characters in it. A majority of the file is plain text, and ultimately I need to replace specified values with other values.The file is an InstallShield .ILG file - I am trying to have a small executable modify the "Feature" GUID entered in the file so that future installations/upgrades identify the new type of features it has. It's a fix for some software issues that would really expedite the solve without having someone un-install and re-install the package each time.
The problem is regardless of the methods I've tried to load the file, it doesn't bring over the data. It's a unique file that I do not want to modify/parse any data in other then those specific fields. Anytime I attempt to convert it to string I just get a few characters that are blocks. I've attempted all types of loading methods within VB but it continues to fail.
I've gotten this utility to modify everything from the config files to the proper DLLs it needs to load and the registry it needs to change. But it's this one piece that regardless of my attempts I can't find a way to load and modify the ILG file.
VS 2010 Loading Extremely Large(dimension) Images?
Feb 8, 2012I'm trying to load this image file on a PictureBox but I get an "OutOfMemoryException was unhandled" error.
How do I allocate more memory for this? Or maybe use another container? My project's main feature is loading maps, unfortunately my boss wants to load the whole map and won't accept sliced version of the map.
Main Form Allow User To Enter And Store Monthly Amounts In An Appropriate Data Structure
Jan 28, 2012The company require an application that displays coffee usage information for the managers of CostaB Coffee. Sample data has been provided for last years (2011) monthly usage amounts in kilos and is as follows: 400.5, 450, 475.5, 336.5, 457, 325, 220.5, 276, 300, 320.5, 400.5 and 415.
Requirements: The main form will allow the user to enter and store monthly amounts in an appropriate data structure. It will enable the users to calculate the total usage for the 12 month period and average monthly usage. A further requirement for the application is for the users to be able to display the monthly totals in ascending (smallest to highest) and descending (highest to lowest) order of the monthly usage amounts. Utilise appropriate formatting for input/output and include appropriate error trapping and data validation in the application.
Saving Variables Large Step
Jul 24, 2010I would like to save the variable LargeStep so it can be used the next time I run my application. There are more variables but just have shown one.
[Code]...
[2008] Rewrite Class (Saving TreeView Data) For Saving Listview Data
Mar 9, 2009rewriting a class I use for saving Treeview data to a XML file for use of saving ListView data I can't really figure out the rewrite, I'm stucked, unfortunately Listviews seems to be a big problem for me in general.
Option Strict On
''' <summary>
''' The TreeViewDataAccess class allows the nodes within a TreeView to be
''' persisted to xml for later retrevial.
''' </summary>
[Code]....
DataGrid Loading/Saving XML?
Jan 14, 2012I have a rather straightforward question.How to I get a DataGrid in WPF to save/load raw XML files and have the ability to display/edit them with other controls? The application will only work offline so I won't need SQL. Just simply open, edit and save data to XML.
View 2 RepliesSaving And Loading Information
Feb 8, 2012I am attempting to create a program that users can create "cards" that have user inputted data. There are textboxes for each field such as Name, Location, Description, etc What is the best way to save and load this information?
View 1 RepliesVS 2008 Loading And Saving Log?
Jul 4, 2010I'm making a log for my application.I have made the log and it works.I use the streamreader and the streamwriter to save and load the data. I thought that it would be more organized to have columns inside the log.The problem is how will i save the information to the text file and load it up again so that it could organize itself again. The code that i used to make the columns.
log.Columns.Add("Task performed ", CInt((log.Width - 4) * 0.3), HorizontalAlignment.Left)
log.Columns.Add("Time and date", CInt((log.Width - 4) * 0.2), HorizontalAlignment.Left)
log.Columns.Add(" Amount of detected files(s)", CInt((log.Width - 4) * 0.2), HorizontalAlignment.Left)
log.Columns.Add(" App version", CInt((log.Width - 4) * 0.4), HorizontalAlignment.Left)
The code that i use to add the information to the log.
[Code]...
Multiple UI Thread - Show An Animated Loading Gif Image Till Data Loading Is Completed In All Text Boxes
Jul 13, 2009I have a window application develpoed in vs 2008, framework 3.5, in which i have put a button.. Now where i click that button the other text boxes are filled up with the data from database thru web service.. what i want is while all text boxes are being filled i want to show an animated loading gif image till data loading is completed in all the text boxes.. i have tried to use image picture box but while data is loading gif image is displyes but in static mode.. cant see animation... i think this is because data loading and animation both are done thru one UI thread..
View 8 RepliesCreating, Saving & Loading A Bitmap?
Aug 7, 2009how to create a bitmap image of a specified size? then how to save and reload such a bitmap to and from a file?VB2005 starter
View 1 RepliesSaving And Loading TextBoxes And Labels?
Apr 5, 2012I've been looking into the SaveFileDialog and OpenFileDialog features, but have been failing to implement them. The actualy program that I would be implementing this in is much larger, so alternative methods are welcomed.
[Code]...
Saving, Loading, Viewing Projects?
Jan 10, 2012I'm looking to work on a project at work and I'm preparing to do my home screen of my program and I'm stuck on how to prep for all of this. I want to be able to save projects (and its not just one form that will be saved, 26 future forms to be exact), load projects, create new projects and view available projects to be selected from in the home screen. Really a very standard home screen when concerning professional programming. I'm not quite sure how to go about this or when looking ahead what might be a best practice. I haven't worked with databases, so my knowledge is limited.
View 17 RepliesSaving/loading Array As Xml File?
Aug 24, 2010i want to save and load an array as and xml file. what is the easiers way to do so.
View 2 RepliesSaving/loading Last Position Of Window?
Oct 30, 2008like when i close a program, i want it to save its location (i guess to the registry, idk) and then when it loads, i want it to load back where it was.this is what i have so far. it saves to the registry ok, but it doesnt load where it should. also, my button1 click is what saves the location for now, but this code is just a test app for this.
Code:
Imports System.IO
Imports Microsoft.Win32
[code].....