VS 2010 Program Logic To Speed Up Processing
Mar 29, 2011
I have setup an application to parse about 3000 files a day where each contains around 4000-5000 posts in xml format with like 100 fields. It involves a lot of cleanup and parsing but on average it takes around 6 seconds per post. Now I tried threading but because of the way I have everything set up with variables being overwritten etc...I have divided the files into different folders and just created copies of the program to run and access the assigned folder. It is running on a windows 2008 server with 16 G of memory and I am told I need to reprogram to speed up the process and also not use so much memory.
[Code]...
View 3 Replies
ADVERTISEMENT
Oct 11, 2009
I have setup an application to parse about 3000 files a day where each contains around 4000-5000 posts in xml format with like 100 fields.It involves a lot of cleanup and parsing but on average it takes around 6 seconds per post.Now I tried threading but because of the way I have everything set up with variables being overwritten etc...I have divided the files into different folders and just created copies of the program to run and access the assigned folder. It is running on a windows 2008 server with 16 G of memory and I am told I need to reprogram to speed up the process and also not use so much memory.
For i As Integer = 0 To fileLists.Count - 1
Do
Try
[code].....
View 2 Replies
Apr 4, 2012
Are there any ways to make my program more accurate or faster? So far, I've been using multithreading and priorities.
View 28 Replies
Nov 30, 2010
I have a codes that calculates DownLoad speed and UpLoad speed kb/s. I would like to implement this kind. I also want to put such kind of graph. Any article or links where can I start building my own like that.
View 2 Replies
Jul 22, 2009
I'd like for debugging purposes to be able to log what functions are called and in what order. So I've been just putting Debug.WriteLine("myFunctionName(args)") all over my functions, logging it in the end to a file. Isn't there a better approach to do this?
View 4 Replies
Nov 22, 2010
I have an application that I need to automate where at a certain time each day, say 6pm, it will run a certain method(which is to check a database for key terms and then access the api to search for these terms). But there is the main process which is running all the time accessing the stream api so when the search is complete, it interrupts the stream and hands over the new terms. Now I thought of adding the .exe file to windows task scheduler but not sure if that would work. The stream method runs indefinitely and at 6pm each day another process needs to run. I thought of using the system.threading.task TaskFactory but I am using visual studio 2008 ( I do have .net framework 4.0)If it launches using the task scheduler as 6pm with my code logic as follows:[code]
I see how this would eat the CPU...the streaming process is basically following a list of user profiles listening for new activites and storing these as XML files. This a real time feed to an API. At a specific time once a day, a second process needs to go access a database for new ids, and if there are new ids, then go to a search API and get new user profiles. This is the main criteria..once the new user profiles are found, the list that the stream users needs to be updated so the process will be interrupted for a second or just paused and then continue processing.
View 10 Replies
Jul 23, 2010
Background: I have a program that has implemented the two "classic" taxes for Ontario Canada: 5% GST and 8% PST. At the beginning of July (2010) the province switched to one combined HST tax of 13% for the most part. Effects and changes here but those aren't the main point of this question...
Question: What are best practices and good solutions to accommodate for future changes easily in retail taxes? Tax changes occur often enough. I'm sure there are a many SO users with good experience.
View 2 Replies
Mar 18, 2011
I just learned some basics of multi threading in VB.net recently as I came across processing a large List of records and inserting them into SQL database one by one.
I have code look like this:
Private Sub btnLoadNow_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles btnLoadNow.Click
Dim autoLoad1 As New Thread(AddressOf AutoLoad)
autoLoad1.Start()
[CODE]...
Itemlists is a global lists i retrieved from database, everything looks fine to me but when i run this program, I found that the threads are inserting one records 9 times into the database(I have 9 threads in total), which makes me think that maybe i need to specifically assign 1/9 of a list to each thread? Is there another way to do it which doesn't require the splitting of the list, if not , how do i split it then assign?
View 1 Replies
Jan 6, 2010
2008 Array Processing and Sequential File Processing
View 14 Replies
May 19, 2011
Im a college student and this is my first programming class, i am having extremely diffcult time with arrays and sequential file processing. Im not asking for the whole program, just something to get me started and hints along as i progress with it. Please help me get started on my program, its due in 2 days.
Here are the requirements....
1. The program must input any number of individual�s last and first names using two separate textboxes.
2. The array of names must be sorted by the last name using a bubble sort. You must code the sort.
3. The program must be able to recall the names from the file and add to the existing list of names so that more names can be added to, sorted, and written back to the file in sorted order.
4. Sort in ascending order: A to Z
5. All names must be displayed in a listbox in sorted order when the user wishes to see them.
6. In the listbox the last and first names must be separated by a comma and a space. Example: Smith, Mary
7. The user must be able to search for a name in the array, using the binary search algorithm. You must code the search.
8. Do not use module-level variables. Instead you may choose to use Static.
9. The program must be designed using Visual Basic 2008
View 3 Replies
Aug 18, 2009
I am connecting to my mail server using IMAP and Telnet. Once I am connected I am marking all items in the inbox as read. Some times the inbox will only have a couple of e-mails, sometimes the inbox may have thousands of e-mails. I am storing the response from the server into a Byte array, but the Byte array has a fixed length. [code]...
But the response from the server varies based on how many e-mails are successfully marked as read since I get one line of confirmation for each e-mail processed. There are times where the response may contain only 10-20 lines, other times it will contain thousands of lines. Is there any way for me to be able to get the response from the server in its entirety? I mean it seems like I would have to know when the server was done processing my request, but I'm not sure how to go about accomplishing this.
So to reiterate my question is: How can I check in my program to see when the server is done processing a response?
View 3 Replies
Oct 5, 2009
How to use VB.NET 2005 for image processing?
View 5 Replies
Sep 15, 2009
the hex convert code seems to work etc but it freezes but it does its job eventually I read that backgroundworkers can be used to fix this issue but I have no idea how to use it for my script
[Code]...
View 2 Replies
May 31, 2012
The goal is to check for invalid data (no data/negative numbers/letters where numbers should be), it does produce a message if the data entered is invalid, but I can't figure out why it STILL displays the results. Results should only be displayed if all data is valid.
View 6 Replies
Jul 15, 2011
I've done many attempts but still didn't succeed in making a logic for pascal's triangle, I want you guys to get me start this task and I'll code it myself. url....
View 5 Replies
Sep 5, 2011
How do I best speed up running of my program?Once I have simplified code as much as possible, made it smaller. By using loops were appropriate etc.
View 7 Replies
Sep 5, 2011
How do I best speed up running of my prog?Once I have simplified code as much as possible, made it smaller. By using loops were appropriate etc.
View 1 Replies
Oct 8, 2010
I am trying to create a tool which executes some oracle procedures and telnet commands. Besides this Job my tool also needs to update a counter in some table in oracle db at regular intervals(10 secs as per current settings). So I used backgroundworker class in VB.NET to implement this back ground job of updating the counter. My problem is I have put logs at every possible exit of the backgroundworker_dowork functions but still this logic stops working after some time --7-8 hours. I am not able to understand when/where/why/how is it stopping? I am saying logic has stopped because it stops incrementing the counter. And am saying it is exiting abruptly because in _RunWorkerCompleted, I have written a log and closed the application but nothing comes in the log and application is not exiting.
Private Sub backlogicthread_DoWork(ByVal sender As Object, ByVal e As System.ComponentModel.DoWorkEventArgs) Handles backlogicthread.DoWork
WriteLog("Background worker", "entered")
dbbackcontrol = New OracleConnection(odbcBill)
Dim dr As OracleDataReader
[Code] .....
View 8 Replies
Sep 3, 2010
The application uses ADO.NET to invoke sprocs for nearly every database operation. Some of these sprocs also contain a fair amount of domain logic. The data access logic for each domain entity resides in the domain class itself. ie, there is no decoupling between domain logic and data access logic. I'm looking to accomplish the following:
[Code]...
View 2 Replies
Feb 10, 2012
are there any way we can make a program to test a speed of mac even if you are not using it?
like for instance
64:16:F0:003:9A
how can i test this without using it?
View 1 Replies
Apr 25, 2011
link where Programmers like me who are new and not very proficient in Vb.Net and ASp.NET..
View 10 Replies
Sep 10, 2010
I am working on a snake game for my portfolio and was wondering where the best place to put the logic for drawing the snake. Should the code reside within the snake object or within the form? Either would work, but I am wondering from a business objects/coding standard perspective where such code belongs.
View 2 Replies
Apr 2, 2012
Is there an easy way to read in a comma deliminated file in VB 2010. In VB 6.0 you could read the file in directly to variables. It appears this has been removed in 2010.
View 1 Replies
Feb 21, 2012
How do i exactly check internet connection speed.I have searched around google and found out a method w/c will Download a file like 1mb size, then it will calculate the speed.
View 1 Replies
Dec 31, 2010
how do i check the bandwidth (download speed and possible upload speed) of a user in vb.net or php that uses my app or visits my site resp?
View 1 Replies
Feb 12, 2009
In Form1 there are a lot of boxes like checkbox, label....I want to show a processing message for opening serial port after program running. So I created Form2 specifically showing "Opening Port...". So in Form1_Load() I used Form2.Show(). However this message showed behind of Form1. I think this was executed before all the other tool boxes loading. So where should I put Form2.Show()?
View 2 Replies
Mar 1, 2012
I am using VB.NET 2008 and SQL Server 2005.The program runs on a different machine than SQL Server machine.If I read a SQL Server view from my VB.NET program (instead of executing a stored procedure)for ex: Select a,b,c from MyView where account = '1' and symbol = 'abc'will the speed of executing the view depends on the resource (CPU and RAM) of the machine where the program is running or the machine where SQL Server is running ?
Dim m_cmdSQL As SqlClient.SqlCommand
Dim m_daSQL As SqlClient.SqlDataAdapter
Dim m_dsSQL As DataSet
[code]....
View 9 Replies
May 22, 2012
I have spent way too much time trying to sort this little issue out. I have narrowed down the issue to the exact procedure that throws the error. Yes, I have used Google..
Try
Dim tempSource as String = Nothing
Console.WriteLine("Loading document...")
[code]....
I am loading a text file, that contains about 1100 lines, and each line is going to be processed with HTML Agility Pack. From what I can tell, when it runs "doc.loadhtml(richtextbox1)", it throws the error. I also have tried to load the file into a string, and load the string with "doc.loadhtml(thestring)". It doesn't make a difference, still errors.
Here are is a sample of how each line looks:
<Site Index="" Name="" Group="" PR="" />
<Site Index="" Name="" Group="" PR="" />
[code]....
I am using HTML Agility Pack, however the above is what is on every line, about 1100 lines! For testing, I have a smaller text file made of about 50 lines before I load up the 1100 line file ;) There aren't any HTML, HEAD, or BODY tags! They aren't needed for my parsing. I am using HTML Agility Pack because it is easy to parse elements with. I can grab each value easily from each line.
I am not sure if maybe the error is because it technically isn't HTML? Meaning since the loaded code doesn't have an HTML or BODY tag, that it errors? I wanted to get this question posted, and while I am waiting on some answers, I am going to parse the document another way. Just curious as to what the deal is and why HTML Agility Pack isn't working. More of a proof of concept then anything, for my own learning and knowledge.
Here is the error I get (btw the on the doc.load() line, is where it throws the exception):
Object reference not set to an instance of an object
Last Note: The routine is on a background thread. I have used multi-threading before, and have delegates created for deeper in the code.
View 1 Replies
Apr 12, 2012
I have a process that recieves a request and issues a response. Sometimes createing the response is taking too long. I would like to start the request, and after 8 seconds, if the response has been created, I would abort the process and send back a generic message.
View 3 Replies
Jul 29, 2009
i want to monitor the speed at which my system is currently Downloading and uploading. I dont have any idea how will it can be done.
View 6 Replies
