C# - Efficient Data Conversion Using .Net
Aug 1, 2009
I am working on an application that will need to read tons of records (close to 500,000) from one table and insert them into another set of tables in the same database. I though about using SSIS package for this but our DBAs don't want to use that. Now, I am thinking of a multi-threaded approach. I am thinking that I can have a few thread started that will read say (500) records at a time and insert them, then come back and read more.
Now, say I spawn off 3 threads of this application. The first thread reads 500 rows and starts processing them. Can I lock these rows that were already read so that the next thread does not pick them up? I am trying to find some articles regarding this on the internet, but perhaps I am not searching for the correct terms in Google.
View 6 Replies
ADVERTISEMENT
Jul 1, 2010
I'd like to sample the data from the Arduino @ roughly 200Hz. Is there a more efficient way to do this than using a timer (which is what I am currently using)? Currently I am using[code]....
View 3 Replies
Mar 12, 2012
Which is the most efficient and speedy data structure in order to carry out calculations on it?. I have seen, collections, arrays, list arrays, databases and more. I would prefer to write just straight forward code that will be effective and which I can still understand. What I would like to do initially is have the ability to add new draws to the end of the file, edit the individual files and delete lines if required.
File would then be reformatted to show the corrections made. Some kind of data entry window is envisioned. As far as number crunching goes, I would like to make counts of each number in each of the columns , calculating averages, times since last drawn and so on.
Without being too long winded, I would eventually like to find triple combinations and maybe use them as predictions. So there you have it. This way I won�t have to go off on the wrong path, on a data structure that may not be able, or be too slow for the tasks at hand.
View 5 Replies
Jul 15, 2011
Im getting that error in the da.Fill(ds)
Imports System.IO Imports System.Data.SqlClient
[Code]...
View 20 Replies
Jan 19, 2012
I have eight text boxes each can have any numerical value only consisting of the numbers 1-8 up to eight digits each. No 0's or 9's.I am using a timer to loop through the sequences of text boxes at a given rate. This is already configured.Now here's the hard part so bare with me.I need to output the first value of a text box, wait some time then output it's counter letter (below the number on the keyboard), go to the next text box and repeat. Example:
1
34
765
[code].....
View 1 Replies
Jun 15, 2012
Here's the function I'm a bit mystified by(Little rusty bitwise operators)
void two_one(unsigned char *in,int in_len,unsigned char *out)
{
unsigned char tmpc;
int i;
[CODE]...
I marked the two places that I don't quite understand. How to convert those pieces to Vb.Net.
Update: So this is what I came up with, but it's not quite giving me back the right data...Anything look wrong here?
Public Function TwoOne(ByVal inp As String) As String
Dim temp As New StringBuilder()
Dim tempc As Char
[code].......
View 2 Replies
Oct 26, 2010
VB 2008 Express edition. I'm pretty new to VB2008, a little over halfway through my first classi am writing a console program to ask the user for the price of gas for 7 days, then to get the average of that price. here is my code so far:
Option Strict On
Module Module1
Sub Main()
[code].....
View 4 Replies
Jun 8, 2011
I`m trying to write a programme ,in VB2008 Express, to receive Serial Port Ascii data ( from a Multimeter) and display it as Hex Data in a textbox. I can get the Ascii data to show, but just cannot convert it into Hex. Once I can do this I want to write a new front end for the Mulimeter software.
This is what i`ve written so far :
Imports System
Imports System.IO.Ports
Imports System.Text
[Code].....
View 1 Replies
Jan 18, 2012
I have eight text boxes each can have any numerical value only consisting of the numbers 1-8 up to eight digits each. No 0's or 9's. I am using a timer to loop through the sequences of text boxes at a given rate. This is already configured.
Now here's the hard part so bare with me.I need to output the first value of a text box, wait some time then output it's counter letter (below the number on the keyboard), go to the next text box and repeat. Example:
[Code]...
Ultimately I'm trying bring my PC Interface project up to date by going from a parallel port to USB. This will be the "Custom Loop" function for the device.
View 8 Replies
Nov 4, 2010
It seems that when using With blocks in VB.NET, the resulting MSIL larger than w/o. So this leads me to ask, are With Blocks really more efficient? MSIL is what gets JITed into native machine code, so smaller code size should imply more efficient code, right?
[Code]...
View 5 Replies
May 7, 2009
I'm writing a C# application that reads data from an SQL database generated by VB6 code. The data is an array of Singles. I'm trying to convert them to a float[]
Below is the VB6 code that wrote the data in the database (cannot change this code):
Set fso = New FileSystemObject
strFilePath = "c: emp emp.tmp"
' Output the data to a temporary file
[Code]....
The problem here is the VB6 binary to string conversion. The VB6 string char is 2 bytes wide and I don't know how to transform this back to a binary format I can handle.
Below is a dump of the temp file that the VB6 code generates:
And here is the dump of the data as I read it from the database in (=the VB6 string):
View 5 Replies
Jun 3, 2012
I am trying to retrieve and display data from MySQL database to vb.net console window using the following code
myconnection = New MySqlConnection("Server=localhost;username=root;password=;database=agro-system;")
myconnection.Open()
cmd1 = New MySqlCommand("select * from sales", myconnection)
myreader = cmd1.ExecuteReader()
While myreader.Read()
[Code] .....
But I get the following error:
Unable to convert MySQL date/time value to System.DateTime
View 5 Replies
Oct 18, 2010
i m working on an application which communicates with PLC machine using Modbus protocol. Now i m able to generate and communicate a modbus data frame with PLC the only problem that i m facing is that in all the data frames of modbus the last ascii characters should be Carriage return + Line feed which should be read by the PLC as 0D 0A that is in Hexadecimal form. But i m not able to do this. The rest entire string is properly read by the PLC but How do I make it read the CR+LF.
View 2 Replies
Mar 2, 2011
Just wondering what the preferred/practised data type conversion technique is?
For example I recently enabled option strict, which in turn found quite a few errors in relation to data types, vb.net prompted me to use CType, which is fine.
However, I have seen other functions for data type conversion, such as .tostring, CInt , Convert, integer.parse and also Ctype.
Why would you use Ctype over the others?
I know its a pretty primitive question , but why do so many conversion methods exist?
View 3 Replies
Sep 2, 2010
I'm working on a form that allows to add new users to a users table in my Access database. The table only has 3 fields: user (string), password (string) and admin (boolean). user is the primary key. But when I run it and try to add, I get an error when casting the query to Double (?). I don't have any double variables or table fields, and I'm not trying to cast anything from or to double. So I have no clue about how to fix this. The code I'm using to insert (and it's working correctly on other forms and tables I have) is:
[Code]...
View 4 Replies
May 4, 2010
Where to add this validation, or if there is a more efficient way of doing it and where to put it?
CODE:
View 6 Replies
Aug 9, 2009
How to use MVC Pattern efficient?
View 8 Replies
Jul 26, 2011
Is there a more efficient way of doing this code?
For Each row As DataRow In dt.Rows
Dim ts1 As String = row(0).ToString
For index As Integer = 1 To 9[code]....
View 2 Replies
Aug 26, 2011
just wondering which of these two sort methods would be more efficient movies.OrderBy(Function(m As Movie) m.Title)
[Code]...
View 1 Replies
Oct 17, 2011
I don't know how to convert the nvarchar value into an int, but that is the way it needs to be set up. I've found other posts about this but I don't know how to use CAST in the INSERT statement I have. All the posts I could find were about converting to int in SELECT statements. I need this statement to change the field @Duration to an int in the database. @Duration is an amount of time. (01:00, 02:00...) They will all get rounded up to the next int value. So if a user enters 0:45, it should be converted to 1. how to get this INSERT to work?
'SQL Insert: Product table
Dim sqlInsertProduct As String = "INSERT INTO Product (ProductName, Status,
CreateDate, ModifyDate, CreateUser,
[Code]....
View 1 Replies
Mar 11, 2010
[code] My project topic is on data conversion for length and weight. There is something wrong with the code.
View 5 Replies
Jan 5, 2010
I need to verify if a certain user exist on my asp.net site.I want to know if which of these two functions is more efficient, faster and better compared to each other and why.
[Code]...
View 6 Replies
Nov 7, 2009
if there is no need for my variable to store negative values, is it more efficient to use UInteger instead of Integer? both are 4bytes and i've got a feeling unsigned works faster though i'm nt sure about it. note that the range of my variable is 0 to 2147483647, hence i could use a UInt32 or Int32 and both would give me the same result so i'm wondering about optimum performance.
View 7 Replies
Jun 22, 2010
I have been reading books trying to learn .net on my own. I am working on an exercise that asks me to create a 1MB file. what i have below does work, but it seems to me there would be a more efficeient way. It seems like what i am doing would cause a lot of overhead. making a 1MB file easier than what i have?[code]...
View 2 Replies
Jul 28, 2009
I have a program that must initialize a table that is usually about 10-15 thousand records. I have attempted several means to empty the records from it, but it always takes several minutes to accomplish the task or in some cases like a 'bindingsource.clear' command, doesn't work at all. I currently have it working using a simple loop to go through each record at a time and 'removecurrent'. but this seems extremely inefficient and it is quite slow.The real time consumer seems to come in with the tableadapter.update and tableadapter.fill that happens after the loop.[code]
View 6 Replies
Apr 8, 2009
a user will enter a number, n, which ranges from 1 to 30. they will also enter a "P" or an "S" (sum or product). depending on which was selected, it will calculate the sum or product of the numbers from 1 to n.i'm having a conversion error on line 5 stating "Conversion from string "S" to type 'Double' is not valid." [code]
View 2 Replies
May 11, 2012
I'm creating a program in VB.net that does the following:At a high level I receive a file in email, put the attachment in a monitored folder, import the text file to excel, format the excel, and then email the excel file to a list of recipients.
Here is my plan:
Completed: Outlook VBA to monitor all incoming email for specific message. Once message is received drop attached .txt file in a specific network folder.
Completed: (VB.net) Monitor folder, when text file is added begin processing
Not Complete: (VB.net) Import text file to Excel
Not Complete: (VB.net) Format Excel Text file.(add in a row of data,format column headers with color/size, add some blank columns, add data validation to some of the blank columns that allow drop down selections)
Completed: (VB.net) Save file.
Completed: (VB.net) Send file to list of recipients.
Obviously the items above that are not complete are the bulk of the work, but I wanted to get some advice on what some of you think would be the best way to approach something like this. The import and formatting of the file are causing me some problems because I just can't decide what would be the most efficient way to do this.
The way stated above. Import to excel -> format Having a template excel that contains all of the formatting already done for me and attempting to transition the data to this document (no clue if/how I can do this). Is it even feasible? Have the template already created and then import the text file to a new excel file, then transition that data to the excel template?
Something I thought about, in terms of formatting the document, was to record a macro of me doing all of the formatting that I'm going to need and then attempt to convert that macro into my vb.net code, but I'm not sure if that will work. I will need to verify that the text file comes in the EXACT format every time correct?
View 5 Replies
Jan 20, 2010
am using visual basics to develop a search on my project using the date picker but any time i try to search for a date on my SQL database i received the following error message from my programme. "Conversion failed when converting data and/or time from character string "
View 5 Replies
Jul 28, 2010
I've an arraylist having 30000 items in it, what's the best way of creating a text file on the fly from an ASP.NEt page? Currently I'm using the code below but it times out with large data,[code]
View 3 Replies
Mar 16, 2010
Let's say I've got: Dim los1 as New List(Of String) los1.Add("Some value")
Dim los2 as New List(Of String) los2.Add("More values")
What would be the most efficient way to combine the two into a single List(Of String)?
Edit: While I love the solutions everyone has provided, I probably should have also mentioned I'm stuck using the .NET 2.0 framework.
View 4 Replies
