SqlBulkCopy From CSV To SQL Datatable?
May 24, 2010
I'm using SQL Server 2005, VB.NET 2005. I want to be able to import a very large excel file into a SQL table called "XYZ"
I've done this by doing the following:
1. Save the excel file as csv.(Using SaveAs XLCSV option)
2. Build a datatable "ABC" From CSV.(using ODBC Connection and Select * from '*'.csv command)
3. copy the datatable"ABC" into database table "xyz" (using sqlBulkCopy.WriteToServer())
It works fine without any error but when i checked my database i found that data type for some columns has been changed and hence it didn't copy some of the records.
View 2 Replies
ADVERTISEMENT
Nov 29, 2010
i have a csv file that needs to be imported to sql server the file includes Unicode characters, so i saved it in notepad as Unicode now when i run this in sql it works excellent BULK INSERT personimps FROM 'C:MyImp.csv' WITH (FIELDTERMINATOR = ',',datafiletype='widechar')but when using the following in my code-behind in asp.net, i get gibberish where the Unicode chars should be. [code] it seems like the oledbconnection is ignoring the extended properties, or maybe i didn't set up the connection-string correctly? the ASCII chars come out OK, the Unicode fields are just gibberish.
View 1 Replies
Aug 29, 2011
We are getting the following error (only on the staging server) when we use SqlBulkCopy. The stored procedure has execute permissions. And they are working properly in our test environment. So what is the setting to be corrected in stage environment to work it properly?
[Code]....
View 3 Replies
May 25, 2012
We have a legacy application that is dumping large volumes of data to tab delimited files.Each file contains a single record type and all fields are fixed length.These files can readily be imported into corresponding tables in our SQL server database using the BCP utility from the command line.We have a VB.Net program written in VS 2003 that imports these files using the SQLDMO.BulkCopy routine. We are updating the system to use VS 2010 with SQL Server 2008 and according to the Microsoft documentation SQLDMO is no longer available.I have searched on the internet and have rewritten the import routine to import the tab delimited files into a DataTable using the Microsoft.Jet.OLEDB.4.0 provider. The SqlClient.BulkCopy object is then used to import this DataTable. This issue I am having is that fields in the tab delimited file that are set to spaces are being treating as NULLs when imported into the DataTable. When the DataTable is processed by the SqlClient.BulkCopy the copy fails because the null values are rejected by the SQL table fields that are defined as NOT NULL.Code being tested is shown below
Private Sub Button1_Click(sender As System.Object, e As System.EventArgs) Handles Button1.Click
Dim data As DataTable = RetrieveSourceData()
[code]....
View 1 Replies
Sep 8, 2011
I need to update a database table from a dataset and only have access to the database through an odbc connection. Is there anyway to make this work or do I need to go a different direction to do this ?
View 1 Replies
Sep 7, 2010
I have a .csv file that is selected using the OpenFileDialog that then populates a ataGridView. The .csv file is then visible for the user to check a number of things. This part works fine.What I then need is once it is checked the user then needs to click a button to import this into my SQL Server table (CSV_Import). I have looked at SQLBulkCopy but am failing to get the data imported.Here is some code I have picked up and I am guessing that it is the bc.WriteToServer(dt) needs correcting within the brackets but I am at a loss at this point.
bc.BatchSize = dt.Rows.Count
bc.DestinationTableName = "CSV_Import"
bc.WriteToServer(dt)
[code].....
View 7 Replies
Jun 14, 2010
I am trying to sqlbulkcopy. I have a dataset defined (.xsd). It seems that I cannot use it with sqlbulkcopy. All the information I can find on sqlbulkcopy shows that it can only take a connection string or a variable that contains the connection string.
View 4 Replies
Apr 30, 2010
In a VB.NET, I code to exec a store procedre (sp_truncate) to truncate 10 tables and using sqlBulkCopy to download a huge data. Both them are working fine. Now I want to use transaction with vb.net (not in store procedure?) to rollback truncate tables if download is failed. Is it possible to use transaction to work with these two steps?
View 6 Replies
May 20, 2010
I used sqlbulkcopy to upload huge data from local to remote. It works great.The only problem is that there is a table tClaim in which there are 50 columns. One clumn "IsUpload" do not need to upload. How to upload all columns except for this column? If I use columnmappings, do I have to code add column one by one?
View 1 Replies
Apr 25, 2009
I was wondering if the following is possible. In a particular operation I want to create a dataset, bulk copy it to another SQL Server, then update a flag column in the copied rows.I'll have a system that will be regularly inserting new rows of data, then at regular intervals want to copy that data to another SQL Server. Once the rows have copied I need to change a flag column so that they won't get copied again.Whilst this is going on there is a strong possibility new rows of data will be being inserted into the source table. These new rows will be copied at another interval.
View 3 Replies
Aug 18, 2011
I am trying to display value of the field ("UserID") for every row exists in datatable to checkboxlist(make the checkboxlist item selected).
I used for loop, but only the field value from last row of RoleUsers table is selected in the checkboxlist.
Here is my code
Private Sub DisplayRoleUser()
Dim conn As SqlConnection
Dim cmd As SqlCommand
[Code].....
View 3 Replies
Mar 15, 2010
I have a datatable and I apply a filter to the defaultview.rowfilter property of that datatable. If I then loop through the rows collection of the datatable, will I only be able to see those rows that the filter applies to, or will it loop through all the rows?
View 6 Replies
Apr 21, 2010
I am working on a project that takes an xml schema and xml data files and places them into a DataTable, the 2 files are generated from a working table that i have written to disk. I wish to load these 2 files into a DataTable. Here is What i have
vb.net
Friend Function CreateTable(ByVal tableName As String) As Boolean
Dim table As New DataTable(tableName)
table.ReadXmlSchema(tableName & ".xsd")
[code]....
this however produces the following error on line 3
Quote:
System.ArgumentException was unhandled Message=DataTable 'get_item_list' does not match to any DataTable in source.
get_item_list is the parameter passed into this function (tableName)
View 6 Replies
May 20, 2011
I have a datagridview bound to a datatable setting its datasource property to the datatable. I would like to have a child form that contains a list of columns associated with the datatable that contains a checkbox that will allow the user to hide and show the columns ( I do not know the best control to use here) (I assume this is the easy part as All i need to do is loop through each of the datatable's columns to get the column name)
now I would like save these visible columns on some event like form_closing so that the next time the user opens the form up it will remember the settings
View 5 Replies
Apr 16, 2012
I came across a problem with using a BindingSource as my DataGridViews.DataSource. Whenever I applied a filter to a column in the BindingSource and the user makes changes that don't match the column filter the DataGridViewRows would automatically disappear. A similar thing would happen when applying a Sort to a column. If the user made any changes the DridGirdViewRows would automatically sort causing rows to be moved around. This was not ideal for my application and there isn't anyway to stop this from happening with the BindingSource.
To correct this issue I have to use subsets of data. I use a DataView to apply the filter and sort to the main DataTable, which creates the subset DataTable.The problem is when I use the DataView.ToTable method I loose the Primary Key and RowError information. So I have to reapply this information everytime the user filters or sorts the DataGridView.Is there a better way to get a subset DataTable?[code]...
View 10 Replies
Jun 5, 2012
I have a datatable that has a resource in one field and hours used in another, it looks like this -
Resource Hours Used
Manager 1
Accountant 1
Field Staff 2
Accountant 3
Manager 4
Manager 1
Administrator 6
Field Staff 4
Manager 0.5
Administrator 1
What I want to do is be able to create a summary of the data table above that groups multiple occurrences of a resource and adds up the hours used for that resource, creating a summary that looks like this -
Resource Hours Used
Manager 6.5
Accountant 4
Field Staff 6
Administrator 7
View 15 Replies
May 28, 2007
Is there a simple way to assign a populated datatable's columns to another empty datatable? That is, I want to copy a datatable's structure only but not its data.
View 6 Replies
Feb 17, 2011
I'm using vb.net 2010.I have a DataSet with a Table and data. MyDataSet1 which contains Table1 I want to create another table that is the same as the Table1 but without data, but it should have the columns, etc.
View 1 Replies
Apr 8, 2009
I am getting array of selected datarows from a datatable.select.I use the commands below to get that array or datarows
Dim foundRows() As DataRow
strExpression =
Here is what I tried.I have looked at examples by MS but they all just write to the screen and I have no interest in that.
For Each rowWork In foundRows
dtWork.Rows.Add(rowWork)
Next[code]....
"LineOfBusiness = 'CPP'"
foundRows = modXchange.pdtWork.Select(strExpression)
Now, I want to place the rows from foundrows into an empty data table.I did what I thought was the obvious but that only returns a bunch of rows with no data
View 1 Replies
Nov 18, 2009
load the contents of a query from a dataTable Adapter into a datatable?
View 2 Replies
Aug 6, 2010
I am trying to add NewRow to the database by using datatable in dataset, but before I do that I want to make sure that row is not already there. I create new row for the datatable I am working with, fill it with information. I fill datatable with the row from database that has the same primary key as my NewRow by using tableadapter.fill method, but when I do that my NewRow that was never added to the datatable is filled with information from database(and not information that I assigned to it). I count rows in my datatable before I fill it and it's 0, so why is my NewRow affected by Fill command? (I am using VB.NET 2005 Framework 2.0)
[Code]....
View 5 Replies
Apr 7, 2012
I'm trying to copy one row from DataTable to another, I looked almost everywhere and I can't find a reason why this is happening, I'm using ImportRow and still the New DataTable is empty. Here's one of the answers similar I found and It's still not working!:
Dim newTable As New DataTable
Dim dsFrom As New DataTable
For Each DBShoes In list
Dim iShoeID As Integer
[code]....
View 1 Replies
Oct 31, 2010
how to copy data from datatable to table in dataset i ry this but its readonly property
ds.datatable1=newdt.copy
View 1 Replies
Aug 10, 2011
I have an asp.net application where I have a datatable ("DataTableA") that returns just one column ("ProductID").
I want to read each row of "ProductID", process some business logic, then copy both those columns (ProductID & ProductIDBusinessLogicValue) to DataTableB. This DataTableB is then displayed on the asp.net page.
What would bhe the best way to read each row of DataTableA ?
View 2 Replies
Aug 10, 2011
I am updating a data table (dt_report_crypt) from an encrypted csv file in the code below:I decrypt the colums and update the same dreport_crypt, such that it will contain de-crypted data.This part is working wellI however need to use this de-crypted datatable as a data source to update a second table(dt_report), using the sql SELECT command to filter relevant data,
Dim dt_report As DataTable
Dim dt_report_crypt As DataTable
Using cn As
[code].....
View 6 Replies
Apr 4, 2011
I have a select statement and it will go to a datatable object, I would like to do the following
textbox1.text=datatable(first field value)
textbox2.text=datatable(second field value)
textbox3.text=datatable(third field value)
View 5 Replies
Mar 16, 2011
Is there a way to nest a datatable into another datatable? I know you can do this with gridviews but thats not what I'm looking for.
Also, I don't want to merge the datatables. What I'm trying to do is have a datatable with 2 columns and each column containing different datatables.
View 7 Replies
Feb 3, 2010
I have a session which contains a datatable and also have a function which returns a datatable. I need to add these two. How can I do this? The below code is to be replaced with correct code.
Session("Table")=Session("Table")+obj.GetCustomer() where obj is an object of the business layer.
The '+' sign cannot be used to add these two, so how can I do this?
View 3 Replies
Apr 26, 2012
I am finding difficulties to convert a datatable to a new datatable using a reference datatable. My question is confusing and I am not good at explaining things so I drew a picture (see below).I have two datatables on memory and I need to create the third datatable using the second mapping table for reference. The column names are just for example and it can't be hardcoded.
View 2 Replies
Apr 28, 2009
Not certain what exactly I am doing wrong here, but I am having problems in setting a new DataTable (for posting back to the database) to the Changes resulting from the Merge proc of 2 DataTables. The code works fine until I attempt to set the ChangesTable --- it always ends up = Nothing.What is strange is that the "preMergeCount" = 0 and the "postMergeCount" = 23, which is EXACTLY how I expect it to be! So I know that the Merge is working correctly.
Dim sqlTable As DataTable = dsMonitoring.Tables("SQL_SRTraps")
Dim exlTable As DataTable = dsMonitoring.Tables("Excel_SRTraps")
AddHandler sqlTable.RowChanged, AddressOf Row_Changed
[code]....
View 13 Replies
