I was wondering if anyone had a better(faster) way to parse a Tab delimited file in VB.net. I need to read a file into an SQL table and the file contains about 300,000+ rows. Takes quiet a while. at the moment i have the below [Code].
View 6 RepliesI was wondering if anyone had a better(faster) way to parse a Tab delimited file in VB.net. need to read a file into an SQL table and the file contains about 300,000+ rows
Using MyReader As New Microsoft.VisualBasic.FileIO.TextFieldParser(FilePath)
MyReader.TextFieldType = FileIO.FieldType.Delimited
MyReader.SetDelimiters(vbTab)
[code].....
I have a text file that is in a comma separated format, delimited by " on most fields. I am trying to get that into something I can enumerate through (Generic Collection, for example). I don't have control over how the file is output nor the character it uses for the delimiter.
[Code]...
So i'm new to working with vba in access and i'm having trouble getting this code to work. What it is suppose to do is take a selected text file and read the original file into a list box. Then there is a second button that when pressed will convert the text file from a pipe delimited file into a tab delimited file and then show the changed file into a new listbox.
Option Compare Database
Option Explicit
Function GetFilenameFromPath(ByVal strPath As String) As String
[code].....
in parsing a string which is delimited by space in to a Double Array
View 1 RepliesI have written code to pull some data into a data table and do some data re-formatting. I need some help splitting some text into appropriate columns.
CASE 1
I have data formated like this that I need to split into 2 columns.
[Code]...
column is the first 11 characters That is easy.column 2 should contain all the text after the first 11 characters up to but not including the first number.The last column is all the text after column 2
I've an arraylist having 30000 items in it, what's the best way of creating a text file on the fly from an ASP.NEt page? Currently I'm using the code below but it times out with large data,[code]
View 3 RepliesMy current project is to process several files. The files come from a Unix server and have been SFTP'd to the Windows XP machine. (That's fixed protocol, I don't have control over it.) My problem now is that the Unix new line characters and Windows characters don't match. The solution is to read the file line by line and replace 0x0A with 0x0D + 0x0A, or Asc 10 with Asc 13 + Asc 10, or vbLf with vbCrLf, however you like to say it.Well I have a working function to do this, but any extra speed I could squeeze out of it would be fantastic. The text files I'm working with can reach sizes of about 100MB. So to the question:
Q: What is the fastest way to read a file in, change characters as necessary and then write the file out?Here is my current working code.
Private Sub FormatCharacters(ByVal files As String())
Try
For Each fileName As String In files
FileSystem.Rename(fileName, fileName & ".old")
[code]....
1) a text document which has content like :
uber|uber|ultra
taxi|taxi|taxi cab|cab|minicab|airport taxi|airport transfer
genitalia|genitalia|genitals
[code].....
trying to input a text file that's tab delimited that looks something like this.
2.2 5.6
3.7 9
1.2 9.1
[code].....
I'm trying to import a tab delimited file into a table.The issue is, SOMETIMES, the file will include an awkward record that has two "null values" and causes my program to throw a "unexpected end of file".For example, each record will have 20 fields. But the last record will have only two fields (two null values), and hence, unexpected EOF.
Currently I'm using a StreamReader. I've tried counting the lines and telling bcp to stop reading before the "phantom nulls", but StreamReader gets an incorrect count of lines due to the "phantom nulls".I've tried the following code to get rid of all bogus code (code borrowed off the net). But it just replaces the fields with empty spaces (I'd like the result of no line left behind).
Public Sub RemoveBlankRowsFromCVSFile2(ByVal filepath As String)
If filepath = DBNull.Value.ToString() Or filepath.Length = 0 Then Throw New ArgumentNullException("filepath")
If (File.Exists(filepath) = False) Then Throw New FileNotFoundException("Could not find CSV file.", filepath)
[code]....
I've tried using SSIS, but it encounters the EOF unexpected error.
I am creating a shell for a FORTRAN application which reads a tab delimited text file.Because I am using Excel to manipulate data, is it possible to use the Excel Automation features to "save as" a tab delimited text file?The only method available seems to be a unicode text format, which does not work. Or is there another format that mimics tab delimited so that the FORTRAN application will read such a file without difficulty?
View 1 RepliesI am trying to import a TAB (NOt comma) delimited text file into a DataGridView. The following code works fine if I have a comma separated file. All I have to do is change the FMT to "Delimited".It just does not work with FMT=TabDelimited. All columns are read into single datatable column. The text file is ANSI text and I have double checked to make sure Tabs are tabs and not spaces, even exported a sample Tab Delimited file from Excel.Can this even be done using Text Driver? [code]
View 2 RepliesI want to load a csv file (A comma delimited text file) into a datatable. I found the OdbcDataAdapter Class which looks perfect, but it says it is supported only in version 1.1 of the .NET Framework.
Is there a better way to import a csv file into a datatable? the first line has the column headers.
I am using Visual Studio 2008, using version 3.5 of the .NET framework
I've got a problem in Importing Text delimited File to access Db , I always get an error "No value given for one or more required parameters' while execution [Select Into] Statement
[LEFT]
Dim svdialog As New SaveFileDialog
svdialog.Filter = "Access Database Files (*.mdb)|*.mdb"
[Code]....
I would like to know a way (of course I want to know the best way) to edit a csv file, preferably without having to read the original and write the results to a new one.
Example 1: I want to split the contents of a column into two columns 123abc into 123, abc
Example 2: I want to remove letters from the beginning of a column AB123 into 123
Clarification: I do not need help solving my examples; I just need to be pointed in the right direction of reading and editing the same file.Here is a code example of using a temporary file that seems to me is too slow
Dim currentLine as string()
tempFile.AutoFlush = True
Do Until origFile.EndOfData
[code]....
I've created a program that will allow me to save user input into a text file on my C: drive. I'm trying to figure out a way where the text will be saved using a tab delimiter (I'm still new to Visual Basic.NET 2003). What I have to do is get the information to save in the form of columns and rows so that when the text file is opened using Microsoft Excel (ex. Microsoft Excel 2007), all of the information will be saved in its own columns and rows without any manual intervention (ex. no changing column widths or anything like that).
Here is my code so far.
HTML
Private Sub Form1_Load(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles MyBase.Load
End Sub
[code]....
When opening the text file using Microsoft Excel, Excel should display the data like this:
Name | Mailing Address | Age
John | 2300 J. Street | 19
modify my code (so that the information will be using a tab delimiter) whereas the text can open up in the right rows and columns in Excel after a user has submitted the data to the text file.
I am working with a database that is used for managing program requirements ie text fields of varying lengths. The database program is capable of exporting data out in the form of tab and comma delimited files. I would like to see an example in vb.net 2003 of how I might be able to loop thru an entire delimited text file line by line isolating each tab delimited field to say a text box or a string variable.My ultimate goal is to be able to write this delimited data to a special spreadsheet application capable of dealing with text block sizes beyond the capability of Excel. So now I am interested in how to manipulate huge delimited text files in vb.net 03.
View 4 Repliesthis is how i would normally import a comma delimited text file into a ms access table:
sql.CommandText = "SELECT * INTO [tblMailList] FROM [Text;DATABASE=" & System.IO.Path.GetDirectoryName(Me.OpenFileDialog1.FileName) & ";HDR=NO].[" & Me.OpenFileDialog1.SafeFileName & "]"
sql.ExecuteNonQuery()
my question is, how can i do something similar for a tab delimited text file?
Currently I am building an application that will do Data Validation on an Excel Spreadsheet.The application will allow a user to load an Excel Spreadsheet in and runs checks on the data. The application needs to export the spreadsheet as a pipe delimited file with all of the fields separated by the character.Currently I have written an Excel Macro that will export it as a Text File then delimit it and save the text file as a .ps1 file. I cant seem to figure out how to write this same code in VB instead of VBA.I am currently using Visual Studio 2010.Here is the code for my Macros that work fine but I need it in the application and not on the spreadsheet.
[Code]...
I was trying to read Quote-delimited file using VB TextFieldParser. It doesn't work. However it seems to work if I set the delimiter as comma (","). How do I read quote delimited file?
Imports System.IO
Public Class Form1
Private Sub Form1_Load(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles MyBase.Load
[Code].....
I need help taking a tab-delimited text file and dumping it into a new worksheet in Excel. I get a ton of errors when I attempt to name the WorkSheet or add it to the WorkBook. I want to be able to control the name of the new worksheet.
[Code]...
I'm trying to parse a text file. First I plan on extrcating each line, then extracting each field by searching for a tasb.When I use InStr to search for a (return for end of line) or (for tab) I always get a zero. But if I put in a visable letter such as a I got a 5.also I tried /r, /n and all return a zero.The file looks as follows:
ID Name
1 Patient
2 Bed
3 PatientSet
[code]....
I have written the following for sending sms's from a txt file through a http web service.The code works and the first 2 messages in the text file are sent , but I always get operation timed out when it trys to send the 3rd sms in the text file.If any one could have a look at my code and give me some sort of idea why it stops after the 2nd sms that would really be great
Dim objFS As New FileStream("c:datafile.txt", FileMode.Open, FileAccess.Read)
Dim objSR As New StreamReader(objFS)
Dim strline, fileline() As String
[Code].....
I'm attempting to read from a comma delimited file, the values are put into a structure (employeerecords) i want to know how i can access the separate sections of this structure i will provide my code so far, i apologize for the comments I'm making sure i know whats going on, I'm new to this, the code currently just dumps the whole file into a textbox, i would like to be able to access and manipulate the individual fields but i am at a genuine loss.[code]
View 5 RepliesSo I've been using VS2010 and haven't had too many problems transitioning over but I have an issue at the moment and I can't seem to find the answer...I have been using a little piece of code to insert comma delimited files to a database, which works great.Today, I received a Tab Delimited file from a client....obv I could edit, replace tabs with commas and move on but I want to know the right way to do this so I feel accomplished I've tried two ways so far1. This is the code I use for comma delimited with a slight change for the tabs -- PF refers to a class module that has the functions I use to get files and parse file paths
Dim Conn as New ADODB.RecordSet
PF.InputFile = PF.GetFile("Select LMR Demo File", "")
conn.Execute("SELECT * INTO [tmp_lmr] FROM [Text;Database=" & PF.InitLoc &
[code].....
I've got a problem reading in a Tab-Delimited text file. There's an extra tab in one of the fields its reading it thats not a delimiter, and it's throwing off me reading the file into a table. This specific file does have quotations around that field though.
What would be the best way to take that tab out before splitting the row by vbTab?
Im reading each line in the text field like this, splitting on vbTab. X is a string array
text = x(J).Split(vbTab)
This is my first program that I'm trying to write. I have been trying to make an application to run a date filtered query against a SQL server and output the results into a txt file that I define. I believe that my code is close for getting the data. I cannot figure out how to actually write the data into a text file. I am trying to use the datareader and streamwriter, but I am not sure what to put in the streamwriter.Write() function to actually get it to past the lines in the text file.
[Code]...
I need to post a tab delimited file via the https post request. I need to be able to do this in asp.net VB. I have found various methods in C# however as I am still rather new to asp.net VB I certainly do not have the ability to translate the C# version. The link it posts to is password and username protected. I need to post the file in the message body. Below is an example request that it needs to produce: [Code]
View 1 RepliesI previously asked a question about my meeting planner app, and how to delete a specific entry in the array. Someone had the interesting suggestion of using a ArrayList, instead of a normal array. I am attempting to learn ArrayList, but to no good result. I can't even get the ToString method to work correctly to write what I want it to into a text file.[code]...
My plan is to have each of those three fields to have their own entry in the ArrayList, but when it is saved to text file, those three fields are comma delimited to a line for each appointment. Of course when the text is loaded, it will have to be converted back. Can anyone point me in the right direction or have any other method of going about this with the ArrayList?