Is it possible to split a file into like 10 parts, and using multithreading copy it faster and then put it all back together? Will the speed increase or will it stay the same?
View 19 RepliesSo, I have a task where I need to basically copy about 600,000 PDFs, some of which can be 5-6 MBs from one network fileshare to another network fileshare on another pc.Now, I crawled through the directories, sub-directories etc etc and created what I call a Filename/Filepath Database lookup table. This table contains the name and the unc fileshare path of each file which comes in handy.I have used Multi-threading and File.Copy to "copy" the files and I getting about 45K files per 4 hours which I need to be significantly faster then that and I am seeing performance degrade over time
View 1 Repliesfriend of mine has no HTML knowledge so I'm attempting to write a program that replaces certain parts of a html file to suit his needs.I've edited the HTML file and marked certain parts with "tags" like this:
#IMAGEURL1# I have a textbox where he can copy + paste an image URL and hopefully the #IMAGEURL1# is replaced with the contents of the textbox.
So can someone please enlighten me to-as how to open a HTML file (there's no textbox to display the contents just yet, I'll add one if needed), find the specified text and then replace it with whats in a textbox.
I need to transfer files from one server to multiple cients (using the internet) in the fastest possible way in .NET . What are the different types of transfer protocols which can be used in .NET or VB.NET so that the files are sent in a very short time ? I have tried using FTP, but that is slow because it requires authentication, handshaking etc. What i want to know is the options which we have in .NET for sending files in the fastest possible way between a server and multiple clients.
View 1 RepliesJust wondering if in the net (VB) world only option for file I/O is the Stream reader/writer. In the VB 6 world we had the slow FSO and we had the native file I/O. As far as speed, mostly concerned with writing few lines of data to a file each second, which may continue 24/7 but each day would have a new file. What are the options available in the net world (that is applicable to VB .net 2003) that can give me the best speed performance?
View 2 RepliesI have a coma separated text file with loads of records. Usually when we read a text file we start from the first line and go towards the last. I know that there will be x comas per record.But I want to start reading from the last line and then towards the top. This enables me to stop before I reach the top (depending on the data).
What would be the fastest way to read a text file in VB.NET?. I am using VS2008. Basically I want to read from last line and go upwards and stop when I want. I may not need to read the entire file.
[Note: I want to store data in an array and not show it in some textbox]
How to divide a wav file into two parts. I don't very know how to implement this functionality. If possibly, can you give me detailed code snippet or other some useful link.
View 4 RepliesWritten down a xml.
We are using vb2005.
How can we read for example on a simple way the node: logstartdate of the three parts.
xml:
<?xml version="1.0"?>
<Map><Algemeen><Vernietigingsjaar>2005</Vernietigingsjaar><total>3</total></Algemeen><Logs><Log><action>action2</action><number>1</number>
[Code].....
What is the fastest way to retrieve all the files within a directory (including sub folders). Currently I am using this function:
[code...]
How can i encrypt or decrypt only a part of a file? I try, and i keep getting an error message that says that the stream might be corrupt. By the way, it is ok to convert the text to a byte array using the system.text.encoding.ascii.getbytes() right? The reason i want to encrypt/compress only a part of a file is because i don't want to encrypt or compress the file header. That way the program can gather info about whether the file is compressed or encrypted.
View 1 RepliesI want select portions of the file and then display them on my site,I thought maybe a combination of objReader and a do loop of some description with a delimiter in the text file to indicated when the program should start or stop reading the file.
View 5 RepliesHow can I break a large mp3 file into one or more mp3 files, and still have each part playable in a media player?
View 2 RepliesI have been investigating xml and find it quite fascinating. Not sure it is worth the effort as far as the sppeed of loading scriptures into a richtextbox.Scenario: User double-clicks in TreeViewLibrary and opens the nodes. He double-clicks on Genesis Chapter 1. Genesis Chapter 1 Verse 1 loads into the RichTextBox.[code]
View 1 RepliesI do have this Textbox1 which contains the file name.Now in Textbox2 I want only a certain part of the file name to appear.
View 2 Repliessplitting and trimming text file
View 1 RepliesI have a file that has > 10 rows. I want to create 9 files that each contains equal number or rows, with the 10th file containing that equal number plus any left over.[code]...
How can I take oDataList and parse it into 10 files without having to loop through each file and oDataList to write line by line?
I've got a problem reading in a Tab-Delimited text file. There's an extra tab in one of the fields its reading it thats not a delimiter, and it's throwing off me reading the file into a table. This specific file does have quotations around that field though.
What would be the best way to take that tab out before splitting the row by vbTab?
Im reading each line in the text field like this, splitting on vbTab. X is a string array
text = x(J).Split(vbTab)
Im trying to load data from a file into three parallel lists, each piece of data is a different data type. Using a split at the "comma", im having trouble trying to load each piece of data in each list. These parallel lists can be like this:
[Code]...
I have an excel file which I attached for ref. My intention is to copy the rows which start with the string "sarah" in column A & paste them to a new excel file, save it; copy the rows which start with the string "mike" in column A & paste them to a new excel file, save it.
View 11 RepliesWhen you need to do random access to the lines of a text file, the regular solution is to put those lines in a list and access them in that list.But doing this if the text file is large creates a large memory overhead and may cause some memory stress on the application.This class maps the file and provide the ability to read any particular line in the file at a random position, without the need to read or put in memory any other line but the desired line. The only memory overhead involve is the 1024 bytes buffer of the base stream.Even if the file mapping can be a process that consume a noticable amount of time if the file is very large ( ~ 5 seconds for each 100,000,000 caracteres) , once the mapping is done the access to a particular line becomes instantaneous regardless of the size of the file. (The file mapping can always be done at a convenient time (ex when the process load) and can be done on a worker thread The class is base on a StreamReader to support the differents Text Encodings Example uf usage ( As I say, if the file is very large, dont do it like that, but declare the class at a convenient time)
Imports Reader = System.IO.MyStreams
Public Class Form1
Private Sub Button1_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Button1.Click
[code]....
I have I text tab delimited file. in every line of that file at the same position in every row of the file I will have a bit that I would want to compare against 23 values (I will call them criteria). So if on every row the string I need matches one of tjhese values then that row will be written in File1.Txt if that value doesn`t match any of the criteria the whole row will be sent to File2.txt.
So far managed to get the original file written in the same format in a newly created file.
how to get the functionality I described working but am stuck with correct syntax.
Here is what I have so far:
Dim fs As New FileStream("C:Original.txt", FileMode.Open, FileAccess.Read)
RichTextBox1.Text = ""
Dim d As New StreamReader(fs)
[Code]....
Now I will need to declare every single row in RichTextBox1 as String then will have to get the bit I need will have to declare that as well(I will need from every row the string taht is between characters 96 and 104), also where do I keep the 23 criteraia values.
I used to do a bit of coding in early versions of VB years ago but moved on to things like RPG400, CL and SQL on an AS/400 box. As I am no longer in this career, I havent touched an AS/400 for a while either.
I am currently working on a visual basic console application in Visual Studio 2005 which takes various csv files from an osCommerce web shop, processes them and writes the data to TAS Books accounts software with the aid of the Infoplex COM module.
I have 2 functions, one reads each line of a csv file into an array, and the second function uses Regex to split the lines array into the various fields before they are added to a structure.
There are something like 5000 records (lines) in the csv file, one example is as follows;
[Code]...
My problem is that due to the formatting of the product description in the example csv line above, it fails the Regex match and therefore fails to read.
I know this is because my pattern is wrong, but I'm not sure how to solve it, I think all I really need is for Regex to split the line by the "," between each element, this might be a little difficult because some of the descriptions contain both , and " but never one after the other.
I am exporting a directory list from a FTP directory to a text file, I would like any suggestions how best to read and split the information detailed on each row in the text file as information isn't Tab Delimited (which i have code for if it was) and the number of spaces between each attribute is different. Below is a snippet of the text file, the main two I require is the File Size and the Filename.
-rw-rw-r-- 1 user_mb www 80520 Jan 10 12:16 GIFT20-000.jpg
-rw-rw-r-- 1 system www 81119 Jan 10 12:16 GIFT25-000.jpg
-rw-rw-r-- 1 system www 80852 Jan 10 12:16 GIFT50-000.jpg
In this readalllines part because my data is saved differently now it used to be like this
CODE:
But now i saved it in a single and more understandable line like this
CODE:
And i have afew ideas like using the split function and stuff to read the months but can i use the "|" and "," in the line at the same time? the first 3 section of the line is for user to know the year, month and day of the starting date of the chinese lunar year. and the following 1,30 is the first month with 30days.
CODE:
So, for my computing project I have to import csv files (got that bit working, got it opening up and displaying in a text box) and search through it to find criteria that I want.
Anyways, I am having trouble splitting/parsing the csv file so that it will display with no comma's (in a kind of tabbed form) e.g. at the moment it displays as
CODE:
But I want it to display it like
CODE:
Thread Performance text file splitting
View 1 RepliesI have a large tab delimited text file to process each day (usually around 25 mb) consisting of usually well over 100,000 lines. The file is actually made up of about 9 or 10 reports separated by "END OF REPORT". I'm wanting to write each individual report to it's own text file. Some values may have trailing spaces or even contain nothing but spaces, so I am wanting to trim those to only the data, or be left with null. Ultimately each report will be imported into sql server tables. The code I have below runs successfully to completionwithout error although each text file is empty. The script is also extremely slow and seems to use quite a bit of memory. The arguments are ad
View 1 RepliesI have a copying error with my program. I am trying to copy the internet cache folder, and the error states that some files cannont be copied (read only maybe?) How can i make it copy, or just skip the uncopyable files?
My.Computer.FileSystem.CopyDirectory(Environment.GetFolderPath(Environment.SpecialFolder.Internet Cache), "d:My Documents")
I have a windows form which to summarize lets the user open a file containing 32 bit hashes, then search for one of them. The hash is then converted to its string representation. The application is giving the results I would expect but I'd like to make it execute faster than it does now; some files can be pretty big > 100 MB.
I'm doing the file read using a BackgroundWorker object to display progress updates and ensure that the UI is available during the process. But for that i need to add a System.Threading.Sleep(1) instruction in the loop; otherwise the application freezes with big files. And System.Threading.Sleep(1) creates a noticeable lag. Any suggestions on how to make searches fast without freezing the UI? Getting speeds comparable to hex editor programs for example.
Im trying to read a text file line by line and place each line in a separate Combobox. right now with my code i can only get it to print lines in separate message boxes.
The text file (test2.txt) contains
1,
2,
3,
[Code].....
if i replace the MsgBox code with Combobox1.text = (strArr(count)) i get nothing.