Fast File Listing Incl Sub Folders
Feb 24, 2012What is the fastest way to retrieve all the files within a directory (including sub folders). Currently I am using this function:
[code...]
What is the fastest way to retrieve all the files within a directory (including sub folders). Currently I am using this function:
[code...]
I have a directory structure as follows;
ad_folder
--folderA
--folderB
--folderC[code]....
at I do not know the number of or the names of the folders, they can be different in different cases, I only have the root path.how I can display folder contents in VB.net and the code worked but couldn't figure out how to create the arrays and display only folders within folders starting with "ad_".
System.IO.DirectoryInfo and System.IO.FileInfo to be used for getting the folders.A literal control can be used to create javascript arrays in ASP.NET. These js arrays can then be used on the client side.
So, I have a task where I need to basically copy about 600,000 PDFs, some of which can be 5-6 MBs from one network fileshare to another network fileshare on another pc.Now, I crawled through the directories, sub-directories etc etc and created what I call a Filename/Filepath Database lookup table. This table contains the name and the unc fileshare path of each file which comes in handy.I have used Multi-threading and File.Copy to "copy" the files and I getting about 45K files per 4 hours which I need to be significantly faster then that and I am seeing performance degrade over time
View 1 RepliesAll I am trying to do is write a simple program that will let me choose a directory and get a listing of all files in that directory and its sub-directories and show it in a RichTextBox. I got as far as being able to select the directory but when I click "OK" I get "access to c:documents and settingsstevedesktopmp3 is denied".The code I am using is listed below.
Imports
System
Imports[code].....
I need to transfer files from one server to multiple cients (using the internet) in the fastest possible way in .NET . What are the different types of transfer protocols which can be used in .NET or VB.NET so that the files are sent in a very short time ? I have tried using FTP, but that is slow because it requires authentication, handshaking etc. What i want to know is the options which we have in .NET for sending files in the fastest possible way between a server and multiple clients.
View 1 Replieshow to get a listing of a directory file, listed by bytes in basic? I'd like to how write a dump utility and no not of any particular diectory. I am interested in dumping directories in general.
View 1 RepliesJust wondering if in the net (VB) world only option for file I/O is the Stream reader/writer. In the VB 6 world we had the slow FSO and we had the native file I/O. As far as speed, mostly concerned with writing few lines of data to a file each second, which may continue 24/7 but each day would have a new file. What are the options available in the net world (that is applicable to VB .net 2003) that can give me the best speed performance?
View 2 RepliesI have a coma separated text file with loads of records. Usually when we read a text file we start from the first line and go towards the last. I know that there will be x comas per record.But I want to start reading from the last line and then towards the top. This enables me to stop before I reach the top (depending on the data).
What would be the fastest way to read a text file in VB.NET?. I am using VS2008. Basically I want to read from last line and go upwards and stop when I want. I may not need to read the entire file.
[Note: I want to store data in an array and not show it in some textbox]
I'm trying to find an easy to create a hierarchical directory structure that I can put in a TreeView, with two caveats:
1) The file list is from a file
2) The paths are un *nix format (e.g. /dir/dir/file rather than c:dirdirfile)
I found this ([URL]) which would do what I want...if not for the two caveats above. I can go through the process of tokenizing the paths and start creating linked lists of objects for a directory structure, but before I do that I'd like to find out if anything else is available...
Is it possible to split a file into like 10 parts, and using multithreading copy it faster and then put it all back together? Will the speed increase or will it stay the same?
View 19 RepliesI want to display file names in a list (pdf files) and open them from inside a folder.
View 3 RepliesI have an app that reads a directory to get the filenames in a directory for each File in Directory(process file) next file. I want to know if the file size makes a difference to the time it takes to get the filenames.eg if a folder contains 10,000 photos of 1 megapixel and another has a folder of 10,000 photos of 8 megapixels will it take the same time.
View 1 RepliesWhere to begin trying to research building a program that can inventory a program and then build a spreadsheet where I can name tabs based on directory names and then color them according to their level in the directory tree. The number of directories and/or total number of files shouldn't be a limiting factor if possible. I would also like all subdirectories to be after the tab for their parent directory.
[1] [1a] [1b] [1b1] [1b2] [1c] [2] [3] [4]
I'm working on a Win 7, Office 2010, and VB 2010 Express machine. The purpose of this is to assist with our data retention policy at my company. I want to split up directories on the tabs to make it easier to search and then employee's can go into certain directories to make files they used for a project so those can get archived and the unused files can be deleted.
When you need to do random access to the lines of a text file, the regular solution is to put those lines in a list and access them in that list.But doing this if the text file is large creates a large memory overhead and may cause some memory stress on the application.This class maps the file and provide the ability to read any particular line in the file at a random position, without the need to read or put in memory any other line but the desired line. The only memory overhead involve is the 1024 bytes buffer of the base stream.Even if the file mapping can be a process that consume a noticable amount of time if the file is very large ( ~ 5 seconds for each 100,000,000 caracteres) , once the mapping is done the access to a particular line becomes instantaneous regardless of the size of the file. (The file mapping can always be done at a convenient time (ex when the process load) and can be done on a worker thread The class is base on a StreamReader to support the differents Text Encodings Example uf usage ( As I say, if the file is very large, dont do it like that, but declare the class at a convenient time)
Imports Reader = System.IO.MyStreams
Public Class Form1
Private Sub Button1_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Button1.Click
[code]....
I have a windows form which to summarize lets the user open a file containing 32 bit hashes, then search for one of them. The hash is then converted to its string representation. The application is giving the results I would expect but I'd like to make it execute faster than it does now; some files can be pretty big > 100 MB.
I'm doing the file read using a BackgroundWorker object to display progress updates and ensure that the UI is available during the process. But for that i need to add a System.Threading.Sleep(1) instruction in the loop; otherwise the application freezes with big files. And System.Threading.Sleep(1) creates a noticeable lag. Any suggestions on how to make searches fast without freezing the UI? Getting speeds comparable to hex editor programs for example.
It appears that when IO.Directory.GetFiles tries to read a folder that it doesn't have access to it throws an exception & stops reading. Is there any way to have skip those folders & continue reading the rest of the folders?
View 1 RepliesI have seen lots of examples with a treeview to list folders then display the folders context in a listview.
But what id like is a checked treeview, that not only displays the folder list, but the actually folder contents as well.
I use the code below to fill the list box and it works great. But i need it to only look in the \Software and \Software\FolderName Foldername could be any folder in the Software folder i need it to get all the .exe from software folder and only one more folder deep no more.
[Code]...
I need help with file enumeration. I'm trying to create a program that can list files, folders and sub folders locations in a log file for diagnostic purposes. After it searches it can open notepad and display the results. The problem I'm having is that I'm a beginner and not familiar with file enumeration.
View 14 RepliesI am trying to list all printers (PrintersConnections) under all users (HKEY_USERS)
problem is I dont know the user name keys in advance and need to exclude .DEFAULT and *_CLASSES so first I need to list all key names (%usernamekey%) directly under HKEY_USERS then for all keys that lists lsit all keys under HKEY_USERS\%usernamekey%PrintersConnections
Here is the code I have so far but I get errors about object variable not set, I suspect because of the way I doing the for each and listing the key names and then doing it again
Code:
Private Sub DetectPrntrs()
Try
Dim RemReg As Microsoft.Win32.RegistryKey
[Code].....
I am wanting to get a complete file/folder listing and then copy these files to another folder.
Here is my
[Code]...
This happens on many folders. How can I get a listing of these folders and also copy these files?
I was assigned a project to create a program of cloning two file servers. It will copy all folders (about 500, one day one folder, there are about 200 files in each day) from one file server (S1) to another file server (S2). If any error occurred while in processing, program will send an email to someone.
View 5 RepliesThis one has been troubling me for some time , i keep coming back to it researching it for a couple of days on and off then get disheartened and give up for a while.Basically i want to copy one file in to multiple folders that have the same structure except for one distinction
[Code]...
I'm attempting to create folders from various files within one folder, based on the file names - extensions. I found this code snippet from this link, however I'm getting a loader lock error ("Attempting managed execution inside OS Loader lock. Do not attempt to run managed code inside a DllMain or image initialization function since doing so can cause the application to hang.").
[code]...
I would like to be able to include the folders "Bible" and it's subfolders into the install folder of the host machine. How do I do that? Also, how do I determine the install folders? I would like them to be: C:Program FilesGarman Softwareetc
View 7 RepliesI'll tell you what I'd like to do which is to create a directory listing of every file inside a specified directory and then use a loop to upload each file in this directory to a remote folder via FTP.
[Code]...
I have a directory with about 200 files in it. Is there a way to create a folder for each file with the folder name being the same as the file name minus the extension and then put the file in the folder.For example: Folder "test" would be created from file "test.doc". Then the file "test.doc" would be moved into folder "test".I have some experience with visual basic, and my thought process for this was: make a loop that brought in each file name > store as a variable > create folder with the name in the variable > remove the last four characters from the folder name > move file into the folder > clear variable > repeat.
View 9 RepliesThe code below creates multiple folders based on different file names and moves those files into the new folders. For example, files ABC and XYZ are moved into a newly created folder named ABC and XYZ. I want to advance the code to allow slightly different file names to go into a common folder. Example, I want file ABC_rock, ABC_soil, and ABC_water to be put into a folder named ABC still, AND file XYZ_rock, XYZ_soil, and XYZ_water to be put into a folder named XYZ. I do not want a separate folder created for ABC_rock, ABC_soil, and ABC_water.
Dim strOutputLocation As String = "C:\Temp"
Dim rootPath As String = strOutputLocation
For Each filepath As String In IO.Directory.GetFiles(rootPath)
[Code].....
I have a VB/C# .NET 2.0 project that, if possible, I would like to customize the OpenFileDialog box to select a directory rather than a file. The reason for this is because the FolderBrowserDialog is ugly and a pain for most of my users to navigate using.
I know how to filter extensions using OpenFileDialog, but is there a flag or variable I can set that will allow me to only show directories and select those directories that is built into .NET? And if not, what is a good third party dialog to use/where should I begin if I am to create my own?
I'm currently making a program in Visual Basic 2010 for my Course work, and I'm struggling a little as it involves a "log-in system."
The system will save the Users Information in a folder (Called UserInfo.txt) (Address, Password, Email etc..), and the folder name being the username of the User.
When an Admin wants to view or edit a User, I want the Admin to be able to select the User from a drop-down list and when selected, the information of the user loads in and is displayed in the text boxes bellow (on the same form). The Information can then be edited and Saved back to the file of that user selected with a "Save" button.