I have a large file (2.7GB). I need to split it into smaller files. How to split a large file into smaller files using VB.NET 2003? Cannot use LINQ and the resources (cpu and memory) on operating environment are very limited (it is a shared hosting environment).
View 1 RepliesThe exe can call functions and forms in the dll's that are part of the solution BUT is there anyway
for the dll's to access forms, dataset's etc in the main exe project?
It doesnt appear that it works that way.
I forgot to add this is a VS2005 application.
I've a word file i open using the word object library.... now i need to split it into a number of files divided by the numbering, ie the file is in the format[code]...
View 3 RepliesI'm really hoping I can describe this question in an understandable way. This is a puzzle that I have not been able to begin to solve even though I (mostly) understand it. I'm just not sure where to start, and I'm really hoping someone out there can get me headed in the right direction.
I have a LARGE table of data. It describes relationships between objects. Let's say the Y-axis has items numbered 1-1000, and the X-axis has items 1-1000 also. If item #234 on the Y-axis is related to item #791 on X, there will be a mark in the table where the row and column cross. In some industries this is referred to an a Truth Table. One can, at a glance, see how many items in a system relate to each other. The marks in the table can help to identify trends and patterns.Here's some other helpful stuff about the nature of the table:
The full range of the number of relationships (r) for each item on either axis can be 1 <= r <= axisTotal.The X and Y axis will share common items, but each axis will also have items that the other axis does not.Each item will only exist once per axis. It can be on X and Y, but it would only be on each one 1 time.The total number of items on each axis will most likely NOT be equal. Each axis could have from 50 to 1000's of items.
The end result is that this is going to be a report that needs to be printed. We have successfully printed a table that had about 100-150 items on each axis on an 11in X 17in piece of paper. Any more than that and it begins to be so small it's unreadable.
What I am trying to do is split the super large tables into smaller tables, but related points need to stay together. If I grab item 1-100 on X then I would need each item they relate to from Y.I've generated a number of these tables and, while the number of relationships CAN be arbitrary, I have never seen an item relate to all other items. So in real practice the range is more like 1 <= r <= (10% * axisTotal). If an item's relationships exceed this range, it can be split up into multiple tables, but that is not optimal at all.
At the end of the day I think we, and our clients, would be happy if a 1000x1000 item table was split into 8 to 10 printed pages of smaller, related tables.One other thing worth noting, there will be no empty rows or columns in the table. Every item on both the x and y axis will relate to at least 1 item on the opposite axis.
Im working on a FTP Server (File Transfer Protocol) where i can download files.The problem occoured when i was about to download a 4BG large file from the server when i only had 3GB RAM on the server computer and the function to read the binary files was " data = File. ReadAllBytes("Files File001.7z") "... so how do i split the binary file into smaller byte blocks like 1MB?I've been trying this which seems to have been a total failure.[code]
View 11 RepliesI have a large text file which I want to split into many different items.
On the next file I have a time between each item it's like this
01:20 a.m.
01:44 p.m.
In between these items is information like you would see in a log file.
How can I split these items like this?
if its possible to split an array into multiple smaller arrays?
View 7 RepliesI want to split an array into two smaller arrays at a given index?
View 5 RepliesI wrote a program to download and play AVI files the files are large in size and long time wise. I have the files playing as they are being downloaded but i can't see how long the file is or seek reliably. i was reading that the AVI headers are in the last 512kb of the AVI file *why would't they put it at the start* lol so my question is is there a way to download the last 512Kb of the file i'm downloading. i have the Bytes Read and Length of the file while its downlaoding i'm just not sure where to go from there, or how to do it atleast. If i had the length in time of the Avi file i could set the trackbar to be able to seek properly. or if someone has an idea how i could get the time of the video by using fps and some math i could prob do it that way too but idk how i would tell how i can find how many kb are in the fps i'm sure it changes so think that way is't going to be reliable. how to get the last 512kb would be the best option not sure if it can be done even.
View 4 Replies[Code] each file is about 30 kilobytes in size, and they contain raw hardware statistical information in a comma-deliminted format. I want to do the following with these files as my end-result.
NEWFILE.CVS contains the contents in this format:
metric_group_001 metric_group_002 metric_group_003 metric_group_004 etc.
I don't want APPEND, I want to concatenate the contents of these files into one large master file. I am able to do this MANUALLY, but I need to have a DYNAMIC method of doing this because of the number of files will change depending on the test we are doing with the hardware. This is the code I am using to do this process manually and it does work, but I need a DYNAMIC method in place. [Code]
I am using zipforge.net to archive files in a small backup program I am creating. Everything works fine however if I try to archive a large number of files the process of zipping them gets slower the further along in the job it gets.
Example: I have a directory that contains a little over 100,000 files in it. Each file is only about 200k of text. When I use the zipforge zip class it starts zip'ing very quickly but as it gets about 40% of the way through the directory it starts to slow down... at about 60% its working at a snails pace.
Memory usage for my solution also goes up proportionate to the archive file size as it grows. Currently it takes around 26hours to backup this directory which only contains 4 gigs worth of information.
If I use a program like winzip I can zip the folder in less than an hour. I am thinking there has to be a way to write to the end of the zip file without having to open it every time or without keeping it open. My backup software scans the specified folder and writes each file path and name into a text file. Then it reads the text file line by line and passes the path + file info to the zipforge addfile().
I am trying to upload 2 large files to a ftp server by uploading as one file to a location. I have it working if the files are small but it crashes with large files.
For i As Integer = 0 To filelist.Count() - 1
Dim fRequest As FtpWebRequest = WebRequest.Create(ftpPath & "/Reports/" & filelist.Item(i))
fRequest.Credentials = New NetworkCredential(username, psswd)
[code]....
I wrote a cleanup program to go through some directories and delete files based on if the creation date is older than say 6 months. It works fine with some of the directories I have that contain around a few thousand small files. However, there is one directory (that contains small backup files from another program) that is loaded with over 300,000 files and it locks up on me as soon as I read in the first file in that directory.I am convinced it is the directory has too many files in it to open it. The server that the directory is on is slow. It takes a half hour to open the directory while on the server itself. I know it will take forever to delete the amount of files I want to delete, but I don't understand why it gets stuck and hangs there with no error message.Here is where I get stuck. Listbox1 is the directory I'm attempting to access
For Each selectFile In My.Computer.FileSystem.GetFiles(ListBox1.Items.Item(Count), FileIO.SearchOption.SearchTopLevelOnly, "*.*")
compFile = Path.GetFileName(selectFile)
[code].....
I would like to upload files using the ASP FileUpload control. However, if I try and increase the limit to about 10000 kB, it doesn't work and accepts files only upto 4 MB in size and I get an error saying that the connection to the server was reset. I referred: [URL]..but when I modified the web.config.comments file, nothing happened. Where am I going wrong?
Also, I wanted to know how this would work when I deploy it on the web server. I'm asking because in the code behind, I'm still giving a hard coded value for the path where the file is to be uploaded. How does this work?
I'm using "My.Computer.FileSystem.CopyDirectory(...)" to copy large directories (30-50gb) from one mapped share folder to another. Using "FileInfo.length" to add up all file and subfolder sizes, determines the 'origin directory' size just fine. However, if I use the same method for determining the size of the 'destination directory', mid copy, it returns the full file size, despite the copy not yet being complete.I'm at a loss as to why, as this method works fine in testing, going from a local PC t
Private Function FolderSize(ByVal dir As String) As Long
Dim Size As Long = 0
Dim d As New DirectoryInfo(dir)
[code].....
I am trying to develop an app that will export a large amount of zip files all of which have the same single file in them - simply named 'dw' (with no extension). They will all be in the same directory. I want the file 'dw' to be renamed to the zip file name + .tif. (I will actually eventually need for this to use the magic number to determine if the file is a .tif or a .rtf.) I have been able to get it to cycle through, if the file is NOT renamed. I seem to run into issues when I want the file renamed. It just creates the first .tif file and thats it. I think its actually just cycling through but everything is getting that same name. For the record i am not a programmer by trade, just trying to help with something at work - thus I know the code I have peiced together probably isn't 'by the book'
Dim p As New ProcessStartInfo(ByVal unzipit As String, ByVal zipdir As String, ByVal arg As String, ByVal arg2 As String)
Dim di As System.IO.DirectoryInfo
di = New System.IO.DirectoryInfo(zipdir)
For Each diar In di.GetFiles()
[code]....
I am trying to take a png file (around 2000 x 2400) and split it into 8 smaller images of 500 x 1250 each (2 rows of 4), each of which is saved as a png file. I then which to display these smaller png files in a picture box so that they look as if they were one image.
My problem is that when I display the png files in the picture box, lines that look like grid lines show up in the picture box at the points where the png files sit next to each other.
When I view the smaller png files in Paint it appears as if the left column (x=0)and top row (y=0) of each file is set to clear (or transparent). What shows up in the picture box is the background colour of the picture box.
This clear/transparent row and column are not added on to size of the smaller png files. They are still 500 x 1250.Not every file is affected. If the smaller files are created from the original bitmap in the following order[code]...
I am wanting to create a large amount of files all copied from a single original file. I then have a list of names in a listbox that each of of these files will rename to. However I am getting an error saying that the file already exists in the save location even though the files are saving to a totally different folder...
code below.
Dim Counter As Integer = listFileNames.Items.Count
Do Until Counter = 0
System.IO.File.Move(txtOpen.Text, txtSave.Text)
[Code]....
I have a large financial application which I am migrating to VB.NETIt has two main components: charting and financial statements.I want to know if it is possible (and how) to create a main exe, and then two separate projects for the two components (as dll's?).
View 3 RepliesMy program has 1,000 + .rtf files and when I publish/Install it's HUGE! 200mb +. I have other apps from other software companies that have more documents than mine, and their entire application is around 50mb. What am I missing here? How do I accomplish the same thing? Does it have to do with the Property Settings of the .rtf files called: "Build Action" and "Copy to Output Directory"? I set my "Build Action" to "Content" for all my .rtf files, and set "Copy to Output Directory" to "Copy Always".
View 4 Repliesim trying to split a folder of text files into several folders of no more then 12 files a piece, we have wedding photos 1-144 which would like to have um split into folders of 1-12,13-25 etc, found something that might work but it does it by files size
Code:
Imports System.IO
Public Class Form1
Private Sub Button1_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Button1.Click
[code]....
I just downloaded a Dictionary Words list .txt( containing all dictionary words ), every word is on a line.What i need is only words > 5 letters ( length > 5 ). S o i though about making a Visual basic software that delete words < 5 letters from the file.
This is how i read a file from VB
Dim FILE_NAME As String = "C:UsersOwnerDocuments est.txt"
Dim TextLine As String
[code].....
I'm editing jpg metadata and when I'm finished the file is less than half the size but ok, IE I can see modified tags correctly via windows explorer. But if I edit the same file again its down to 16k and corrupted. The image being edited is the standard desert.jpg found in the picturessample pictures directory.
I'm using the following
Public Sub Put_FileMetadata(ByRef glb_UserArray() As String, ByRef glb_SecurityArray() As String, ByRef glb_InputParms() As String, ByRef glb_InError As Boolean, ByRef glb_ErrorNumArray() As Long, ByRef glb_ErrorDescArray() As String)
On Error GoTo error_handler
' Initialise Variables
[Code] .....
How do you recommend I copy large files over the LAN (>20GB)Currently I am using File.Copy.Another question I have is how can I implement this class to be self contained, meaning that it would report progress to the object that called it? or do I have to define a delegate in the calling object?
Code:
Public Class cCopier
Private Delegate Function CopyProgressRoutine(ByVal totalFileSize As Int64, ByVal totalBytesTransferred As Int64, ByVal streamSize As Int64, ByVal streamBytesTransferred As Int64, ByVal dwStreamNumber As Int32, ByVal dwCallbackReason As Int32, ByVal hSourceFile As Int32, ByVal hDestinationFile As Int32, ByVal lpData As Int32) As Int32
[code].....
The underlying connection was closed: An unexpected error occurred on a receive.If I look on te FTP server I can see that the file has been uploaded entirely which led me to believe that the control channel was timing out. I have tried modifying the timeout on the FTP server as well as the ReadWriteTimeout in my code to no avail.Here is my code...
Dim ftprequest As System.Net.FtpWebRequest = DirectCast(System.Net.WebRequest.Create(destination), System.Net.FtpWebRequest)
ftprequest.Credentials = New System.Net.NetworkCredential(username, password)
[code].....
I am opening a large PDF file using the following
Process.Start(Application.StartupPath & "PREVI.pdf")
I have two questions:
1) Is there a way to go directly to a page number?
2) Can I write a code to have the table of contents show up on the left side of the document so users can click on to go to different sections of the document, not sure if this needs to be done while creating the PDF or if we can do it by code.
If you were to upload a project to any site but are concerned about the large file size, what are the only files you need to zip up for your project to work for either VB 2008 or VB 2010? So far I know you don't need the exe's, the pdbs, and xml files.
View 5 RepliesWhich is the most performant way to read a large csv file in .NET? Using FileStream? or another class
View 4 RepliesDoes anyone know what the best way to split up large files in VB.NET? These files can be in excess of 10GB. I have found ways of doing it by googling all day! most of the solutions I have found almost work. But what I really want to know is what is the most efficient way to do this?
View 1 RepliesI have trying to upload some large files using FTP. Here is the code I am using below.
Private Sub UploadFTP()
' Open file.txt with the Using statement.
Using r As StreamReader = New StreamReader("list.txt")[code]....
I basically loop the above to upload all the files in a specific directory. This works fine with small text files,but when I try uploading a large 30+- mb file it gives me an error.
Quote: The underlying connection was closed: An unexpected error occurred on a receive.
On
cls_stream.Close()
I understand this is caused by .Net not communicating with the server properly? I tried searching all morning to only get confused by all the different methods.