I am coding a file downloader, when I got over this problem. I can not figure out how to download files in chucks.-file-chunks.htmlbut since it's not answered yet, I'm reposting it here kind of.
View 13 RepliesI keep trying to encrypt a large file using this method: How to encrypt and decrypt a file by using Visual Basic .NET or Visual Basic 2005
However, these files can be upwards of 400MB. Naturally, I keep getting a system.outofmemory ex. Apparently, I can fix this by processing the file in chunks, but I haven't the slightest idea of how to do this.
I have a large wikipedia dump that I want to cut into different files (1 file for each article). I wrote a VB App to do it for me, but it was quite slow and crapped out after a few hours of cutting. Im currently splitting the file into smaller 50mb chunks using another app but thats taking a long time (20-30 minutes for each chunk). I should be able to cut each of these up individually if I do this.
Does anyone have any suggestions of a way to cut this file up quicker?
I have a list of files and all of them have a different size. I need to upload them in chunks of 250Kb (or less if it's a small file or if it's the last chunk of a file).What I would like to do is read a bunch of chunks (lets say 15 chunks), in a separate thread, and then store the chunks of data in some sort of list. This list must be available to other threads.
An upload thread (I don't need help with uploading itself) takes the first chunk from the list and marks the chunk as "currently being uploaded". When the chunk has been fully uploaded, then the chunk is removed from the list. A second upload thread takes the next available chunk in the list that has not been set to "currently being uploaded", etc. There are a total of 10 upload threads working at the same time.
As soon as a chunk is removed from the list, then a new chunk of data is read and added to the list.Does anybody know what kind of list I need or how I should do something like this? I don't expect people to write out the code for me, but I have no idea where to start with this.
I've been trying to create my own backup system by sending specific files to a server running on my desktop, and then having those files copied to an external. So far, I'm trying to send files using a tcp network. Unfortunately, for soem reason, tcp cannot send more than 9kb at a time, so when i tried to send a 30kb image, it recreated 1/3 of it. My fix to this problem was to send data by chunks of 8kb, then reconstruct the file chunk by chunk. For some reason, when I run the server and client, the client says it sends all the data, however the server seems to be stuck. Here is my code;
[Code]...
I usually download file using following code:My.Computer.Network.DownloadFile("url of the file","filepath to save the file")But recently I encountered a site that only allow file download if you click it from its site and not via direct downloading from vb.net code.How to download file from http server that requires a referral before allowing the download?
View 1 RepliesWhat is the meaning of asynchronous file download and synchronous file download ?
I came to them while using system.net.webclient class
I know a basic meaning of tcp/ip and http .
i try to download multiple file + progressbar.. but its seems nothing happened and the file is not download.. my program just function like.. when the file was error.. it will download the latest file from webhost..
[code]...
Imports System.Net
Public Class DownloadStuff
Dim downloader As New WebClient()
[code].....
I want to get some HTTP source with VB.net. The page is huge though, so it would suit me to pull it in chunks. I'm also already reading about the VB.net background worker. So far I'm using this code: HTTP GET in VB.NET but my program stalls while it loads the page, for a decent amount of time. The page to get is http://ftp.drupal.org/files/projects/, but don't go there unless you absolutely have to.
Should I stick with the background worker, and/or is there a way to split up the HTTP request?
I want to download thousands of files from the web and save them locally. What is the most efficient way? It is important the failures timeout within 10 seconds.
Is there a better way to stream one stream into another? Maybe a smaller buffer, like 1024 bytes at a time, is more efficient for large files?
Dim w_req As System.Net.HttpWebRequest = CType(System.Net.HttpWebRequest.Create("http://blah.blah.blah/blah.html"), System.Net.HttpWebRequest)
[Code]....
I have a class with a lot of methods. This class and methods are in one file. These methods can be put into 3 groups based on the things that they can be used for. What would be a good way to break these methods up into the 3 groups? I was thinking about doing a partial class definition and breaking up these methods into 3 files.
View 3 RepliesI have created a application in vb.net. I am using Web Browser control in it.With this Web Browser control I open an URL and tries to Download something, it will populates an dialog for "File Download" to Open/Save/Cancel for the file..I am downloading the .ZIP file, and it will not show the checkbox for Automatically Do.Is there any way to perform the Download operation at the backend, means it will not ask me for such options.
View 2 RepliesReading a .txt file in VB.net. My file path is C:UsersMyLilMulePepeDocumentsVisual Studio 2008Projectscurtain_calls.txt.
This is my line of Dim LoanOptionsFile As String = "C:UsersMyLilMulePepeDocumentsVisual Studio 2008Projectscurtain_calls.txt"
I can read the file when I run the program, but how do I write the file path so that someone else can download my program and file and read the file on their system?
I cannot read filename in response header:Content-Disposition: inline; filename="
View 6 RepliesI am writing a Windows Form program to automatically download and store generated PDF reports from a web site using the WebBrowser Control. The web site uses Ajax to link an icon back to the source aspx file which then returns a PDF file.
The problem I have is that the WebBrowser control brings up the File Save As dialog box when the PDF file is returned and I can find no way of handling this to cature and save the returned file. I have found other examples of how to manage this using the Navagating event to validate the extension of the file that is being accessed (e.g. [URL] and, if not an HTM, file then use the HTTP Web control to directly download the file. Unfortunately this will not work as the call references a .aspx page.
How can i make a button that download a file using http show a progress bar about the downloading file state?
View 10 Repliesi made downloader that will display the following items to the user. The Name of the file that the user is downloading The Url Were the file is being saved The Size of the file The speed at which the file is being downloaded And the Status. But the Problem is that the downloader can only download one file at a time. How can i make a multiple file downloader Which if the user wants to download 2 or 23 files he can.
View 13 RepliesI'm looking for a way to (easily, by preference ;)) create a download link to a file on a separate file server.The situation is as follows: the application I'm developing (asp.net 2.0 in vb.net but I have a similar issue in c#, either solution works for me) will be run internally for a company.As is good practice, the file storage and web application are on two separate servers.I basically need to be able to create a download link to a file, the only available URL i have to access the file is servernamefolder1folder2folder3file.txt (can be any sort of file)[code]Which doesn't work for obvious reasons. It used to be set up to write that file to the application path itself and that worked perfectly, but it isn't good practice and that's why I'm changing it (or trying to).I read solutions about creating a download page and then having a table in your DB which holds the links and returns the proper web URL for download but the time constraint I am faced with unfortunately doesn't allow me to develop that.
Assuming I can provide a string with the full filepath to the file like the above, what is the easiest way to just create a link that, when clicked, downloads the document? I have 0 admin rights in this environment. That really isn't helping me. Let's assume I am given the correct link like above and have the appropriate file access rights and such.The above example does work in IE, but not in Firefox and Chrome. IE converts it to a file://servername/... link which does what it's supposed to, but FF and Chrome both actively decided that this is unsafe and have disabled it from their browsers.
im going get ot the point i just wanta download a file from a url and have it zip to a specific user defined fileurl so here is my fake code please put in vb 2008 language. [code]
View 1 Repliesi want to automatic file download using vb from an https site.i don't know the full file name. the file name is make up by 2 pieces, i only the 1st portion of filename.
View 2 RepliesI have sockets receiving data from a barcode reader, the problem is the reader sends the string in chunks for whatever reason as opposed to sending the whole string, for example:
<00001>st6
comes as
<0
000
01
[Code]...
well i'm currently making a downloader for miniclip games to play them offline. i could make the code to get the download link and i could download them getting the code to get the link took some time to collect . i could find through google how to download that link
My.Computer.Network.DownloadFile(TextBox2.Text, SaveFileDialog1.FileName)everything works fine and the file is downloaded successfully, what i need to know now is how to get file size, or how much is downloaded from the file, download speed and show the download on a progressbar
I am trying to automate file downloads. Sometimes I get to a webpage that has a file link to download a file, but it is not a direct link. Instead it is a PHP request on the server side, for the file.
Is it possible to automate this using the webbrowser control, or is there another way I can do this using VB .NET?
I have an account with a website and I want my software to automatically download files that are generated.
I go to the website and login, and then I click a link that downloads a file. Unfortunately, I can't use the My.Computer.Network.DownloadFile function, because the first argument of that function is a file address (http:// www . website . html/file.txt). Instead of that, the address if I look at the link to download the file is something like this (http:// www . website . com/pid=1&output=csv&action=view&pview=pview).
You see how this won't work? I'm looking to use my software to automatically download the file that's available, but I can't use the DownloadFile function.
I have ~ 1 page how to that is currently in a text file which I want to add to a richtext box.I am just wondering if there is some way I can just copy/paste it so it keeps its formatting etc.
View 1 RepliesWe are trying to find a way to download a file (PDF) that is attached as link to a web page. In our VBA application we were using URLDownloadtofile but that command has seemed to stop working and we think the company changed the proxy setup. We believe that the system needs a log in to work correctly, so we decided to try it in VB 2005. I was trying to find out if there is a way for me to use a similar command, and I am hoping that if I stay attached to the web browser active session that I'll be able to bypass the problem.another way to do it that would work in VBA that would be fine too. The benefit to the VBA is that all of the code is written unlink my VB 2005 app which is only partly done.
View 6 RepliesI have the following code to download the file from FTP. But from the code below, it had set the destination to C: constantly. How should I change the code so that savefiledialog can be prompt and the destination will be the one that choose from savefiledialog??
My.Computer.Network.DownloadFile("ftp://abc.my.com/IN/1.txt", "C:1.txt", "abc", "password")
I'm trying to figure out what code I can use in vb.net that will allow me to download a file form any website URL I use. The URL is not on my web server, it will be for other websites.Is this possible? If so what type of code would I use?
View 5 RepliesI am using Network.DownloadFile to download exe file but it didn't fully download the file i am only getting 1kb of the exe file the code i use is [code]...
View 1 Replies