HTTP Request Performance For Large Volumes Of Requests?

Oct 13, 2009

I'm looking for some advice on how to optimise the following process:App reads csv file.For each line in the file an XML message is created Each XML message is posted to a URL via a HTTPWebRequest This process was designed to handle low volumes of messages (up to about 200 at a time), un suprisingly thinks have changed and it is now expected to handle up to about 3000 at a time.

The code used to post the message is here: Public Function PostXml(ByVal XML As String) As HttpStatusCode

[Code]...

I am currently restricted to sending multiple messages due to restrictions elsewhere in the system. There is a noticable delay in responding to the request at the other end (the receiver) but this is outside my control. I am trying to ensure that the process of sending is as efficient as possible (external factors notwithstanding).

View 4 Replies


ADVERTISEMENT

Post - Error 403 In HTTP Web Requests?

May 22, 2011

while using HTTP web Requests, when i try and read the stream i always get an error saying 403 Forbidden but if i try to do it in the VB.Net web browser it works fine. Here is my code:

Imports System.Net
Imports System.Text
Imports System.IO

[Code]....

View 1 Replies

Respond To HTTP HEAD Requests Using ASP.NET?

Nov 24, 2011

I have a server making a head request to a database dump I've created. The remote server does this to make sure that it's not using excessive bandwidth when not necessary.However, due to some other circumstances outside my control this causes the script to be hit twice: once for the head request, and then another time to download the data.

What I'd like is to have the script I've written detect the head request, send back a couple of headers (e.g. last modified is right now, filesize different than before), and exit. Is there a way to do this?

View 1 Replies

Respond To HTTP HEAD Requests?

Dec 26, 2011

I have a server making a head request to a database dump I've created. The remote server does this to make sure that it's not using excessive bandwidth when not necessary.However, due to some other circumstances outside my control this causes the script to be hit twice: once for the head request, and then another time to download the data.

View 1 Replies

Access HTTP Requests Made By Web Browsers?

Jun 2, 2012

In VB.Net, how do I make a program to tap into the HTTP requests made by external web browsers? I don't want to edit or stop the headers, only 'read' them, i.e., access its contents. I'm speaking of something like Fiddler2, but I only want the 'reading' part. I also want to read the user-agent.

View 1 Replies

Switching From Webbrower To Http Headers And Requests

Sep 15, 2011

i am working on a auto click program and it is working well apart from it goes slow because im using a web browser to visit the websites.

I heard i can use http request to vist websites ?

Im just using

WebBrowser1.Navigate(url)

Is there anyway i can edit that so it does a http request to (url) rather than get the web browser to go there ?

View 1 Replies

VS 2010 Intercept Web Requests And Edit <title> Of HTML Then Continue Request

Mar 14, 2012

I am trying to make a program that when run changes the <title> attribute of the HTML, on any page requested then loads the page (IE). Is this possible, without making a new browser? If so, how?

View 3 Replies

Unauthorized HTTP Web Request

Mar 26, 2012

I'm attempting to login to a cPanel using a POST Request in VB.Net. I have the correct credentials when logging in and when posting I still get an 'Unauthorized (401)' response when it should be '301' (analysed using Tamper Data Firefox Add-On). Below is my post request information and function.[code...]

View 1 Replies

.net - Conversion Of VB6 HTTP Request To 2.0 ?

Jun 2, 2009

I'm attempting to update a legacy VB6 component (not written by me) to the .NET platform. There is one function which posts an XML string to a URL:

Function PostToUrl(ByRef psUrl, ByRef psData, Byref psResponseText, ByRef psErrorMsg, ByRef psUsername, ByRef psPassword)

On Error Resume Next
Dim objWinHTTP

[CODE]...

I've updated this to:

Public Function PostXml(ByVal XML As String) As Boolean

Try
Dim URL As String = My.Settings.NTSPostURL
'TODO: supply username and password! '

[CODE]...

However when I run the .NET code the server returns the error '403 Forbidden - protocol error' on the line: Using Response As HttpWebResponse = DirectCas (HTTPRequest.GetResponse(), HttpWebResponse). The VB6 code runs fine. identify any discrepancies between the two that might be causing this?

View 4 Replies

C# - Choosing Which IP The HTTP Request Is Using When Having Multiple IPs (.NET)?

Apr 1, 2011

I am writing a .NET program which will run on a computer with several IP addresses. The program makes HTTP requests to given web addresses. I want to choose which IP address I use (so I can determine which IP address will appear on the log of the other server).

View 1 Replies

Get The Second Chunk After Receiving The First One Since It Is Within The Same HTTP Request ?

Jun 17, 2011

Is there any way we could get directly say the 1000 characters after the first 5000 characters, skipping everything before that after sending in an HTTP request to an HTTPS page using either GET or POST in VB.NET? The reason why I ask this question is because in one of the webpage I am trying the get through my program, the website is sending response data in chunks with the first chunk containing some javascript garbage that I have no interest in, the only data I care is in the second chunk and

how to get the second chunk after receiving the first one since it is within the same HTTP request.It would save some time and Internet traffic if I can skip the first chunk that I do not need.Is that possible or I am just day dreaming?

ADDED: Here is how a typical header of the response I am getting from the webpage I am trying to get:

Date: Mon, 20 Jun 2011 13:21:56 GMT
Set-Cookie: JSESSIONID=1AF1AF9EF936E1CB2FA85B750EDC67C4; Path=****some path******; Secure
Content-Type: text/html; charset=ISO-8859-1[code].....


Not sure if that helps, but as you can see, the chunk size is not visible to me, there is no "Trailer" in the header as well.

View 1 Replies

Internal Error 500 Http Web Request

Jun 24, 2010

Im using httpWebRequest to get a response from a website.Ive created / creating a dvd manager for my dvds on disk. My method works fine if i double click a movie name. It will download the data into the correct directories. Im implementing a "process all titles" feature and im finding that around 15 titles im getting "internal Server error 500" or the program bombs out Could this error becoming from the poor internet speed (3G dongle) and the website rejecting my query because of slow downloading?Moved into a new house and ive no broadband in yet?

View 2 Replies

Python Conversion Http Request

Jul 28, 2011

I have gotten this code in python - been going in circles trying to figure out the vb.net equivalent. Will pay somebody for the conversion also.

[Code]...

View 1 Replies

Switching From Webbrower To Http Request

Sep 15, 2011

i have a program that uses a web browser to view the users website in side a proxy.But of course web browsers are slow so would like to change to http request. [ code] To go to the url and the url is stored in (url)Is there any way i can change it to http request ?

View 1 Replies

VS 2010 HTTP GET Request Difficulty?

Apr 10, 2012

Okay, i've tried httpwebrequest, webclient, and a couple of others methods; using the headers parameter of each to set headers and then either opening a response stream or simply setting the system.net.webclient method to download a response into a string. Put simply, how do I make a simple GET request with a few headers and read the data back! I am very, very stuck in a hole right now..

View 4 Replies

Asp.net - Retrieve Date/time Of A Http Request?

Oct 19, 2009

Is it possible to retrieve the date/time of a request in ASP.NET (preferably VB.NET)?

I have tried HttpContext.Current.Request.Headers.Get("date"), but it returns nothing (null).

View 3 Replies

Cookies - HTTP Web Request Works For Other Sites, But Not One?

Jun 3, 2012

I'm writing a program in VB.NET, and I'm having trouble with my httpwebrequest code. I've used live HTTP headers for firefox to get the correct post data, but for some reason it won't login.The thing is, I've used identical code for another similar site (changing just the post data) and it works just fine.

Imports System.Windows.Forms
Imports System.Net
Imports System.IO
Imports System.Text

[Code]...

View 1 Replies

Create An HTTP Request In Program With These Properties?

Jul 27, 2011

I need to know how to create an HTTP request in vb.net with these properties? No idea which parts I send in as text, and what might be built in properties.[code]...

View 6 Replies

Download, Edit And Post HTTP Request?

Feb 15, 2012

is have a bot at the moment which basicly uses the browser to get around things and its really slow as the process which i need doing is repetitive. i need a really quick method. Can any1 post a sample script where it

Downloads HTTP source to text file or temp text box edits source strings as needed post to server (submit)

View 19 Replies

Grab A Folder Contense(http Request)?

Sep 15, 2009

i found this code

Code:
Private Sub btnDownload_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles btnDownload.Click

[code].....

View 1 Replies

Http Post Request Through Httpwebrequest To Forum?

Mar 19, 2010

I'm creating an app that edit a post in a ipforum with httpwebrequest and httpwebresponse in vb.net.I use fiddler2 to get the post forms.I successfully create the code to connect to the site the authentication works well and i don't found problems. But to edit a post i don't find how to do it this is the request of the site taken from fiddler:

[Code]...

View 1 Replies

Send A HTTP Request To A Servers Interface?

Jan 12, 2012

I'm trying to send a HTTP request to a servers interface.But I'm really confused about how to specify the parameters I want to send to the servers interface method. What I've done so far.My server interface only accepts POST requests, that's why I'm using POST and asked if something is wrong with the way I use the parameters.

Dim parameters As String = "?text=test&type=person"
Dim buffer As Byte() = Encoding.UTF8.GetBytes(parameters)
Dim WebReq As HttpWebRequest = CType(WebRequest.Create(NameRecPage), HttpWebRequest)
'NameRecPage is the url

[code]....

Are these spellings correct in my content? What is content type about? What does it say and how do I determine which value to put in there?I don't know if thats the correct value for ContentType, actually I just want to receive some JSON fromatted data returned as string.

View 2 Replies

Send A POST HTTP Request To A Server?

Oct 12, 2010

How can I send a POST HTTP request to a server (in Visual Basic 2010) and then receive the reply into a string.

View 1 Replies

Send POST Body With HTTP Request?

May 3, 2010

I have used the WinHttp.WinHttpRequest object in VB6 to make HTTP POST requests many times. It works great: .Open the URL, then .SetRequestHeader (however many are needed) and then .Send the body. The .Send method makes the actual connection and sends everything to the server at once.How to I emulate this behavior in .NET? The examples I've tried with System.Net.HttpWebRequest open a stream with .GetRequestStream() and then write the body to the stream. Unfortunately, the server is responding immediately to the .GetRequestStream method and therefore never sees the POST body.I am obviously trying to connect up some legacy stuff here, but am having a hard time Googling the problem or finding another approach in .NET.

View 2 Replies

VS 2008 - Return Image From A Http Request

Apr 25, 2012

I have coded very simple asp pages to return an image when requested. But I need to do this from a vb.net application. So I assume I need to create a mini http web server. I have code for some that does not support asp or anything like that. Is there another method to return an image? Anyone have an example of this? Or again, do I need to find a web server control or app to use?

View 3 Replies

Web Scraping - Http Request In Program Freezing?

Sep 15, 2011

I have just made a program were i enter a proxy list then my software views a url over and over using the proxys . I was using a web browser in side the program but worked out slow.So i now have changed the code to htpp request. But now when i run the program it goes up by 2 the views then frezzes .Here is my code

rivate Sub Timer1_Tick(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Timer1.Tick
If ListBox1.Items.Count = 1 Then

[code].....

View 1 Replies

Get Performance For Comparing 2 Large DataTable's?

Oct 13, 2011

DataTable1“ About 16 000 entries“ coming from SQL[code]...

I have tried using a NOT IN clause in my SQL query with all the entity numbers from table 2 in that query but it takes over 10 minutes to execute.

Using a For Each loop and comparing each row takes about 3 minutes

View 3 Replies

HTTP Post Request - Content Length Error

Mar 1, 2012

i am trying to build, or better edit, my own HTTP Post Request Source Code. The main purpose if it is working, and i receive the data successfully but when i try to put a progressbar with it, it starts getting sticky, because the ContentLength will always stay -1. [Code]

View 4 Replies

Receive A Http Web Request On A Windows Form Application?

Jul 30, 2011

How can one pass http get or post methods to a windows application? I require a webserver to send a get method to my windows form application that will querry a database then reply back to a webserverI'm developing a windows based search engine that searches a MySQL database. It receives a keyword from an SMS gateway software as a HTTP get request and should reply to the gateway software using the same HTTP request.This is my code. It is correctly searching the database but I don't know how to receive the get methods on the application however it's sending the messages to SMS gateway.

Private Sub bSend_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles bSend.Click
Dim request As HttpWebRequest

[code].....

View 1 Replies

Retrieve Http Request Generated By Web Browser Control In .net

Dec 19, 2010

How can i retrieve the HTTP Request generated by the web browser control in .net (3.5). When the user navigates to an html page it may contain images, for every image the web browser control needs to make a HTTP Request. I want to display all HTTP Requests made by the web browser control. Does the web browser control use the httpWebRequest / httpWebResponse Classes internally? if so how can i access these objects?

View 3 Replies







Copyrights 2005-15 www.BigResource.com, All rights reserved