i am using System.Net.WebRequest.Create(url) to download html code, but it missed some data. if i use IE to view page and click "view source", all data will be showed.
my code:
Dim req As System.Net.WebRequest
Dim resp As System.Net.WebResponse
req = System.Net.WebRequest.Create(url)
resp = req.GetResponse()
[code]....
I have a big problem with a software I'm creating for my own use.I have code in my software that downloads the source code of a webpage into a .txt file and filters out information it's looking for. For normal HTML code this works fine.The problem is when I can't target specific parameters in the HTML code because they're too vague.I can download this kind of unique HTML code and pass the variable (Brown in this case) to Strings in my software because it's on the same line of code making it unique:
<div class="Performer_DataLabel">Hair Color:</div> Brown</div>
However I want to know how to search a specific table and its rows and cells (like this one below showing the code for 1 row and the 2 cells I'm interested in):
1. <tr>
2. <td class="paramname">
3. <b>Hair Color:</b>
4. </td>
[code]....
The question (Hair Color), regardles of how many hundreds of lines the full source code is, is always on the same line within the row of the table (line 3).The answer is also always on the same line (line 6) in the row of the table.However the question rows themselves are not always on the in the same place of the table.
I need to Download all the content i a HTML file using VB.NET is it possible?what all are the function can u gave me the code snippets??
View 1 Repliesall I want is a function like this:
[URL] but then with the option to provide username & password. I have managed to do this with the webbrowser, first logging in then go to webpage and get source code but this takes much longer than just getting the source code...
Is there any way to do this? I found this:
[URL]
I tried with &username=...&password=... in the URL but it didn't work
I have tried a few things like converting HTML to XML and then using an XML navigator to get input elements but I get lost whenever I start this process.What I am trying to do is to navigate to a website which will be loaded using textbox1.text.Then download the html and parse out the input elements like . username, password, etc and place the element by type (id or name) into the richtextbox with the attribute beside the name.[code]Any clues or how to properly execute an HTML to XML conveter, reader, parser?
View 2 RepliesI'm creating an application where I want to save a webpage to a file. The webpage has a Javascript function written into it. See below
<html>
<head>
<title>Javascript</title>
[Code]....
There is a reason for this. I will be required to retrieve data from a Javascript API. The API can only display data on the webpage and somehow I have to retrieve it from the webpage.
I'm using Visual Studio 2008 but with .Net Framework 2.0. Haven't tried out 3.0 or 3.5.
I'm currently grabbing HTML from my site using webrequest and storing it in a string. I'm looking to take this string, and scrape all of the prices in order to calculate this against my cost price (for a consistent profit spreadsheet). What is the most feasible way to do this? Would using a webbrowser control be a better idea?
View 1 RepliesI'm trying to make an executable in VS2008 that will read a webpage source code using a vb.NET function into a string variable. The problem is that the page is not *.html but rather *.aspx.I need a way to execute the aspx and get the displayed html into a I have tried the following code, which works properly for html pages, but generates the wrong source code with "access denied" for the page title when I pass in the above aspx page.
Dim myReq As WebRequest = WebRequest.Create(url)
Dim myWebResponse As WebResponse = myReq.GetResponse()
Dim dataStream As Stream = myWebResponse.GetResponseStream()
[code].....
How to create HTML fieldset and legend in asp.net code behind? and add controls in that fieldset?
View 1 RepliesI have a NameValueCollection in vb.net and I need to be able to iterate through it and create an html form that posts automatically to a 3rd party site.
I have this to go off of as an example, but I am not sure exactly how to do this from code behind and end up with an html page that actually posts.[code]...
This may sound really stupid but I have to ask cause I'm not finding this answer anywhere.I have an application where the user will need to sign up for a new user account on the website [URL]..However when I am using Firefox's plug-in Firebug to view html I am getting something totally different than when I just right click on the site and view the page source.
What I am trying to do is to get the captcha from the website and display it in a picturebox on the application so the user can view the captcha, solve the captcha and then the app post is back to the service for a response.
Here is the source that I am getting using Firefox's Firebug to inspect the element:
<td>
<input type="hidden" value="Oo3Jo1I8bgzK68agMqo3s79ZZib2OkbK" name="iden">
<img class="capimage" src="/captcha/Oo3Jo1I8bgzK68agMqo3s79ZZib2OkbK.png" alt="i wonder if these things even work">
</td>
[Code]...
Why would the two be showing me two different versions of the HTML?
And how would you be able to grab that source to view in a picturebox using webclient?
I'm letting my users write their own HTML from my webpage. When they click the preview button, my code behind needs access to controls on the page (and so I understand I can't use a web method here). It builds the HTML and saves it as a file on the server. My question is: Once the file has been made, I want to automatically open the file in a new window for the user to see their handy work. I'm using vb.net, but happy to receive c# answers.
[Code]...
I am trying to use httpwebrequest but I keep getting a message that says "Create is not a member of webrequest" every time I try and use the msn example code.
vb
Dim myReq As HttpWebRequest = WebRequest.Create("http://www.contoso.com/")
I am writing some rest calls to the LinkedIn API using web request and have hit an encoding issue.The LinkedIn API takes requires an encoded URI as one of the parameters on the lookup i am trying to run.
We are calling the api through .Net's WebRequest.Create; and when we pass in the URI it decodes it and as a result we can't get the data from the call. Im trying to open a URI like this[URL]..Is there a mechanism in the webrequest class to stop it decoding the passed in URI; or a work around for this?
I need to call a web service to receive a JSON object which I'll parse before rendering the content. Here's the code for the same:[code...]
This works as a stand alone ASP.Net page. However, I need this as a Web Part to port to a Sharepoint site. Using the method described here I've given the above code in the RenderControl() method. I get the error "The "CustomWebPart" Web Part appears to be causing a problem. Request for the permission of type 'System.Net.WebPermission, System, Version=2.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089' failed."[code...]
Using WebRequest.Create inside RenderControl() for WebParts
View 18 RepliesI am an absolute beginner on ASP.net (VB.) Please pardon me if the question is too obvious for the experienced members.I tried to make a simple WebRequest in the async mode in case the target URL takes long to provide the data. In my code below, I just want to see if the callback block (RespCallback) is called correctly every time. If all goes well, lblResult should have the string '123' appended to it every time I click the button which calls the 'GetData' sub.
However, the lblResult only shows 123 after the first click. After the subsequent click, the lblResult only gets appended with '12', as if RespCallback is never called. When I tried to debug this in Visual Studio, the execution actually stepped right into the RespCallback part and the lblResult.Text watch actually shows '123123' but the resulting Web page always shows only '12312'
I am sure I am missing something basic here, but I just don't know what. I was even guessing that it has to do with browser cache (hence the result changes for the second time) but I don't know how to fix that either.
[Code]...
I am a one man dev shop and need some outside opinions on how to approach this project.
I need to create a "post office" program that will send html emails thru the system.net.mail framework.
For each job submitted to the postoffice the app would need to read a user created html email string from the database, read a string of email addresses to send to and send out the emails based on a set processing time.
The first step would be to parse out the email addresses to find out how many emails it needs to send out and determine how many it would need to send per minute to complete the job in 20 minutes tops. I.e. if 1000 email addresses are submitted per job it would determine that it needs to send 50 emails per minute to complete the job.
The part I am stuck on is how I should queue the emails. If the app determines it needs to send 50 a minute should I only load up the first 50 on a timer event then get the next 50 queued up for the next timer tick? Or would it be better to load up all 1000 in a loop and build in some kind of wait time after it sends the first 50?
I borrowed part of this routine to download files, and it works great; except when I download text files the returns aren't written into the outputted file. I've tried different web request and techniques with no luck in solving the problem.
Test file:[URL]
Private Sub DownloadFile(ByRef FileSource As String, ByRef FileDestination As string)
Dim request As WebRequest
Dim response As WebResponse
[Code].....
I am trying save a value from an input tag in some HTML source code. The tag looks like so:
<input name="user_status" value="3" />
I have the page source in a variable (pageSourceCode), and need to work out some regex to get the value (3 in this example). I have this so far: [Code] Which works fine most of the time, however this code is used to process source code from multiple sites (that use the same platform), and sometimes there are other attributes included in the input tag, or they are in a different order, eg:
<input class="someclass" type="hidden" value="3" name="user_status" />
I just dont understand regex enough to cope with these situations.
Probably a simple question but I cant figure it out. I have a webbrowser control, which navigates to a URL where it logs in, then a different URL where theres some information I need. I would like to save this page as an HTML document. I can navigate to the page easily, so is there any way to tell the webbrowser to save the current page as an HTML document?
View 2 RepliesThis might be a strange question, but I need my project to get/download name of a html input. The html source code is:
HTML
<td><input class="text" type="text" name="ebd435a" value="" maxlength="15" /> <span class="error"> </span></td>
I need my project to get the "ebd435a".Why? Because the 'name' is changin sometimes and I wan't my site updater to works whatever the 'name' is.EIf this is not possible or to hard, does anyone know if I could make a website get the code and then my project to get it from the website?
I have a requirement to move the html text available in a string builder to a word document and open the word document after the data is appended in a VB.NET console application. I am new to console applications and am not sure how this could be done, but I am aware that if I am using a Web Application then I can use the following code:[code]
View 1 RepliesDim wc As New System.Net.WebClientGamerTag.Replace(" ", "+")wc.Credentials = New System.Net.NetworkCredential(Email, Password, "http://live.xbox.com/en-US/profile/profile.aspx?GamerTag=" & GamerTag)Dim fx As New System.IO.StreamReader(wc.OpenRead("http://live.xbox.com/en-US/profile/profile.aspx?GamerTag=Dark Slipstream" & GamerTag))Dim str As String = fx.ReadToEndfx.Close()
The above code will open a webclient, set the credentials (possible error?), create a stream of the entire page, and then load it into a string (str).I then scan through and look for what is needed (Gamerscore, Motto, Bio, etc)-in this case.This doesn't work however, it doesn't sign in.
How I Can Download The File Into The Server To Client System In Vb.Net Appliction
View 1 Repliesi'm working on a system that upgrades a basic version to a proversion but i have a payment gateway . it generates a code in an SQL DB.now i have a form in VB that has a textbox and a button how can i let VB connect to my SQL DB receive the code and then check if that code is correct and if its correct download silence the pro file. from an url.
View 7 RepliesI have a windows service written in .NET 2.0 that will run every 5 minutes and executes bunch oracle SQL/PLSQL scripts based on time/validation, it throws the above said error some times against some SQLs, the same SQLs run fine at later point without any error, I have no idea what is going on with the app. I am not sure if this has any thing to do with oracle connection pool as I am properly closing the connections after every SQL execution.
Exception:
System.Exception: Unexpected return code: 1 at System.Data.OracleClient.DBObjectPool.GetObject(Object owningObject, Boolean& isInTransaction) at System.Data.OracleClient.OracleConnectionPoolManager.GetPooledConnection(String encryptedConnectionString,
[CODE]............................
i m usingin vb.net hw can i call system calculator thought code
View 3 RepliesI have had several occasions recently to access a specific class several times over a relatively small time frame.So I've been storing the value of the class in Session and trying to access it on page load, if it's not available creating a new instance and storing that in session.
So instead of constantly replicating the same code for different classes on different pages I'm trying to create an extension method to do this for me.
[Code]...
I'm stuck on what to do when I make my new instance of my class (it would have to have a New() sub)
I'm not sure where to go from here... or even if this is the best way to do it.
I have a normal winform and I would like to know is there any possibility to generate a html page and to add a css file to the html page from the local folder.
something like this:
<html>
<head>
<script type="text/css" src="MyDir/main.css"></script>
</head>
<body>
</body>
</html>
How do I do this from the codebehind(logic part)not web application codebehind using webbrowser control.