i use this code to download the source of a page from a site
Dim MyWebClient As New System.Net.WebClient()
TextBox1.Text = MyWebClient.DownloadString("site")
but it doesn't work when i try to grab a site that has .php so how could i accomplish downloading the page source of a site that ends with .php
i need to download page from source code..for example<span id="businessNumOnMap" class="resultNumberOnMap" style="display:none;"></span><span><a ref="/len/aapproximatch%20search/285295.php" onclick="loadBusinessInfo('0', '285295'); return false;" class="businessName">Cellini's Italian Restaurant</a>i want to download the "/len/aaproximat...php"..i didnt find the suitable regex for it..and i need to download that page
View 3 RepliesI want to download the same information which is obtained when we right click view page source in browser. I want to do this either in vb.net or perl
I need it for google image search result webpage.When that page is saved then html code is not same as view page source info.tags for images are absent. [code]...
I am not sure if this is possiable but I am looking to build an application that will login to a web site, navigate the site and download files. I would like to do this all in code and able to run multiple instances of the program to get information from many different web sites. Is something like this possiable in VB.net?
View 3 RepliesI'm deploying a VB.Net app (VS 2010 Pro) that requiers the user click a command button to open IE to a financial WEB site and download informaion from the site. The app works fine in every detail when installed on the development computer. But, on the target computer when the command button is clicked an unhandled exception occurs which says: System.IO. FileNotFoundException:File Not found.My code behind the button is Shell("C:Program Files (x86)Internet Exploreriexplore.exe www,fidelity.com",AppWinStyle.NormalFocus)
This works fine on the development computer. Do I need a way to code this as a relative path? If so,can you tell me how this is done?Throughout the app I have written relative paths to needed files using paths like (Open(Environment. GEtFolderPath (Environment. SpecialFoldder.Desktop) + "File Name). They all work fine when deployed.
I'd like to know how I can pull info from a site's source.Here's an example
<li>
<div>
<a href="http://www.autozone.be/bmw_1-reeks_120d-m-sportpakket-xenon/auto/detail.jsp?zoekId=2347653&locale=nl_BE">
[Code]...
I'm trying to save the source of a site and then read certain lines, this works once. The second time I get this error: "IOException was unhandled"
Public Function GetNumberOfLines(ByVal File_Path As String) As Integer
Dim SR As New StreamReader(File_Path)
Dim NumberOfLines As Integer
[Code]....
This might be a strange question, but I need my project to get/download name of a html input. The html source code is:
HTML
<td><input class="text" type="text" name="ebd435a" value="" maxlength="15" /> <span class="error"> </span></td>
I need my project to get the "ebd435a".Why? Because the 'name' is changin sometimes and I wan't my site updater to works whatever the 'name' is.EIf this is not possible or to hard, does anyone know if I could make a website get the code and then my project to get it from the website?
all I want is a function like this:
[URL] but then with the option to provide username & password. I have managed to do this with the webbrowser, first logging in then go to webpage and get source code but this takes much longer than just getting the source code...
Is there any way to do this? I found this:
[URL]
I tried with &username=...&password=... in the URL but it didn't work
Is it possible to load the page source of a website without loading the page using webbrowser?
View 1 Repliesany code sample to enable user to download all pdf links on one gridview and download all by one button click instead of clicking the link one by one?
View 2 RepliesI've used this method tons of times, always worked but for some reason it does not work with [URL]..anyone has an idea what the problem is and how to fix (I tried also with just 'http://blinkx.com' did not work too or maybe other ways to get the source page of this website?
[Code]...
url...only after you have logged in (because then you can see your collected points)How can I do this? I tried the &password=.... thing after the url didn't work I also tried with [code]this would work but it's complicated because then you'll need to check if you are logged in, log in through webbrowser and then get source page, I think it should be possible faster..also how can I check if the page is completely loaded in a webbrowser control? now I usually go to a webpage and then continue my code in the [code]but this become complicated if I want to go to another website after that because then it starts from the beginning again and I need goto statement, etc this is really annoying and complicated after a while
View 1 RepliesWay to space out the source code of a web page, having each tag on one line, without having to search for each tag ending and then making a new line after.
My code for obtaining the source code is:
CODE:
Also if anyone knows a way to colour the tags.
Is it possible to display the page's source by opening notepad.exe (via Process.Start) and somehow set the text to the source?
View 7 Repliesokay is there anyway i can login to a site and get the site's source without using a webbrowser ? i want to do this cause i do rewards1 and i want to check my ballence every 5 sec to see when an offer credit's.
View 13 RepliesI want view source of any site in XML file.
View 2 RepliesI'm trying to make an application that would give me the source code off a web page. But so far I have nothing.
View 39 RepliesI have a program that logs into a secure site, looks on the user's home page to find a list of links to reports that can be downloaded and then selects each one - this is currently a manual process but with 100 reports a time it takes a while. The idea is that all the reports will download to a specified folder with generic names so the user can play with them on their own computer rather than having to search through them online.
Anyway, everything's gone well as far as using a WebBrowser to connect to the site, log in and get the list of URLs however it falls down when it tries to link to them. I have tried two methods:
1 - Navigating straight to the URL, this gives an error message every time (asking me to try again)
2 - Directly downloading the URL with a WebRequest class (below) however this doesn't download the actual file, but rather a copy of the login page.
Current Code:
Public Sub DownFile(ByVal sFile As String, ByVal sRemoteUrl As String)
Dim wr As HttpWebRequest
Dim ws As HttpWebResponse
[Code].....
Last month (i think) i needed help with regex which i used to find MP3 urls in the source code of a site.Now the code doesn't function properly
[Code]...
Ive got an app that holds a list of site we have, At each site there are a few devices. The idea is when they click on a site all the details for the site are loaded and then a second thread sits and pings each device to see if its live. Im trying to do this in a seperate thread so if they click another site while its still pinging them it doesn't wait before it switches site. This all seems to be workling fine except if you click through the sites quickly, when you do that it will eventually come up with
Quote:
{"Collection was modified; enumeration operation might not execute."}
The error flags up on the "Next" line in "ThreadedPing"
Thread stuff
Public Sub ThreadedPing(ByVal dt As DataTable)
Try
Dim dr As DataRow
[CODE]...
I am trying to get the html source of a web site but getting an "Internal Server Error (500)" instead. [code]
View 1 Repliesis there anyway to get the page source with out complete loading the page?
View 3 RepliesIs there a way to check if a site had a page update or a new post easily?? Even just to check if something had changed on the page.
View 4 Repliesim trying to to fill the value for the login page of site here the html code
<input type="text" placeholder="Email" class="login_textbox" name="username" id="username" tabindex="1"> i tried this but doesnt work WebBrowser1.Document.GetElementById("username").Se tAttribute("value", "elvin")
I used this code to duplicate the contents of the tab.
Private
Sub
Form1_Load(ByVal
sender As
[code]...
But I want the tabpage to display the title of the site?
I'm working on a project. I want to be able to right click on a webpage and click on my custom context menu item (let's say 'screen'). What this should do is get all the page source from the current web page from where I righ clicked and save it on the disk. Basically, "right click -> view source -> file -> saveAs ", this is what i want to do programmatically.
View 6 RepliesIn my Site.Master.vb file, I have a custom User object:[code]Now in one of the content pages, I want to be able to see if a user is logged in. I figured if the object u was declared in the Site Master, I could use it in the pages that derive from the Site Master. For example, I want to do:[code]
View 2 RepliesI am working on a task in which I have to download all flash objects swf and flv files running in web page. I have got no clue to find he source of .swf file, as mostly swf files comes from other servers. I want to find out some way to find the source / url of .swf currently running. Kindly suggest me some way.
I have 2 ideas in mind, but currently unsuccessful in implementing them
1. Using WebBrowser class and somehow find url of swf.
2. Using Pcap to fetch all http packets and after decoding, some how try to find url coming.
Download a webpage source without using a browser and place in to a textbox ready to edit and post(stop page/image load times)
View 3 Replies
