VS 2008 Extracting Information From A Webpage?
May 10, 2009
I am trying to take specific information from a web page and then process that information so that it can be sent to a label or text box.Previously, I had wanted to do this by using Regular Expressions. I've looked around and it seems that using regular expressions to parse information isn't always the best way because website aren't always coded to standards.Regardless, learning regex isn't working out too well for me. So, I was wondering if there was another way to do this?I was thinking that I might be able to use the web browser control. It would be ideal to be able to see the page in the form, select the information, and then be able to display it.
View 8 Replies
ADVERTISEMENT
Feb 25, 2009
I want to extract a specific information from a webpage.For example:url...So can I make the software see what's between "<h1>Your IP address is<BR>", to "</h1>"?And doing all this by using the webbrowser form in Visual basic studio 2008.
View 1 Replies
Oct 2, 2009
The method I'm currently using to extract html and the parse is via a WebBrowser control. I'm grabbing a collection of tags, sorting through the ones I want, and then pulling the innertext.
Doing this on my development machine is kind of slow, but manageable. At max, I can go through 60 different web pages across 3 different sites. It takes about 5 mins on my machine.
However, this app is targeted towards machine that have a quarter of the technology that my computer has. So, it takes anywhere from 10-15 minutes. This is less than ideal.
Does anyone know of any other method that I could do that would take less resources and perform a lot quicker?
View 7 Replies
Aug 16, 2009
I'm currently using a webbrowser control to extract information from multiple websites. At any given time, my application could be searching through 1-80 different webpages across 1-4 different websites. On my computer, it runs pretty quick. I could go through all 80 sites in just a few minutes. But when on another machine with fewer resouces, it runs awfully slow. Taking up to 15 minutes. Which kind of beats the purpose, but not entirely, of my application.
I'll begin by explaining my methods, and go from there. When utilizing the Webbrowser control, I use While statements and Application.DoEvents, instead of the Webbrowser controls's DocumentCompleted event. I'm wondering if this is one thing that could be slowing down the process. Though I'm not sure why it would be. Also, would utilizing separate threads help with this? I can't imagine it would boost performance. But I'm not entirely sure. I think it bogs down because the application uses so much memory when running. On idle, the application uses about 9.5k memory. When running, I've seen it go as high as 110k.
View 4 Replies
Feb 3, 2010
My university has a website that students can use to check stuff like their lesson schedules, latest grades, exam times, etc. Just general information about you and your study (after you have logged in of course).For interested, this is the website (not much use without a login obviously, but still): [URL]I have been thinking lately that it would be nice to have a desktop application that could give me the same information. However, I have absolutely no idea how that would work, and whether or not it is even possible. I mean, technically it should be possible for me to get the information (how else does the website get it) provided it is not secured (even when using the correct login details). I am sure the website communicates with a database somewhere. Does that mean I could theoretically also communicate with the database (probably: read from it only, not write) for example by executing queries?If that is possible, how do I figure out which queries to use for the different pieces of information? Obviously I don't know the details of the database so I can't just send a random query and expect it to work...
View 8 Replies
Nov 1, 2009
I'm trying to get the version of IE and Google Chrome from the registry. I've successfully been able to get IE, but it seems chrome is eluding me.The following code is what I'm trying:
vb.net
Public Sub ChromeVersion()
Dim SoftwareKey As String = "HKEY_CURRENT_USERSoftwareGoogleUpdateClients{8A69D345-D564-
[code].....
View 2 Replies
Feb 15, 2010
I have a list box containing all urls in a websitemy code for getting the urls from a site is:
Dim wc As new webclient
Dim aa As String
Dim sr as new streamreader(wc.open("TextBox1.Text"))
[code]....
View 14 Replies
Apr 22, 2010
Im trying to get certain text from a webpage and display it in a textbox. In the image below , i want to disply all the text after "Filename:" in a textbox as highlighted below.
View 16 Replies
Feb 16, 2010
I need to extract email id from website...
i am able to get urls from the webpage. but i couldnt get email id's from the webpage.
View 1 Replies
Feb 18, 2012
lets say webpage has 2 strings named sampleObj="sample1" and sampleObj="sample2" Even though sampleObj remains the same the text inside, however, changes.How would you loop inside page and get sampleObj text each time? I tried Regular Expressions and GetElementsByTagName but no luck.
View 1 Replies
Oct 2, 2009
The method I'm currently using to extract html and the parse is via a WebBrowser control.I'm grabbing a collection of tags, sorting through the ones I want, and then pulling the innertext.Doing this on my development machine is kind of slow, but manageable. At max, I can go through 60 different web pages across 3 different sites. It takes about 5 mins on my machine.
However, this app is targeted towards machine that have a quarter of the technology that my computer has. So, it takes anywhere from 10-15 minutes. This is less than ideal.I've bee reading up on the documentation on HTTPWebRequest. However, form what I've seen I can't seem to find a way to grab the HTML and then parse it with a method from HTTPWebRequest.
Due to the way I'll be using it, I won't be able to use RegEx to parse the data and was hoping there was a method within the HTTPWebRequest property to do it.
View 2 Replies
Jul 4, 2011
I have the following text, it displays like this in a textbox, but is all stored in one string:
[Code].....
But I cant think of a way to do it, the only thing I can think is to try and grab the text on the line after each "+CMGR:"
View 2 Replies
Feb 19, 2011
I have a lot of information distributed among some tables in a database (and must likely it will all be represented into oop). I will need to create text files with different formats from the same data depending on the request. My idea is to create a design that will require no coding if such formats are to change of be added.I was thinking in using some sort of XML magic trick to accomplish this but I have no idea how to. I am also open to new ideas.
View 1 Replies
Nov 7, 2009
I was just wondering how to extract or parse any particual tags (whichever I specify) from webpages. I know how to extract text and links from webpages, but I tried to use the same method from the following code for div tags, title tags etcetera and it doesn't seem to work:
[Code]...
View 2 Replies
Feb 5, 2011
I'm trying to identify a specific string within a text file, and then extra a couple of bits of information that follow from that.
Example snippet from text file:
>Date 5.3: Tech Manual {30201}
Freya Plumes (30201) - 1
mu
These are made from brightly coloured. I want to be able to find where it says "Tech Manual", and then assign "Freya Plumes", "30201" and "1" to variables for manipulating and exporting to another file. There will be many instances from the same text file with similar information, so I'd need the extracted strings popped into an array for later referencing.
View 7 Replies
Dec 20, 2010
I want to extract some information from a web site (Bloomberg). This side has a search textbox with a onKeyUp event that, as far as I can understand, uses AJAX to create a table. Is it possible to insert some text in the textbox and then get the table created with AJAX? Given the source code of the page with the tabled already AJAXed (If you understand what I want to say here), I can easily retrieve the table. I just need to get the source code with the table already on it.
View 7 Replies
Aug 18, 2010
I'd like to look into extracting EXIF tags/data from jpg images. I've looked around but can't seem to see any simple example. Anyone able to point me into the direction of pulling out the model/date values etc out of EXIF data?
View 2 Replies
Jun 10, 2011
I'm trying to pull information from an XML webpage but for some reason it just isn't working. The XML webpage looks a little like
<?xml version="1.0" encoding="UTF-8"?>
<item>
<reqdat>Date and time</reqdate>
<result>Completed</result>
</item>
I want to get the node, but everything I've tried hasn't worked :( I think what I need to do might have something to do with SelectSingleNode but I'm not sure.
View 1 Replies
Feb 4, 2010
I am having a bit of trouble figuring out how to collect a piece of information from a web page. Here is the web page I want to retrieve the information from:
RuneScape - The Number 1 Free Multiplayer Game
I would like to retrieve the first "Price" of the item and collect the price every time I execute the code. I understand how to retrieve the source code of the webpage and split strings but how would I retrieve that price?
View 1 Replies
Feb 12, 2012
I've currently got a service that produces xml files every 10 seconds containing server information. I'm looking for a way to display this on a web page. I have been looking on the web for the best way to do this and it seems that using AJAX would be good as it allows the loading of dynamic content to be done in the background. However how can I use AJAX? Should I add a ASP.NET website to my visual studio project? OR should I look to use javascript & AJAX in something like dreamweaver? I'm very new to programming so i only really have a bit of experience in vb.net.
View 2 Replies
May 5, 2012
I need to navigate to a webpage and copy a string of information from it within the shortest possible timeframe. The site has the following written on it:This is the string that you need to apply to your algorithm.
Generated String: 61*76*83*47*69*88*
I want to copy the string from the webbrowser control and place it into a string called "GenString"
View 1 Replies
Jul 1, 2011
What I want to do is to get information which has been stored on a webpage in a hidden field.
I have been able to put information on to a web page using the following
WebBrowser1.Document.GetElementById("email").InnerText = email
WebBrowser1.Document.GetElementById("college").InnerText = coll
WebBrowser1.Document.GetElementById("status").InnerText = status
[Code]....
I have tried various lines of code but non of them seem appropriate for what I want to do. The current line I have got is:
'hidfld is the hidden field on the webpage which I want the info from
findword = WebBrowser1.Document.GetElementById("hidfld").OuterText
View 2 Replies
Mar 27, 2011
I am *VERY* new to web-scraping and am trying to scrape some information off of a webpage that is heavily javascript enabled. An example of the page I am trying to scrape from is: [URL] I am trying to scrape the property links such as "322 E 98th St" The text appears on the webpage and I can find the link myself, but it doesn't appear in the page source code.
I am trying to scrape it using the webbrowser control using the WebBrowser1.DocumentText property, but it doesn't even show the links simply when I view the source in ie. I am sure this has something to do with the javascript it uses to load up the page or maybe iFrames,
View 3 Replies
Apr 25, 2012
I have been working lately on a program who extracts URl Source codes!The program does work with most of URL but not for MEdiafire URL!When i check the source code from the web browser i can see there is some code missing;y tried diferrent types of Encoding.
Example:This is the final source code extracted from WEBBROWSER(Firefox,InternetExplorer,GoogleCrome)
--------------------------------------------------------------------------------------------
<div class="mf_lightbox_btns lb-footer" style="text-align: right;">
<a href="javascript:void(0);" class="secondary btn" onclick="$('body').removeClass('has-virus'); return false;">Dismiss Message</a>
<a href="http:www.bitdefender.com/mediafire/fix-it.html" target="_blank" class="alt btn">Get BitDefender</a>
[code]....
View 1 Replies
Oct 20, 2009
All I've been able to do is create the form. We have to get information off of a website and load certain information back into the textboxes on our form.
Assignment 6 - Text Parsing Many applications require you to extract information from a block of text. We will be using this heavily in the project. This project is designed to give you some practice extracting information out of text files. You will need to open up a file, search the file for some specific content, and then copy that content and place it on screen.
Go to Jobs.com and select a state that starts with the same letter as your last name (if there is no state that starts with the same letter, use the second letter, then the third letter, etc.). For example if my name was 'John Byway', since there was no B or Y, I would pick a state starting with W - either Washington, West Virginia, Wisconsin, or Wyoming.
The idea is you want to extract all the jobs information out of the page. We want to put the jobs names in a combo box, so the use can pick any of the jobs. Ideally, this would also show the information about each job. You don't need to do that. However, you do need to extract the information and put it on the screen (When you load the next job, the old job information will be lost, and you will be left with the information about the last job loaded)
Tasks
1. Go to the above address, view the source in the browser, copy and paste it into a text file. You do not need to access the Source of the web page within your application.(in IE go to View / Source; In FireFox go to View / Page Source)
3. Extract each job title and place the name in the Combo box.
4. Find and extract the following fields. Note, some jobs may not list all of these. In that case, get as many as are presented.
a. Date
b. Title of job
c. Company
d. Location
[code].....
Indicate on screen how many jobs you found. Note, you only need to look on the first page of jobs?
View 1 Replies
Dec 21, 2010
I have a program made in VB that on a button click extracts a exe file from its resources to the HDD then runs the program and deletes it after it closes. I first used the desktop to extract the file to, but seeing as I need to use this program on several computers the account names will be different so this is of no use. I've tried using C: but access is denied.
View 2 Replies
Jun 21, 2009
I've found all sorts of threads about extracting file icons, and I'm able to do that no problem, but I would like to also extract some other information from a file (like you can find in the properties window), such as the file description. Are there any commands that are geared specifically toward getting this information?
View 1 Replies
Oct 19, 2009
I am wondering if there is an option of extracting fielpath using OpenDialog control.
I am using following code..
strFilePathAndName = openFileDialog1.FileName
strFilename = IO.Path.GetFileName(strFilePathAndName)
[code].....
View 2 Replies
Jul 20, 2009
I have been looking everywhere to find a way to extract the main icon from for example c:/test/file.exe and put the icon in for example c:/test/fileicon.ico i did find something but the icon looked dreadful, it must of been like 16 colours.
anyway if someone has managed to do this or knows how to do it please help before i go insane.
also i will settle for knowing how to do it with reshacker.exe instead which i also cant get to work.
View 14 Replies
Jan 14, 2010
I'm extracting icons from running processes and then adding them to a ListView. Some processes don't have icons or I can't get access to them, so the icons are sometimes all mixed up. The following is how I'm extracting the icons:
[Code]...
View 4 Replies
