I'm trying to do some screen scraping, and discovered the HTML AgilityPack, but am having some trouble figuring out how to use it with VB.net.The first thing I want to do is find the URL string for an HREF tag if I know the text that is enclosed in the HREF..
View 1 RepliesI've been programming in VB.NET 2005, 2008 and now 2010 for almost 2 years. Just casual little applications, nothing big.In this project I need to parse links from a web page, it doesn't quite work though, it parses the names only and no links.I'll give you my code, let's say for a random page:
Private Sub Form1_Load(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles MyBase.Load
TextBox1.Multiline = True
WebBrowser1.Navigate("http:www.buyfixuse.com")
[code]....
If I activate this function in my application instead of links to the two blog posts on that website, it only gives out the text that is related to these links - (more...)
I tried using it and to get it to work I had to add some code to my project:
Public Enum HRESULT
S_OK = 0
S_FALSE = 1
E_NOTIMPL = &H80004001[code].....
I didn't like the fact that I had to use the MSHTML stuff (cause I think IE uses it also, and we all know that IE sucks :) ) and that I had to add code the make it work.Don't want to start a browser-war thread so neglect my last remark.Is there a different (/better) approach of parsing html-pages in VB.Net.Basically what I'm trying to do is get all the links (<a> tags) and embeds (<object> tag) on a page.
I'm just curious as to how some software programs that I see out there have the ability to extract links & text from thousands of web pages at an extremely high and fast rate. Has anyone here, ever created a link or text extracting program the has the ability to parse many webpages and return data into a textbox? I know how to extract links via the webbrowser control, but it doesn't seem to parse/extract data at a very high & fast rate like many email, link & text extracting programs that I see out there.
[Code]...
I've given a job to convert old data in table format to new format.Old dummy data is as follows:
<table>
<tr>
<td>Some text 1.</td>
[code].....
I have this code to take links from a page
CODE:
But how would i also get the links name?
<div style="color: #000000; font-family: Verdana, Arial, Helvetica, sans-serif; font-size:12px; background-image: initial; background-attachment: initial; background-origin:
initial; background-clip: initial; background-color: #ffffff; margin: 8px;" mce_style="color:
#000000; font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 12px; background-
[code].....
I certain html page contains links that are displayed with each onclick event. I am unable to parse the html for the url that will follow these onlick links. If this is the source on the page, how do I capture the content that each onclick link displays. In other words for example:
[Code]....
Now this is the onclick link that will display some content which I need to capture. Basically I want to be able to activate the onclick event from a program to display and capture the url links from that specific page.
There have probablly be thousands of threads just like mine[code]...
View 1 RepliesI'm trying to get all <A> and <IMG> tags from the webresponse I got from [URL]. Basically Im trying to get a collection of all links and images in an html string.
View 1 RepliesWhen investigating effective methods of documenting our VB .NET project, by experimentation I discovered that I can make a comment like'See the file at file://path_to_file and I can then ctrl-click on this link to bring up the file in a new tab. Is this feature and perhaps other capabilities of Visual Studio comments documented anywhere? I would like to make a system of documentation consisting of an html pages that link to code, and vice versa.
View 1 RepliesI was able to grab all the links in that html code but I was wondering how do I can grab the the links under the "Common fruits". how to get grab
<html>
<td id="item_menu" class="line" valign="top" width="100%">
<a class="nopd" target="mainly" href="http://myfruits/aboutfruits.html">About fruits</a>
[code].....
I am trying to pull a set of html elements from a webpages to copy all the links on the page and toss them into a richtextbox.The tags are <a href "I need everything inside the quotes"but for the life of me I cannot figure out of to work the line of code to accomplish this..
View 2 RepliesI'm having some trouble putting the pieces together.First of all, I'm currently using the WebBrowser component, but would be plenty happy with HtmlAgilityPack if it had some decent documentation, but for a newbie as VB.Net, it's a rough road.
<h3 class="this-class">
<p><a href="file.html">Title</a></p>
</h3>
[code]....
What I'd like to do is grab all the h3's with the "this-class" class and stash them into an array (one in each array element).I'd then like to search through each one and see which has "And Another Title" - which I already have the code to do... I just don't know how to do the first bit.
I'm having a brain block on how I can make this happen.I have an HTML document, like below.
<blockquote>
<p><a href="file1.html">Hyperlink 1</a></p>
<p><a href="file2.html">Hyperlink 2</a></p>
[code]....
Imports System.Web
Imports System.Net
Imports System.Net.ServicePointManager
Public Class GetSource
Function GetHtml(ByVal strPage As String) As String
tryAgain:
[Code]...
What I got here is a vb.net code where I parse the website for its html This function works fine. The question is this...
1.If I run 100 threads with this function at the same time, Will it work?
2.Won't it affect my internet connection as well?
I don't want to waste time creating threads and codes a hundred times so if you know the answer please advice me on what should I do instead
I successfully wrote a code to retrieve a version number from a HTML page which is this:
<div class="header">Latest Version: <span class="version">6.59</span></div>
So the following code will return the version number which currently is 6.59 which is what I'm after. [Code] But then i remembered that releases are done as following: 6.59, 6.59b, 6.59c, 6.60, 6.60b etc. So when the b version of 6.59 is released the parser will still return 6.59. So how can i make this code better?
so here's the code I'm using right now.
View 4 RepliesI need to parse a web page for blocks that contain open trouble tickets. The web page display several unresolved tickets and each one is inside a html divison labeled "issue-status". I've written the following code which does find the blocks, but when I try to parse its children to get its element fields (date opened, person requesting, history...) it instead pulls every element from the web page, not just the children.Is there a way to just parse the sub-fields under a particular DIV?
Code:
Dim theElementCollection As HtmlElementCollection
Dim strResult As String = ""
[code].....
Parsing HTML in code? Content removed.
View 7 RepliesI am trying to parse some html in vb.net but i not sure how to do it. The html that what i am trying to parse is:
[Code]....
get generic regular expression for my html file ....????? My html is....
[Code]...
I'm a PHP/MySQL/HTML guy, but in the course of my work, I sometimes have to delve into Gatesland.I am working in VS2005 developing reports, and occasionally I have to write some custom code. This code is in (I believe) VB.NET. I avoid this as much as possible. It is my belief that if you have to use custom code in a report, you're doing something wrong with the DB, or with your query.Now, my boss (for reasons unknown) is storing data in the database as HTML. This data is historical, having a month and a dollar amount, and comes in a form like this:[code]I know this breaks even 1NF. I did not design the database. I simply must suffer under it's schema. See, the developer did this so that he could just read in a field, and dump it straight out to an echo/print statement when forming up the HTML. Unfortunately for me (the report developer), HTML shows up as verbose text if I dump it out as a field in a text field in a VS2005. So, I need to strip out he HTML tags, and replace them with appropriate values.
I am first trying to strip out the <th> data, and print it out with appropriate line feeds and carriage returns. This is the code I am trying to use:[code]Now, far from doing what I intend it to do, it simply returns the jubilent result "#Error". Wonderful. I'm sure the client will be happy.There must be some simple syntax errors or something going on there, but I am nowhere near an expert with VB.NET. I've used VBA extensively, but last time I used it was about 3 years ago. I'm hoping I can cash in some of that positive rep I've got, and get some much needed help in the dark wilderness of Microsoftia
I Have a folder that gets a lot of html files dumped into it I have to read each file and parse it to extract information. What I need is to be able to load the html into a HTMLDocument, but I'm having trouble.. here's my code so far..
Imports System.IO
Imports System.Reflection
Imports mshtml
[code].....
I have saved some HTML pages from the web...now i want to parse some specific data. I mean I want to retrieve some specific part from the HTMl page using VB/C# code. How do I go about it? I am using this code to read the html file..All i want to do now is to save the specifications to the DATABASE.
1. How do i select the specifications and display them in a ListBox??
2.How do i save it to the DATABASE??
I have an website with dynamic text on it, i want to transfer the text to an textbox, and the text is between this tags:
View 11 Repliesi need help parsing html using regex..i am hardly find the exact expression to use.
[Code]...
what i am looking to do is Parse this webpage [URL]...and pull out certain pieces like
@ScriptManifest(authors = { "ZMSP" }, keywords = "Crafting", name = "ZMSP's Battlestaff Maker", version = 1.00,description = "Makes Battlestaff.")pull out
[Code]...
how would i go about doin this putting those in a textbox and then putting the entire script into a richtextbox or anything really.this is the program so far so u can get an idea what im doing.
This page here has a table I need to parse.
It has multiple tags like this:
<td style="text-align: center;"><img src="http://www.pkmdb.com/res/icons/001.png" alt="Pokemon" /></td>
<td style="text-align: center;">001</td> <td style="text-align: center;"><a href="http://www.pkmdb.com/DL/PKM/bulbasaur.pkm">Bulbasaur</a></td> <td style="text-align: center;"><img src="http://www.pkmdb.com/res/types/grass.png" alt="Type" /></td>Different Number, different name. I need a way to get the number and name out of these tags. I'm rather terrible at this, and I've seen examples on the site, I just don't know where to start really on this.
I have a WebBrowser control on a form and pass HTML code to it to "preview". This works fine in development on a Win XP machine but on the target machine with Win 2K it just shows the HTML code in the control and doesn't parse it.
[Code]...