what i am trying to do is extract information beween two tags in some html from the source of a website. The contents of the text between the two tags will always be different. the code i currently have is;
[Code]...
I am trying to extract everything between the body part as I am building a forum crawler
and since all the user posts are between the <body></body> I have chosen to experiment
with Regex. So far I have coded the following but sort of stuck on how to output the result say in a textbox? Also I am not sure if the body part of the regex is correct.
Dim URL As String = Textbox1.Text
Dim request As System.Net.HttpWebRequest = System.Net.HttpWebRequest.Create("URL")
Dim response As System.Net.HttpWebResponse = request.GetResponse
Dim streamReader As System.IO.StreamReader = New System.IO.StreamReader(response.GetResponseStream())
[Code] .....
I have got a problem with the regex pattern. I couldn't be able to extract the id in the images tags from the html source when I find the matches pattern that I selected on the listview items. [code] It have found the matches with the html tags, but it doesn't extract the id from the images tags. [code] Do anyone know how I can extract the id in the images tags from the html source?
View 15 RepliesThe info i need extracted is formatted:
<TD><A HREF="http://xxxxx.com/xxxxxx/index.html"><IMG SRC="../xxxxx/thumbnails/xxxxx.jpg"> </A></TD>
<TD>=== <B><A HREF="http://xxxxxxxxx.com/xxxxxxxx/index.html">LINE 0</A></B> ===<BR>
<FONT SIZE="2" COLOR="#400080">
[code]....
how do i extract the info between TD=== and /a and Line 1,2, and 3 and store it into a database from a live website?
i am trying to extract some usernames from a website. normally i dont have a problem and but cant get it to work...here is the code i normally use
For Each temp As HtmlElement In WebBrowser1.Document.Links
Dim str As String = Nothing
str = temp.GetAttribute("href")
[Code]....
but this is the html code i want to get from
<a href="http://help.com/?status=@astradamasta%20&in_reply_to_status
how would i go about getting the user which is astradamasta
i'm trying to get some information of a webpage via regex on visual basic 2010
it's something like this:
<SPAN CLASS="clear"></SPAN>
<h2> blabla </h2>
<h2> blabla </h2>
<b> blabla </b>
[Code]...
I want to get tags content in a string with regular expression. I wrote it for just one line. When the content changed into some lines from one line, Regex will never do pattern on the tag. I choose RegexOptions.Multiline + RegexOptions.Singleline for finding options.My pattern in low level: (>)[ a-z A-z 0-9 ]*(</)
View 2 RepliesI have an HTML document in .txt format containing multiple tables and other texts and I am trying to delete any HTML (anything within "<>") if it's inside a table (between <table> and </table>). For example:
===================
other text
<other HTML>
<table>
<b><u><i>bold underlined italic text</b></u></i>
[code]....
I wan't a Regex to remove all html tags with NO data between them...
sofar i have got:
"<span(s[^<]+?)?>([s
]+?)?</span(s[^<]+?)?>"
but this will obviously only work for all span tags ... how can i make it work for ALL tags?
I am trying save a value from an input tag in some HTML source code. The tag looks like so:
<input name="user_status" value="3" />
I have the page source in a variable (pageSourceCode), and need to work out some regex to get the value (3 in this example). I have this so far: [Code] Which works fine most of the time, however this code is used to process source code from multiple sites (that use the same platform), and sometimes there are other attributes included in the input tag, or they are in a different order, eg:
<input class="someclass" type="hidden" value="3" name="user_status" />
I just dont understand regex enough to cope with these situations.
.net framework 2 vs 2008?I need to extract a string from website. Loading a site in a big string works perfect. Im searching on google and here and I come to conclusion that regex is the easiest way to go. So...How to extract a string from one big string between known words using regex?reader string holds next data to use with regex:
...
<div id="sites-content0" class="sites-canvas-main-content sites-clear" style="">
<div dir="ltr">SampleDataToExtract v.1.2.6.7<br /></div>
</div>
...
I need to extract: SampleDataToExtract v.1.2.6.7 to another string and then work with that...
Vb.net
response = request.GetResponse()reader = New StreamReader(response.GetResponseStream(), System.Text.Encoding.GetEncoding("utf-8"))Dim test As String = System.Text.RegularExpressions.Regex.Replace(reader.ReadToEnd, "<[^>]*>", "$1", System.Text.RegularExpressions.RegexOptions.IgnoreCase)
I'm in need of some help trying to figure out the RegEx formula for finding the values within the tags of HTML mark-up like this:
<span class=""releaseYear"">1993</span>
<span class=""mpaa"">R</span>
<span class=""average-rating"">2.8</span>
<span class=""rt-fresh-small rt-fresh"" title=""Rotten Tomatoes score"">94%</span>
I only need 1993, R, 2.8 and 94% from that HTML above.
How would I use Regex to extract the body from a html doc,taking into account that the html and body tags might be in uppercase, lowercase or might not exist?
View 3 RepliesI need to extract some info of a HTML source code and put it in a textbox...i treid a lot of things and even the best idea's crasht what i got this far is :
Private Sub Button2_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Button2.Click
WebBrowser1.Document.GetElementById("value_wood").SetAttribute(TextBox3.Text, "class")
End Sub
[code]....
the number that i want in the textbox is : 8,466
Like in firefox or Internet Explorer where you can right click and view the html page source how can you do this in an app?I have a web browser in the form and I'm trying to view the web page in the web browser and then view the source code of that page in a box below it.
View 8 RepliesI want to take the text and some special characters between the xml tags.. My input file contains:
[Code]...
now i want the Regex to take text and the special characters between the tags <line>,<inline>..
I'm working on a program that get's a file list from an FTP server and it's getting it as one giant html string, here's what I'm getting:
[code]...
Alternatively, if anyone knows how to get an ftp file object using .Net 2.0 instead of an html string that would be even better.
I have a HTMLDocument, and in it there are a number of TAGS with a value between them:
[code]...
I'm trying to analyze web pages for seo. I'm trying to create my own personal tool to extract all the keywords and tags from web pages (a little clearer).I already know how to extract or parse links and text from web pages. The issue is that I tried to implement title tags, body tags or keyword tags in general via using the following code:
Dim theElementCollection As HtmlElementCollection = WebBrowser1.Document.GetElementsByTagName("a")
For Each curElement As HtmlElement In theElementCollection
If curElement.GetAttribute("href").Contains("http://twitter.com/") Then
[code]....
Try to extract all the keywords from the title, body etc. for this page:[URL] and send it to separate textboxes (title keywords in textbox1, meta tags in textbox2 etc.).
I have been stumped on this for about 3 weeks now. In the beginning me and my partner have been trying to hit this at the internal angle. only problem is different html tables are constructed different than others. We are needing to extract from multiple pages and sites so we know that Regex will be the best solution. We can use the same script for everything. This is my first time working with Regex, I got it actually extracting the very first ip[proxy]. I have no idea why it isn't extracting every one on the page. I also have to add the . in between each each octave of the ip. That is weird because I have it in the Regexpession to find the .'s.What I'm Needing is for this to basically scan the whole page and grab all the ipsorts and add them to a listbox.Here is my
Dim request As HttpWebRequest = Nothing
Dim response As HttpWebResponse = Nothing
Try
[code].....
I have been trying to get this regular expression for hours now with no luck, i'm trying to get:
<tr bgcolor="#ffffff" class="text" height=10>
<td>Graham</td>
<td>29</td>
<td>Date</td>
</tr>
This is the format of the html, i just need to gett he users age and name, using reg ex i have so far:
Dim proxySourceHTML As New Regex("(?<=<tr bgcolor=""#ffffff"" class=""text"" height=10>"").*?(?="".*?"">)", RegexOptions.IgnoreCase Or RegexOptions.Singleline)
Dim matchesFound As MatchCollection = SourceHTML.Matches(GETHTMLResponse)
[code]....
Still getting to grips with regex and have seen a few samples about that give me most of what I need so asking for opinion on this. I need to extract x words from a single line, so the regex could use w+ to get characters, however my line may contain anything inside the word like:
[Code]...
I was just wondering how to extract or parse any particual tags (whichever I specify) from webpages. I know how to extract text and links from webpages, but I tried to use the same method from the following code for div tags, title tags etcetera and it doesn't seem to work:
[Code]...
This may sound really stupid but I have to ask cause I'm not finding this answer anywhere.I have an application where the user will need to sign up for a new user account on the website [URL]..However when I am using Firefox's plug-in Firebug to view html I am getting something totally different than when I just right click on the site and view the page source.
What I am trying to do is to get the captcha from the website and display it in a picturebox on the application so the user can view the captcha, solve the captcha and then the app post is back to the service for a response.
Here is the source that I am getting using Firefox's Firebug to inspect the element:
<td>
<input type="hidden" value="Oo3Jo1I8bgzK68agMqo3s79ZZib2OkbK" name="iden">
<img class="capimage" src="/captcha/Oo3Jo1I8bgzK68agMqo3s79ZZib2OkbK.png" alt="i wonder if these things even work">
</td>
[Code]...
Why would the two be showing me two different versions of the HTML?
And how would you be able to grab that source to view in a picturebox using webclient?
i have this
Dim wc As New System.Net.WebClient()
Dim p As New System.Net.WebProxy()
Dim test As String
wc.Encoding = System.Text.Encoding.GetEncoding("utf-8")
p.Credentials = System.Net.CredentialCache.DefaultCredentials
wc.Proxy = p
[Code]...
I have a html string like this:[code]I wish to strip all html tags so that the resulting string becomes:From another post here at SO I've come up with this function (which uses the Html Agility Pack):[code]
View 4 RepliesSo I grab a source from an url in vb, and as expected it lists everything written in there. My interest lies in the info that resides outside of the tags in the code. And that stuff gets updated daily, so they're not static strings eitherm here, I've been able to filter out all the tags, and grab everything outside them, and show em in a messagebox, but somehow it picks up every line change, that's essentially an empty character, and lists those as well. We hit our heads together with a couple of friends but we couldn't work out why.Also, I've tried modifying it to find different stuff, but somehow everytime I try something different the system gets screwed up and it finds no results. But that's just because I'm such a buffoon with the code.
Imports System.Net
Imports System.IO
Imports System.Text.RegularExpressions
[code].....
This may take some explaining but the concept is pretty simple. A user will select a file which contains data that they wish to extract from, so keeping it simple they pick a file like so:
[Code]....
So, I need to show the user the file, allow them to select a line to match and/or extract from. So they select the first line ready for a match, they then select a word/s to mark as a constant for matching, so in this case it would be: MyGroup A simple version for text match would be like "MyGroup *" Now, I need to convert this to regex dynamically (I assume its the best method), its not a one off, the data that is selected is all open and up to user selection. There could be multiple selections and multiple extractions on the same line!
[Code]....
i need help parsing html using regex..i am hardly find the exact expression to use.
[Code]...
Im trying to make an appliaction that tells the user his/her location depending on the URL
Im using this site to get the information :[URL]..Im having trouble with the tags that are always changing.
What i have so far:
[Code]...