Extract Data From Websites With Program?
Sep 4, 2009I find no male in a forum the idea of extracting data from websites using java or php but the idea is to do with VB.NET
View 3 RepliesI find no male in a forum the idea of extracting data from websites using java or php but the idea is to do with VB.NET
View 3 RepliesI use Visual Basic.net to create a program that connects to several websites, logins, then post some data. I can't use the httpwebrequest, some java is required on those sites, so i use the webbrowser control.Now I created a form, some fields for input data and a submit button. The coding part is like this:
Code:
sub website1(vars)
'login here
'post some data
[code].....
The problem is that I can't control what happens after submit button is clicked. I need to pause or stop the process at any time. If I exit the program while processing, I can see that even if the window disappear, the program is still running!I tried to use a thread for this, but the subs only get called if I use begininvoke, or invoke on a starter thread.
I'm Trying to make a Program that Blocks / unblocks websites.[code]...
View 4 Repliesi am making a program that you should be able to block websites with. and i want the program to block the websites that is inside a text file or something, so the user can change the website that should be blocked.
View 9 RepliesI want to write a program, which if you provide username and password, will go thru the authentication of a specific website, and then jump to a specified section.
View 4 RepliesI need to make a program that will log into various websites in firefox. I have done this using the webbrowser control. But now I need to do it using Firefox. I have looked into HTTPWebRequests but with that it seems that you are just pretending to be a web browser. I actually need the page to load and log in in firefox. Considered just bundling a load of sendkeys in but that is very un-professional.
View 1 RepliesHow can I get HTML page source for websites in VB.NET?
View 3 Repliesi'm Trying to make a Program that Blocks / unblocks websites.With 2 buttons.one button with : ( block website ) and one with : ( unblock website )And one listbox, where i add the sites i want to block.if the site is blocked the color is "Red" if its not blocked the color is "green"?
View 11 RepliesI need to download certain sites, client informationit is a phone book that would be automatically taken to the download by clicking
View 2 RepliesI have used VB6 years ago. Few days ago I just got started again with VB 2010. So I'm newbie again, Almost forgot everything. I want to create a program for parental control that block specific websites.
What I exactly want to do is The code should check the titles of the open windows and see if it is blocked one. If it is, it will close the browser with a message showing it's blocked. For example If I put "yahoo" to check and someone opens yahoo.com it should be terminated.What I have done so far is, I made DOS batch file that will terminate all the browsers that are open and set that ready to run when the title matches blocked site name/address.But I am stuck at how I can check the titles of the window that are open.
[Code]...
Basically I want to know how to access a particular website from my application. I have used System.Net Namespace to request HTML from a website, It returns a complete HTML code which is used by Browsers to render the content on the screen but what i want is to interact with the website only without the use of a browser. I currently dont know how to do that.
I have a application which displays a Image when a user enters a keyword, lets say user enters a word "Envelope", the application will go to Google Images and search for this keyword. Now google returns images as results, the application now needs to download the first result ( which is a image) and display it on a form ). Everything here is done without a browser but via my application.
I use the webbrowser control to navigate to certain websites and login and retrieve some data. For that I created a sub for each website. On the form i have a button that calls every sub when clicked. The problem is that I don't know how to pause or stop the process once started. If I quit the program it will still run in the background until all calls complete. I tried to use a thread, but that doesn't go well with the webbrowser control.
View 15 Repliesthe "text", such as that you would find in a forum, and use it in a Visual Basic Windows Form.Everything in bold is finishedGrab theHTML source of a web page and store it into a string variable.Next I need to search that string variable for two HTML syntax, and place the text between them into another string variable
View 4 RepliesI have an application that receives data input from an automated set of devices. This data stream I have managed to capture & get it into a list box which I can sort based on the Device ID & the time that the response was received.There is a set time window for the devices to transmit their data into the application and during this each device is not limited to the number of responses it can send (ie :- Device 1 can send in 2 responses where Device 3 can send in 40 responses, etc).All of the responses are captured, listed & sorted within the listbox (this bit is working ).I now need to extract the last (ie:- latest) entry in the listbox for each Device ID & this is where I am stuck. I can retrieve the last item in the list but cant seem to extract the last item for each Device ID.[code]
View 2 RepliesIs it possible? And before you tell me to use SharpZipLib or something, i should warn you since i am a complete noob and cant use it without a complete, easy to understand guide.
View 6 Repliesi want to make a program that can extract only text from html code.
so far i have done this:
dim br as new browser
br.Navigate(url.Text)
While Not br.ReadyState = WebBrowserReadyState.Complete
[Code].....
this code generate whole html source code including text and everything. iwant only text shown in webpage.
I want to know how to unzip a zip file and extract the files to a particular location
View 5 Repliesi have a question is it possible to make a program that can self extract it self? EG. i have app1 and i run it and other 2 files are produced.and another program that does the opposite: i have app2 and other files and packs it self into 1 .exe file
View 8 RepliesThis XML file is CONSTANTLY updated every 3 seconds..
[code]...
If value of each field exceed a certain reading, do (sendsms)I've that sensms function already..
I am still learning the ropes of vb.net. Most of the time I get by fine, using google and searching here. But i've run into a road block. I am trying to extract email adresses from the source code of my website, suppose I can populate the Rich text box with all the source code, and the are emails sitting inside. How would I extract the emails from it and put them in a separate box.[code]...
View 1 RepliesI have been working on a program that can extract comments / tracked changes from a word document.Its coming along okay except for trying to extract the page numbers. The properties of Revision can be extracted very quickly:
[Code]...
I have an array DetailsArray in VB.NET which contains the result of a LINQ query. I have shown below the values of the array. i need to get the "ProjectID" from the array and assign it to 'ProjID' variable
DetailsArray (0){Name =
"TestProject1", ProjectID = 10}
Dim ProjID as Integer = DetailsArray(??)
How would I do that?
I would like to extract data from a html tag. The html tag is included inside a big html document.
Precisely i would like to extract the value of "txtGUID" from this html tag :
<td width='75%' bgcolor='#F3F3F3'><input type='hidden' name='txtGUID' value='soft:24f709f1-becb-44c6-8359-7c8b0b4a6e14:SLIP'/></td>
I have the following code to open a webpage:
Dim IE As Object
Dim x As Integer
Dim c As Variant
[code]....
The page that opens is in xml and in that xml there is the "page_count" that I need to pick out so I can tell my macro when to stop looping. I have dimmed it as "c" in the code above. Following is the XML.
<search>
<total_items>360</total_items>
<page_size>100</page_size>
<page_count>4</page_count>
Somehow I need c = "4", which is the "page_count". Does anyone know how I can pick out the "4" from the xml on my page?
I have to do my project in computing which requires extract data from excel to VB for further processes. I am a beginner. I know a little bit about VB and Pascal.
View 2 RepliesI need to extract some data from a html source [code]...
Now the problem is the words info ect.. wont always be there the content will change so can do something like getelementsbyclass or is there is a way to extract the text between
"<div class="bbcode_quote_container"></div>" and "</div>"
I am using a web browser control by the way
I need to convert a VB6 application into VB.Net Windows application. The program pulls data from MS Exchange (UserID, firstname, lastname, etc - not the emails themselves) and places it in a .txt file. The code has been converted, but the program does not work. When the application is run, the .txt file is created, but is blank and I get a pop-up that shows the following, "trying to access email in outlook do you want to allow this?". The popup box is gone in an instant and when I try to click on yes, it does nothing. I always have to end the program as it is non-responsive.
View 1 RepliesI have a situation where certain information from PDF documents is entered into a Data Base. I need an easy way for a user to do this. So given a situation where a data entry program is running, then certain data is taken off a PDF document, then entered on to a data entry form etc. So it would be nice to say, have a user click on certain entries on the PDF document, or the document itself and then have the required data load on the data entry form automatically, with using cut and paste on each entry. Note the required data from the PDF document is in same each time, just different values.
View 17 RepliesI have a variable with date and time, with the next format "yyyyMMdd_HHmmss" (e.g. var = 20100228_171535)
I'd like to write it in a file, but in a separately way. I mean, to write[code]...
Extract Data from Webpage?I have this code so far.[code]...
View 2 Replies