I am developing a web program using asp.net(vb) that scrapes data of a certain website. I am using System.Net.HttpWebRequest and System.Net.HttpWebResponse.My problem is I can not retrieve the codes of certain frame/container where the data that I needed is located. I mean, when I view the source code of the website, I can not find the data but I can see it on the web page. When I view source it, it is under the
[Code]...
I'm just starting working on a program and the amount of pages I'm trying to screen scrape take over 20 minutes, so I was hoping I could run like 4 or 5 threads to cut that down??? I'm pretty much still a novice, so be easy on me. I understand good, though.
View 1 RepliesI have an older VB6 program that uses a MDI sheet. this program was upgraded to VB.net. I can not get a new Windows Form to use the MDI Container. the new sheet lays over the top of the MDI sheet.
View 10 RepliesI'm creating a program that requires an MDI Parent Container to keep its Children inside of the client area. If you didnt understand id like a MDI to have all the forms it creates to stay inside of the actual MDI.
I've said like the windows desktop becuase thats what the windows desktop is. It's basically a realy advanced MDI container.If you know any methods on how to do this as this may be used a lot by future programmers and it would be great to just link this to the same type of question.
I usually use table-layout-panel container in windows form to enable formre-sizing. But I've got too many label boxes and text boxes in a form to to fit in normal resolution. So I am in need of a similar container which is bothscroll-ableandre-sizable. Can someone tell me how it can be done using table-layout-panel container. If it doesn't support that kind of things then which one does?
View 7 RepliesI'm trying to make a small scraper can't figure out how what i want to do is scrape the <a href over the webpage I just navigated with webbrowser1.navigate now there are many <a href over the page i need to scrape all the <a href only this ones:
"<a href="/page/page/218/445/"><img src="/images/***.gif" width="44" height="16" alt="Download ***" title="Download ***" border="0"></a></td>"
i need the code between "<a href=" and "><img is there a command to find a string in html after <a href=" and before "><img ? scrape all of them there are many and save it over txt file how can i do that?
I'm trying to make an app that will scrape numbers off of a webpage. What I want to do is have it read the Game Name and then Views (for statistics keeping). The WebPage is set up like
<tr class="odd">
here are 7 <td> tags that display different things
</tr>
[Code]....
I'd like the app to check the second TD tag to see if it's innertext says, lets say, 'GAME', and then if it does, it adds the innertext of the 7th TD tag (which is a number), to the total sum, and it scrapes all of that info off the page.
I can understand the logic of how to process the info, but I have no clue as to reading the correct tags.
oke On-Screen keyboard through my VB code. I am using windows 7 and below code to open the keyboard. Everytime when i run this code i am getting error "Could not start On-Screen keyboard".e to fix this error?
Dim proces As New Process
proces.StartInfo.UseShellExecute = False
proces.StartInfo.RedirectStandardOutput = True
[code].....
Im trying to scrape some text on a webpage, I asked in the regex section and they recommended to use HtmlAgilityPack with Xpath to scrape the info I want.
[code]...
I am using a for next loop to scrape through some html code. I am testing elements for a certain string, and when it hits that, I need to get the string that resides 2 elements earlier.When going through a for...next loop (I know you can loop completely backwards with step -1), is there a way to 'go back' 2 loops?
Ex)for each'lets say we are 5 loops in and our if returns true'can i go back to loop 3, perform an action, then return to loop 5 and continue the real loops?
I'm trying to make a small scraper can't figure out how what i want to do is scrape the <a href over the webpage I just navigated with webbrowser1.navigate now there are many <a href over the page i need to scrape all the <a href only this ones:
"<a href="/page/page/218/445/"><img src="/images/***.gif" width="44" height="16" alt="Download ***" title="Download ***" border="0"></a></td>"
i need the code between "<a href=" and "><img is there a command to find a string in html after <a href=" and before "><img ? scrape all of them there are many and save it over txt file how can i do that?
I'm trying to scrape the right url from html file using webbrowser I want to scrape this Href and navigate to it. But the problem is every other comment with reply is almost the same. So if I use to scrape hrefs and check the name it will give me the reply buttons of all the comments + the new comment button. Is there a way to grab this link only this one by it's Class name or something?
<a href="forums.php?op=post&p=1409951"><img src="/images/icons/comment_add.png" class="inline_icon" align="top"> New Comment</a> The ones I don't need:
<a href="forums.php?op=post&p=1409971">Reply To This</a> I'm trying to create my own browser and this should be a button short cut If I want to comment.
I just got VB and I am having a hard time learning this stuff. but I am not giving up.I am looking to make a web text scraper, so I can scrape words off of webpages and put them into a text file.I couldnt find a whole lot of help in the search function. bare with me, I am new here and new to programing also.
View 5 Repliessee this codes scrapes all href links and check if it contains "/file/" to save it but I get duplicate links saved so If i can change this code to work some how with Innertext("More") I will have no duplicatestried to configure it to work with innertext it just doesn't fit the way I think it should ;/and if anyone can add how can I remove duplicated urls on my txt file that would be really nice I might need it
Dim links As System.Windows.Forms.HtmlElementCollection
Dim b As String
links = WebBrowser1.Document.Links
[code]....
I have used Web Browser in VB to get the HTML source code of a web page and put it in a richtextbox. I need to take that HTML and extract the data needed from it. I have searched and cant find an example that I can understand being new to VB.Net I am trying eventually import the data into excel.
[Code]...
I am *VERY* new to web-scraping and am trying to scrape some information off of a webpage that is heavily javascript enabled. An example of the page I am trying to scrape from is: [URL] I am trying to scrape the property links such as "322 E 98th St" The text appears on the webpage and I can find the link myself, but it doesn't appear in the page source code.
I am trying to scrape it using the webbrowser control using the WebBrowser1.DocumentText property, but it doesn't even show the links simply when I view the source in ie. I am sure this has something to do with the javascript it uses to load up the page or maybe iFrames,
BTW this issue occurs in any MS office program when the VB.Net (or even VBA) is processing information.Example: In Excel, a worksheet is displayed on the screen. I start either, a VB.Net or VBA procedure and within 30 seconds the Excel worksheet (previously displayed) blanks out. In both VB.Net and VBA,ScreenUpdating = False. My expectation is that the previously displayed screen would stay static as if I left my desk to get a cup of coffee; came back and the same ole Excel worksheet was still there?Of course, setting VBA Screen Updating = False accomplishes two goals: 1) speeds up processing and 2) saves the user from seeing unnecessary "garbage-processing" steps.Why does VBA or VB.Net ScreenUpdating = False not freeze the screen at the time of its invoking?
View 11 RepliesSome programs display a window, like some antivirus programs, at the windows welcome screen. This is before anybody has logged in.I want to do the same thing. I am creating a security program that can be used for maybe a library to monitor the computer and/or block webpages (That's another thread!).Anyhow, how would I be able to have my program run before anybody logs on. Would it have to be a Windows Service? How could I get it to be running in safe mode, too.
View 6 RepliesI am writing a simple password self service app that allows users to change their password and unlock their accounts. My last step is to figure out how to get it on the login screen. Basically so users can run it before logging in (necessary because this
is to help if their passwod is lost or account disabled). I've seen screenshots of commercial apps putting it on this screen and/or the actual login box (like in XP) but I cant find any information on how to do this.
I am writing a simple password self service app that allows users to change their password and unlock their accounts. My last step is to figure out how to get it on the login screen. Basically so users can run it before logging in (necessary because this is to help if their passwod is lost or account disabled). I've seen screenshots of commercial apps putting it on this screen and/or the actual login box (like in XP) but I cant find any information on how to do this.
View 2 RepliesI am working on a web project where content security is client's first priority. I need to create a windows app which will track if the user while visiting the website, is running any screen recorder. If he is, I need to log him out. I have knowledge on c#, vb.net. Can you please tell me if it is possible to track if screen recorder is running on user's computer?
View 3 RepliesMe.Bottom: is this get the X coordinate in the lowest x of the screen I only ask this because when i use me.bottom it returns 822 when my screen resolution is only 800 and my form height is only 750. Also when i use this function in different class it returns 300 when me forms is 750 Well i just want to know the code which get the height of my screen not including xp toolbar
View 6 RepliesAt the moment when i run my form1.vb program it runs in the top left of my screen, when i save it as an application and then open it from a shortcut will it still do this or will it open in the centre of the screen? In the designer it is in the top left of the screen, is there a way to move it here? as my assumption (which is probably wrong) is that the position it is in the designer is the position it is as an application? Is that right? and if it is how to i change the position in the designer?
View 4 RepliesWe are running XP workstations in an Active Directory domain. I used gpedit.msc to setup a startup script that launchs Spy++. This works, and just before the login screen comes up, Spy++ pops up. The only problem is, the Spy++ window then goes away just before the login window loads.
I want to use Spy++ to find the attributes of the XP (Active Directory) login window. Is there a way to do this?
Visual basic 2008.I want to make an on screen keyboard exactly like the one in windows. I have made one which uses app activation, but that only works with the one you write in your codding or using a combobox to select one. How do you make one that works with everything like the one in windows.
View 6 RepliesI'm wondering, do services run at the welcome screen??
View 1 RepliesI' am Use Notebook (Samsung R580) OS : Windows 7 Home Basic Sceen ..
As shown in the image the camera is black, but somehow the image Get Connected Profile is not .. There follows a look at the program's source code and would be happy if you tell me where the error
I saw the splash screen of the Corel-Draw 12 application and lost my mind What technique do they use? On application start-up they load a transparent image, use windows api or what?
How do they achieve this transparency?
Ok so basically heres what i need to do: Extract text from the webpage that meets a certain criteria. There will be a ton of these on 1 page and i would like to add them to a rich textbox on sperate lines.
I know that it needs to be in a loop and its needs to Parse the wepage(Dim web1 As String = Me.WebBrowser1.Document.Body.InnerText)
The criteria is: Starts with 1 to 4(random) integers, Followed by "my" then 13(random) numbers and letters. Or if it starts with "167my" + 6(random) number and letters.
Edit: Also im going to try to make it loop through a list of webpages to do this.
I have an application than disables the screen saver temporarily in order to run a slide show. I use this to turn it on or off:
i = SystemParametersInfo(SPI_SETSCREENSAVEACTIVE, active, Nothing, SPIF_SENDWININICHANGE)
This works fine in XP. In Windows 7, it disables the screen saver properly. However, when it is enabled again, at the normal time for the screen saver to come on, the system asks for a password instead of showing the screen saver.From this time on until the screen saver settings are adjusted in the control panel, the password screen is displayed in place of the screen saver.Is there something else I should be doing for Windows 7? I understand that SPI_GETSCREENSAVEACTIVE is not supported in Windows 7, but SPI_SETSCREENSAVEACTIVE is supposed to be.