Screen Scraping Still Not Working
Mar 12, 2010
I have browsed through many posts on this and have tried some of the suggestions but still not understanding it fully. I would like to scrape html pages that have some script running that usually executes the script to display a link after clicking. Some mentioned firebug and others talked about reverse engineering the code I need. But after trying reverse engineering I still dont see how to get the data after tracing the script function.[code]I am using vb.net and some sites were easy using firebug where looking at the script I was able to pull the data that I needed. What woudl I do in this scenario? the link is url... and the categories are what I am trying to access. Notice the url does not change.
View 1 Replies
ADVERTISEMENT
Jan 13, 2010
working on some code that will screen scrape a site then fine some code in there and pull it out for me...but for some reason i cant find the right regular expression. Anyone can with creating a regular expression that will match
/clipmark/C51BC80B-173F-4BC7-B630-CCDB8B56C9DF/
Have tried multiple attempts of writing it and each time it doesnt bring back all of the content or the wrong content.
View 4 Replies
Sep 18, 2010
Im making a vb.net app and im using htmlagilitypack. I need hap to get the profile links from [URL]
Here is an example of the html:
<a href="/bus/Ontario/Brampton/A-Safe-Self-Storage/17142.html?what=af&where=Ontario&le=1238793c7aa%7Ccf8042ceaa%7C2ae32e5a2a" onmousedown="utag.link({link_name:'busname', link_attr1:'in_listing_left',
[Code].....
View 1 Replies
Jan 27, 2010
I'm working on a vb 2010 project where I am playing mpeg movies using the Media Player control.The computer has dual heads (extending windows desktop to other display). My aim is to be able to selectwhich screen to show the video on. I have two forms, the first form (frmControl) has two buttons, Play and Stop.The second form (Player) has the embedded Media Player. Initial tests worked fine (not choosing a screen, but making the player fullscreen and playing a movie). When I add the following code to allow choosing the screen
View 4 Replies
Nov 8, 2011
Splash Screen VS2010 - Not working correctly
View 15 Replies
May 19, 2009
I was looking up how to make a screen recorder when I ran into a source code that uses Windows Media Encoder SDK. I tried it out and it crashes saying that Data Execution Protection stopped the program. So, I debugged the program and found that when it creates a new instance that this is the cause of the crash. [code]
View 1 Replies
Dec 13, 2009
make the form size exceed the screen working area? like setting the size to (1600,1600) doesn't work if the screen is not as big as it is.
View 4 Replies
Jul 13, 2010
i am trying to parse an excel file. its structure is very complex. The possible way i know are.
Use Office introp libraries
Use OLEDB provider and read excel file in a dataset.
But the issue is of its complexity like some columns,cells or rows blank etc. What are the best possible ways to do this?
View 5 Replies
Jun 2, 2012
i need to scrape a p tag which has h3 tag after it but does not have a closing p tag. It looks like this :
<script ad>asdasdasd</script>
<p>Translation companies are
-----------------------
-----------------------
<h3 class="this_class">mind blown site</h3>
There is no </p> tag so i cannot parse it completely. Now i have two questions :
1) can this be parsed using httpagility xpath ?
2) i have a function to find text between two strings (getbetween). But i have a doubt - If i use "asdasdasd" and " is it always 100% that vb.net will use the script tag which is just above h3 because there are 2-3 same lines - "asdasdasd"
View 2 Replies
Jun 24, 2011
I have a windows forms application that scrapes a website to retrieve some data. I would like to implement the same functionality as a windows service. The reason for this is to allow the program to run 24/7 without having a user signed in.
To that end, my current version of the program uses a web browser control (system.windows.forms.webbrowser) to navigate the pages, click the buttons, allow scripts to do their thing, etc. I cannot figure out a way to do the same without the web browser control, but the web browser control cannot be instantiated in a windows service (because there is no user interface in a web service).
View 11 Replies
Mar 14, 2010
I was amazed with how little documentation or examples are out there for checking the pagerank for a website using vb.net . I was hoping that someone might have some example code or other resources regarding how to do this (using toolbarqueries.google.com - not by scraping data from a 3rd party website).
View 3 Replies
Jan 30, 2012
Im trying to get school information of a site and want to save it as an excel tables sheet with details in each column, inital start was the below code help me in going further.Column headers: school name, mascot, address, type, phone, fax etc. for a list of schools I have. For example I used one link.
[Code]...
View 1 Replies
Jul 7, 2010
Is there anyway to access internet sites if i code in VB6. i have gone thru a few basic tutorials and didn't found any command/method to develop or code a program which can access internet and do my work.
View 6 Replies
Apr 8, 2012
I am making scraper that uses url list. But I have no idea how to pass that wanted url from that list to thread that does scraping.
Public Sub init2_check()
Dim t(source1.Items.Count()) As Thread
For x = 0 To UBound(t) - 1
t(x) = New Thread(AddressOf ScraperDoWork)
t(x).IsBackground = True
t(x).Start(x)
thread.Sleep(100)
Next
Me.Invoke(New button_Delegate(AddressOf enable2_button), btn_StartScrape)
End Sub
View 1 Replies
Oct 20, 2011
I want to download a webpage by httpWebRequest.
Web page Address >> http://www.stockbangladesh.com/resou...l=18455&inv=60
from a free website
[URL]
But that page requires login first. my user name : babul37 and pass : mhbb7337 How can I download that page by httpWebRequest?
View 2 Replies
Sep 15, 2011
I have just made a program were i enter a proxy list then my software views a url over and over using the proxys . I was using a web browser in side the program but worked out slow.So i now have changed the code to htpp request. But now when i run the program it goes up by 2 the views then frezzes .Here is my code
rivate Sub Timer1_Tick(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Timer1.Tick
If ListBox1.Items.Count = 1 Then
[code].....
View 1 Replies
Mar 13, 2011
I know how to browse page witht he browser control etc, but i need to know how to grab data from within the html.
[Code]....
View 1 Replies
Jun 29, 2011
BTW this issue occurs in any MS office program when the VB.Net (or even VBA) is processing information.Example: In Excel, a worksheet is displayed on the screen. I start either, a VB.Net or VBA procedure and within 30 seconds the Excel worksheet (previously displayed) blanks out. In both VB.Net and VBA,ScreenUpdating = False. My expectation is that the previously displayed screen would stay static as if I left my desk to get a cup of coffee; came back and the same ole Excel worksheet was still there?Of course, setting VBA Screen Updating = False accomplishes two goals: 1) speeds up processing and 2) saves the user from seeing unnecessary "garbage-processing" steps.Why does VBA or VB.Net ScreenUpdating = False not freeze the screen at the time of its invoking?
View 11 Replies
Jul 6, 2011
Currently I have the following VB.NET code to make a screenshot of my desktop, but it only takes a picture of the active screen:
Public Function SaveScreen(ByVal theFile As String) As Boolean
Try
SendKeys.Send("%{PRTSC}")[code].....
The following code is how I execute the above function, if it makes any difference, which I don't think it does:
SaveScreen("C:Lexer_tracescreen.png")
Now, I need to be able to take a picture of the entire screen, not just the focused window.
View 4 Replies
Feb 2, 2012
Now I'm creating at app in VB (Microsoft's, Visual Basic 2010) which will be in full screen but I want to know if I can put all my content in the centre of the screen. At the moment it's at the far top, left of the screen. When the screen size varies I want it will stay in the middle for all shapes and sizes. Like :
<div style="margin: 0 auto; width: 500px;"></div>
But this is for web pages using HTML and CSS.
View 1 Replies
Feb 29, 2012
I'm trying to get coordinates on my screen by holding down my mouse and placing it over different parts of the screen. I'm using the mouse_up and down events in a button to kinda simulate the mouse being held down. The problem I'm running into is that anytime I go past the button's bounds, the coordinates I want stop. This is what I have so far:
[Code]...
View 2 Replies
Sep 6, 2009
Sometimes when updating the entire screen or moving around controls etc, there is some fairly bad screen flickering.
View 2 Replies
Feb 8, 2011
I have created a GUI and have set my 'Form1' window to match that of my PC monitor ( 1280x1024 ). However when i move the project to work on my netbook, the screen on my netbook is only 1024x600 and half my GUI is missing. Is there any way i can adjust my settings so that my 'Form1' GUI will auto adjust and display in full on both screen when i move the project back and forth?
View 2 Replies
Dec 20, 2009
I'm coding a splash screen in VB.Net that displays for 3 seconds then shows a login screen. But the splash shows up even when login shows and I have told the splash to hide. Here is my code:
[code]...
View 3 Replies
Jul 1, 2009
I send a message a while ago and no one answerd, how can I draw directly on the screen (not on a specific window) just on the screen, neither if it's on the desktop or anything else.Is there is any option to bring up the switch between applications window (Alt + Tab), I don't want to use sendkeys because the user need to keep the key down and I just want the user to select the application with his mouse.
View 3 Replies
Jun 23, 2009
im about to develop a small appliacation for a bet system, which needs 6 screens, each screen will be a touch screen for each client... the application will be running in one computer only just with 6 screens. my question is does anyone knows how to control each screen separately?. somethign that would allow me to output each forms in different screens would work fine.
View 2 Replies
Feb 18, 2010
I am making a program that will put a black mask over an application (like a full screened game). This black mask will fade in and out, depending on certain criteria. Is there a way I can do that with VB? It's to help me dim my monitor without having to push anything.
View 3 Replies
Aug 20, 2010
I wanted to make a screen recorder (not screen capture) program, but I am not entirely sure how to get it started. I have seen many videos and things on how to make one, but all of these just take multiple pictures and then don't compile them into a movie file, and I don't want to take many pictures (unless that is the only way possible.) I am using Visual Basic 2010 Express and I have looked at the Windows Media Encoder, but I can't seem to figure out how to use/implement it (yes, I have downloaded and installed it.) Maybe I can use some kind of ActiveX control?
View 3 Replies
Sep 18, 2011
In my project is a form called "Secondary". It is suppose to appear on any and all screens (if any) other than the primary screen. The following code seems pretty logical to me, but Secondary is not appearing on any screen.
[Code]...
View 6 Replies
Sep 30, 2009
How can I get my screensaver to fill the whole screen. it has in the past but, just quit working several months ago. I have Windows Vista
View 1 Replies