Screen Scraping Still Not Working

Mar 12, 2010

I have browsed through many posts on this and have tried some of the suggestions but still not understanding it fully. I would like to scrape html pages that have some script running that usually executes the script to display a link after clicking. Some mentioned firebug and others talked about reverse engineering the code I need. But after trying reverse engineering I still dont see how to get the data after tracing the script function.[code]I am using vb.net and some sites were easy using firebug where looking at the script I was able to pull the data that I needed. What woudl I do in this scenario? the link is url... and the categories are what I am trying to access. Notice the url does not change.

View 1 Replies


ADVERTISEMENT

Screen Scraping With Regular Expression?

Jan 13, 2010

working on some code that will screen scrape a site then fine some code in there and pull it out for me...but for some reason i cant find the right regular expression. Anyone can with creating a regular expression that will match

/clipmark/C51BC80B-173F-4BC7-B630-CCDB8B56C9DF/

Have tried multiple attempts of writing it and each time it doesnt bring back all of the content or the wrong content.

View 4 Replies

Screen Scraping - Get Links From Webpage To Textbox?

Sep 18, 2010

Im making a vb.net app and im using htmlagilitypack. I need hap to get the profile links from [URL]

Here is an example of the html:

<a href="/bus/Ontario/Brampton/A-Safe-Self-Storage/17142.html?what=af&amp;where=Ontario&amp;le=1238793c7aa%7Ccf8042ceaa%7C2ae32e5a2a" onmousedown="utag.link({link_name:'busname', link_attr1:'in_listing_left',

[Code].....

View 1 Replies

Setting Form's Screen Location Not Working?

Jan 27, 2010

I'm working on a vb 2010 project where I am playing mpeg movies using the Media Player control.The computer has dual heads (extending windows desktop to other display). My aim is to be able to selectwhich screen to show the video on. I have two forms, the first form (frmControl) has two buttons, Play and Stop.The second form (Player) has the embedded Media Player. Initial tests worked fine (not choosing a screen, but making the player fullscreen and playing a movie). When I add the following code to allow choosing the screen

View 4 Replies

Splash Screen VS2010 - Not Working Correctly?

Nov 8, 2011

Splash Screen VS2010 - Not working correctly

View 15 Replies

Screen Recorder Using Windows Media Encoder SDK Not Working

May 19, 2009

I was looking up how to make a screen recorder when I ran into a source code that uses Windows Media Encoder SDK. I tried it out and it crashes saying that Data Execution Protection stopped the program. So, I debugged the program and found that when it creates a new instance that this is the cause of the crash. [code]

View 1 Replies

Make The Form Size Exceed The Screen Working Area?

Dec 13, 2009

make the form size exceed the screen working area? like setting the size to (1600,1600) doesn't work if the screen is not as big as it is.

View 4 Replies

C# - Excel File Parsing / Scraping Using .NET

Jul 13, 2010

i am trying to parse an excel file. its structure is very complex. The possible way i know are.

Use Office introp libraries
Use OLEDB provider and read excel file in a dataset.

But the issue is of its complexity like some columns,cells or rows blank etc. What are the best possible ways to do this?

View 5 Replies

Httpagility Pack Scraping Between Broken Tag?

Jun 2, 2012

i need to scrape a p tag which has h3 tag after it but does not have a closing p tag. It looks like this :

<script ad>asdasdasd</script>
<p>Translation companies are
-----------------------
-----------------------
<h3 class="this_class">mind blown site</h3>

There is no </p> tag so i cannot parse it completely. Now i have two questions :

1) can this be parsed using httpagility xpath ?

2) i have a function to find text between two strings (getbetween). But i have a doubt - If i use "asdasdasd" and " is it always 100% that vb.net will use the script tag which is just above h3 because there are 2-3 same lines - "asdasdasd"

View 2 Replies

Scraping A Website From A Windows Service?

Jun 24, 2011

I have a windows forms application that scrapes a website to retrieve some data. I would like to implement the same functionality as a windows service. The reason for this is to allow the program to run 24/7 without having a user signed in.

To that end, my current version of the program uses a web browser control (system.windows.forms.webbrowser) to navigate the pages, click the buttons, allow scripts to do their thing, etc. I cannot figure out a way to do the same without the web browser control, but the web browser control cannot be instantiated in a windows service (because there is no user interface in a web service).

View 11 Replies

Scraping Data From A 3rd Party Website?

Mar 14, 2010

I was amazed with how little documentation or examples are out there for checking the pagerank for a website using vb.net . I was hoping that someone might have some example code or other resources regarding how to do this (using toolbarqueries.google.com - not by scraping data from a 3rd party website).

View 3 Replies

Code Made More Nice And Correct Of Web Scraping?

Jan 30, 2012

Im trying to get school information of a site and want to save it as an excel tables sheet with details in each column, inital start was the below code help me in going further.Column headers: school name, mascot, address, type, phone, fax etc. for a list of schools I have. For example I used one link.

[Code]...

View 1 Replies

Scraping Results From A Site Or Search Engine With VB6?

Jul 7, 2010

Is there anyway to access internet sites if i code in VB6. i have gone thru a few basic tutorials and didn't found any command/method to develop or code a program which can access internet and do my work.

View 6 Replies

VS 2008 - How To Pass Info (URL) To Thread For Scraping

Apr 8, 2012

I am making scraper that uses url list. But I have no idea how to pass that wanted url from that list to thread that does scraping.

Public Sub init2_check()
Dim t(source1.Items.Count()) As Thread
For x = 0 To UBound(t) - 1
t(x) = New Thread(AddressOf ScraperDoWork)
t(x).IsBackground = True
t(x).Start(x)
thread.Sleep(100)
Next
Me.Invoke(New button_Delegate(AddressOf enable2_button), btn_StartScrape)
End Sub

View 1 Replies

VS 2008 : Webpage Login+scraping With HttpWebRequest?

Oct 20, 2011

I want to download a webpage by httpWebRequest.

Web page Address >> http://www.stockbangladesh.com/resou...l=18455&inv=60

from a free website

[URL]

But that page requires login first. my user name : babul37 and pass : mhbb7337 How can I download that page by httpWebRequest?

View 2 Replies

Web Scraping - Http Request In Program Freezing?

Sep 15, 2011

I have just made a program were i enter a proxy list then my software views a url over and over using the proxys . I was using a web browser in side the program but worked out slow.So i now have changed the code to htpp request. But now when i run the program it goes up by 2 the views then frezzes .Here is my code

rivate Sub Timer1_Tick(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles Timer1.Tick
If ListBox1.Items.Count = 1 Then

[code].....

View 1 Replies

Vb 2010 Express - Webbrowser Control Getting / Scraping Data From Html?

Mar 13, 2011

I know how to browse page witht he browser control etc, but i need to know how to grab data from within the html.

[Code]....

View 1 Replies

Screen Blanks After 1 Min Of Processing (of Excel File) / Refresh Or Freeze Screen To Avoid Blank Screen?

Jun 29, 2011

BTW this issue occurs in any MS office program when the VB.Net (or even VBA) is processing information.Example: In Excel, a worksheet is displayed on the screen. I start either, a VB.Net or VBA procedure and within 30 seconds the Excel worksheet (previously displayed) blanks out. In both VB.Net and VBA,ScreenUpdating = False. My expectation is that the previously displayed screen would stay static as if I left my desk to get a cup of coffee; came back and the same ole Excel worksheet was still there?Of course, setting VBA Screen Updating = False accomplishes two goals: 1) speeds up processing and 2) saves the user from seeing unnecessary "garbage-processing" steps.Why does VBA or VB.Net ScreenUpdating = False not freeze the screen at the time of its invoking?

View 11 Replies

.net - Taking Photo Of Screen - Take A Picture Of The Entire Screen, Not Just The Focused Window?

Jul 6, 2011

Currently I have the following VB.NET code to make a screenshot of my desktop, but it only takes a picture of the active screen:

Public Function SaveScreen(ByVal theFile As String) As Boolean
Try
SendKeys.Send("%{PRTSC}")[code].....

The following code is how I execute the above function, if it makes any difference, which I don't think it does:

SaveScreen("C:Lexer_tracescreen.png")

Now, I need to be able to take a picture of the entire screen, not just the focused window.

View 4 Replies

Putting VB Content In The Center Of A Full Screen With Variant Screen Size?

Feb 2, 2012

Now I'm creating at app in VB (Microsoft's, Visual Basic 2010) which will be in full screen but I want to know if I can put all my content in the centre of the screen. At the moment it's at the far top, left of the screen. When the screen size varies I want it will stay in the middle for all shapes and sizes. Like :

<div style="margin: 0 auto; width: 500px;"></div>

But this is for web pages using HTML and CSS.

View 1 Replies

Get Coordinates On Screen By Holding Down Mouse And Placing It Over Different Parts Of The Screen

Feb 29, 2012

I'm trying to get coordinates on my screen by holding down my mouse and placing it over different parts of the screen. I'm using the mouse_up and down events in a button to kinda simulate the mouse being held down. The problem I'm running into is that anytime I go past the button's bounds, the coordinates I want stop. This is what I have so far:

[Code]...

View 2 Replies

Screen Flickering When Updating The Entire Screen Or Moving Around Controls

Sep 6, 2009

Sometimes when updating the entire screen or moving around controls etc, there is some fairly bad screen flickering.

View 2 Replies

Screen Size - Screen On My Netbook Is Only 1024x600 And Half My GUI Is Missing

Feb 8, 2011

I have created a GUI and have set my 'Form1' window to match that of my PC monitor ( 1280x1024 ). However when i move the project to work on my netbook, the screen on my netbook is only 1024x600 and half my GUI is missing. Is there any way i can adjust my settings so that my 'Form1' GUI will auto adjust and display in full on both screen when i move the project back and forth?

View 2 Replies

Splash Screen That Displays For 3 Seconds Then Shows A Login Screen

Dec 20, 2009

I'm coding a splash screen in VB.Net that displays for 3 seconds then shows a login screen. But the splash shows up even when login shows and I have told the splash to hide. Here is my code:

[code]...

View 3 Replies

VS 2008 Draw Directly On The Screen (not On A Specific Window) Just On The Screen?

Jul 1, 2009

I send a message a while ago and no one answerd, how can I draw directly on the screen (not on a specific window) just on the screen, neither if it's on the desktop or anything else.Is there is any option to bring up the switch between applications window (Alt + Tab), I don't want to use sendkeys because the user need to keep the key down and I just want the user to select the application with his mouse.

View 3 Replies

[2005] Multi-Screen Application - Control Each Screen Separately?

Jun 23, 2009

im about to develop a small appliacation for a bet system, which needs 6 screens, each screen will be a touch screen for each client... the application will be running in one computer only just with 6 screens. my question is does anyone knows how to control each screen separately?. somethign that would allow me to output each forms in different screens would work fine.

View 2 Replies

Create An Overlay Screen On A Full Screen Application?

Feb 18, 2010

I am making a program that will put a black mask over an application (like a full screened game). This black mask will fade in and out, depending on certain criteria. Is there a way I can do that with VB? It's to help me dim my monitor without having to push anything.

View 3 Replies

Make A Screen Recorder (not Screen Capture) Program

Aug 20, 2010

I wanted to make a screen recorder (not screen capture) program, but I am not entirely sure how to get it started. I have seen many videos and things on how to make one, but all of these just take multiple pictures and then don't compile them into a movie file, and I don't want to take many pictures (unless that is the only way possible.) I am using Visual Basic 2010 Express and I have looked at the Windows Media Encoder, but I can't seem to figure out how to use/implement it (yes, I have downloaded and installed it.) Maybe I can use some kind of ActiveX control?

View 3 Replies

Multiple Screen Management - Appear All Screens (if Any) Other Than The Primary Screen

Sep 18, 2011

In my project is a form called "Secondary". It is suppose to appear on any and all screens (if any) other than the primary screen. The following code seems pretty logical to me, but Secondary is not appearing on any screen.

[Code]...

View 6 Replies

Screen Saver On Appears On Taskbar And Will Not Fill Whole Screen

Sep 30, 2009

How can I get my screensaver to fill the whole screen. it has in the past but, just quit working several months ago. I have Windows Vista

View 1 Replies







Copyrights 2005-15 www.BigResource.com, All rights reserved