VB 2010 + HTMLAgilityPack + Large Processing = Error?

May 22, 2012

I have spent way too much time trying to sort this little issue out. I have narrowed down the issue to the exact procedure that throws the error. Yes, I have used Google..

Try
Dim tempSource as String = Nothing
Console.WriteLine("Loading document...")

[code]....

I am loading a text file, that contains about 1100 lines, and each line is going to be processed with HTML Agility Pack. From what I can tell, when it runs "doc.loadhtml(richtextbox1)", it throws the error. I also have tried to load the file into a string, and load the string with "doc.loadhtml(thestring)". It doesn't make a difference, still errors.

Here are is a sample of how each line looks:

<Site Index="" Name="" Group="" PR="" />
<Site Index="" Name="" Group="" PR="" />

[code]....

I am using HTML Agility Pack, however the above is what is on every line, about 1100 lines! For testing, I have a smaller text file made of about 50 lines before I load up the 1100 line file ;) There aren't any HTML, HEAD, or BODY tags! They aren't needed for my parsing. I am using HTML Agility Pack because it is easy to parse elements with. I can grab each value easily from each line.

I am not sure if maybe the error is because it technically isn't HTML? Meaning since the loaded code doesn't have an HTML or BODY tag, that it errors? I wanted to get this question posted, and while I am waiting on some answers, I am going to parse the document another way. Just curious as to what the deal is and why HTML Agility Pack isn't working. More of a proof of concept then anything, for my own learning and knowledge.

Here is the error I get (btw the on the doc.load() line, is where it throws the exception):

Object reference not set to an instance of an object

Last Note: The routine is on a background thread. I have used multi-threading before, and have delegates created for deeper in the code.

View 1 Replies


ADVERTISEMENT

Multi-threading Processing - Processing A Large List Of Records And Inserting Them Into SQL Database One By One

Mar 18, 2011

I just learned some basics of multi threading in VB.net recently as I came across processing a large List of records and inserting them into SQL database one by one.

I have code look like this:

Private Sub btnLoadNow_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles btnLoadNow.Click

Dim autoLoad1 As New Thread(AddressOf AutoLoad)
autoLoad1.Start()

[CODE]...

Itemlists is a global lists i retrieved from database, everything looks fine to me but when i run this program, I found that the threads are inserting one records 9 times into the database(I have 9 threads in total), which makes me think that maybe i need to specifically assign 1/9 of a list to each thread? Is there another way to do it which doesn't require the splitting of the list, if not , how do i split it then assign?

View 1 Replies

ThreadPool And Large Processing Of WorkItem?

Oct 11, 2010

Been trying to implementing ThreadPool over a large and variable amount of data like the following:

public sub ProcessWorkItem(byval state as object)
Dim originalState as CustomStateInfo = CType(state, CustomStateInfo)
'Do stuff

[Code]....

This of course will bomb out if we have more than 64 items/threads being placed on the ThreadPool.

So, how would one process say x amount of items until there are no more items left to process?

View 30 Replies

VS 2008 Sql Processing Large Notes?

May 21, 2009

I got a question on sql splitting a record into peaces.I got a big record like this and all of this in one piece of record:

"
5/21/2009 1:03:49 PM
Order has been placed
5/25/2009 1:45:49 PM

[code]....

This is used for making notes, so you can keep adding notes on it until it's done.And I know this is not the 'best' way of keeping these records, this is the way how it was kept until now.So now my manager comes to me and asks to make a different structure of processing these notes.Because it is stored this way I can only retrieve full record from the database, but what I need is a way how to take for example only the 'top line' of it.Example:5/25/2009 8:45:49 PM Confirmation send

View 4 Replies

.net - HtmlAgilityPack Interfering With Code (not A HtmlAgilityPack Question)?

Sep 13, 2010

Here is a snip of my code:

Dim content As String = ""
Dim web As New HtmlAgilityPack.HtmlWeb
Dim doc As New HtmlAgilityPack.HtmlDocument()
doc.Load(WebBrowser1.DocumentStream)
Dim hnc As HtmlAgilityPack.HtmlNodeCollection = doc.DocumentNode.SelectNodes("//div[@class='address']/preceding-sibling::h3[@class='listingTitleLine']")

[Code]...

View 1 Replies

Stack Overflows - Filesystemwatcher Unreliable With Large Amounts Of Processing?

Apr 19, 2010

I created a program that watches about 10 folders for different excel files. Using the filesystemwatcher with filters in place and correct error handling, it still misses some files once in a while (that's ok I guess).Anyways, I'm writing this because I added another form that has a filesystem watcher, when I tried to load the form I got a stack overflow error - an error that isn't debugged (a greenish line that you can only stop debugging).Am I going about this a wrong way? Is filesystemwatcher unreliable with large amounts of processing?

View 1 Replies

HtmlAgilityPack Interfering With Code (not A HtmlAgilityPack)

Sep 13, 2010

Here is a snip of my code:

[Code]...

View 1 Replies

HtmlAgilityPack - Getting Error When Looping Through Nodes Doesn't Make Sense

Dec 31, 2011

I'm trying to get all nodes below but I am getting an error message of: Overload resolution failed because no accessible 'GetAttributeValue' accepts this number of arguments.

[Code]...

View 1 Replies

VS 2010 - Finding Tutorials For The HtmlAgilityPack?

Sep 6, 2010

Im having a hard time finding tutorials for the HtmlAgilityPack, all of them are for c#, so im having to use c# code and convert it to vb.Here is the my code, im still getting errors with the 3rd line:[code].......

View 4 Replies

VS 2008 Error - An Error Occurred While Processing This Command: Exception From HRESULT:0x800A018A (CTL_E_GETNOTSUPPORTED)

Aug 10, 2009

I imported an app from vb6 to vb.net It works fine. It has one axmsflexgrid control. Now I want to add another axmsflexgrid control in the same app. I tried to copy and paste from one frame (groupbox) to another and got this error:

"An error occurred while processing this command: Exception from HRESULT:0x800A018A (CTL_E_GETNOTSUPPORTED)"

An inputs on how would I fix this? Or just make a new axmsflexgrid?

View 18 Replies

Error : An Error Has Occurred During Report Processing

Feb 22, 2012

I have a .rdlc report I created using vs2010.The report has 2 parameters: location (integer) and dteo(datetime).When I run running the report using vss reportviewer, I get following error:An error has occurred during report processing.is not a valid value for Int32.Index was outside the bounds of the array. The code below is generated from the report ran on vss2010.As you can see, there are 2 parameters, doe and location. Location is integer while doe is of date datatype. location is coming from a lookup table called Locations. Each location (integer) is associated with location_description (nvarchar)

View 1 Replies

2008 Array Processing And Sequential File Processing?

Jan 6, 2010

2008 Array Processing and Sequential File Processing

View 14 Replies

VB 2008 Array Processing And Sequential File Processing

May 19, 2011

Im a college student and this is my first programming class, i am having extremely diffcult time with arrays and sequential file processing. Im not asking for the whole program, just something to get me started and hints along as i progress with it. Please help me get started on my program, its due in 2 days.

Here are the requirements....

1. The program must input any number of individual�s last and first names using two separate textboxes.
2. The array of names must be sorted by the last name using a bubble sort. You must code the sort.
3. The program must be able to recall the names from the file and add to the existing list of names so that more names can be added to, sorted, and written back to the file in sorted order.
4. Sort in ascending order: A to Z
5. All names must be displayed in a listbox in sorted order when the user wishes to see them.
6. In the listbox the last and first names must be separated by a comma and a space. Example: Smith, Mary
7. The user must be able to search for a name in the array, using the binary search algorithm. You must code the search.
8. Do not use module-level variables. Instead you may choose to use Static.
9. The program must be designed using Visual Basic 2008

View 3 Replies

An Error Occured During Local Report Processing

Mar 15, 2012

Heres what my app is trying to do:

[Code]...

The guy who originally developed this program is ridiculously BAD at collaborating with me on this. He is currently looking into it but he hasnt even called me back about it and this is of the most importance as today the 2012 member cards start getting printed and they wont print!

View 1 Replies

An Error Occurred During Local Report Processing

Dec 30, 2011

I have a form with 2 Report-viewers each displaying their own rdlc file they both are Identical the only diference is the user has the option to have their name or their logo on it..They both render perfectly in the report-viewer..I get the error only on one of the reports when I try to export to PDF with code I wrote not the built in export button in ReportViewer,if I use the built in export button it exports well.[code]

View 5 Replies

An Error Occurred During Local Report Processing?

May 14, 2010

An Error Occurred During Local Report Processing

View 7 Replies

Batch File Processing Resulting In Error ?

Feb 27, 2009

I was working on an app that calls a batch file to do some simple tasks and found out this machine has some issues when trying to run them. really weird! so i did some testing and here are my resultsthis is a little strange to me and i can't think of why this is happening... let's say i have a simple bat file called test.bat these are the contents

@echo off
echo testing...
pause

When i go to run this bat, this is the output: C:>â– @ 'â– @' is not recognized as an internal or external command, operable program or batch file. It seems every bat i make on this machine is being preempted by the block character which renders bat files useless...

View 2 Replies

Forms :: An Error Occurd During Local Report Processing?

Nov 2, 2008

The Local Report (.rdlc) I designed, returns on some data ranges with this error "An error occurd during local report processing". How can I please find out which data elment (SQL 2005) is causing the problem?

View 5 Replies

Sequential File Processing In VB 2010?

Apr 2, 2012

Is there an easy way to read in a comma deliminated file in VB 2010. In VB 6.0 you could read the file in directly to variables. It appears this has been removed in 2010.

View 1 Replies

VS 2010 - Create Processing Time Limit

Apr 12, 2012

I have a process that recieves a request and issues a response. Sometimes createing the response is taking too long. I would like to start the request, and after 8 seconds, if the response has been created, I would abort the process and send back a generic message.

View 3 Replies

VS 2010 Program Logic To Speed Up Processing

Mar 29, 2011

I have setup an application to parse about 3000 files a day where each contains around 4000-5000 posts in xml format with like 100 fields. It involves a lot of cleanup and parsing but on average it takes around 6 seconds per post. Now I tried threading but because of the way I have everything set up with variables being overwritten etc...I have divided the files into different folders and just created copies of the program to run and access the assigned folder. It is running on a windows 2008 server with 16 G of memory and I am told I need to reprogram to speed up the process and also not use so much memory.

[Code]...

View 3 Replies

Value Was Either Too Large Or Too Small For An Int16 Error

Jun 9, 2010

I am working on fixing a bug in VB that is giving this error. I am new to VB, so there is some syntax that I am not fully understanding. The code that is throwing the error says:

.Row(itemIndex).Item("parentIndex") = CLng(oID) + 1000000

I understand that adding 1000000 is too much for an int16. I can't change that value (not right now anyway). What I don't understand, and can't seem to find, is what .Row is referring too.

View 1 Replies

VS 2005 Error On Large XML File

Apr 22, 2009

Is there a quick way of finding a character?? I have this error

Invalid character in the given encoding. Line 1, position 7173.

Eak, I need to know what this is but don't really want to count across 7000+ letters

View 2 Replies

Large Multidimensial Array - Write A Program To Do Markov Chain But States Are Quite Large

Jun 9, 2011

I want to write a program to do Markov chain, but my states are quite large. First of all I calculate all the transition probabilities and revenues for all states(1381860 total states), and store in a multidimensional array. Public RevArr(0 To 9, 0 To 750, 0 To 282) As Long

After that the iteration of markov chain should use these as inputs to calculate the steady-state probabilities. But when I try to run the main code I got this error.Exception of type 'System.OutOfMemoryException' was thrown.

The following is the declaration of second array I add just another dimension for storing all the iterations, but I get this error. Dim stateprob(IT + 1, 0 To 9, 0 To 750, 0 To 282) As single

View 1 Replies

Intermittent Crystal Reports Error "The Request Could Not Be Submitted For Background Processing."?

Feb 2, 2010

We are running Crystal Reports on a Windows Server 2008 with .NET framework 3.5 SP1. I have seen many causes of the general error "The request could not be submitted for background processing." on other forums, however they tend to be persistent and repeatable affecting just a single report due to a specific formatting issue with a specific report.We are seeing this error with the below stack trace, intermittently. It affects multiple different reports we have. It affects one particular report more frequently than other reports. Once a report is affected the same error will often appear in multiple reports at approximately the same time eg. for the next 10 minutes.The same report run with the same parameters may work when run again (soon after) or the application may need restarting before the report can be successfully re run. These reports all worked previously without issue. No change in server or code seems apparent which would have precipitated this error. All code behind for this is VB.NET We have had difficulty reproducing it in test environments and upgrading to the latest version of Crystal has not helped at all.

[code]...

View 3 Replies

DB/Reporting :: Error Record Too Large While Creating Access Database?

Feb 8, 2009

use the following code to create a database in ms access

Code:
'reference: Microsoft ActiveX Data Objects 2.8 Library
'reference: Microsoft ADO Ext. 2.8 for DDL and Security

[code].....

View 1 Replies

Large Number Of Record - Error: Operation Has Been Canceled By The User

Apr 22, 2012

When large number of records in Database, it throws error "Operation has been canceled by the user" in vb.net. I want to retrieve records from DB2 and display the records in DataGridView in VB.net. If number of records is less it works fine. But if the database tabe has large number of records it throws error "Operation has been canceled by the user". [code]

View 1 Replies

HTTP 404 Not Found Error On Web Service Call, Only With Large Amount Of Data

Sep 2, 2011

I have a vb.net Windows application that calls a vb.net Web Service function. Both the vb.net application and Web Service have been in use for over 5 years and have worked well. The Windows App builds a text file consisting of a number of inserts into an Oracle table, followed by a call to an Oracle package. The Web Service call uploads the text file to the Web Server, loops through the statements in the text files and executes them. It then does a Select statement to put the resultant data in a string which is passed back to the calling program. We have both people on our local area network as well as external users where the call to the Web Server is over the internet.

The data string returned is the pricing for each of the lines inserted in the text file, separated by asterisks. Normal use of this call has anywhere from 1 to a few dozen lines, and the program works fine for this for both internal and external users.

Our problem right now is one external person is attempting to price a job with 491 individual line items. At first it would not price, whether the job was priced from a computer at the customers site or one of our internal people on the LAN. The problem turned out to be the timeout value was not long enough (it was set at 2 minutes, this job takes 5 minutes) so changing both the Timeout value in the Web Service call as well the httpRuntime executionTimeout value in the web.config file on the web server addressed the problem, but only for our internal users on the LAN. Our external customer wants to be able to price jobs of this size going forward, and I am at a loss as to why it errors on internet connected machines but not locally connected machines. Our customer is in New York, We are in Wisconsin, and I am able to recreate the error condition from my home computer.

The other thing is, if I create a VPN connection to our server from my computer at home, this job will price (again, it takes about 5 minutes) but if I disconnect the VPN connection, it gets an error after approximately 3 minutes, http 404: Not Found.The customer can otherwise price all of his other jobs with no problems, it's only this one, very large job that gets the error.

View 4 Replies

C# - HTMLAgilityPack And Timeouts On Load

May 3, 2011

I'm using HTMLAgilityPack in a parser that I have up on a server, but I'm having issues with one of the websites that I'm parsing: Every day around 6am they tend to shut down their servers for maintenance, which throws off the Load() method for HTMLWeb, and makes my app crash. Do any of you guys have a more secure way of loading a website into HTMLAgilityPack, or maybe some way to do error checking in C# to prevent my app from crashing? (my c# is a little rusty). Here is my code right now:

HtmlWeb webGet = new HtmlWeb();
HtmlDocument document = webGet.Load(dealsiteLink); //The Load() method here stalls the program because it takes 1 or 2 minutes before it realizes the website is down

View 2 Replies

VB 2010 - Interpolation Large Array

Jun 18, 2012

I need to write code to interpolate the values shown in the image below. By "interpolate" I mean that if you were given a value of [Code]. I have working in Excel but I can't figure out how to make it work in VB 2010. Should I set my data up as an array or as 6 lists? If the user inputs a certain number how do I code it to look for the next highest number and next lowest number?

View 10 Replies







Copyrights 2005-15 www.BigResource.com, All rights reserved