Create A Web Crawler?
Jan 18, 2010create a web crawler using vb.net?
View 5 Replies
ADVERTISEMENT
Implementing Multithreaded Crawler Using The Single Thread Crawler Code
Feb 1, 2010I would like to implement a mulithtreaded crawler using the single thread crawler code I have now. Basically I read the urls from a text file, take each one and crawl and parse it. I know how thread basics of creating a thread and assigning a process to it but not too sure how to implement in the following way: I need at least 3 threads and need to assign a url to each thread from a list of urls, and then each needs to go and fetch it and parse it before adding contents to a database.
[Code]...
Asp.net - Crawler In C# Or In .net?
Jul 24, 2009i have a link of working crawler sample code written in either c# or in Vb.net
View 3 RepliesCreating A Simple Web Crawler?
Oct 21, 2010I'm attempting to do a school project dealing with a simple web crawler. I have a form with a web browser control embedded that loads a web page will all the available courses. I have a text box and a button design for a user to search for a specific course by using the four letter department abbreviation. The page that I have loaded has all the department abbreviations as hyperlinks.is it possible to search the page using the four letter abbreviation specified by the user and if the search finds a corresponding hyperlink open it. Then I would use a loop to repeat the process of opening each class offered by that department and obtaining information such as course name, section number and so forth.
View 2 RepliesImplement Multithreaded Crawler - Add A Unique Url To Each Thread To Go Process
Feb 1, 2010I would like to implement a mulithtreaded crawler using the single thread crawler code I have now. Basically I read the urls from a text file, take each one and crawl and parse it. I know how thread basics of creating a thread and assigning a process to it but not too sure how to implement in the following way:
I need at least 3 threads and need to assign a url to each thread from a list of urls, and then each needs to go and fetch it and parse it before adding contents to a database. [Code] Now the code maynot make sense but what I need to do is add a unique url to each thread to go process.
Website Crawler Creating Recursive Function To Get All The Site Link
Aug 26, 2009i'm trying to build websites crawler and i having a bit of problem creating recursive function to get all the site link, provide a link to an example ?
View 2 RepliesVS 2008 - Multithreaded Crawler - Each Time A New Thread Accesses One Of The Lists The Content Is Changed
Mar 18, 2010I have written a multithreaded crawler and the process is simply creating threads and having them access a list of urls to crawl. They then access the urls and parse the html content. All this seems to work fine. Now when I need to write to tables in a database is when I experience issues. I have 2 declared arraylists that will contain the content each thread parse. The first arraylist is simply the rss feed links and the other arraylist contains the different posts. I then use a for each loop to iterate one while sequentially incrementing the other and writing to the database. My problem is that each time a new thread accesses one of the lists the content is changed and this affects the iteration. I tried using nested loops but it did not work before and this works fine using a single thread.
Here is my
SyncLock dlock
For Each rsslink As String In finallinks
postlink = finalposts.Item(i)
[CODE]...
Finallinks and finalposts are the two arraylists. I did not include the rest of the code which shows the threads working but this is the essential part where my error occurs which is basically here postlink = finalposts.Item(i) i = i + 1
ERROR: index was out of range. Must be non-negative and less than the size of the collection. Parameter name:index
I tried copying it to a new list but dosent work.
Create A Windows Form Application Program That Can Create Games Something Like Gamemaker Or Klik?
Aug 4, 2010Hello I want to create a windows form application program that can create games something like Gamemaker or Klik & Play (butt less advanced) with D&D "Drag and Drop" events and actions.
View 7 RepliesCreate A Program That Asks For Input Then Uses An Else Statement To Create A Handling Fee Balance
Nov 30, 2011To create a program that asks for input then uses an else statement to create a handling fee balance.
Input: sales record - first name, last name, purchase amount, balance before purchase
Output: report - full name, old balance, purchase amount, handling fee, new balance
Definitions: handling fee is 5% of the old balance if the old balance is less than $1000.00 else it is 2% new balance = old balance + purchase + handling fee
Processing:
Ask for and receive sales information
Calculate new balance
Print output report
End the program when a purchase amount of 9999.99 is entered
VS 2008 Object Data - Create A Class And Create A Instance Of CarData?
Nov 28, 2010I want to create a class is it where I can do...
[code]...
How do I do this? Do i create a class and create a instance of CarData? but how do I add Color and Year etc to it?
VS 2010 Create Workspace Where Can Drag And Drop Icons And Create Connection
Mar 3, 2012I Want to develop a software like Yed.i just don know where to start.how we can create a workspace where i can drag and drop icons and create connection etc etc.
View 6 RepliesCreate A Create A New Connection To Database And Produce A New Dataset For Form?
Apr 17, 2009I have produced an application which works with datasets but I now wish to provide the user the ability to add and admend records within the database.But i wish to do this in a seperate form.My current dataset instanciates classes onLoad.Should i try passing the Dataset to the new form class? although I have the problem where by when i pass the dataset to the form class using code below i get this problem:[code]Should i just create a create a new connection to the database and produce a new dataset for this form? or is there a better way to do this?
View 2 RepliesAsp.net - Create Function To Create Thambnails Of Available Images In A Folder
Aug 28, 2009I have create a CMS to upload all image to a folder using ed all my images to a folder using,
file.SaveAs(Server.MapPath("../images/") + advertID.ToString + "_" + i.ToString + fileExt)
Now, all images are saved and i forgot it create thumbnails. :(
I need to read all images at once and create thumbnails,
myimg = System.Drawing.Image.FromFile(imgFileName)
myimg = myimg.GetThumbnailImage(154, 94, Nothing, IntPtr.Zero)
myimg.Save(Server.MapPath("../Content/") + "Thumb_" + imgFileName, myimg.RawFormat)
I need this to function fast. I don't seems to know how to read these image names one by one.
How To Create Actual 'wizard' That Allows Users To Use It To Create Their Own Forms
Dec 1, 2010I've designed my own encryption application in VB 2008 that has a free tools section where users can choose a particular wizard to use from the drop down. The javascript wizards display the code required to put in their own sites. I already created wizards that users can well, use.I see people have their own "contact form wizards" on their websites all the time. Where users can use the wizard and get the displayed code to copy and paste on their sites. But trying to locate source codes to these things is very aggravating on the web.So what I want to do is create my own "form wizard" like out of javascript, that allows the user to put in some information then get the displayed code to put in their own websites. I'm not looking for the generator such as the online form generators.But the javascript source code(s) for the generator itself.Then I could simply put a form generator inside of my VB-app, that will allow the user to use the wizard, then get the html code to paste in their own sites. Preferably not the PHP one because the php backend is very difficult to put in a VB app.I know that it can be done. For example copying a web pages source code then putting it inside a string, then calling that string from a button click that will open the javascript page in the webbrowser inside the VB app.
View 2 RepliesVS 2010 Create A Program To Allow A Student To Create Their Own Schedule?
Nov 30, 2010I have a project to do for one of my classes that i need help on. Its and extra credit so im left on my own. Project Create a program to allow a student to create there own schedule. what i am trying to do is create a checkedlistbox for the student to check classes they are taking, and need something else to pop up or to show in another box or listbox the classes they can take for the next quarter. I know it has to do with if then statements but i dont know how to write basically:"if (class is checked in checkedlistbox) then ( these are the classes you can take)".
View 2 RepliesSQL Data Access: VB2008 / VB2010 - WinForms - Create A Datasourse And Drag / Drop Fields Or Tables On A Form To Create A Grid
Oct 22, 2010I have used VB (versions 2 - 6) through many years; however, I am crash-course training myself into the VB2008 / VB2010 world kicking a screaming. I would like suggestions as to what SQL database access method should I focus more on in my learning process without making me feel that I'm a million years behind. I know I have WinForms where I can create a datasourse and drag / drop fields or tables on a form to create a grid (not really what I'm looking for).
My trouble isn't so much designing the form but in how I access the database. Theres XML, LINQ to SQL, ADO.NET, and many other methods. Not only do I need to grasp these methods quickly but I also need to know what type of projects I should create. What I mean is...I was thinking that I would design a WinForm app; however, I see that there are WPF apps and others to chose from. This is getting deep. I know it depends on the project that I'm working on. My plans are to write an app based off of either an SQL Express 2008 or SQL Server 2008 database. This first app will be standalone for now but may later become multi-user. I know I'm far behind on my learning curve coming from VB6. I have read a bit on VB2005 / 2008 / 2010. I own
both VB2008 and VB2010. I use VB2008 at work. I know ADO.NET is still alive but by what I read online, it's a dying method and is only kept for backward compatibility. XML and LINQ to SQL and other methods are all pretty new to me.
Create A Button That Can Create Custom Enteties?
Feb 7, 2009I am not a new coder, but i am not a know-it-all. I have been watching some of those NVidia fluid videos, and got jealous. I thought "Why can't i do it?" I'm not good enough for OpenGL or some other 3d engine, but i thought i would try it in 2d.
View 4 RepliesCreate A Class That Will Allow To Create Windows Shortcut?
Sep 10, 2008I'm in the process of trying to create a class that will allow me to create windows shortcut; Im using the following PDF file that gives me the shortcut file structure.
Ive been able to successfully load a shortcut file and parse its Lnk File Structure but now Im on the Shell Item ID List structure but I cannot find the Structure of the ITEMIDLIST anywhere
Furthermore I know I could use the Windows script object, but this is a dependency Im trying to avoid if I can, hence writing my own Shortcut class.
Create Service That Will Create Timers At Run Time?
Nov 12, 2009I just want to create an service which will on start read my XML file .It gets the number of parameters connected to PC. I just want to know that is it possible to create the timers at run time in my service and the timers should start at the same time but will having different time span to exicute means one timer will start after every one minute while another after 2 or 3 or whatever i set.
View 1 RepliesCreate VB Code To Email A VB Create Report?
Feb 11, 2010I have created reports that print on my printer via Visual Studio 2008/VB 2008 Basic code. I want to be able to send these reports to other people via emai. I don't care how its done, but it seems that if I could get the report into Word 2007 the problem would be solved. What are your suggestions to accomplish my objective.Terry 01
View 1 RepliesCreate Website Or Delete One / But Not How To Create List
Oct 28, 2009I am trying to create a VB.Net windows application that will list out IIS websites from a remote server when the user pushes a button as a means of verifying that a website got installed (from a previous section of the app...that part already works).I have googled all over the place and all I can seem to find is how to create a website or delete one, but not how to create a list.
View 1 RepliesFile Create - Create - Open In Binary
Feb 8, 2011Tell & interduce a pdf the full explain about file programming in vb.net(such as create , open in binary and .... , explain file stracutre and all)? a full article (most of the ways about file in vb.net)?
View 4 RepliesCreate "a Windows Form Game Called Yahtzis Which Uses Five Dice And Three Throws To Create A Score"?
Oct 18, 2010i am suppose to create "a windows form game called Yahtzis which uses five dice and three throws to create a score" .
The problem is that i don't even know how to start it can anyone shed some light.
How To Create A Code To Create Backup
Jun 22, 2010how to write a code in vb2005 to create an sql database
View 2 Replies.net - Given A Large Number Of Objects, Create Multiple Forms In Designer For Them Or Use Code To Create The Forms?
Dec 29, 2010If I have a large number of classes, each similar to the other in certain aspects (they all share a common base class, but each does things differently), and I need to create Windows forms for each to allow easy changing of their values through a GUI? Create one matching form for each object in VS' forms designer, Or Use code to create the forms dynamically at runtime.
#2 makes the most sense to me, because a lot of these objects will share very common features of the form, notably "Ok" and "Cancel" buttons. But one object might need to draw a textbox on the form while another might need to draw a combobox. Not to mention, if I want to put icons on the "Ok" and "Cancel" buttons, I'd have to do this for each copy of the form in designer, and that sounds like it could get out of hand quickly.But is drawing forms through code sane? VS' forms designer is pretty sophisticated and designed to make life easier. Am I wise to consider ignoring its functionality and diving into the trench warfare of forms design through code? Or are there examples of automating form creation based on an existing object's properties?
Create A Single Dataset In Studio To Database / Create A Dataset For Each Form
Jun 28, 2009I created a SQL database using the migration tool.I am converting my access forms to VB.net (VS2008).I am wondering if I create a single dataset in studio to the database or do I create a dataset for each form (query)? I am trying to determine what the best solution is. Many of my forms have drop downs that are populated using queries from tables.
View 3 RepliesDoes VB Allow A MS Access Database DataSet Create A Stored Procedure Or Will It Only Allow SQL Database DataSet Create SP
Oct 9, 2009does VBasic allow a MS Access Database DataSet create a Stored Procedure or will it only allow SQL Database DataSet create SP...
View 4 RepliesVS 2005 List(of T) - Create A List To Hold More Than One Control Type Or Create A List For Each Control Type?
Jan 20, 2011If I create a list for a TextBox:
[Code]....
I am able to only add controls that are of type TextBox. My question to you is, can I create a List to hold more than one control type or do I have to create a list for each control type?
Create A 64 Bit Key?
Jan 31, 2012I am writing an encryption application that requires a 64 bit key. I am currently using the following code to automatically generate a key.[code]...
View 3 RepliesCreate A C++ DLL For VB?
Mar 5, 2012I am attempting to create a VS2010 C++ DLL (named TstPrintIO.dll) and include it in VS2010 VB but its giving me an error so "Unable to find an entry point named 'PrintDb' in DLL 'TstPrintIO.dll'."
I tried to define entry point in the Properties-Linker-Advanced-Entry Point. But both _tmain() and PrintDb() give same result.
How do I define the entry point so I can correctly attatch in VB?
VB
Declare Function PrintDb Lib "TstPrintIO.dll" (ByVal i As Integer) As Integer
Private Sub MsgView_Load(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles MyBase.Load
[Code]....