Website Crawler Creating Recursive Function To Get All The Site Link
Aug 26, 2009i'm trying to build websites crawler and i having a bit of problem creating recursive function to get all the site link, provide a link to an example ?
View 2 Repliesi'm trying to build websites crawler and i having a bit of problem creating recursive function to get all the site link, provide a link to an example ?
View 2 RepliesI would like to implement a mulithtreaded crawler using the single thread crawler code I have now. Basically I read the urls from a text file, take each one and crawl and parse it. I know how thread basics of creating a thread and assigning a process to it but not too sure how to implement in the following way: I need at least 3 threads and need to assign a url to each thread from a list of urls, and then each needs to go and fetch it and parse it before adding contents to a database.
[Code]...
I'm attempting to do a school project dealing with a simple web crawler. I have a form with a web browser control embedded that loads a web page will all the available courses. I have a text box and a button design for a user to search for a specific course by using the four letter department abbreviation. The page that I have loaded has all the department abbreviations as hyperlinks.is it possible to search the page using the four letter abbreviation specified by the user and if the search finds a corresponding hyperlink open it. Then I would use a loop to repeat the process of opening each class offered by that department and obtaining information such as course name, section number and so forth.
View 2 RepliesCan someone explain to me what the difference is between a recursive function and a factorial function. I know that a factorial function returns the product of all the numbers from 1 to itself. But how does that differ from what a recursive function does
View 2 RepliesI have made a tabbed webbrowser and adding the final touches to it. I want to add:A progressbarHistoryStatus label to show status of current tabA changing addressbar to show URL of current tabMake it so that the title of the Form is the title of the current tabI know this is overwhelming.
View 10 RepliesI am hopeing someone can help me here with a recursive function I have that is not returning either true or false as I would have espected it to. The function loops through a Active Directory group for its members and then calls itself if it encounters any groups within the membership in order to gets its members as well. I am trying to return either true or false based on if any errors were encountered but not haveing any luck at all. It appears to just hang and never return back to the primary calling sub that starts the recursive function. Below is my code I am using:
[Code]...
I have the following data in this a table
ID ParentID Active Node
1 0 1 <RCExtRequest>?</RCExtRequest>
[Code]....
If changing the table layout would make this any easier then I could so that.
i have these 2 functions that search for any .jpg files starting from a given path the algorithm works, it's just that it freezes up the gui at times this is why i wish to know how to implement it through a new thread or a backgroundworker maybe.[code]
View 2 RepliesI'm making a program that can mark my shooting cards and i have created it and it works nicely But i want to get as much speed out of it as possible so I switched my target CPU to X64 and sure enough my recursive function threw a Stack overflow exception telling me i need to make sure i don't have Infinity recursions. Strangely when I set It back to X86 the same recursive function works...
vb.net
Dim bullethole As New List(Of Point)
Function GetBulletHole(ByVal point As Point) As Point()
[Code]....
Is it possible to use a recursive function on an array
If I have an array like this[code]...
I want to use a recursive function to make in out like this[code]...
i'm creating a website that allows people to upload images to the website in a folder called images on the Site. But I don't know how to upload a file and I'v searched everywhere Please Note: In this Website were not Using the asp:fileupload, were developing our own interface
View 1 RepliesI have a recursive function in this function i am adding some value to path variable here i want to acess this value outside of function for this what changes i will do in this function.
Private Sub GeValuePath(ByVal ParentID As Integer)
Try
dim path as string =""
[Code]......
have an xml file like this.
<?xml version ="1.0" encoding ="utf-8"?>
<menu>
<menuNode title="Register" value="true">
[Code]....
I have 3 variables. Lets call it "a", "b" and "c". These 3 variables can "independently" have 3 different values. Lets say: "1", "6" and "10". when you think of them as combination; there are (3^3) 27 combinations. I am told that it can be done through the recursive functions. However i am not a good developer to handle with that. Would u please help me?
- 3 variables and 3 different values are simplified. In fact; the numbers of variables and different values can vary.
- i know only the language, visual basic in .net; please don't answer in other coding languages.
additional note: i am going to put the these combinations in the string format into a collection.. for example "1;1;1", "1;6;1", "1;6;10".. and so on..
I have a recursive function wich objective is scan an structure and represent that structure with treenodes. Inside my function depends the structure I'll have to create another treenode inside my treenode or just create a node. My problem is that I don't know how to remember my treenode position when I have to call my function again.
If strTop.TextString.ToUpper = "DMN" Then
gcTreeno.Nodes.Add("Node")
Else
Dim perf As New TreeNode
gcTreeno.Nodes.Add(perf)
End If
if i would like to write next time a node into perf, how i could do it?
How can I use a recursive function to remove a character from a string thats stored in a array.
Like so
MMMMM
MMMM
MMM
MM
M
I need to remove a letter from the string each time it loops through the string until there is only 1 letter left in the string.
i build a website in vb.net ... i have a table process that have a begin date and end date... in the date that appropriate i want the system automatically update the data in database...
Example :
Tabel process
ProcessName || begin || End
process A || 02/02/2012 || 04/04/2012
When the current date 02/02/2012 then update table master that processName is "process A" into active and when the current date 04/04/2012 then update table master that processName is "process A" into expired.
I don't know how to create it? is anyone know about making like that?
Public Function GetIPInfo(ByVal IPNumb As String, ByVal GetInfo As String) As String
Dim i1, i2 As Integer
Dim s1, s2, s3 As String
Dim IPCheckWebsite As String
[code]....
It says the website server has a 503 Error, But the site is up and works fine. Am I Doing Something Wrong?
Dim WC As System.Net.WebClient = New System.Net.WebClient()
IPCheckWebsite = WC.DownloadString("http://whatismyipaddress.com/ip/" & IPNumb)
I'm hoping to improve the performance of the below as well as return the GUID of each user.
I've converted and modified the code found here for searching through groups recursively to get all the members and their details and adding them to a class collection. However I also need to capture the user's managers details so I'm calling the AD twice for each user. This doesn't seem efficient as many of the users will have the same manager. It would seem logical to get the distinct manager details from the collection class and call only these, then replace them wherever they occur in the collection.
I'd also like to be able to get the user's GUID, I've tried accessing it directly as a property of the collection, but it doesn't return anything.
I'm using vs2005 and .Net 2.0
Public Class ADCLass
''' <summary>
''' Calls recursive function to return users in group
[Code]....
this its a function i made to make sure all the fields on a form are filled before to save to database but once it finds a object it should exit. but it just doesnt... i tried also with exit for and exit sub also tried puting the exit for just after the msgbox shows up but it wont exit, this its the last thing i did using a flag but it doesnt exit either.
[Code]...
I got that little function(I changed the name of variables)
Private Function everythingLinked(ByRef myClass As cls, ByVal found As Boolean) As Boolean
If Not found AndAlso myClass.checked = False Then
myClass.checked = True
[code]....
I want to rewrite it so it would only be loop and no recursion and I'm currently lost?I'm passing a class to this function(with a starting value for found as false) to know if it is linked to the middle of the tree. The class got an array with a maximum of 4 link to other class and it can be circular(this is why I have a checked_link boolean).It does the recursion until there is no more link(return false) to check or until it find the middle link(return true).
edit?for an example, this
in pos 0 got link with 1
in pos 0 got link with 6
in pos 1 got link with 0
[code]....
middlepoint would be pos 15 the code above can prove that every position can be linked with the middlepoint so initial arg would be
everythingLinked(random pos, false)
and in this case it would be always true
i have been asked to turn a recursive function into a stack base but i am not sure what that's mean but i choose the fibonacci recursive function and i turned it into the stack base ?Public Function fib(ByVal value As Integer) As Integer
Dim x As Stack
x = New Stack(30)
Dim temp As Integer = 1
Dim result As Integer = 0
[code]....
I'm trying to make a simple game tree.Previously I used nested loops:
[Code]...
I am looping through all folders on the computer in a background worker. Starting with just the C: drive, the function works perfectly I've been tasked with adding recursiveness to this function to loop through all subfolders within each and every folder.
This is the working code without recursive. Startpath is set = "c:".
Private Sub BackgroundWorker1_DoWork(ByVal sender As Object, ByVal e As System.ComponentModel.DoWorkEventArgs) Handles BackgroundWorker1.DoWork
Dim fs As New FileSystemObject
Dim fsfolder As Folder
Dim subfolder As Folder
[Code]...
EDIT: I was doing some testing and threw in an if check to skip the C:$ folders. Working ok so far and noticed something really strange. It doesn't loop through all the folders in the C: drive. I think it will loop through only the first 2 folders. One is C:Boot so I skip that and the other is C:Dev-cpp. It won't loop through the Program Files, Program Files (x86), or Users.
I'm making a winform program to automatically login to a website and then do a search on the site. Problem is, it works for one site but not for another.
Here's the code:
Code:
Dim cookies As CookieContainer = New CookieContainer
Try
[Code]......
I have created an application which will open a text file on the click of a button, when i am running the application in local, I am able to get the popup asking to open or save the text file, I uploaded the same code to live site there it is not displaying the popup to open or save the text file. It just flashes a window for fraction of seconds and then closes, user is not able to perform any action in that course of time. Text document which I am trying to open is available at both server and local, and path is also correct in both cases.
Below is the code I am using to open the text file:
If (File.Exists(strFolderPath & "" & strFileName)) Then
objFileStream = New FileStream(strFolderPath & "" & strFileName, FileMode.Open, FileAccess.Read)
objStreamReader = New StreamReader(objFileStream)
objStreamReader.BaseStream.Seek(0, SeekOrigin.Begin)
[Code] .....
How can i make an app that clicks a button on a site link called say every 5 seconds ?
View 4 RepliesI am descending all the directories of my C drive to get a complete list of all extensions.When I get to: C:Windows.oldDocuments and SettingsAll UsersApplication Data
the program goes into a loop: C:Windows.oldDocuments and SettingsAll UsersApplication Data Application Data Application Data until the path exceeds maximum length (248 characters for the directory).
[Code]...
I am trying to write code to save (in a text file) a list of folders/files that are contained in a specified folder. I want the list to be formatted to illustrate the folder tree structure by indenting sub-folders and there related files according to their relationship to the base folder.
I found and incorporated a recursive function for listing file & folders. This works fine for generating the list, but I am having difficulty with code to determine the sub-directory level relative to the base folder. the code that I have included below sort of works.......The problem seeme to be when going from a folder that is multiple levels up? from the base to one that is only one level from the base. Refer to my sample output. This should not be as difficult as I seemed to have made it, but recursion kinda blows my mind.
Code:
' The following function call is in a button handler
GetFilesFolders(txtBaseFolder.Text)
Public Sub GetFilesFolders(ByVal path As String)
[code]....
I am working on networks. My work involves finding out what nodes connected to a specific node (Source node). I have developed a code which does this using a recursive function. The only problem that I have I need to record the path. For example shown in the picture below, my program give me the following results[code]...
View 1 Replies