wonderwebware.com - Ideas Player
September 09, 2010, 03:25:48 AM *
Welcome, Guest. Please login or register.
Did you miss your activation email?

Login with username, password and session length
News: Posting in this forum is currently disabled. I am out of home and there is no one to delete the spam. Will turn on the forum when I come back.
 
   Home   Help Search Login Register  
Pages: [1]
  Print  
Author Topic: Is it "looping"  (Read 474 times)
sleepgone
Newbie
*
Posts: 1


View Profile
« on: November 09, 2009, 02:18:56 PM »

I have a relatively small site that I maintain for my church.  I downloaded your software and it "seems" to be working, however in the extraction info pane, crawler tab, it is telling me that there are currently over 43,000 pages to scan.  most of the 4,000+ already scanned seem to be in the phpBB3 directory.  at present there are only 11 posts and 2 users.  The program has been running for almost 30 minutes so far.  gonna let it continue to see if anything changes.  My site is located at http://www.hrvsttime.org/.  Is it possible that it is caught in a loop?
Logged
V
Administrator
Full Member
*****
Posts: 111


View Profile
« Reply #1 on: November 09, 2009, 02:36:20 PM »

I suppose it is possible, especially with such auto-generated content. I am not sure right now where the problem comes from, but I suppose the spider just found some neverending way to get more pages from the BB and it is probably the best idea to stop it and use some professional tool. I have some plans to continue with the development of this tool to try to fix such wrong behavior (along with many other frequently asked features) but right now in these crazy times here I just cannot promise this will happen soon...
Logged
tony
Newbie
*
Posts: 2


View Profile
« Reply #2 on: February 10, 2010, 01:53:37 PM »

I have a relatively small site that I maintain for my church.  I downloaded your software and it "seems" to be working, however in the extraction info pane, crawler tab, it is telling me that there are currently over 43,000 pages to scan.  most of the 4,000+ already scanned seem to be in the phpBB3 directory.  at present there are only 11 posts and 2 users.  The program has been running for almost 30 minutes so far.  gonna let it continue to see if anything changes.  My site is located at http://www.hrvsttime.org/.  Is it possible that it is caught in a loop?
you could try excluding the phpBB3 in the Exclude Patterns   select *phpBB3/*
I found smf created lots of links not wanted I used exclude *smf/*
happy computing from systems-edge.co.uk
Logged
Pages: [1]
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.11 | SMF © 2006-2009, Simple Machines LLC Valid XHTML 1.0! Valid CSS!