Puppeteer

Author Topic: We missed you Lister engine Forum.  (Read 14805 times)

Stan

  • Guest
Re: We missed you Lister engine Forum.
« Reply #30 on: April 24, 2009, 09:18:41 PM »
Years ago a teacher friend of mine used to go on to a site and "copy" the entire site and burn it onto a CD.  Then she could go into her classroom and put the CD on to the network and all the kids could work on the site over the local network.  Her school isp was too slow to do this for a whole classroom.  does anyone know how to do this?  It might be a good thing to have this entire site, or individual forms archived like this.
Stan

mike90045

  • Mendocino Metro
  • Hero Member
  • *****
  • Posts: 1466
  • Mmmm BBQ
    • View Profile
    • Mikes Solar PV page
Re: We missed you Lister engine Forum.
« Reply #31 on: April 24, 2009, 11:45:05 PM »
Ditto - I'm glad the site is back up, and I hope we don't have a scare like this again. 

I'd be in favor a of site CD backup.   Since the site is mostly text, and text compresses quite well, a single CD should hold it. $10 for a CD/DVD  should generate enough cash ($8 per sale) to fund the site, and give each "supporting member" a nice collection of data to hold in hand.   I'm in for one, if the Admin wants to make it possible.

Mike

lowspeedlife

  • old iron for a new age
  • Hero Member
  • *****
  • Posts: 726
  • no i'm not no cowboy
    • View Profile
Re: We missed you Lister engine Forum.
« Reply #32 on: April 25, 2009, 12:04:53 AM »
I'd be up for that, it's less that half what i payed for the utterpower cd.
  SR.
Scott R.

5.7 liter diesel k-5 blazer. converting to wvo.
omega 20/2 listeroid

GuyFawkes

  • Hero Member
  • *****
  • Posts: 1184
    • View Profile
    • stuff
Re: We missed you Lister engine Forum.
« Reply #33 on: April 25, 2009, 01:52:36 AM »
don't need a CD, just google "teleport pro" and create a browsable copy on your hard disk.
--
Original Lister CS 6/1 Start-o-matic 2.5 Kw (radiator conversion)
3Kw 130 VDC Dynamo to be added. (compressor + hyd pump)
Original Lister D, megasquirt multifuel project, compressor and truck alternator.
Current status - project / standby, Fuel, good old pump diesel.

lowspeedlife

  • old iron for a new age
  • Hero Member
  • *****
  • Posts: 726
  • no i'm not no cowboy
    • View Profile
Re: We missed you Lister engine Forum.
« Reply #34 on: April 25, 2009, 03:43:30 AM »
Guy, will this work to a CD or a flash drive? I don't want to put all this on my hard drive.

   Scott R.
Scott R.

5.7 liter diesel k-5 blazer. converting to wvo.
omega 20/2 listeroid

mike90045

  • Mendocino Metro
  • Hero Member
  • *****
  • Posts: 1466
  • Mmmm BBQ
    • View Profile
    • Mikes Solar PV page
Re: We missed you Lister engine Forum.
« Reply #35 on: April 25, 2009, 09:41:26 PM »
Quote
don't need a CD, just google "teleport pro" and create a browsable copy on your hard disk.

Wow - using a spider crawler to pull down a mirror of the site, that will bog things way down, if say, 2 folks try it at one.

Stan

  • Guest
Re: We missed you Lister engine Forum.
« Reply #36 on: April 26, 2009, 03:59:06 AM »
Has anyone done this using listerengineforum yet?  How big is the resulting file(s).  Can it go on a 2 gig card?
Stan

GuyFawkes

  • Hero Member
  • *****
  • Posts: 1184
    • View Profile
    • stuff
Re: We missed you Lister engine Forum.
« Reply #37 on: April 26, 2009, 10:01:52 AM »
220 mb 4200 files raw on a disk, 30 mb compressed archive

a spider uses no more server capacity than a human user, it is just more methodical and patient.

obviously I don't know if the above is a 100% complete rip, I just used the default settings in teleport.
--
Original Lister CS 6/1 Start-o-matic 2.5 Kw (radiator conversion)
3Kw 130 VDC Dynamo to be added. (compressor + hyd pump)
Original Lister D, megasquirt multifuel project, compressor and truck alternator.
Current status - project / standby, Fuel, good old pump diesel.

GuyFawkes

  • Hero Member
  • *****
  • Posts: 1184
    • View Profile
    • stuff
Re: We missed you Lister engine Forum.
« Reply #38 on: April 26, 2009, 10:05:42 AM »
Guy, will this work to a CD or a flash drive? I don't want to put all this on my hard drive.

   Scott R.

it will work on any media, for almost any website.

if you save the project file for teleport pro you can then run it weekly to sync up, which is how I can be in the middle of bum fuck nowhere and I can show anyone my websites, which are all LAMP (Linux Apache Mysql Php) generated and not static html.

cheer
--
Original Lister CS 6/1 Start-o-matic 2.5 Kw (radiator conversion)
3Kw 130 VDC Dynamo to be added. (compressor + hyd pump)
Original Lister D, megasquirt multifuel project, compressor and truck alternator.
Current status - project / standby, Fuel, good old pump diesel.

mike90045

  • Mendocino Metro
  • Hero Member
  • *****
  • Posts: 1466
  • Mmmm BBQ
    • View Profile
    • Mikes Solar PV page
Re: We missed you Lister engine Forum.
« Reply #39 on: April 26, 2009, 07:34:31 PM »
Quote
don't need a CD, just google "teleport pro" and create a browsable copy on your hard disk.

Wow - using a spider crawler to pull down a mirror of the site, that will bog things way down, if say, 2 folks try it at one.

Well, it's slow, I'm at 2.12GB, 48,101 files, 36 folders, after about 24 hours.
I'm at a point, where it's startting to skip what it thinks are binary files:
listerengine.com/smf/index.php?action=printpage;topic=1157.0

11:28:22   Info:    engine: transfer-status: link added: listerengine.com/smf/index.php?topic=3231.msg40869 -> t:/My Web Sites/Lister Engine Forum/listerengine.com/smf/index32e0.html

11:28:22   Warning:    File not parsed, looks like binary: listerengine.com/smf/index.php?topic=1157.msg15132

11:28:22   Info:    engine: transfer-status: link added: listerengine.com/smf/index.php?topic=3231.msg40698 -> t:/My Web Sites/Lister Engine Forum/listerengine.com/smf/indexbf6d-5.html

11:28:23   Warning:    File not parsed, looks like binary: listerengine.com/smf/index.php?topic=1157.msg18545

But yet, it looks like a valid page, when pasted into a browser.   And it's still crunching.

UPDATE
 Finished the crawl.  2.48GB  66,872 files, 45 folders.   Should be all text, and compressible by at least 50%, if not more.

HTTrack Website Copier/3.33 mirror complete in 1 days, 5 hours 51 minutes 10 seconds : 67833 links scanned, 66788 files written (1977475170 bytes overall), 66649 files updated [589582870 bytes received at 5486 bytes/sec], 1975030644 bytes transfered using HTTP compression in 65832 files, ratio 28%, 15.3 requests per connection
(142 errors, 33076 warnings, 66654 messages)

rl71459

  • Full Member
  • ***
  • Posts: 121
    • View Profile
Re: We missed you Lister engine Forum.
« Reply #40 on: April 27, 2009, 11:29:18 PM »
I downloaded and try'd the "TelePort Pro". The trial "Free" does not allow you to copy the entire site, and it was done
in about 30 minute's or less. And upon review.... WOW what a load of Data! And to answer the "CD" question. It allowed me to Burn a CD. I was not yet ready to spend the $40.00 to buy the complete version. Although I Think I will. And I dont know how long it will take to do the entire thing.... If it goes anywhere near 24 Hours I'll most likely bail out in frustration!

Just my .02
Rob

lendusaquid

  • Sr. Member
  • ****
  • Posts: 353
    • View Profile
Re: We missed you Lister engine Forum.
« Reply #41 on: April 28, 2009, 06:35:20 PM »
Mike
What settings did you use with Httrack? I dont want to download the entire internet if i can help it.

mike90045

  • Mendocino Metro
  • Hero Member
  • *****
  • Posts: 1466
  • Mmmm BBQ
    • View Profile
    • Mikes Solar PV page
Re: We missed you Lister engine Forum.
« Reply #42 on: April 28, 2009, 11:44:46 PM »
I just gave it http://listerengine.com/  (with 800RPM)  and let the wizard do the rest.  it goes slowly, so as to not bog down the internet in your state !!