Page 4 of 4

Posted: Sat Sep 03, 2005 5:22 pm
by ricardo
techjunkie wrote: The couple of 100 megs I'm going to DL from the forum is nothing
If everyone here do it, Fred's monthly bill will grow up.

In business there are a simple rule: who pays the bill, decide.

Its up to Fred allow or not this thing.

Posted: Sat Sep 03, 2005 6:01 pm
by Fred
We won't allow this, for obvious reasons. The forum itself in SQL text format is 400 MB, i expect to be more than 1 GB when formatted in HTML, which will be an huge charge for the server if everyone does that (and a lot of bandwidth). I'm ready to propose a dump for offline browsing (without the users infos/md5 passwords of course), but i don't know how it will be read.

Posted: Sat Sep 03, 2005 6:36 pm
by jack
maybe NicTheQuick could help?

Posted: Sat Sep 03, 2005 6:39 pm
by MrMat
Fred wrote:The forum itself in SQL text format is 400 MB
Does that include the search tables? If so we could drop them, they're usually huge!

Posted: Sun Sep 04, 2005 1:33 am
by Rescator
I suggest making snapshots, and turning them into a browsable/readable form.
Then make it available at http://www.archive.org/

The Internet Archive is awsome, I recently put a album there
(shameless plug) http://www.archive.org/audio/audio-deta ... lbum_Ryoko

The main issue (besides the looooong upload (via ftp thankfully))
is what to store, how to present it and how to view it.

One idea that comes to mind is converting a sql dump of the forum to sqlite,
and then a simple tool could be made to display the information.

Fred wouldn't have to make the tool at all, just dump the sql forum data,
exclude non content stuff (and user safety related stuff)
convert to sqlite, compress and upload to the Internet Archive
(usually takes around 2 days for submission approval depending on the media)
Submissions can be pull back by the author too, so pulling back a old snapshot and submitting a new one shouldn't be miuch issue.

Might also wanna email the guys at the Internet Archive to hear what
solution would be best for something like this,
they may have better ideas.

Reason I suggest a compressed archive with a sqlite is that
we would at least see a couple people on these forums write a tool to view and search the data, or optionally write tools ourself.
(plus there is plenty sqlite tools out there as well)

Posted: Sun Sep 04, 2005 10:21 am
by lexvictory
Fred wrote:We won't allow this, for obvious reasons. The forum itself in SQL text format is 400 MB, i expect to be more than 1 GB when formatted in HTML, which will be an huge charge for the server if everyone does that (and a lot of bandwidth). I'm ready to propose a dump for offline browsing (without the users infos/md5 passwords of course), but i don't know how it will be read.
this probably could be done - database exported, userinfo, private stuff etc ripped out, zipped up (winzip 9 with max compression?, or better compression engine - perhaps pb's packer functions (im working on a prog to do this - packer funcs)) and then put up on a different site (to save this one's bandwidth) and users at home who have apache and phpbb could just import it to their phpbb

Posted: Mon Sep 05, 2005 10:23 pm
by griz
I haven't tried it myself but here's an Apache/Mysql/Php distro for Windows intended to run on pen drives :

http://portablewebap.com/

Add phpBB and you should be able to import the PB forums...