Download the forum?

For everything that's not in any way related to PureBasic. General chat etc...
ricardo
Addict
Addict
Posts: 2438
Joined: Fri Apr 25, 2003 7:06 pm
Location: Argentina

Post by ricardo »

techjunkie wrote: The couple of 100 megs I'm going to DL from the forum is nothing
If everyone here do it, Fred's monthly bill will grow up.

In business there are a simple rule: who pays the bill, decide.

Its up to Fred allow or not this thing.
ARGENTINA WORLD CHAMPION
Fred
Administrator
Administrator
Posts: 18162
Joined: Fri May 17, 2002 4:39 pm
Location: France
Contact:

Post by Fred »

We won't allow this, for obvious reasons. The forum itself in SQL text format is 400 MB, i expect to be more than 1 GB when formatted in HTML, which will be an huge charge for the server if everyone does that (and a lot of bandwidth). I'm ready to propose a dump for offline browsing (without the users infos/md5 passwords of course), but i don't know how it will be read.
jack
Addict
Addict
Posts: 1358
Joined: Fri Apr 25, 2003 11:10 pm

Post by jack »

maybe NicTheQuick could help?
MrMat
Enthusiast
Enthusiast
Posts: 762
Joined: Sun Sep 05, 2004 6:27 am
Location: England

Post by MrMat »

Fred wrote:The forum itself in SQL text format is 400 MB
Does that include the search tables? If so we could drop them, they're usually huge!
Mat
User avatar
Rescator
Addict
Addict
Posts: 1769
Joined: Sat Feb 19, 2005 5:05 pm
Location: Norway

Post by Rescator »

I suggest making snapshots, and turning them into a browsable/readable form.
Then make it available at http://www.archive.org/

The Internet Archive is awsome, I recently put a album there
(shameless plug) http://www.archive.org/audio/audio-deta ... lbum_Ryoko

The main issue (besides the looooong upload (via ftp thankfully))
is what to store, how to present it and how to view it.

One idea that comes to mind is converting a sql dump of the forum to sqlite,
and then a simple tool could be made to display the information.

Fred wouldn't have to make the tool at all, just dump the sql forum data,
exclude non content stuff (and user safety related stuff)
convert to sqlite, compress and upload to the Internet Archive
(usually takes around 2 days for submission approval depending on the media)
Submissions can be pull back by the author too, so pulling back a old snapshot and submitting a new one shouldn't be miuch issue.

Might also wanna email the guys at the Internet Archive to hear what
solution would be best for something like this,
they may have better ideas.

Reason I suggest a compressed archive with a sqlite is that
we would at least see a couple people on these forums write a tool to view and search the data, or optionally write tools ourself.
(plus there is plenty sqlite tools out there as well)
lexvictory
Addict
Addict
Posts: 1027
Joined: Sun May 15, 2005 5:15 am
Location: Australia
Contact:

Post by lexvictory »

Fred wrote:We won't allow this, for obvious reasons. The forum itself in SQL text format is 400 MB, i expect to be more than 1 GB when formatted in HTML, which will be an huge charge for the server if everyone does that (and a lot of bandwidth). I'm ready to propose a dump for offline browsing (without the users infos/md5 passwords of course), but i don't know how it will be read.
this probably could be done - database exported, userinfo, private stuff etc ripped out, zipped up (winzip 9 with max compression?, or better compression engine - perhaps pb's packer functions (im working on a prog to do this - packer funcs)) and then put up on a different site (to save this one's bandwidth) and users at home who have apache and phpbb could just import it to their phpbb
Demonio Ardente

Currently managing Linux & OS X Tailbite
OS X TailBite now up to date with Windows!
User avatar
griz
Enthusiast
Enthusiast
Posts: 167
Joined: Sun Jun 29, 2003 7:32 pm
Location: Canada

Post by griz »

I haven't tried it myself but here's an Apache/Mysql/Php distro for Windows intended to run on pen drives :

http://portablewebap.com/

Add phpBB and you should be able to import the PB forums...
Post Reply