sqlite in memory vs IMPBDB

Just starting out? Need help? Post your questions and find answers here.
User avatar
idle
Always Here
Always Here
Posts: 6026
Joined: Fri Sep 21, 2007 5:52 am
Location: New Zealand

Re: sqlite in memory vs IMPBDB

Post by idle »

PBJim wrote: Thu Dec 19, 2024 8:55 pm
idle wrote: Thu Dec 19, 2024 7:55 pm You might be surprised that I can't see the error at all, that's dyslexic for you. I had to look at it 10 times just to find city :lol:
I understand and sympathise with you Idle, as I have recently found that a limitation with my sight is preventing me from spotting things like this quickly, as I used to be able to do. It's frustrating because I don't see things in my code. Wearing specs. helps, but they don't give me the broad view of my VDU screen that I used to enjoy. :?
Today we risk getting whiplash as our VDUs are 40 inches, 4k resolution and wrap around.
PBJim
Enthusiast
Enthusiast
Posts: 296
Joined: Fri Jan 19, 2024 11:56 pm

Re: sqlite in memory vs IMPBDB

Post by PBJim »

idle wrote: Fri Dec 20, 2024 1:12 pm Today we risk getting whiplash as our VDUs are 40 inches, 4k resolution and wrap around.
Very true, I recently retired my 17" square monitor for a 25" and found it uncomfortable to keep turning my head.
User avatar
idle
Always Here
Always Here
Posts: 6026
Joined: Fri Sep 21, 2007 5:52 am
Location: New Zealand

Re: sqlite in memory vs IMPBDB

Post by idle »

infratec wrote: Thu Dec 19, 2024 8:12 am Added save to disk.
sqlites performance in memory and dumping to disk is very fast, though it's not acid like that.
IMPBDB isn't supposed to replace Sqlite at all but I would still like to have it capable of doing basic queries
The elephant in the room is the key depth and it requires a bit of work to address, I've been putting it off until I've sorted out how to manage cursors and flag where records reside.
A record can be in mem on disk or remote to another instance of IMPBDB or a public file, it's being designed to work in the cloud and edge behind reverse proxies. I have no idea how far I'll get with it as I'm mostly doing it for entertainment value and the challenge that it provides but I think it'd be very cool to have a JADE language like experience for PB.
JADE is built on Delphi and links the server db and presentation layers into one, your just designing the system not the schema.
User avatar
Fangbeast
PureBasic Protozoa
PureBasic Protozoa
Posts: 4792
Joined: Fri Apr 25, 2003 3:08 pm
Location: Not Sydney!!! (Bad water, no goats)

Re: sqlite in memory vs IMPBDB

Post by Fangbeast »

Today we risk getting whiplash as our VDUs are 40 inches, 4k resolution and wrap around.
I'm shortsighted, have Glaucoma and developing cataracts so I needed to get a 49 inch monster 7 years ago. Postage was a bitch by the way!

But in an amazing coincidence, the physio gave me neck exercises to help keep the spine plates in and swiveling side to side on this monster actually helps me do that.

Go figure!
Amateur Radio/VK3HAF, (D-STAR/DMR and more), Arduino, ESP32, Coding, Crochet
User avatar
idle
Always Here
Always Here
Posts: 6026
Joined: Fri Sep 21, 2007 5:52 am
Location: New Zealand

Re: sqlite in memory vs IMPBDB

Post by idle »

Fangbeast wrote: Fri Dec 20, 2024 11:22 pm
Today we risk getting whiplash as our VDUs are 40 inches, 4k resolution and wrap around.
I'm shortsighted, have Glaucoma and developing cataracts so I needed to get a 49 inch monster 7 years ago. Postage was a bitch by the way!

But in an amazing coincidence, the physio gave me neck exercises to help keep the spine plates in and swiveling side to side on this monster actually helps me do that.

Go figure!
I just say no to everything the wife says, problem solved!
infratec
Always Here
Always Here
Posts: 7662
Joined: Sun Sep 07, 2008 12:45 pm
Location: Germany

Re: sqlite in memory vs IMPBDB

Post by infratec »

SQLite save speed:

If it is possible to write a complete memory dump, it will be fast.
User avatar
idle
Always Here
Always Here
Posts: 6026
Joined: Fri Sep 21, 2007 5:52 am
Location: New Zealand

Re: sqlite in memory vs IMPBDB

Post by idle »

creating index's takes me quite a lot longer but I solved the issue.

IMPBDB
q1 sum time 16 ms avg cycles 3,871,333 0
q2 sum time 16 ms avg cycles 3,990,494 0

SQLITE
q1 sum time 29 ms avg cycles 7,170,665 0
q2 sum time 42 ms avg cycles 10,375,158 0
Post Reply