Opened 16 years ago

Last modified 16 years ago

#717 new Defect

db_dump is inefficient — at Initial Version

Reported by: Nicolas Owned by: davea
Priority: Minor Milestone: Undetermined
Component: Server - Other Version:
Keywords: Cc:

Description

Let's compare.

  • Write a potentially big uncompressed XML file (over 2GB for SETI@Home), then use system() to run gzip on it (which reads it again, writes something like 300MB, then deletes the original that took so long to write). Total I/O: 2GB read, 2.3GB write, plus the database reads (which are quite a lot too).
  • Use zlib to write the file in compressed form in the first place. I/O: 300MB write, plus database reads.

Which would you choose?

I'll see if I can modify db_dump myself to use zlib.

Change History (0)

Note: See TracTickets for help on using tickets.