Opened 17 years ago

Closed 17 years ago

#133 closed Enhancement (fixed)

Reduce bandwidth used when server is out of disk space

Reported by: Thyme Lawn Owned by: Bruce Allen
Priority: Major Milestone: Undetermined
Component: Server - File Upload Handler Version:
Keywords: Cc:

Description

CPDN has a server disk space problem at the moment, which means that file uploads are being rejected with a No space left on device message. But this is only happening after the upload has been completed. The problem is that we're talking about 5 or 8MB worth of data being uploaded on every upload attempt of a single file.

If the client was modified to send <nbytes>file size</nbytes> in its <data_server_request> message the file upload handler could prevent any file transfer that's going to fail by a number of means, including (but not limited to):

  1. including an acknowledgment status tag in the <data_server_reply> block, possibly with another tag specifying the duration the client should wait before retrying a denied request.
  1. responding with 413 Request Entity Too Large instead of 200 OK.

Personally I'd prefer the first option because it allows for requests being denied for reasons other than shortage of disk space (e.g. load balancing).

This requires an update to the client and the file upload handler.

Change History (7)

comment:1 Changed 17 years ago by MikeMarsUK

The CPDN out-of-disk-space problem is proving to be a significant headache for multiproject crunchers on dial up lines who can't resort to 'network activity disabled' without affecting their other projects.

comment:2 Changed 17 years ago by Richard Haselgrove

I would also prefer Thyme's option 1 (acknowledgement tag in server reply block), rather than a 413 error. Care will need to be given to devising suitable and appropriate messages to appear in the user's client message log - 'too large' sounds like a permanent error, and might lead to people aborting the transfer and the projects losing data.

comment:3 Changed 17 years ago by MikeMarsUK

Perhaps : 'Not currently enough space on remote server to hold the upload, postponed transfer'

Needs to be backward compatible with older versions of the Manager, of course... :-)

comment:4 Changed 17 years ago by KSMarksPsych

Priority: UndeterminedMajor

comment:5 Changed 17 years ago by Bruce Allen

If someone agrees to modify the client, then I'll modify the file upload handler.

Cheers,

Bruce

comment:6 Changed 17 years ago by Thyme Lawn

I'd be happy to take that on Bruce. See my email.

comment:7 Changed 17 years ago by Nicolas

Resolution: fixed
Status: newclosed

Fixed in [13574]? Reopen if I'm wrong.

Note: See TracTickets for help on using tickets.