Changes between Version 3 and Version 4 of RemoteInputFiles

Timestamp:

Feb 5, 2013, 12:04:38 AM (11 years ago)

Author:

davea

Comment:

--

RemoteInputFiles

@@ -12 +12 @@
 job submitters to place files on the BOINC server.
 
-Each of these mechanisms deals with two issues:
+Each of these mechanisms deals with several issues:
 
  * '''File immutability''': BOINC requires that a file
@@ -22 +22 @@
  * File cleanup: There must be some way to clean up
   files on the server when they are no longer needed.
+ * Authorization: only users authorized to submit jobs
+  should be able to move files to the server.
+
+Note: both mechanisms upload files via PHP.
+PHP's default max file upload size is 2MB.
+To increase this, edit /etc/php.ini, and change, e.g.
+{{{
+upload_max_filesize = 64M
+post_max_size = 64M
+}}}
 
 == Content-based file management ==
@@ -57 +67 @@
 Inputs:
  * '''project_url''': the project's master URL
- * '''authenticator''': the job submitter's authenticator
+ * '''authenticator''': the job submitter's authenticator.
  * '''paths''': a list of file paths on the calling host.
  * '''md5s''': a list of the MD5s of the files.
  * '''batch_id''': the ID of a batch whose jobs will reference the files
   (these jobs need not exist yet).
+  The operation will fail if the user is not authorized to
+  submit jobs to the batch's application.
 
 Action: for each file, see if it exists on the server.
@@ -85 +97 @@
  * '''paths''': a list of paths of files to be uploaded
  * '''md5s''': a list of MD5 hashes of these files
- * '''batch_id''': the ID of a batch with which the files are associated
+ * '''batch_id''': the ID of a batch with which the files are associated.
+  The operation will fail if the user is not authorized to
+  submit jobs to the batch's application.
 
 Action: Upload the files, and create associations to the given batch.
@@ -99 +113 @@
 == Per-user file sandbox ==
 
+This mechanism allows job submitters to explicitly
+upload files via a web interface: PROJECT_URL/sandbox.php.
+
+Links to the files are stored in a "sandbox directory"
+PROJECT_ROOT/sandbox/USERID/.
+The entries in this directory have contents
+{{{
+size MD5
+}}}
+
+The actual files are stored in the download directory,
+under the name '''sb_userid_MD5'''.
+
+Currently, files in the sandbox are not cleanup up automatically.
+The web interface allows users to delete their files.