Changes between Version 1 and Version 2 of CondorBoinc

Timestamp:

Jul 27, 2012, 11:13:05 PM (12 years ago)

Author:

davea

Comment:

--

CondorBoinc

@@ -41 +41 @@
    with the BOINC GAHP.
 
-=== Implementation notes ===
+=== GAHP protocol ===
+
+The API exported by the BOINC GAHP has the following functions:
+
+{{{
+submit_jobs()
+   inputs:
+      batch_name (unique within project)
+      app_name
+      jobs
+         job name
+         cmdline
+         list of input files
+   output:
+      error code
+}}}
+
+Each input file is described by its path on the submit node.
+The file name is the name by which the app will refer to the file.
+
+What the BOINC GAHP does:
+
+ * From the list of input files, filter out application files.
+   Need to figure out how to do this: could be attribute specified in Condor submit file,
+   or the list could be fetched from BOINC server.
+ * Eliminate duplicates in file list
+ * Compute MD5s of files
+ * BOINC physical name of each file is condorv_(md5)
+ * Do query_files() RPC to see which files are already on BOINC server
+ * Do upload_files() RPC to copy needed files to BOINC server
+ * Do submit_jobs() RPC to BOINC server; create batch, jobs
+
+{{{
+query_batch
+   in: batch name
+   out: list of jobs
+      job name
+      status (done/error/in prog/not in prog)
+}}}
+
+{{{
+query_job
+   in: job name
+   out: status
+      list of URLs of output files
+}}}
+
+{{{
+abort_jobs
+   in: list of job names
+}}}
+
+{{{
+set_lease
+   in: batch name
+      new lease end time
+}}}
+=== BOINC Web RPCs ===
+
+{{{
+query_files()
+   in: list of physical file names
+   out: list of those not present on server
+}}}
+
+{{{
+upload_files()
+   in: batch name
+      filename
+      file contents
+   out: error code
+
+uploads files and creates DB records (see below)
+}}}
+
+{{{
+submit_jobs()
+   in: same as for GAHP, except include both logical and physical name
+   out: error code
+}}}
+
+== File management mechanism ==
+
+To keep track of input files,
+we'll add the following to BOINC:
+
+ * DB tables for files, and for batch/file associations
+ * daemon for deleting files and DB records of files with
+   no associations, or past all lease ends
+
+== Changes to BOINC ==
+
+ * The job creation primitives (create_work()) will let you directly specify
+  the logical names of input files,
+  rather than specifying them in a template.
+ * Add lease_end field to batch
+
+
+
+== Implementation notes ==
 
 The BOINC GAHP will need to