Changes between Version 1 and Version 2 of JobTemplates


Ignore:
Timestamp:
Feb 15, 2013, 11:08:44 PM (11 years ago)
Author:
davea
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • JobTemplates

    v1 v2  
    4848  '''<sticky/>''':: if present, the file remains on the client after job is finished.
    4949  '''<no_delete/>''':: if present, the file is not deleted from the server after job is completed.  Use this if the file is used as input to more than one job.
    50   '''<report_on_rpc/>''':: if present, report file in each scheduler request (for sticky files)
    51   '''<url>, <md5_cksum>, <nbytes>''':: used only for "non-local" input files (see below)
     50  '''<report_on_rpc/>''':: if present, report file in each scheduler request (for sticky files).
     51   Include this for compatibility with old (pre-7.x) clients; 7.0+ clients report all sticky files.
     52  '''<url>, <md5_cksum>, <nbytes>''':: Use these for files that are [JobStage staged] to
     53   a server (or servers) other than your BOINC server.
     54   Each '''<url>''' element specifies a directory (i.e. it should end with a /) to which the file name will
     55   be appended to give the URL.
     56   You must provide the MD5 checksum and size of the file.
    5257
    5358 '''<file_ref>''':: describes [BoincFiles#Filereferences the way the file is referenced].
     
    6873   on a host with insufficient disk space.
    6974
    70 Notes:
    71  * The input template is copied into a BLOB column of the workunit table and will substitute filenames,
    72   and have download urls, signatures and other elements inserted into your provided template.
    73   The total expanded BLOB cannot exceed 65,535 bytes.
    74   This is enough for about 200 input files,
    75   fewer if you use long file names are multiple download URLs.
    76   If this isn't enough, you can use [FileCompression BOINC file compression] to zip several files into a single file reference for download,
    77   and expanding them prior to running on the client machine.
     75The input template (substituted with filenames and URLs) is stored in a database field
     76with a 64KB limit.
     77This is enough for about 200 input files,
     78fewer if you use long file names or multiple download URLs.
     79If this isn't enough, you can use [FileCompression BOINC file compression] to zip several files into a single file reference for download,
     80and expanding them prior to running on the client machine.
    7881
    7982== Output template files ==
     
    143146(i.e. no more replicas will be created).
    144147
    145 In general, you should not attempt to use more then 50 files in your output template.
    146 This is because the provided template will have upload URLs, and file names expanded, and signatures added to it.
    147 The total size of the result must remain under 65,535 bytes to fit in the xml_doc_in and xml_doc_out BLOBs in the result table.
    148 Your actual limit on number of files will depend upon the length of your job names, and upload URLs.
    149 If your expanded output template is approaching the size limit,
     148The output template, substituted with filenames and URLs,
     149is stored in a database field with a 64KB limit.
     150This imposes a limit of about 50 output files;
     151the exact number depends upon the length of your filenames and URLs.
     152If you need more files,
    150153you can use [FileCompression BOINC file compression] to zip several files
    151154into a single file reference for upload, prior to completing each task on the client machine.
    152155Once you have run some jobs through your project,
    153 you can compare the size of the expanded xml with the 65,535 limit by running the following MySQL statement:[[BR]]
    154 {{{select max(length(xml_doc_in)), max(length(xml_doc_out)) from result;}}}[[BR]]
    155 Note that here "_in" and "_out" are both references to the output template.
    156 "_in" being when the task was created, and "_out" how it looked,
    157 with actual file sizes and checksums, at the time the task was returned.
    158 So don't confuse these column names with the "input" and "output" templates.
     156you can compare the size of the expanded xml with the 65,535 limit by running the following MySQL statement:
     157{{{
     158select max(length(xml_doc_in)), max(length(xml_doc_out)) from result;
     159}}}