Changes between Version 5 and Version 6 of LocalityScheduling
- Timestamp:
- Jul 21, 2014, 11:03:24 PM (10 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
LocalityScheduling
v5 v6 11 11 12 12 To use locality scheduling you must declare the large input files as 13 [JobSubmission#Inputtemplatefiles sticky]. 13 [JobTemplates sticky] (so they're not deleted on the client) 14 and [JobTemplates no_delete] (so they're not deleted on the server). 14 15 15 16 There are two variants of locality scheduling: … … 18 19 fairly small (of order 100). 19 20 * '''Standard''': use in other cases. 20 Note: this hasn't been implemented yet. 21 A design document is [LocalityNew here]. 21 A highly project-specific version of this is used by Einstein@home. 22 A more general version has been [LocalityNew designed] 23 but is not yet implemented. 22 24 23 25 == Limited locality scheduling == … … 25 27 Limited locality scheduling (LLS) uses BOINC's standard share-memory job cache scheduling mechanism. 26 28 It assumes that the ratio of the job cache size to the number of data files 27 is sufficiently large that , on average, there isat least one job29 is sufficiently large that there is usually at least one job 28 30 in the cache for a given data file. 29 31 It dispatches jobs that use files resident on the client … … 44 46 and the policy won't work well. 45 47 46 Currently there is no mechanism for deleting old, unused sticky files from clients. 47 We'll need to add one at some point.48 When you have no more jobs for an input file, 49 you can [DeleteFile arrange for it to be deleted from clients].