Changes between Version 4 and Version 5 of DataFlow
- Timestamp:
- Jun 11, 2008, 4:24:27 AM (16 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
DataFlow
v4 v5 11 11 * Each host downloads the input files. 12 12 * After some queueing delay due to other jobs in progress, the host executes the job, then uploads its output files. 13 * T He host reports the completed job, possibly after an additional delay (whose purpose is to reduce the rate of scheduler requests).13 * The host reports the completed job, possibly after an additional delay (whose purpose is to reduce the rate of scheduler requests). 14 14 * A '''validator''' (a program you supply) checks the output files, perhaps comparing replicas. 15 15 * When a valid instance is found, an '''assimilator''' (a program you supply) handles the results, e.g., by inserting them in a separate database.