Changes between Version 11 and Version 12 of BossaOverview
- Timestamp:
- Jul 25, 2008, 10:56:09 AM (17 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
BossaOverview
v11 v12 22 22 == The diverse requirements of distributed thinking == 23 23 24 Distributed thinking projects may have widely varying25 properties andrequirements.26 27 First, they may require different orders of job distribution.24 Distributed thinking projects have widely varying properties 25 and hence different requirements. 26 First, they may require different ''distribution policies'', 27 i.e. different orders in which jobs are distributed. 28 28 Consider the two cases: 29 29 … … 31 31 * Project B has an unbounded stream of jobs and a limited set of volunteers. 32 32 33 Project A will want to have each job performedabout the same number of times.34 It will want to issuesall jobs once,33 In project A the goal is to perform all jobs about the same number of times. 34 Hence its best distribution policy is to issue all jobs once, 35 35 then issue them all a second time, and so on. 36 In constrast, project B will want to issue the first job to a quorum of volunteers, 37 then issue the second job to a quorum, and so on. 36 The longer the project runs, the more accurate the results become. 37 38 In constrast, project B has a predetermined "accuracy threshold". 39 Its best distribution policy is to issue the first job to a set of volunteers 40 sufficient to meet the accuracy threshold, 41 then issue the second job to another set, and so on. 42 The longer the project runs, the more jobs are finished. 38 43 39 44 Second, projects may want to assess the ability of each volunteer, … … 42 47 43 48 * The volunteer's performance on a training course. 44 * The volunteer's performance on a stream of "calibration jobs"(with known answers) intermixed with the job stream.45 * The fraction of time a volunteer's response to a jobagrees with the "correct" response, as determined by replication.49 * The volunteer's performance on a stream of '''calibration jobs''' (with known answers) intermixed with the job stream. 50 * The fraction of jobs for which the volunteer's response agrees with the "correct" response, as determined by replication. 46 51 47 52 In addition, the way in which ability is described may vary. 48 In simple cases it might be a single number, e.g. and error rate. 49 For tasks that involve feature detection we might want to track 50 the rates of false positives and false negatives separately. 51 For more complex tasks there could be arbitrarily many dimensions. 53 * In simple cases it might be a single number, e.g. an error rate. 54 * For tasks that involve feature detection we might want to track the rates of false positives and false negatives separately. 55 * For more complex tasks, ability could have arbitrarily many dimensions. 52 56 53 57 Third, there are various way in which "experts" might be used. … … 75 79 * Users can be assigned integer '''levels''', in which case each job has a vector of priorities, one per level. 76 80 77 This framework enables all of the examples listed above 78 (and others not yet conceived) 81 This framework enables all of the examples listed above (and others not yet conceived of) 79 82 to be implemented with a small amount of PHP programming.