Changes between Version 11 and Version 12 of BossaOverview


Ignore:
Timestamp:
Jul 25, 2008, 10:56:09 AM (16 years ago)
Author:
davea
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • BossaOverview

    v11 v12  
    2222== The diverse requirements of distributed thinking ==
    2323
    24 Distributed thinking projects may have widely varying
    25 properties and requirements.
    26 
    27 First, they may require different orders of job distribution.
     24Distributed thinking projects have widely varying properties
     25and hence different requirements.
     26First, they may require different ''distribution policies'',
     27i.e. different orders in which jobs are distributed.
    2828Consider the two cases:
    2929
     
    3131 * Project B has an unbounded stream of jobs and a limited set of volunteers.
    3232
    33 Project A will want to have each job performed about the same number of times.
    34 It will want to issues all jobs once,
     33In project A the goal is to perform all jobs about the same number of times.
     34Hence its best distribution policy is to issue all jobs once,
    3535then issue them all a second time, and so on.
    36 In constrast, project B will want to issue the first job to a quorum of volunteers,
    37 then issue the second job to a quorum, and so on.
     36The longer the project runs, the more accurate the results become.
     37
     38In constrast, project B has a predetermined "accuracy threshold".
     39Its best distribution policy is to issue the first job to a set of volunteers
     40sufficient to meet the accuracy threshold,
     41then issue the second job to another set, and so on.
     42The longer the project runs, the more jobs are finished.
    3843
    3944Second, projects may want to assess the ability of each volunteer,
     
    4247
    4348 * The volunteer's performance on a training course.
    44  * The volunteer's performance on a stream of "calibration jobs" (with known answers) intermixed with the job stream.
    45  * The fraction of time a volunteer's response to a job agrees with the "correct" response, as determined by replication.
     49 * The volunteer's performance on a stream of '''calibration jobs''' (with known answers) intermixed with the job stream.
     50 * The fraction of jobs for which the volunteer's response agrees with the "correct" response, as determined by replication.
    4651
    4752In addition, the way in which ability is described may vary.
    48 In simple cases it might be a single number, e.g. and error rate.
    49 For tasks that involve feature detection we might want to track
    50 the rates of false positives and false negatives separately.
    51 For more complex tasks there could be arbitrarily many dimensions.
     53 * In simple cases it might be a single number, e.g. an error rate.
     54 * For tasks that involve feature detection we might want to track the rates of false positives and false negatives separately.
     55 * For more complex tasks, ability could have arbitrarily many dimensions.
    5256
    5357Third, there are various way in which "experts" might be used.
     
    7579 * Users can be assigned integer '''levels''', in which case each job has a vector of priorities, one per level.
    7680
    77 This framework enables all of the examples listed above
    78 (and others not yet conceived)
     81This framework enables all of the examples listed above (and others not yet conceived of)
    7982to be implemented with a small amount of PHP programming.