|
There is some flexibility about the details of the research topic; two possible directions are discussed below (and there may be others).
One starting-point for research is [George 2023] below (by Dr. William George, Kleros Cooperative). The paper studies mechanisms for crowdsourcing judgements of real-world scenarios, in settings where there is a ground truth, or correct answer, to be elicited. The general topic of research is voting schemes, which is a major theme of computational social choice theory. A general principle identified in the paper is that voting for the “right answer” to a question is a Schelling point, a strategy where the participant gets rewarded for being in agreement with other participants. [Lesaege et al] gives an overview of how Kleros aims to apply these ideas.
There is quite a wealth of research problems that could be investigated in this general line, based on models of the ground truth, and what signals are received by the participants. An intriguing concern with this general approach, is that it may be the case that the desire to agree with other participants may be in conflict with the desire to output one’s own best guess as to the right answer. This issue originates in the long-standing concept of a Keynesian beauty contest (KBC), in which participants may base their vote on their own assessment of their peers’ assessment of the (subjective) beauty of the alternatives.
The project would investigate models of how the participants receive signals based on the ground truth, and analysis of where/how the KBC problem arises. The modelling may include, for example, multi-level reasoning amongst the participants about how they predict each other are likely to vote, along with the design of payoff systems, as discussed in [George 2023]. [George 2023] also studies the presence of adversaries in the electorate, and the design of voting mechanisms that are resistant to those. It is likely that there are plenty of research issues in the adversary-free setting, but dealing with adversaries is of course of interest.
An alternative line of work addresses disputes in which the settlement is a numerical value, as opposed to a binary ruling in favour of one side or the other. That arises in the context of lawsuits, claims for damages, or insurance payouts. The two disputants can be thought of as the “maximiser” and the “minimiser”, referring to the amount that the former receives from the latter. In Final-offer arbitration (FOA) each side submits a proposed payment to the arbitrator, who chooses which of those two amounts looks the more reasonable, and that becomes the settlement. FOA incentivises the two disputants to make reasonable proposals. (Link to detailed discussion about why it often works well, and some variations of the basic idea.) It is interesting to model the situation game-theoretically (example), where for example the knowledge the disputants have about the arbitrator consists of probability distributions over the arbitrator’s judgement. The problem becomes more interesting and challenging when there is more than one arbitrator, or if we assume that the arbitrator’s likely judgement is to be learned from a small number of prior observations.