Obstacles and Risks. To enable this research we need broad collaborations between IR researchers and communities outside IR. Finding effective ways of collaborating and finding a shared language requires con- siderable effort and investment that may not be properly “rewarded” by funding bodies and evaluation committees. An important risk concerns the diversity of perspectives on the definition of core concepts such as fairness, ethics, explanation or bias across scientific and engineering disciplines, gov- ernments or regulating bodies. Having more transparent IR systems could make systems more vulnerable for adversaries as knowledge about the internals of systems need to be shared through explanations. A potential obstacle is initial resistance from system developers and engineers, who might have to change their workflows in order for systems to be more transparent. Another possible obstacle is the tension between transparency and fairness, and an enterprise’s commercial goals. An inadvertent risk is introducing a new type of bias into our systems about which we are unaware. 4 IR for Supporting Knowledge Goals and Decision-Making 4.1 Description IR systems should support complex, evolving, or long-term information seeking goals such as acquiring broad knowledge either for its own sake or to make an informed decision. Such support will require understanding what information is needed to accomplish the goal, scaffolding search sessions toward the goal, providing broader context as information is gathered, identifying and flagging misleading or confusing information, and compensating for bias in both information and users. It requires advances in algorithms, interfaces, and evaluation methods that support these goals. It will be most successful if it incorporates growing understanding of cognitive processes: how do people conceptualize their information need, how can contrasting information be most effectively portrayed, how do people react to information that flies in the face of their own biases, and so on.
Appears in 3 contracts
Sources: End User Agreement, End User Agreement, End User Agreement