org.openimaj.experiment.evaluation.agreement

Class PercentageInterraterAgreement

java.lang.Object

org.openimaj.experiment.evaluation.agreement.PercentageInterraterAgreement

public class PercentageInterraterAgreement
extends Object

Calculates the percentage interrater agreement for a given dataset between two (and only two) raters.

Author:

David Dupplaw (dpd@ecs.soton.ac.uk)

Created:

12 Aug 2013

Constructor Summary

Constructors

Constructor and Description
PercentageInterraterAgreement()

Method Summary

Modifier and Type	Method and Description
static <K,A> double	calculate(Map<K,A> rater1, Map<K,A> rater2) The input should be a Map for each rater where the keys represent all the subjects that were rated by the raters and the values represent the annotations given by the raters.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PercentageInterraterAgreement

public PercentageInterraterAgreement()

Method Detail

calculate

public static <K,A> double calculate(Map<K,A> rater1,
                                     Map<K,A> rater2)

The input should be a Map for each rater where the keys represent all the subjects that were rated by the raters and the values represent the annotations given by the raters. Agreement between the raters is determined by Object.equals(Object) for the INSTANCE type. Annotations for subjects which are not in both sets are ignored.

Parameters:

rater1 - The annotations from rater 1

rater2 - The annotations from rater 2

Returns:

The percentage agreement