org.openimaj.experiment.evaluation.agreement

Class FleissInterraterAgreement

java.lang.Object

org.openimaj.experiment.evaluation.agreement.FleissInterraterAgreement

public class FleissInterraterAgreement
extends Object

Calculates Fleiss inter-rater agreement - a version of Cohen's kappa that works with multiple raters. Note that it is technially not a kappa as it does not reduce to Cohen's kappa when used with only 2 raters.

Author:

David Dupplaw (dpd@ecs.soton.ac.uk)

See Also:

"http://en.wikipedia.org/wiki/Fleiss'_kappa"

Created:

16 Aug 2013

Constructor Summary

Constructors

Constructor and Description
FleissInterraterAgreement()

Method Summary

Modifier and Type	Method and Description
static <K,A> double	calculate(List<Map<K,A>> data) Calculate Fleiss interrater agreement

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FleissInterraterAgreement

public FleissInterraterAgreement()

Method Detail

calculate

public static <K,A> double calculate(List<Map<K,A>> data)

Calculate Fleiss interrater agreement

Parameters:

data - The rater's annotations

Returns:

The Fleiss Kappa

See Also:

"http://en.wikipedia.org/wiki/Fleiss'_kappa"