org.openimaj.ml.annotation.evaluation

Class AnnotationEvaluator<OBJECT extends Identifiable,ANNOTATION>

java.lang.Object

org.openimaj.ml.annotation.evaluation.AnnotationEvaluator<OBJECT,ANNOTATION>

Type Parameters:

OBJECT - Type of object being annotated

ANNOTATION - Type of annotation.

public class AnnotationEvaluator<OBJECT extends Identifiable,ANNOTATION>
extends Object

A class to help evaluate the performance of an Annotator using standardised classification and/or retrieval evaluation methodologies.

Author:

Jonathon Hare (jsh2@ecs.soton.ac.uk)

Constructor Summary

Constructors

Constructor and Description
AnnotationEvaluator(Annotator<OBJECT,ANNOTATION> annotator, Dataset<? extends Annotated<OBJECT,ANNOTATION>> testData) Construct a new AnnotationEvaluator with the given annotator and test data (with ground-truth annotations).

Method Summary

Modifier and Type	Method and Description
<RESULT extends AnalysisResult> ClassificationEvaluator<RESULT,ANNOTATION,OBJECT>	newClassificationEvaluator(ClassificationAnalyser<RESULT,ANNOTATION,OBJECT> analyser) Make a new ClassificationEvaluator, backed by the annotations computed by this AnnotationEvaluator, with the given ClassificationAnalyser.
<RESULT extends AnalysisResult> RetrievalEvaluator<RESULT,OBJECT,ANNOTATION>	newRetrievalEvaluator(RetrievalAnalyser<RESULT,ANNOTATION,OBJECT> analyser) Make a new RetrievalEvaluator, backed by the annotations computed by this AnnotationEvaluator, with the given RetrievalAnalyser.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AnnotationEvaluator

public AnnotationEvaluator(Annotator<OBJECT,ANNOTATION> annotator,
                           Dataset<? extends Annotated<OBJECT,ANNOTATION>> testData)

Construct a new AnnotationEvaluator with the given annotator and test data (with ground-truth annotations).

Parameters:

annotator - the annotator

testData - the test data with ground-truth annotations.

Method Detail

newClassificationEvaluator

public <RESULT extends AnalysisResult> ClassificationEvaluator<RESULT,ANNOTATION,OBJECT> newClassificationEvaluator(ClassificationAnalyser<RESULT,ANNOTATION,OBJECT> analyser)

Make a new ClassificationEvaluator, backed by the annotations computed by this AnnotationEvaluator, with the given ClassificationAnalyser.

Type Parameters:

RESULT - The type of AnalysisResult produced by the evaluator

Parameters:

analyser - the ClassificationAnalyser

Returns:

the evaluator

newRetrievalEvaluator

public <RESULT extends AnalysisResult> RetrievalEvaluator<RESULT,OBJECT,ANNOTATION> newRetrievalEvaluator(RetrievalAnalyser<RESULT,ANNOTATION,OBJECT> analyser)

Make a new RetrievalEvaluator, backed by the annotations computed by this AnnotationEvaluator, with the given RetrievalAnalyser.

Type Parameters:

RESULT - The type of AnalysisResult produced by the evaluator

Parameters:

analyser - the RetrievalAnalyser

Returns:

the evaluator