Package | Description |
---|---|
org.openimaj.experiment.evaluation | |
org.openimaj.experiment.evaluation.classification | |
org.openimaj.experiment.evaluation.classification.analysers.confusionmatrix | |
org.openimaj.experiment.evaluation.classification.analysers.roc | |
org.openimaj.experiment.evaluation.cluster | |
org.openimaj.experiment.evaluation.cluster.analyser |
This package contains classes that can be used to evaluate clustering performance.
|
org.openimaj.experiment.evaluation.retrieval | |
org.openimaj.experiment.evaluation.retrieval.analysers | |
org.openimaj.experiment.validation | |
org.openimaj.ml.annotation.evaluation |
Modifier and Type | Interface and Description |
---|---|
interface |
Evaluator<T,Q extends AnalysisResult>
Evaluator s are used to perform evaluations. |
interface |
ResultAggregator<RESULT,AGGREGATED extends AnalysisResult>
A
ResultAggregator aggregates multiple results
into a single AnalysisResult . |
Modifier and Type | Interface and Description |
---|---|
interface |
ClassificationAnalyser<RESULT extends AnalysisResult,CLASS,OBJECT>
A
ClassificationAnalyser is used to analyse the raw
results from a Classifier in the context of
a ClassificationEvaluator and to produce an AnalysisResult
describing the performance of the ClassificationEvaluator . |
class |
ClassificationEvaluator<RESULT extends AnalysisResult,CLASS,OBJECT>
Implementation of an
Evaluator for the evaluation of classification
experiments. |
Modifier and Type | Class and Description |
---|---|
class |
AggregatedCMResult<CLASS>
Aggregated confusion matrix results
|
class |
CMResult<CLASS>
Results of a confusion matrix analysis using the
CMAnalyser . |
Modifier and Type | Class and Description |
---|---|
class |
ROCResult<CLASS>
An
AnalysisResult representing a set of ROC curves and associated
statistics. |
Modifier and Type | Class and Description |
---|---|
class |
ClusterEvaluator<D,T extends AnalysisResult> |
class |
RangedAnalysisResult<KEY,ANA extends AnalysisResult> |
class |
RangedDBSCANClusterEvaluator<D,T extends AnalysisResult> |
Modifier and Type | Class and Description |
---|---|
class |
RangedAnalysisResult<KEY,ANA extends AnalysisResult> |
Modifier and Type | Interface and Description |
---|---|
interface |
ClusterAnalyser<T extends AnalysisResult> |
class |
DecisionClusterAnalyser<T extends AnalysisResult>
Gather the true positives, true negatives, false positives, false negatives for a
DecisionAnalysis instance |
class |
RandomBaselineClusterAnalyser<ANNER extends ClusterAnalyser<ANNYS>,ANNYS extends RandomBaselineWrappable & AnalysisResult>
Wraps the functionality of any
ClusterAnalyser as corrected by
a Random baseline. |
class |
RandomBaselineClusterAnalysis<T extends RandomBaselineWrappable & AnalysisResult>
The result of a
TestRandomBaselineClusterAnalyser which wraps the
baseline result and result of an AnalysisResult |
Modifier and Type | Class and Description |
---|---|
class |
AdjustedRandomIndexAnalysis
The adjsuted random index as described by: http://faculty.washington.edu/kayee/pca/supp.pdf
|
class |
ClusterStatsAnalysis
Counts some overall statistics of cluster evaluation such as min, max and average cluster length
|
class |
DecisionAnalysis
Counting the number of true positives, true negatives, flase postitives and false negatives
one can produce various cluster quality metrics including the fscore and randindex
|
class |
FScoreAnalysis
Uses a decision analysis to produce the random index result
|
class |
FullMEAnalysis
Sina Samangooei (ss@ecs.soton.ac.uk)
|
class |
NMIAnalysis
Measures normalised mutual information.
|
class |
PurityAnalysis
A measure of how pure each cluster is.
|
class |
RandomBaselineClusterAnalysis<T extends RandomBaselineWrappable & AnalysisResult>
The result of a
TestRandomBaselineClusterAnalyser which wraps the
baseline result and result of an AnalysisResult |
class |
RandomBaselineSMEAnalysis
Results of applying a RandomBaselineSMEAnalysis to evaluate clustering.
|
class |
RandomIndexAnalysis
Uses a decision analysis to produce the random index result
|
class |
SimpleMEAnalysis
Result of applying a
SimpleMEClusterAnalyser . |
Modifier and Type | Field and Description |
---|---|
AnalysisResult |
FullMEAnalysis.adjRandInd |
Modifier and Type | Interface and Description |
---|---|
interface |
RetrievalAnalyser<RESULT extends AnalysisResult,QUERY,DOCUMENT extends Identifiable>
A
RetrievalAnalyser is used to analyse the raw search results from a
RetrievalEngine in the context of a RetrievalEvaluator and to
produce an AnalysisResult describing the performance of the
RetrievalEngine . |
class |
RetrievalEvaluator<RESULT extends AnalysisResult,DOCUMENT extends Identifiable,QUERY>
An implementation of an
Evaluator for the evaluation of retrieval
experiments using the Cranfield methodology. |
Modifier and Type | Class and Description |
---|---|
class |
IREvalResult
An
AnalysisResult that is bascked by a SetRetrievalEvaluator to
capture the results of a retrieval experiment. |
class |
PrecisionAtNResult<QUERY>
AnalysisResult used with PrecisionAtN to hold the P@N
precision after N documents have been retrieved. |
class |
TRECResult
An
AnalysisResult wrapping the output of the
trec_eval tool. |
Modifier and Type | Method and Description |
---|---|
static <DATASET extends Dataset<?>,ANALYSIS_RESULT,AGGREGATE_ANALYSIS_RESULT extends AnalysisResult> |
ValidationRunner.run(ResultAggregator<ANALYSIS_RESULT,AGGREGATE_ANALYSIS_RESULT> aggregator,
DATASET dataset,
CrossValidator<DATASET> cv,
ValidationOperation<DATASET,ANALYSIS_RESULT> round)
Perform cross validation using the given cross validation scheme
on the given data.
|
static <DATASET extends Dataset<?>,ANALYSIS_RESULT,AGGREGATE_ANALYSIS_RESULT extends AnalysisResult> |
ValidationRunner.run(ResultAggregator<ANALYSIS_RESULT,AGGREGATE_ANALYSIS_RESULT> aggregator,
DATASET dataset,
CrossValidator<DATASET> cv,
ValidationOperation<DATASET,ANALYSIS_RESULT> round,
ThreadPoolExecutor pool)
Perform cross validation using the given cross validation scheme
on the given data.
|
Modifier and Type | Method and Description |
---|---|
<RESULT extends AnalysisResult> |
AnnotationEvaluator.newClassificationEvaluator(ClassificationAnalyser<RESULT,ANNOTATION,OBJECT> analyser)
Make a new
ClassificationEvaluator , backed by the annotations
computed by this AnnotationEvaluator , with the given
ClassificationAnalyser . |
<RESULT extends AnalysisResult> |
AnnotationEvaluator.newRetrievalEvaluator(RetrievalAnalyser<RESULT,ANNOTATION,OBJECT> analyser)
Make a new
RetrievalEvaluator , backed by the annotations computed
by this AnnotationEvaluator , with the given
RetrievalAnalyser . |