Confidence Score Function

A Confidence Score Function, [math]\displaystyle{ \operatorname{PredScore}(M_i,T_j,\bf{o}_k) }[/math], is an estimation function that can produce a confidence score for a prediction.

• Context:
  • ...
• Example(s):
  • a Predicted String Segment Confidence Score Function.
  • ...
• Counter-Example(s):
  • Precision Measure.
  • Recall Measure.
  • Accuracy Measure.
  • F1 Measure.
• See: Segment Chunking, Prediction Confidence Estimate, Performance Measure.

References

2008

• (Westerhuis et al., 2008) ⇒ Johan A Westerhuis, Huub CJ Hoefsloot, Suzanne Smit, Daniel J Vis, Age K Smilde, Ewoud JJ van Velzen, John PM van Duijnhoven, and Ferdi A van Dorsten. (2008). "Assessment of PLSDA Cross Validation." In: Metabolomics. doi:10.1007/s11306-007-0099-6
  • QUOTE: We argue against the use of a single final model, but instead promote the use of many slightly different models to obtain a range of class membership predictions. This range can be used as a confidence measure for class membership assignment.

• Concept
• Statistical Inference
• Machine Learning