Docsity
Docsity

Prepare for your exams
Prepare for your exams

Study with the several resources on Docsity


Earn points to download
Earn points to download

Earn points by helping other students or get them with a premium plan


Guidelines and tips
Guidelines and tips

Understanding Confusion Matrix: TP, TN, FP, FN, Study notes of Statistics

An explanation of a confusion matrix, which is a table used to describe the performance of a classification model. The matrix shows the number of True Positives (TP), True Negatives (TN), False Positives (FP), and False Negatives (FN) in the automatic and manual classification of three groups. The document also includes definitions and calculations of main parameters such as Accuracy, Recall, Specificity, Precision, and additional statistics like F-measure, Balanced accuracy, Matthews Correlation Coefficient, and Chi-square. useful for students and researchers in the field of machine learning, data analysis, and statistics.

Typology: Study notes

2021/2022

Uploaded on 09/12/2022

ilyastrab
ilyastrab 🇺🇸

4.4

(52)

382 documents

1 / 6

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
Statistics calculated on confusion matrix
Confusion matrix
Theoretical confusion matrix
Automatic classification
Positive Negative
Manual
classification
Positive TP FN
Negative FP TN
Example
Automatic classification of three groups A, B, C
Automatic classification
A B C
Manual
classification
A1 1 1
B1 3 0
C0 0 3
For group A, the matrix can be reduced as:
Automatic classification
Group A Not group A
Manual
classification
Group A TP = 1 FN = 2
Not group A FP = 1 TN = 6
For group B, the matrix can be reduced as:
Automatic classification
Group B Not group B
Manual
classification
Group B TP = 3 FN = 1
Not group B FP = 1 TN = 5
For group C, the matrix can be reduced as:
Automatic classification
Group C Not group C
Manual
classification
Group C TP = 3 FN = 0
Not group C FP = 1 TN = 6
1
pf3
pf4
pf5

Partial preview of the text

Download Understanding Confusion Matrix: TP, TN, FP, FN and more Study notes Statistics in PDF only on Docsity!

Statistics calculated on confusion matrix

Confusion matrix

Theoretical confusion matrix

Automatic classification Positive Negative Manual classification Positive TP FN Negative FP TN

Example

Automatic classification of three groups A , B , C Automatic classification A B C Manual classification

A 1 1 1
B 1 3 0
C 0 0 3

For group A , the matrix can be reduced as: Automatic classification Group A Not group A Manual classification Group A TP = 1 FN = 2 Not group A FP = 1 TN = 6 For group B , the matrix can be reduced as: Automatic classification Group B Not group B Manual classification Group B TP = 3 FN = 1 Not group B FP = 1 TN = 5 For group C , the matrix can be reduced as: Automatic classification Group C Not group C Manual classification Group C TP = 3 FN = 0 Not group C FP = 1 TN = 6

Explanation of main parameters

TP : True Positive

Number of particles of the group of interest correctly classified.

TN : True Negative

Number of particles of all the other groups classified as other groups.

FP : False Positive

Number of particles of other groups classified in the group of interest.

FN : False Negative

Number of particles of the group of interest classified in the other groups.

General statistics

Accuracy

( TP + TN )
( TP + TN + FP + FN )

Error

1 – Accuracy

FOR : False Omission Rate

FN
( FN + TN )
= 1 – NPV

The four ratios of ratios

LRPT : Likelihood Ratio for Positive Tests

TP /( TP + FN )
FP /( FP + TN )

Recall ( 1 − Specificity )

Recall FPR

LRNT : Likelihood Ratio for Negative Tests

FN /( FN + TP )
TN /( TN + FP )

( 1 − Recall ) Specificity

FNR

Specificity

LRPS : Likelihood Ratio for Positive Subjects

TP /( TP + FP )
FN /( FN + TN )

Precision ( 1 − NPV )

Precision FOR

LRNS : Likelihood Ratio for Negative Subjects

FP /( FP + TP )
TN /( TN + FN )

( 1 − Precision ) ( 1 − FOR )

FDR
NPV