Standard metrics for biometric system evaluation

Forked from tutorial/postperf/1

This algorithm is a legacy one. The API has changed since its implementation. New versions and forks will need to be updated.
This algorithm is an analyzer. It can only be used on analysis blocks.

Algorithms have at least one input and one output. All algorithm endpoints are organized in groups. Groups are used by the platform to indicate which inputs and outputs are synchronized together. The first group is automatically synchronized with the channel defined by the block in which the algorithm is deployed.

Group: main

Endpoint Name Data Format Nature
scores tutorial/probe_scores/1 Input

Analyzers may produce any number of results. Once experiments using this analyzer are done, you may display the results or filter experiments using criteria based on them.

Name Type
scores_distribution plot/bar/1
frr float32
far float32
roc plot/isoroc/1
eer float32
number_of_positives int32
threshold float32
number_of_negatives int32

The code for this algorithm in Python
The ruler at 80 columns indicate suggested POSIX line breaks (for readability).
The editor will automatically enlarge to accomodate the entirety of your input
Use keyboard shortcuts for search/replace and faster editing. For example, use Ctrl-F (PC) or Cmd-F (Mac) to search through this box

An algorithm that implements standard metrics for biometric system evaluation.

Specifically, it returns:

  • eer: the equal error rate (EER)
  • far: the false acceptance rate (FAR)
  • frr: the false rejection rate (FRR)
  • number_of_positives: the number of positive (genuine) trials
  • number_of_negatives: the number of negative (impostor) trials
  • threshold: the threshold at the equal error rate
  • roc: the receiver operating characteristic (ROC) curve according to the biometrics standard ISO/IEC 19795-1:2006(E)

This implementation relies on the 'measure' package from the Bob library.

Experiments

Updated Name Databases/Protocols Analyzers
amohammadi/tutorial/eigenface/1/atnt-eigenfaces-66-comp atnt/5@idiap tutorial/postperf_iso/1
amohammadi/tutorial/eigenface/1/atnt-eigenfaces-67-comp atnt/5@idiap tutorial/postperf_iso/1
anjos/tutorial/eigenface/1/atnt-eigenfaces-75-comp-bis atnt/3@idiap tutorial/postperf_iso/1
anjos/tutorial/eigenface/1/atnt-eigenfaces-172 atnt/3@idiap tutorial/postperf_iso/1
tutorial/tutorial/eigenface/1/atnt-eigenfaces-70-comp atnt/3@idiap tutorial/postperf_iso/1
tutorial/tutorial/eigenface/1/atnt-eigenfaces-50-comp atnt/3@idiap tutorial/postperf_iso/1
tutorial/tutorial/eigenface/1/atnt-eigenfaces-45-comp atnt/3@idiap tutorial/postperf_iso/1
tutorial/tutorial/eigenface/1/atnt-eigenfaces-7-comps atnt/3@idiap tutorial/postperf_iso/1
tutorial/tutorial/eigenface/1/atnt-eigenfaces-8-comps atnt/3@idiap tutorial/postperf_iso/1
tutorial/tutorial/eigenface/1/atnt-eigenfaces-9-comps atnt/3@idiap tutorial/postperf_iso/1
namratachede/tutorial/eigenface_with_preprocessing/1/namrataTest2 atnt/2@idiap tutorial/postperf_iso/1
omenemac/omenemac/gagatoolchainfork/1/MacsExperiment4 atnt/2@idiap tutorial/postperf_iso/1
chennu/tutorial/eigenface_with_preprocessing/1/test21 atnt/2@idiap tutorial/postperf_iso/1
soumik/tutorial/eigenface_with_preprocessing/1/Eigenface-22 atnt/2@idiap tutorial/postperf_iso/1
Vijay/tutorial/eigenface_with_preprocessing/1/Pparistest atnt/2@idiap tutorial/postperf_iso/1
mojtabaeslahi/cwhitela/cwhitela_eigenfaces_with_preprocessing/1/paristest atnt/2@idiap tutorial/postperf_iso/1
tutorial/tutorial/eigenface_with_preprocessing/1/paris-test atnt/2@idiap tutorial/postperf_iso/1
magedsoft/tutorial/eigenface_with_preprocessing/1/histogram_test_creteil atnt/2@idiap tutorial/postperf_iso/1
ilyaskhantmg/tutorial/eigenface/1/aint-15-comp atnt/2@idiap tutorial/postperf_iso/1
smarcel/tutorial/eigenface/1/eigenface-rr2 atnt/2@idiap tutorial/postperf_iso/1
cwhitela/cwhitela/cwhitela_eigenfaces_with_preprocessing/1/cwhitela_test atnt/2@idiap tutorial/postperf_iso/1
tutorial/tutorial/eigenface_with_preprocessing/1/atnt-eigenfaces-33-comp-histoeq atnt/2@idiap tutorial/postperf_iso/1
tutorial/tutorial/eigenface/1/atnt-eigenfaces-10-comp atnt/2@idiap tutorial/postperf_iso/1
tutorial/tutorial/eigenface/1/atnt-eigenfaces-9-comp atnt/2@idiap tutorial/postperf_iso/1
tutorial/tutorial/eigenface/1/atnt-eigenfaces-8-comp atnt/2@idiap tutorial/postperf_iso/1
tutorial/tutorial/eigenface/1/atnt-eigenfaces-7-comp atnt/2@idiap tutorial/postperf_iso/1
tutorial/tutorial/eigenface/1/atnt-eigenfaces-6-comp atnt/2@idiap tutorial/postperf_iso/1
tutorial/tutorial/eigenface/1/atnt-eigenfaces-5-comp atnt/2@idiap tutorial/postperf_iso/1
smarcel/tutorial/eigenface_with_preprocessing/1/eigenface-prepro-tutorial-pca15-ter atnt/1@idiap tutorial/postperf_iso/1
anjos/tutorial/eigenface_with_preprocessing/1/foorbar atnt/1@idiap tutorial/postperf_iso/1
pranayd/pranayd/pranay/1/pranay atnt/1@idiap tutorial/postperf_iso/1
pkorshunov/tutorial/eigenface/1/eigenface-with-8-components atnt/1@idiap tutorial/postperf_iso/1
pedro/tutorial/eigenface_with_preprocessing/1/eigenface-with-51-components atnt/1@idiap tutorial/postperf_iso/1
EderKapisch/EderKapisch/eigenface_preproc/1/eigenface-with-10-components atnt/1@idiap tutorial/postperf_iso/1
tutorial/tutorial/eigenface_with_preprocessing/1/eigenface-with-10-components-preproc atnt/1@idiap tutorial/postperf_iso/1
jastuchi/tutorial/eigenface/1/eigenface-with-11-components atnt/1@idiap tutorial/postperf_iso/1
marcus/tutorial/eigenface/1/eigenface-with-23-components atnt/1@idiap tutorial/postperf_iso/1
tutorial/tutorial/eigenface_with_preprocessing/1/eigenface-with-preproc-15 atnt/1@idiap tutorial/postperf_iso/1
murilovarges/tutorial/eigenface/1/eigenfaces_15comp_unesp atnt/1@idiap tutorial/postperf_iso/1
kgrm/tutorial/eigenface/1/eigenfaces_11comp atnt/1@idiap tutorial/postperf_iso/1

This table shows the number of times this algorithm has been successfully run using the given environment. Note this does not provide sufficient information to evaluate if the algorithm will run when submitted to different conditions.

Terms of Service | Contact Information | BEAT platform version 2.2.1b0 | © Idiap Research Institute - 2013-2024