Foundation Models for Face Presentation Attack Detection: A Unified Linear-Probing Benchmark

Peter Lorenz1, Anjith George1, Sébastien Marcel1,2
1Idiap Research Institute, 2University of Lausanne (UNIL), Lausanne, Switzerland Accepted at IJCB 2026
Bonafide and print-attack face crops for the four MCIO corpora.
ModelTrainTest
MCIOAvg.Std.
InternViT-6BM4.4216.6445.2914.6520.2515.18
C28.071.8121.2625.8619.2510.36
I28.5425.260.0650.3326.0517.83
O48.5038.8940.370.2732.0118.68
DeepPixBiSM7.8947.0549.6536.4635.2616.56
C33.742.0130.7430.2024.1712.87
I47.3661.340.0050.9439.9123.61
O46.5538.3645.103.8433.4617.38

(a) Bonafide (left) and print-attack (right) face crops of MSU-MFSD (M), CASIA-FASD (C), Replay-Attack (I) and OULU-NPU (O), cropped to 224×224 with MTCNN. (b) Test ACER (%) for InternViT-6B and DeepPixBiS, trained on the corpus in the row and evaluated on the corpus in the column: the intra-dataset diagonal (yellow) is near zero, while cross-dataset transfer (green) stays high.

Abstract

Face presentation attack detection (PAD) remains challenging under cross-dataset evaluation, where domain shift degrades models trained on a single dataset. The scarcity of large-scale labeled data motivates adapting pretrained vision models rather than training task-specific architectures from scratch, raising a fundamental question: do general-purpose vision foundation models encode PAD-relevant information accessible with minimal task-specific training? To investigate, we systematically evaluate 24 frozen encoders, including self-supervised Vision Transformers, vision–language encoders, and supervised CNNs, using a unified linear-probing protocol on the MCIO benchmark (MSU-MFSD, CASIA-FASD, Replay-Attack, OULU-NPU). The backbone remains fixed, and only a lightweight linear head is trained, isolating the PAD information already present in the pretrained representation. We report intra- and cross-dataset performance alongside accuracy–compute trade-offs relative to two specialist PAD baselines. Results show that frozen foundation-model representations can support strong intra-dataset PAD performance with only a linear classifier, but this performance does not reliably transfer across datasets. Model scale is beneficial within several families, although the effect is not monotonic and is strongly mediated by architecture and pretraining. InternViT-6B achieves the lowest mean intra-dataset error, whereas CLIP ViT-B/32 offers the most favorable cross-dataset transfer–compute trade-off among the evaluated probes. These findings suggest that while pretrained representations contain PAD-relevant information, explicit adaptation remains necessary to address domain shift. Code and evaluation protocols will be publicly released.

Method

Every backbone stays frozen. A face crop is encoded into a global embedding \( h \in \mathbb{R}^{d} \) (CLS token, mean-pooled patch tokens, or global average pooling, depending on the encoder family), and only a single fully connected layer \( z = w^{\top} h + b \) is trained with binary cross-entropy, with bonafide labelled 1 and attack labelled 0. At inference the bonafide probability is \( p = \sigma(z) \). Freezing the backbone isolates pretraining strategy and model scale from adaptation recipes such as LoRA or full fine-tuning, and equalizes trainable capacity across all encoders.

Models are trained on one MCIO corpus and tested on all four. We report the Average Classification Error Rate (ACER, ISO/IEC 30107-3) in percent, at a threshold \( \tau \) tuned on the development split by the equal-error-rate criterion and applied unchanged to the test split: \[ \mathrm{ACER}(\tau) = \tfrac{1}{2}\bigl(\mathrm{APCER}(\tau) + \mathrm{BPCER}(\tau)\bigr) \]

Experiments

We evaluate only the single-source cross-dataset protocol, where a model is trained on one source dataset and evaluated on a different target dataset. Multi-source protocols such as leave-one-out (LOO) and limited-source-domain (LSD) evaluation are not considered. We evaluate on four widely used MCIO datasets for intra-dataset (M→M, C→C, I→I, O→O) and cross-dataset (M→C, M→I, M→O, …, O→…) transfer.

  • MSU-MFSD (M) includes videos of printed attacks, as well as replay attacks generated with a mobile phone and a tablet. Protocol protocol (all folds), bob.db.msu_mfsd_mod-2.2.9.
  • CASIA-FASD (C) includes warped-photo, cut-photo, and replay attacks under varying illumination. Protocol grandtest, pad-face-casia-fasd-0b07ea45.
  • Replay-Attack (I) provides high-resolution print-and-replay spoofs on a fixed display setup. Protocol grandtest, pad-face-replay-attack-aca6b46f.
  • OULU-NPU (O) comprises six mobile phone sensors and multiple print-and-replay attack types, offering the strongest sensor diversity. Protocol Protocol_1, pad-face-oulunpu-7bfb90c9.

The four corpora differ by an order of magnitude in size and are attack-heavy throughout: the test splits range from 2,398 frames (MSU-MFSD) to 12,000 (OULU-NPU), with roughly one bonafide frame per three attack frames.

Bonafide and attack frame counts of the MCIO test splits.

Bonafide and attack frame counts of the four MCIO test splits.

No single encoder dominates every compute budget. InternViT-6B is the most accurate overall and the most expensive, while CLIP ViT-B/32 needs about the same forward-pass cost as the compact specialist DeepPixBiS (~8.7 vs. ~9.2 GFLOPs at 224×224) at markedly lower cross-dataset error (mean off-diagonal ACER 31.6% vs. 43.1%). Similar inference budgets do not guarantee similar transfer.

Overall ACER versus parameters and GFLOPs for the 24 frozen encoders and the two specialist baselines, colored by model family.

Mean ACER over the intra-dataset and cross-dataset pairs versus model size and GFLOPs. Points are colored by model family; lower ACER is better.

Summary in ACER (%). All: mean over the sixteen train/test pairs. ID: mean of the four intra-dataset evaluations. CD: mean of the twelve cross-dataset pairs. Gap = CD − ID. Bold: lowest value per column.

ModelAllIDCDGap
InternViT-6B24.41.632.030.3
CLIP ViT-B/3226.812.631.618.9
CLIP ViT-L/1428.210.634.023.4
BEiT-large29.39.136.026.9
EVA-CLIP-8B30.410.237.126.9
CLIP ViT-H/1431.610.538.728.2
DINOv2-giant31.98.439.731.3
DINOv2-registers-giant31.98.639.731.1
DINOv3-huge+32.75.741.836.1
DINOv3-base33.29.441.131.7
DINOv2-registers-base34.414.640.926.4
Qwen2.5-VL-7B-ViT34.817.240.723.4
BEiT-base35.09.243.734.5
DINOv2-base35.513.242.929.7
ViT-MAE-huge36.216.742.726.1
SigLIP-large36.319.342.022.8
Qwen2.5-VL-3B-ViT36.516.143.227.1
SigLIP-base39.522.545.122.6
ConvNeXt-V2-huge40.518.248.029.7
ConvNeXt-V2-base41.321.447.926.5
ViT-MAE-base41.718.549.431.0
InternViT-300M41.823.947.723.9
ViT-MSN-large46.845.247.32.0
ViT-MSN-base53.646.556.09.4
Specialized FAS models
FSFM-FAS29.04.237.333.1
DeepPixBiS33.23.443.139.7

Intra-dataset

Backbone scale and pretraining objective drive intra-dataset accuracy. InternViT-6B reaches the lowest mean error (1.6% ACER) with a single trainable layer, and DINOv3-huge+ follows at 5.7%. Self-supervised and vision–language encoders consistently outperform similarly sized ViT-MAE, ViT-MSN and ConvNeXt-V2 variants. The specialist baselines remain strong (DeepPixBiS 3.4%, FSFM-FAS 4.2%), while zero-shot InternVL-14B averages 28.8% — generic multimodal inference without a task-aligned readout is not enough.

Cross-dataset

Transfer stays hard for nearly every model. InternViT-6B pairs the best intra-dataset error with a 30.3-point gap (32.0% mean cross-dataset ACER), and DeepPixBiS reaches 0.0% on Replay-Attack yet 47.4–61.3% on the other corpora. Scale alone does not buy transferability: CLIP ViT-B/32 attains the lowest mean off-diagonal error among the probes (31.6%) with only ~90M frozen parameters, ahead of the much larger CLIP ViT-L/14 and ViT-H/14.

BibTeX

@inproceedings{lorenz2026foundationpad,
  title={Foundation Models for Face Presentation Attack Detection: A Unified Linear-Probing Benchmark},
  author={Lorenz, Peter and George, Anjith and Marcel, S{\'e}bastien},
  booktitle={IEEE International Joint Conference on Biometrics (IJCB)},
  year={2026},
}