Testing the Tests - Opportunities for Corrections and Improvements in NIST SP 800-22r1a and its Reference Code

Elias Riesinger; Jürgen Fuß

Paper 2025/856 Original: eprint.iacr.org/2025/856 ↗

Testing the Tests - Opportunities for Corrections and Improvements in NIST SP 800-22r1a and its Reference Code

Elias Riesinger

Jürgen Fuß

Abstract

During an analysis of the NIST SP 800-22r1a document, which provides a test suite to validate random number generators and their reference implementation, various issues were identified, including imprecise probability constants, erroneous example calculations, and discrepancies within test descriptions. Here, we provide a technical analysis of the Statistical Test Suite, documenting inconsistencies and deficiencies in both the theoretical specification and the official C reference implementation. The analysis also reveals concrete implementation bugs and structural limitations in the reference codebase. Rather than revising any of the statistical tests, this work documents these flaws to support the ongoing revision process of the standard and to encourage more reliable and maintainable implementations.

Metadata

Available format(s): PDF
Category: Applications
Publication info: Preprint.
History: 2025-05-15: last updated; 2025-05-15: published
Short URL: https://ia.cr/2025/856
License: https://creativecommons.org/licenses/by-nc-sa/4.0/

BibTeX

@misc{cryptoeprint:2025/856,
      author = {Elias Riesinger and Jürgen Fuß},
      title = {Testing the Tests - Opportunities for Corrections and Improvements in NIST SP 800-22r1a and its Reference Code},
      howpublished = {Cryptology {ePrint} Archive, Paper 2025/856},
      year = {2025},
      url = {https://eprint.iacr.org/2025/856}
}