Input size recomendation of sequence for each test in NIST SP 800-22

Question

I am using the NIST SP 800-22 to evaluate the performance of the Random Numer Generator.

NIST SP 800-22 has a total of 15 tests. In each test, it has a recommendation for the size of the tested sequence. For example, in the Discrete Fourier Transform (Spectral) Test : "It is recommended that each sequence to be tested consist of a minimum of 1000 bits (i.e., n ≥ 1000)." So it means, the size of each sequence to be tested must be greater than 1000.

So, I selected n = 1,000,000 bits and the number of bitstream = 100. After I run the Discrete Fourier Transform (Spectral) Test, I get a failed result ( proportion: 95/100).

However, when I selected n = 100,000 bits and the number of bitstream = 100. After I run the Discrete Fourier Transform (Spectral) Test, I get a passed result ( proportion: 96/100).

So, which value of n should I select? In order to confirm that the Random Number Generator passes the Discrete Fourier Transform (Spectral) Test, does the Random Number Generator always passes with all values of n ≥ 1000

Thanks

Answer 1

1,250 bits x 10 streams works:-

    ------------------------------------------------------------------------------
RESULTS FOR THE UNIFORMITY OF P-VALUES AND THE PROPORTION OF PASSING SEQUENCES
------------------------------------------------------------------------------
   generator is <Blum-Blum-Shub>
------------------------------------------------------------------------------
 C1  C2  C3  C4  C5  C6  C7  C8  C9 C10  P-VALUE  PROPORTION  STATISTICAL TEST
------------------------------------------------------------------------------
  0   0   2   2   2   1   1   2   0   0  0.534146     10/10      FFT


- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

as the above is a very good pass.

Assuming that your RNG is good, just running the FFT is inconclusive. You often get isolated test failures as randomness is pesky, especially as the sample size gets smaller. Randomness is very much a function of sample size. That's why test 'suites' have a broad variety of very simple and very complex tests. So no to "does the Random Number Generator always passes(sic) with all values of n ≥ 1000".

I would also be wary of 100 bitstreams. From experience again, 10 seems a good amount and allows a decent p value to be determined. You'll bang up against diminishing returns after >> 10 bitstreams. So do 10 bitstreams of 1,000,000 bits each (1.25 MB total) to run all the tests. You won't get any p values for the RandomExcursions(Variant) tests but you'll get an indication of success from the pass rate.

But before anything, if you've designed your own TRNG (and presumably the randomness extractor), run ent. It's ostensibly the most robust randomness test out there. Use 500 kB. If your samples fail ent, then your TRNG is bad.