0
$\begingroup$

I'm looking to create some tokens using a keyed hash mechanism to represent our individual customers. I was planning on using combinations of the customer's personal information (e.g. H(Firstname,Surname,DOB)) in the token to prevent frequency analysis, but is there some way I can quantify this?

For example, qualitatively I assume that using:

H(Firstname,Surname,DOB,FirstPurchaseDate)

will be more secure than using just:

H(Firstname)

as the latter will render some values of the first name identifiable by frequency analysis given a large enough sample (I will have to open source the protocol for this, so I'm assuming that attacker knows which variables the tokens consist of). I would like know what combinations of variables will render frequency analysis impractical - are there any established techniques for this?

$\endgroup$
3
  • $\begingroup$ As far as I know hashes aren't vulnerable to frequency analysis. Do you just want to create different hashes for each customer with some given values like the name, date, etc. so that no two given customers share one hash? $\endgroup$ Aug 23, 2019 at 11:04
  • $\begingroup$ Presumably they will be vulnerable in some circumstances? In a more theoretical example, if you were encoding each word in a corpus as an individual hash then you could run frequency analysis on the hashes to work out which hash represented the common words? I'm fairly new to this area though, so happy to be corrected if I'm misunderstanding. $\endgroup$
    – psym
    Aug 23, 2019 at 15:16
  • 1
    $\begingroup$ @psym we don't call that frequency analysis, rather something like repeated ciphertexts / hashes. When detection of repetitions needs to be prevented, we use nonces (number used once) / IV:s (initialization values) that differ for each instance. Also, how will you efficiently perform lookups in keyed hashes? You may want searchable encryption, or work in plaintext in RAM but use end-to-end database encryption. $\endgroup$
    – Natanael
    Aug 23, 2019 at 16:00

2 Answers 2

1
$\begingroup$

Whatever parameters you pass in will affect the resulting hashes. If you compute only H(Firstname), then two users with the same first name will lead to the same hash even if they have different surnames.

P.S. Consider letting users simply have a name so that you respect the vast populations of people out there whose names do not conform to the anglophone forename/surname model of names, or other problematic oversimplifications.

$\endgroup$
0
$\begingroup$

There are statistical patterns or distributions. Like gamma, beta, chi-square... etc. There is a software called Arena Input Analyzer which will show you how your data is distributed with a chi-square test and a histogram.

With that, I could randomly create data like the one you have. But the software is very expensive. I have the student version.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.