I've got this neural network running like a champ on my machine. The data is concatenated works of shakespeare in a plaintext file. RNN trains on the data, then gives you a 'sample', aka it tries to freestyle its own shakespeare based on what it has learned.
So now I've encrypted the dataset with a standard mid ROT cipher, and gave that to the NN to train on. Which it did, and it returned a result which was ROT ciphered. Decrypting that yielded valid results. As it should have, training on data that kept all its 'context', without randomness, unpredictability, or 'fuzz'. Not sure if those are the exact words, but you get it.
I'm wondering if there are any other ciphers, or really any other algorithms like compression schemes or what have you, that may yield the same results as my previous experiment? That training on its encrypted data would likely yield a sample that could then be decrypted accordingly? Or would most other stuff be 'lossy' in some way?