Many of the beginner explanations use very simple examples: like this
It is still hard to factorize a small number by hand, compared to other operations. There is definitely a size of prime numbers where hand computation is still feasible, but hand factorizing isn't. Would you, for instance, even armed with a list of primeslist of primes, be able to quickly tell me what the prime decomposition of 1043 is?
Spoiler text It'sIt's 149 and 7. Slow to decompose, but easy to multiple by hand. You can go a lot bigger by hand or with an abacus etc.