Let me guess... Your pet processor sucks at crypto.
No, x86 has clear and absolute leadership in scalar integer performance including crypto. Write any crypto algorithm you want in C and run it on the fastest x86 and the fastest ARM and see who wins and by how much. :-D
However the problem is when certain processors include special purpose functional units in silicon (a little silicon easily beats software running on the fastest processor for twisty bit swizzling and XORfests like crypto) and a certain benchmark presenting itself as a CPU benchmark uses that special purpose hardware in some cases and mixes the results in with real CPU benchmark results to present a single composite score.
Funny how often the same people who criticize SPEC CPU for being a compiler optimization target see no problem with a so-called CPU benchmark calling up special purpose functional units on some chips to greatly goose the results. Don't criticize a mote in someone else's eye while ignoring the redwood tree log in your own.