His agenda is to tax it and regulate, not to crack down. Also he has only written to 5 of 9 states. Mainly the more liberal recreational ones. Notice he has not written any notice to medical programs?
It's subtle but if you see his letters they are regulatory to certain lose states and rec only.