Sorry about mixing the terms affinity and agonism, I understand what you are saying. Now is it possible that drugs that are strong agonists also have stronger side effects, as we have seen in Donepezil?
Personally side effects of drugs are a HUGE concern because my personal experience is that almost every CNS drug that I've taken the side effects outweigh the benefits.
A drug that gently coaxes the system back into balance or homeostasis seems infinitely preferable to one that radically alters brain chemistry.