i have to say, in my personal anecdotal experience, i have never seen a person that has smoked or consumed marijuana become aggressive towards another person in a physical way, unless alcohol was also involved.
I imagine it happens, as there are always the tails of the bell curve, but i tend to agree with your observation.
Even though i have seen data that marijuana is an independent variable in amotivational syndrome, i have noticed that if someone consumes large quantities on a regular basis, they are really mellow and laid back, but sometimes have a hard time getting their ass in gear. The literature says that those persons would be that way even without marijuana, but i don't totally agree with that aspect. The modern very-high active ingredient pot (that is high in THC, not necessarily CBD, the analgesic component) isn't called "couch-lock" for nothing.