Even if there was any violence, like you said it wouldn't be more than anything else.
But there wouldn't be jack-booted-thugs (DEA agents, SWAT teams, etc.) kicking in people's doors in the middle of the night over some weed. Plus there wouldn't be NARCO terrorism over getting marijuana into the country and distributing it. (Not saying there would be NO narco terrorism and violence because they would switch all of their resources to meth, cocaine, and heroin.)
