With Great Power Comes Freedom and responsibility to share it.
Most Chaotic Good characters don't constantly break the law, but they cannot see much value in laws (or, for weaker-CCGs, do not see the value in laws that do not function solely to punish evil). They believe that their own consciences are their best guides, and that tying themselves to any given code of conduct would be limiting their own ability to do good. They do not get along with anyone who tries to instill any kind of order over the Chaotic Good character or others, believing these people to be restricting their freedom and the freedom of others; however, most Chaotic Good characters will respect the right of others to impose strong codes of conduct on themselves. Chaotic Good characters often focus very strongly on individual rights and freedoms, and will strongly resist any form of oppression of themselves or anyone else.
Quoted from the TvTropes page.