What's it mean to 'stand by your convictions'?

It sounds like it should mean stand up for what you believe in, but at the same time I usually associate convictions with being accused of something. What's it mean? Excuse my ignorance on the matter but I'd really like to know.