He declares himself guilty who justifies himself before accusation. – Proverb

Care should be taken that the punishment does not exceed the guilt; and also that some men do not suffer for offenses for which others are not even indicted. – Marcus Tullius Cicero

The very presence of guilt, let alone its tenacity, implies imbalance: Something, we suspect, is getting more of our energy than warrants, at the expense of something else, we suspect, that deserves more of our energy than we – Melinda M. Marshall

Where the guilt is doubtful, a presumption of innocence should in general be admitted. – Junius