Javert could probably go either way. I guess he's innocent in the strictest sense of the word - utterly devoted to upholding the law, loyal, quite possibly a virgin. He's practically never done anything wrong intentionally in his life. The key word is intentionally, though, because he's done quite a lot of wrong - either inadvertently, or because of his by-the-book idea of justice.

So really, I guess it's your call. xD;