He doesn't need to think that Crowley thinks he's lying. Crowley just thinks he's wrong.

"Oh, no, no, you're not talking about alternate universes and that sort of shite, are you? I really, really don't want to know anything about it, I don't want any comic book nerds appearing out of the woodwork to explain what could've been and should've been and all of that..."