For knobby-style tires, I don't think it matters than much.
That being said, I would recommend you take it easy until you feel confident that is the case.
For road tires, it matters more because they are designed to push the water out of the way, so if you flip them, you end up making them...