Do you fear you're being punished for leaving?

Do you ever fear that God is punishing you for leaving Christianity? That the awful things happening in your life right now is punishment? Or that something really bad is right around the corner?