You are exactly right in the sense that you need to allow for occasional indulgences, otherwise what is the point of it all. I have reached the point that I eat clean at home for all the regular meals. When I go out, I eat what I want, without guilt. This mostly works for me because I don't go out very often, maybe 3-4 times a month, but it works.
I guess my point is, have a great time and hit it hard again in the morning!