I think to be a casual Mormon, you would not want to care about going to the temple, and you would need the ability to say "No" to a lot of things, perhaps including bishop interviews, callings, and tithing. There might be some wards in more progressive areas where that would fly.
Forum:
Recovery Board