If a person is involved in a society and for what ever reason that society decides to shun it would seem to me that the society would lose more than they gain.
If you shun me then you will no longer have access to my expertise in whatever skills I may possess . There may come a time when you might need access to those skills.
Also you will lose the pleasure of my company which could conceivably be more you loss than mine.