2) They're rejected by their group. These castaways usually still adhere to the teachings of their group or leader but are sent away for real or imagined offenses, and serve as an example for other members.
3) The cult dissolves or disbands. This can happen for several reasons, including the death of the leader.