In some religions walking away from the church means being excluded from family, social, and business contacts. So cutting ties with everyone you know basically.