Derek Hatton
Decision to grant provisional membership had sparked anger from MPs.
Deputy leader refused to hand over his mobile phone in fractious meeting.
It comes amid fears as many as 10 MPs are preparing to resign and join the new Independent Group.
The former Militant member suggested Luciana Berger "went before she was pushed".
The 70-year-old said Jeremy Corbyn inspired him to apply for membership.
Shadow minister appeared to back illegal budget setting, quoting the famous line "better to break the law than break the poor".