An ex-minister who quit Sir Keir Starmer's government tells Sky’s Cathy Newman that the prime minister "doesn't listen"