Smith only carried on fronting the band because he’d fallen out with everyone who filled the role