His years as a K-Pop idol were far from smooth sailing.