In a new episode of her podcast 'Let's Be Clear,' Doherty revealed the real reason behind her 'Charmed' exi