Can't have bipolar without being hospitalised for mania?

I've been diagnosed with bipolar 2 for 4 years, most of that spent avoiding therapy/meds, ruining relationships, and turning my life into one big dumpster fire. Towards the end of 2022 after a long bender and being expelled from my university, I found myself the most depressed I had ever been, and so dissociated I couldn't differentiate what was real. It was around that time I reached out, found a new psychiatrist, and started on lithium/lamotrigine/quetiapine. As of this past month, that psychiatrist has resigned and I've started seeing a new dude. He's of the opinion that because I've never been hospitalised for mania I can't truly have bipolar disorder. He's taken me off my meds, is discharging me from public psychiatry, and has recommended that I switch to my university counselor (who only does 6 sessions per person). This doesn't sit right with me. Even if it isnt bipolar specifically, it doesn't make sense that they would discharge someone with a history of suicidal tendencies and self destructive behaviour simply because they're doing better on medication. Why would they not screen for anything else before sending me on my way? Could this be to do with public funding cuts? I feel like I'm being left without a lifeline.