The difference is that the PM is simply the person who his/her party elects to lead them.
Albo is currently doing a good job but if he were to fall off the perch or do something stupid, someone else in his party would do just as well.
(I think Jim Chalmers the current treasurer has real potential.)
It's not a popularity contest over here. We elect the party, they choose the leader.