I don't think that's true! At least, you haven't run away from us yet, and you've had plenty of chances.

[ Not that she's suggesting he do so, BUT. ]

I know for a fact Karkat wouldn't have minded you travelling with him still. Although I think his group is still attached to the other group in Kanto, unless they split up.

So you haven't made the active decision not to travel with us. I think you like us!