You only spend time together when it’s convenient for him
Basically, you only get together when
he’s free and he expects you to change your plans to accommodate that. He does this because he doesn’t have much time between all the people he’s seeing. This is also true because he doesn’t want to plan things too far in advance because he doesn’t know when he’s going to drop you.