That's the best way to deal with the situation. But I assume OP doesn't like him overall.
if OP seriously doesn't want him to stay around, how about he talk to the landlord and pay for the rent before the neighbor pays, if possible pay a little more than him, when he moves out, you can then...