Moving boyfriend out?

I let my boyfriend move in again, 1 month ago, he is not working, and I found out he is cheating with the same girl as before, bringing her into my apartment while I am at work. He also is back using drugs and his best friend is also coming over also using drugs. He refuses to move out, I've asked him, he says evict me. Unfortunately he has stolen from me before, so if I go with the courts I am sure he will steal stuff while I am at work. Because it is a civil matter the police can do little to help. I am moving out on the 3rd and have a new apartment lined up and will have the police present while I move. I do not plan to tell him until the movers arrive, all he has is his personal belongings. Does anyone see any problem doing it this way. Or any suggestions.