Do i legally have to let him take my kids he wont tell me where they live?

Take him to court for full custody of your children, and they will for sure give you the kids because their living condition with their father.