If you log into iCloud using your account do you see his library? Are you logged into iCloud on his machine? Does he have his own iCloud account? Are you using iCloud Family?
Sounds like your identity is attached to his iCloud Photo Library. You just need to disable Photos in the iCloud settings of his Mac if that’s the case, then remove/add iCloud to your iPhone again.