There Are Doors by Gene Wolfe

A man becomes entangled with a mysterious woman and the inexplicable doorways that connect his ordinary life to a shadowy, alternate city; as he follows her through these thresholds he is drawn into a strange world of social rules, violence, and moral uncertainty, forcing him to confront shifting identities, jealousy, and the blurred line between supernatural menace and personal obsession.

Purchase from Bookshop.org