Odd, I don't remember any reference to the housemate/servant's race in the story, nor anything that would suggest racism. Whole lotta ambiguity going on :).

I wish I had the Woolrich story at hand right now; it was in a great collection called No But I Saw the Movie,edited by David Wheeler, which I left back home when I moved to the States