A lot of people feel exactly the way you do. My approach is somewhat different: the art work is independent of its creator. The creator is just the medium through which the work came into being. The composer Kyle Gann expressed this in the phrase: "I am not my music's fault."
So I care more about what Goytisolo expresses directly in his work, than about some private behavior of his that I may never hear about. My position is exactly opposite from yours. Of course, your approach is not wrong (for you). There is no reason to try to force yourself into liking something you associate with the repugnant behavior of its creator.
I am not my music's fault.
Response to Clarrisa
I left this comment on Clarrisa's blog: