If authorship is irrelevant, does it matter that Heidegger and Paul de Man penned anti-Semitic works?

If you remove an author from his or her work, does that also remove accountability? Should writers like Heidegger and Paul de Man be able to write sexist, racist or homophobic works under the anonymity that the death of the author gives them?