I think the problem is with the fact that ALL narratives are biased, not none, and the farther away from a situation that you are the more likely that stereotypes and bias will guide your writing rather than truth. As far as freedom of speech I am not saying that there should be censorship by any outside agency or government, but perhaps self-censorship, just because you can write about something doesn't mean that you should.
It is delicate to be sure, but too often in American history white men have been the voice of the marginalized in our society. This takes power away from the powerless and reinforces a white dominant culture, in my opinion of course.