Depends. Some people define racism (& sexism etc) as "descrimination against a disadvantaged group by a privilieged group based on what separates them".

This would mean a black person in USA would not in general be able to be racist against a white person.