Is affirmative action fair?

I understand that there must be equality between all ethnicities but it seems that colleges should except the most qualified students, regardless of race.