This is how institutional racism works, isn't it? A bunch of older whites, all of whom likely think of themselves as in favor of diversity and absolutely not racist, look past the candidates of color and focus on the white ones. They see the whites as more qualified, a "better fit," more likely to take the job and remain at the institution, etc. Because what older faculty look for in a new department member is someone who will fill their shoes--a Mini Me.
Additionally, individuals who are from groups that have traditionally been excluded may actually lack some of the experience/pedigree that is a product of generational accrual--the social and cultural capital that can have such effect in academia.