and, in reality, Vegas casinos were very racist at that time.
Not as much as you would think. The Rat Pack used their popularity to strong-arm the Vegas casinos into ending segregationist policies. The city was actually fully desegregated in 1960, in large part thanks to the Rat Pack’s actions. Vic seems to be a fictional member of the group invented by Felix, so it tracks that his personal establishment would be one of the most welcoming.