Probably because we don’t dead reckon off the position of the gas pedal, but rather, our mental shortcut is, “clutch is furthest left pedal.”
As others have said, brake on automatic tends to be a wide pedal. Pedals on a smaller car or sports car tend to be small and very close together for heel and toe and whatnot.