The average poll respondent is older, whiter, and more conservative than the average voter. So you end up with a skewed sample.
Any reputable polling group will adjust for that. Granted, fewer and fewer people are answering their phones and taking these polls, but basic demographics are a well-known and pretty easy to adjust for thing. Most polls take a lot of that information for that reason