Go ahead and try scraping an arbitrary list of sites without an API and let me know how that goes. It would be a constant maintenance headache, especially if you’re talking about anything other than the larger chains that have fairly standardized sites