This is pretty much the only way that I use AI. It can brainstorm 50 ideas faster than I can and format them in a way that I can actually get started on projects rather than planning out each step.
AI is pretty strong at what I have been calling “permanent facts”. Using any song as an example, it will always have the same key, tempo, scales, etc. As such, when asking for details about a song, listing out the key, scales, tempo, and asking it to show unconventional scales that will play over it. Another example of a permanent fact would be the death date of someone, as that isn’t really going to be changing.
On the other hand, temporary facts are where hallucination and other inaccuracies come in. There’s no way for LLM’s to get new information, so it doesn’t know about career changes, current ages or net worth. You can utilize permanent facts to get accurate information about temporary facts, but that’s not nearly as useful. I think one of the major issues people have with LLM’s (model creation aside) is that our society really values temporary facts, and so when it gets it wrong people like to point at that as a fault. Which it certainly is, but to me it’s kind of like pointing at Photoshop and laughing that it can’t even be used to write a book - like, OK but that’s not really it’s purpose?
I think another example of LLM’s definitely being useful was all of those privacy nightmare Excel/Sheets plugins. Privacy aside, that’s basically the ideal use-case for LLM’s as you are pointing out Permanent Facts (the data in cells A-Z) and having it sort them in some fashion. I’ve seen a lot of LLM hallucinations for sure, but I’ve also seen a lot of consistency when actually using it as intended. I’ve yet to have it be “wrong” when I was testing my music information template or when sorting out data in excel.
Much outside of that though, no. It’s only useful as getting mass amounts of theory in a short session, not so much for being reliable in that information. That might sound like a bad tool, but as mentioned it has plenty of use-cases, people are just using it as a tool very, very poorly. (It can also be used maliciously more easily than most other tools, which definitely prohibits its status as a “good” tool.)