“On-device” has to be a half-true at best. I’m having a hard time believing that the NPUs on these new ARM chips are powerful enough for it to be fully on-device. Even more-so with “approved” x86 chips. There has to be some data sharing between the client and server, similar to how Rabbit does their shit.