Apple are. Their “Personal Voice” feature fine tunes a voice model on device using recordings of your own voice.
An older example is the “Hey Siri” model, which is fine tuned to your specific voice.
But with regards to on device training, I don’t think anyone is seriously looking at training a model from scratch on device, that doesn’t make much sense. But taking models and fine tuning them to specific users makes a whole ton of sense, and an obvious approach to producing “personal” AI assistants.
They already do some “simple” training on device. The example I can think of is photo recognition in the photo library. It likely builds on something else but being able to identify which phase is your grandma versus your neighbor is not done in Apple‘s cloud. It’s done when your devices are idle and plugged into power.
A few years ago it wasn’t shared between devices so each device had to do it themselves. I don’t know if it’s shared at this point.
I agree you’re not going to be training an LLM or anything. But smaller tasks limited and scope may prove a good fit.
An older example is the “Hey Siri” model, which is fine tuned to your specific voice.
But with regards to on device training, I don’t think anyone is seriously looking at training a model from scratch on device, that doesn’t make much sense. But taking models and fine tuning them to specific users makes a whole ton of sense, and an obvious approach to producing “personal” AI assistants.
[1] https://support.apple.com/en-us/104993