You can teach models new tasks by transmitting just labels instead of data, if clients have a generic reference dataset pre-loaded.
Instead of sending large datasets over the network, this paper proposes sending only class labels for images from a reference dataset that clients already have locally. A smart filtering mechanism picks which images are most relevant to the new task, reducing communication to under 1 MB while maintaining accuracy.