AI inferencing at crossroads
Bloomberg Intelligence believes techniques such as quantization and distillation may gain momentum to shrink the size of trained models for more privacy-centric use cases, including personal assistants and AI agents.