Core ML: Inference That Ships in the App Binary
Apple's Core ML runtime runs converted models on CPU, GPU, and Neural Engine so features like camera effects and keyboard suggestions do not need a round trip to a datacenter.
3 min read
Tag
2 articles · 6 min of reading
Apple's Core ML runtime runs converted models on CPU, GPU, and Neural Engine so features like camera effects and keyboard suggestions do not need a round trip to a datacenter.
How Microsoft Research's Phi series argued that carefully curated training data can produce capable small models that fit on-device and on modest GPUs.