Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable
243stars24forksPython
apple-siliconiosiphonellama-cppllm-inferencelocal-llmmacosmetalqwensme2speculative-decoding
Real data pulled from GitHub this week. The author's original repo lives upstream.
View on GitHub