Technical Notes
Karui
Notes on how Karui works and what I’ve learned while working on it.
- KN001: Measuring the Background Rate Limit of Apple’s On-Device Foundation Model
The rate limiting Karui hits when it runs Apple Intelligence in the background, and how it copes. - KN002: Accessing Private Cloud Compute in an App Through Shortcuts
How Karui asks Apple’s Private Cloud Compute through the user’s shortcut, and the alerting modes built on it. - KN004: Verifying What Karui Sends Off Your iPhone
How to check for yourself that, by default, Karui only connects to Apple domains, and what changes when you turn on Private Cloud Sorting. - KN005: Translating Notifications Before a Two-Second Deadline
How Karui translates notifications without delaying them for too long. - KN006: Apple’s Private Cloud Compute vs. Claude Opus 5.5, etc. for Categorizing Notifications
How well Apple’s Private Cloud Compute categorizes my notifications for Karui compared with Claude Opus 5.5 and other models. - KN007: Measuring Phone Checks With the Screen Time API
Whether fewer interruptions from Karui meant picking up my iPhone less, from a month of my own Screen Time data.
Talks
- Lightning Talk: Apple Intelligence in the Background
Four slides, from KN001 and KN002: why Karui uses Apple Intelligence, what Karui is, how often the on-device model refuses background requests, and how Private Cloud Compute through a Shortcut answers instead.