Karui app icon

Lightning Talk: Apple Intelligence in the Background

Karui

Four slides for a five-minute talk, from Karui’s Technical Notes KN001 and KN002.

The talk, recorded with captions · 3:20

1/4 · Why Apple Intelligence

Private, free

On-device option
No model to download
Free
Trust
It’s Apple
2/4 · What is Karui

A spam filter for push notifications

Karui app icon
Private, free, uses Apple Intelligence
Karui needs Apple Intelligence in the background to categorize notifications
3/4 · On-Device Foundation Model

iOS refuses background on-device requests

Three examples
~10 PM
8 acceptedrefused for ~5 h
~3 PM
5 acceptedrefused for ~2 h
~6 PM
8 acceptedrefused for ~2 h
~50%
of ~3k requests in a month refused
~6
accepted before a refusal
16 h
the longest run of refusals
4/4 · Workaround

Use a Shortcut

  • Ask your users to install your Shortcut.
  • You get a separate rate limit budget.

← All Technical Notes