TL;DR

• Apple’s 2019 launch of Voice Control in iOS 13 and macOS Catalina, plus 2020’s Screen Recognition in iOS 14, shows the OS can map visible UI to actions—exactly the substrate a more agentic Siri needs. [1][2]
• Bloomberg reported in March 2024 that Apple discussed bringing Google’s Gemini to iPhone features, implying any “smarter Siri” will blend on‑device work with cloud assist that defines cost and latency trade‑offs. [4]
• The real moat isn’t a chatbot veneer; it’s Apple’s OS‑level semantic map—accessibility labels in UIKit/SwiftUI and the App Intents framework, introduced at WWDC22—turning taps into addressable actions rivals can’t replicate on iOS. [3][9]

What the source said

Bloomberg’s March 2024 report by Mark Gurman said Apple and Google discussed integrating Gemini into iPhone AI features, including potential Siri enhancements; the piece framed this as complementary to Apple’s on‑device stack, not a replacement. [4]

Apple itself shipped two relevant building blocks years earlier: Voice Control arrived on June 3, 2019 with iOS 13/macOS Catalina as a system‑wide voice interface, and Screen Recognition landed in 2020 with iOS 14 to infer element structure when developers didn’t supply labels. [1][2]

Apple’s developer materials from June 2022 added App Intents, binding app entities and actions into a structured model that Siri, Shortcuts, and Spotlight can call—an explicit signal that per‑app automation would move from ad hoc to first‑class. [3]

MacRumors coverage in 2024 also highlighted a planned Siri redesign with a chat interface and more on‑device processing in iOS 18, aligning with the trajectory implied by Apple’s accessibility and intents investments. [6]

Why it matters

Accessibility users benefit first because robust “what’s on my screen?” interaction reduces mode errors and cognitive load in daily tasks on iPhones and iPads running Voice Control since 2019. [1]

For developers, semantics decide who wins: clear accessibility labels and App Intents make actions discoverable and routable, whereas missing traits push the system into brittle heuristics that feel broken. [3][9]

If cloud assist enters the loop, economics join reliability: every extra round‑trip to Gemini or a peer model adds dollars and milliseconds, shaping which Siri features scale to millions of daily requests. [4][5]

Historically, Apple’s platform wins—Automator in 2005 on Mac OS X 10.4 Tiger and the 2017 Workflow acquisition that became Shortcuts—came from making automation an OS primitive, not a bolt‑on. [8][10]

Original analysis

Apple’s accessibility stack is the agentic scaffold

Consensus says “Siri just needs a bigger LLM.” That’s a half‑truth. The strategic shift is Apple baking an OS‑level semantic model of the UI—via 2019 Voice Control, 2020 Screen Recognition, and 2022 App Intents—so an agent can reference what’s visible and act deterministically. [1][2][3]

Voice Control’s heritage (number overlays, element targeting) and Screen Recognition’s inferred labels imply Apple already maps pixels to selectors when developers fall short, which is the quiet superpower for third‑party apps. [1][2]

Historically analogous moves include Automator in 2005 creating action chains on the Mac and Shortcuts’ rise after the 2017 Workflow acquisition, which normalized user‑authored automations across iOS by 2018. [8][10]

The contrarian read: a “chatty” Siri matters less than a boringly reliable action layer; once taps become addresses, any competent model can orchestrate them, and Apple’s review‑enforced semantics keep that layer consistent. [3][9]

Back‑of‑envelope: the Gemini bill for “Siri that actually does stuff”

Assume Apple blends on‑device parsing with selective cloud calls, per Bloomberg’s 2024 reporting on Gemini talks. [4]

Working from publicly cited Gemini API prices: roughly $1.25 per 1M input tokens for 1.5 Pro and $0.075 per 1M for 1.5 Flash; output tokens often run 3–5× input cost, per industry summaries. These are proxies; Apple’s deal will differ. [5]

Scenario math (assumptions stated and shown):

• Users: 1,000,000 people/day invoking agentic Siri twice (2,000,000 invocations/day).
• Tokens per invocation: 3,000 input + 500 output (moderate, multi‑step task).
• Input tokens/day: 2,000,000 × 3,000 = 6,000,000,000 → 6,000 “million‑token” units → 6,000 × $1.25 ≈ $7,500/day (if Pro‑class input). [5]
• Output tokens/day: 2,000,000 × 500 = 1,000,000,000 → 1,000 units → if output costs 3× input rate, ≈ $3.75 per 1M → ~$3,750/day. [5]
• Total: ≈ $11,250/day per 1M daily users → ≈ $4.1M/year; scale linearly to 50M daily users and you reach ≈ $205M/year.

Even with Flash‑tier calls, prompt compression, or on‑device summarization, a popular feature risks nine‑figure OpEx, which makes reliability and scope control first‑order product decisions, not polish. [5]

Named‑stakeholder breakdown (what this means for them)

• Apple
  • The moat is the OS action layer: accessibility semantics plus App Intents shipped at WWDC22. Ship reliability and you minimize cloud fallbacks; miss, and token burn rises alongside latency. [3][5]
• Google Cloud
  • A Gemini deal would bring sustained “agent minutes” rather than spiky chatbot traffic; Apple will optimize prompts to cut token counts, squeezing margins unless value‑based pricing emerges. [4][5]
• Third‑party app developers
  • Accessibility labels, traits, and intents become growth levers; if Siri can’t find your “Add to cart” or “Post comment” intent, your competitor wins the invocation in Spotlight or Shortcuts. [3][9]
• Regulators in the U.S. and EU
  • A brokered Siri that can route to multiple assistants (as reported) defuses “default” concerns under regimes like the DMA while keeping Apple in control of entry points. Watch how third‑party models access intents. [4]
• Accessibility community
  • Immediate, concrete benefits accrue on devices from 2019 onward that run Voice Control; this cohort will surface edge cases (fatigue, dexterity, noisy rooms) that harden the on‑screen model. [1]

2x2: How Apple could roll out an agentic Siri

• Axis 1: Execution locus (On‑device vs. Cloud‑assist).
• Axis 2: Entry point (Accessibility‑first vs. Mainstream‑first).

Quadrants:

• On‑device × Accessibility‑first: Voice Control (iOS 13, 2019) and Screen Recognition (iOS 14, 2020) deliver fast, private, deterministic targeting. [1][2]
• Cloud‑assist × Accessibility‑first: When on‑device parsing fails, server‑side vision or ASR can backstop captioning and descriptions; Apple has shipped hybrid approaches in media apps.
• On‑device × Mainstream‑first: App Intents‑driven Shortcuts and Spotlight actions (WWDC22 onward) cover quick local tasks with typed or spoken triggers. [3]
• Cloud‑assist × Mainstream‑first: A “Siri agent” that reasons across apps with selective Gemini calls, as discussed in 2024 reporting, likely launches with usage caps and clear disclosure. [4][6]

The bet: start in the top‑left where Apple’s silicon and privacy story shine, then expand diagonally as reliability and unit economics improve. [1][2][5]

What others are missing

Coverage often fixates on a chat UI and model brand, but the plumbing matters more: Apple is turning accessibility metadata—labels, traits, and hints—plus App Intents domains into a de facto automation DSL that any compliant app inherits. [3][9]

Because Screen Recognition can infer structure when labels are missing, the system gains resilience across older apps, while review guidelines nudge new apps to expose entities and actions cleanly. That architecture removes the need for one‑off bot integrations and makes Siri’s competence scale with conformance. [2][9]

What to watch next

1. By June 8, 2026: Apple demos Siri completing a multi‑step task across at least two third‑party apps in one request during the WWDC keynote, and explicitly marks the feature “beta” on a slide or in a footnote.

2. By June 12, 2026: Apple posts WWDC sessions and docs expanding App Intents domains to cover at least one new commerce or social action category, verifiable in Developer Documentation change logs.

3. By December 31, 2026: Natural‑language Voice Control expands beyond English to at least one additional language/locale listed on Apple’s public support matrices.

My take

Apple picked the right hill. “Agentic Siri” won’t be won by the cleverest model voice—it will be won by the OS that turns any pixel into a reliable action, the way Automator did for Mac tasks in 2005 and Shortcuts did for iOS workflows after 2017. [8][10]

If Apple ships a ruthlessly reliable action layer grounded in 2019–2022 primitives and adds cloud assist only where needed, Gemini becomes an accelerant, not a crutch—and Siri starts feeling like iOS itself waking up. [1][2][3][4]

Sources

1. Apple Newsroom — “Apple introduces Voice Control in macOS Catalina and iOS 13” (June 3, 2019) — Establishes system‑wide Voice Control origins and scope across Apple platforms.

2. Apple Developer Documentation — “Screen Recognition” (iOS 14, 2020) — Details on‑device inference that identifies UI elements when accessibility labels are missing.

3. Apple Developer — “App Intents” (WWDC22 session and docs, June 2022) — Explains the framework linking app entities/actions to Siri, Shortcuts, and Spotlight.

4. Bloomberg — “Apple in Talks With Google to Bring Gemini AI to iPhone” by Mark Gurman (March 2024) — Reports discussions that frame potential cloud assist for Siri.

5. TechTarget — “Google Gemini pricing and models explained” (2024) — Provides indicative token pricing for Gemini 1.5 Pro and 1.5 Flash used in cost estimates.

6. MacRumors — “iOS 18 to Feature Revamped Siri With On‑Device AI” (2024) — Summarizes expected Siri redesign and greater on‑device processing.

7. Apple Newsroom — “Apple announces WWDC24 for June 10–14” (March 26, 2024) — Confirms Apple’s June WWDC cadence used for dating predictions.

8. Wikipedia — “Automator (software)” (first released with Mac OS X 10.4 Tiger in 2005) — Historical analogue for OS‑level automation on the Mac.

9. Apple Human Interface Guidelines — “Accessibility” (ongoing) — Documents labels, traits, and patterns that form the semantic substrate for automation.

10. The Verge — “Apple acquires Workflow, the iOS automation app” (March 2017) — Context for Shortcuts’ lineage and Apple’s automation strategy.