What's New / Apple Intelligence, ML & Evaluation
FoundationModels adds 270 APIs including AnyTool and DynamicInstructions; Vision adds 138 including OCRTool; Evaluations debuts with 99 model-scoring types.
FoundationModels gives apps on-device access to Apple's system language model through a LanguageModelSession.
Vision is Apple's image and video analysis framework.
Evaluations is a framework for measuring the behavior of models and other systems against expected results.
MusicUnderstanding analyzes musical audio.
TrustInsights is an Apple Intelligence framework whose API evaluates insights about user interactions on device.
DataDetection finds structured data in text and returns typed matches for links, email addresses, phone numbers, postal addresses, and calendar…
MediaIntelligence is an Apple framework for analyzing images and video.
ImagePlayground is Apple's framework for generating images using Apple Intelligence.
SuggestedActions is a SwiftUI framework for showing suggested next actions in a conversation message UI.
_Vision_FoundationModels is a Swift cross-import overlay, not a standalone framework.
Visual Intelligence lets an app contribute semantic content to the system's visual search, so the system can surface and act on items the app…
SensitiveContentAnalysis detects nudity and other sensitive imagery in photos and video using on-device analysis.
_FoundationModels_AppKit is a Swift cross-import overlay, not a standalone framework.
_FoundationModels_UIKit is a Swift cross-import overlay, not a standalone framework.