TechnologiesMachine Learning & AI

SoundAnalysis

iOSmacOStvOSwatchOSvisionOS

SoundAnalysis analyzes streamed or file audio with Core ML sound classification models to detect and classify sounds over time. You configure an analysis with SNClassifySoundRequest, then feed audio to an SNAudioStreamAnalyzer for live streams or an SNAudioFileAnalyzer for recorded files. Conforming a type to SNResultsObserving lets you receive SNClassificationResult values, each carrying SNClassification entries that report the classified sounds and their confidence over the course of the audio.

Analyzers 2

Objects that process live or recorded audio and dispatch analysis results to your observers.

  • Cl
    SNAudioStreamAnalyzeriOS 13.0+
    Analyzes a stream of audio data and provides analysis results to the client
  • Cl
    SNAudioFileAnalyzeriOS 13.0+
    Analyzes an audio file and provides analysis results to the client

Sound Classification Requests 3

The request that configures a Core ML model to classify sounds and the protocol it conforms to.

  • Cl
    SNClassifySoundRequestiOS 13.0+
    Configure an analyzer to perform sound classification using the provided MLModel.
  • St
    SNClassifierIdentifieriOS 15.0+
    Identifiers denoting particular recognized sound classifiers.
  • Pr
    SNRequestiOS 13.0+
    The base protocol to which analysis requests conform

Classification Results 3

The result and classification types an analyzer produces over the course of the audio.

  • Cl
    SNClassificationResultiOS 13.0+
    A result containing the most likely classification candidates in the time range specified
  • Cl
    SNClassificationiOS 13.0+
    The likelihood of a sound belonging to identified class
  • Pr
    SNResultiOS 13.0+
    The base protocol to which analysis results conform

Observing Results 1

The protocol you adopt to receive classification results and completion callbacks from an analyzer.

  • Pr
    SNResultsObservingiOS 13.0+
    The interface through which clients receive the results of an analysis request

Constraints and Errors 2

Types that describe windowing constraints and report failures during sound analysis.

  • En
    SNTimeDurationConstraintiOS 15.0+
    Constrains CMTime durations to a subset of legal values.
  • St
    SNErroriOS 13.0+
    A structure that describes errors that occur during sound analysis.
← Machine Learning & AI