ios-local-llm
OnDevice Local AI Studio — run LLMs on iPhone offline. SwiftUI workbench with MLX, llama.cpp, whisper.cpp, RAG, and authenticated OpenAI/Anthropic/Ollama-compatible local APIs.
File Explorer
- bug_report.yml
- config.yml
- feature_request.yml
- codeql.yml
- dco.yml
- dependency-review.yml
- scorecard.yml
- source-release.yml
- validate.yml
- CODEOWNERS
- copilot-instructions.md
- dependabot.yml
- PULL_REQUEST_TEMPLATE.md
- README.md
- source.json
- offline-voice-models.json
- AppIcon-1024.png
- Contents.json
- Contents.json
- CoreAIAssistantService.swift
- CoreAICompatibilityTypes.swift
- CoreAIDashboardView.swift
- CoreAIDebuggerServices.swift
- CoreAIHFDownloadManager.swift
- CoreAIOnDeviceLAS.entitlements
- CoreAIOnDeviceLASApp.swift
- CoreAIToastHost.swift
- CoreAIZooCatalog.swift
- Info.plist
- PrivacyInfo.xcprivacy
- assistant.png
- home.png
- local-vision.png
- models.png
- ios-local-llm-spec-chart.png
- ios-local-llm-spec-chart.svg
- social-preview.png
- 01-idle.png
- 02-preparing.png
- 03-listening.png
- 04-thinking.png
- 05-speaking.png
- AGENT_INTEGRATION.md
- BACKGROUND_ASSETS_INTEGRATION.md
- CODING_AGENT_IMPLEMENTATION.md
- CORE_AI_INTEGRATION.md
- FORK_CONFIGURATION.md
- LOCAL_LLM_FOUNDATION_HANDOFF.md
- OPEN_SOURCE_PROGRAM_READINESS.md
- PCC_INTEGRATION.md
- RELEASE_VERIFICATION.md
- REUSABLE_COMPONENTS.md
- SECURITY_MODEL.md
- VALIDATION.md
- XCODE_SECURITY_SETTINGS.md
- Contents.json
- app_logo_small.png
- Contents.json
- AppIcon-1024.png
- Contents.json
- AppIconClassic-1024.png
- Contents.json
- AppIconClassicPreview-256.png
- Contents.json
- AppIconCoreAI-1024.png
- Contents.json
- AppIconPreview-256.png
- Contents.json
- Contents.json
- image_studio_app_icon.png
- Contents.json
- img_assistant.png
- Contents.json
- img_generation.png
- Contents.json
- img_lens.png
- Contents.json
- img_mac_bridge.png
- Contents.json
- img_prompting.png
- Contents.json
- img_prompting_alt.png
- Contents.json
- img_voice.png
- Contents.json
- token_app_icon.jpg
- Contents.json
- LocalAIController.swift
- LocalAIFoundationConfig.swift
- LocalAITypes.swift
- RuntimeError.swift
- PendingIndexQueue.swift
- PIIRedactor.swift
- RuntimeEngine.swift
- LocalModelFileValidator.swift
- StreamingResponseCoordinator.swift
- README.md
- WebToolModels.swift
- AppBridge.swift
- ApplePrivateCloudPromptBuilder.swift
- ApplePrivateCloudTypes.swift
- AppSettings.swift
- AssistantModelCatalog.swift
- ChatMessage.swift
- ChatTemplate.swift
- CodeTask.swift
- ConversationStore.swift
- Detection.swift
- FastVLMConfig.swift
- FastVLMGenerationResult.swift
- FastVLMGenerationSettings.swift
- FastVLMModelState.swift
- Int64+FormattedBytes.swift
- KittenVariant.swift
- KoduTheme.swift
- LegalDocuments.swift
- LensPromptPreset.swift
- LoRAAdapter.swift
- ModelCapabilityProfile.swift
- ModelCatalogTypes.swift
- Persona.swift
- SamplerPreset.swift
- SpeechAlignment.swift
- TokenLogprob.swift
- VoiceCatalog.swift
- VoiceEngine.swift
- VoiceModelState.swift
- VoicePerformanceSnapshot.swift
- VoiceProfile.swift
- VoiceSessionState.swift
- VoiceSettingsStore.swift
- VoiceSynthesisResult.swift
- WebTriggerKeywords.json
- cmudict.txt
- LICENSE
- VoiceModelCatalog.json
- AgentProtocol.swift
- BridgeAgentClient.swift
- BridgeAgentMode.swift
- BridgePinningDelegate.swift
- AiderConfigurationExporter.swift
- BonjourPublisher.swift
- BridgeIdentity.swift
- BridgeManager.swift
- BridgePairingStore.swift
- BridgeServer.swift
- BridgeWakeup.swift
- DEREncoder.swift
- HubApiDownloader.swift
- LocalAPIHistorySelector.swift
- LocalAPIServer.swift
- LocalAPITokenBudget.swift
- RemoteInferenceGate.swift
- CrashReporter.swift
- Diagnostics.swift
- SystemSnapshot.swift
- IOSLocalLLMAppIntents.swift
- IOSLocalLLM-Bridging-Header.h
- LlamaCppBridge.swift
- LlamaCppVLMService.swift
- EmbeddingPassageScorer.swift
- KnowledgeBaseService.swift
- OnDeviceEmbedder.swift
- AudioMeterAtomics.swift
- AudioPlaybackSnapshot.swift
- AudioVisualClock.swift
- VoiceDisplayLink.swift
- EndOfTurnEstimator.swift
- TurnEndpointer.swift
- VoiceActivityDetector.swift
- VoiceAudioMeter.swift
- AudioQueue.swift
- LanguageDetector.swift
- ReasoningStripper.swift
- SemanticChunker.swift
- AcousticSpeechAlignmentProvider.swift
- KaraokeCueTrack.swift
- KaraokeTimeline.swift
- PredDurWordAligner.swift
- SpeechTimingProvider.swift
- AudioPlaybackService.swift
- KittenTTSService.swift
- KokoroPhonemizer.swift
- KokoroTTSService.swift
- LensVoiceNarrator.swift
- PhonemizerEN.swift
- SpeechPlaybackCoordinator.swift
- SystemSpeechService.swift
- TextChunker.swift
- VoiceAudioSessionManager.swift
- VoiceModelBundleValidator.swift
- VoicePerformanceSignposts.swift
- VoicePresentationModels.swift
- VoiceProfileRegistry.swift
- VoiceRuntimeDiagnostics.swift
- VoiceService.swift
- VoiceVisualLevelStore.swift
- WhisperService.swift
- KeychainStore.swift
- SearchQueryBuilder.swift
- URLSafetyValidator.swift
- WebActivityLogger.swift
- WebContentExtractor.swift
- WebContentSanitizer.swift
- WebContextCompressor.swift
- WebPageFetchService.swift
- WebPassageReranker.swift
- WebRateLimiter.swift
- WebSearchService.swift
- WebToolDecisionEngine.swift
- WebToolPromptBuilder.swift
- WebToolService.swift
- AnalysisService.swift
- AppleFoundationModelService.swift
- ApplePrivateCloudRuntime.swift
- AudioTranscriptionService.swift
- BackgroundDownloadCoordinator.swift
- BenchmarkService.swift
- BundledVLMInstaller.swift
- CameraService.swift
- CloudSyncService.swift
- CodeExtractionService.swift
- CodeModeController.swift
- CodingAssistantService.swift
- ConversationTitler.swift
- CoreAIConversationPlanner.swift
- CoreAILanguageModelService.swift
- CoreAIModelStore.swift
- CoreAIVisionService.swift
- DeviceSafetyMonitor.swift
- DeviceTierAdvisor.swift
- DownloadLiveActivity.swift
- FastVLM.swift
- FastVLMCoreMLStub.swift
- FastVLMModelBundleValidator.swift
- FastVLMPromptBuilder.swift
- FastVLMRepoAutoDiscovery.swift
- FastVLMService.swift
- FileAttachmentService.swift
- HFModelDownloadManager.swift
- HFSearchService.swift
- HFTokenStore.swift
- ImageGenerationService.swift
- LASAppIdentity.swift
- LegalAcceptanceManager.swift
- LensFramePreparer.swift
- LensInferenceLoop.swift
- LifecycleController.swift
- LiveOCRService.swift
- LocalizationService.swift
- LocalModelDocumentPickerSession.swift
- LocalModelImportService.swift
- MacroChain.swift
- MemoryAdvisor.swift
- MemoryStore.swift
- MetricKitHandler.swift
- MLXGenerationGate.swift
- MLXToolCallConstraint.swift
- MLXVisionService.swift
- ModelArenaStore.swift
- ModelCacheProbe.swift
- ModelDownloadCenter.swift
- ModelPrefetcher.swift
- ModelQualityEval.swift
- ModelResidency.swift
- ModelUsageTracker.swift
- NanbeigeMLXModel.swift
- NetworkActivityMonitor.swift
- OCRService.swift
- OnDeviceCompatibility.swift
- ReasoningCompletionGuard.swift
- RecoveryState.swift
- RuntimeLogCenter.swift
- SmolVLM2Rescue.swift
- SnippetStore.swift
- SpeechDictationService.swift
- SpotlightIndexer.swift
- SystemStatusService.swift
- TextRegionDetector.swift
- TipsManager.swift
- ToastCenter.swift
- ToolRunner.swift
- VisualModelInstallStatus.swift
- VLMCapabilities.swift
- VoiceCatalogStore.swift
- VoiceConversationService.swift
- WipeAllDataService.swift
- 1.PNG
- 1840 a.PNG
- 2.PNG
- 3.PNG
- 4.PNG
- 6.PNG
- 7.PNG
- DeviceCompatibility.swift
- HapticManager.swift
- ImageExtensions.swift
- KeyboardDismiss.swift
- Clip.swift
- Configuration.swift
- Image.swift
- LICENSE
- Load.swift
- Sampler.swift
- StableDiffusion.swift
- Tokenizer.swift
- UNet.swift
- VAE.swift
- VoiceSettingsViewModel.swift
- ArgentRemoteView.swift
- BridgeAgentCard.swift
- BridgePairingView.swift
- BridgeQRScannerView.swift
- ArenaLeaderboardCard.swift
- CapabilityPill.swift
- AttributionsView.swift
- LegalAcceptanceView.swift
- LegalDocumentView.swift
- AudioRoutePicker.swift
- KaraokeTranscriptView.swift
- ThinkingOrbShaders.metal
- VoiceActivityOrb.swift
- VoiceControlsView.swift
- VoiceIsolatedContainers.swift
- VoiceSettingsView.swift
- VoiceStatusPill.swift
- VoiceStatusView.swift
- VoiceUITestFixtureView.swift
- VoiceValidationView.swift
- WebActivityLogView.swift
- WebPermissionSheet.swift
- WebSettingsView.swift
- WebSourcesView.swift
- WebStatusBadge.swift
- AnalysisHistoryView.swift
- AnalysisPanelView.swift
- AppDesignSystem.swift
- AssistantChatComponents.swift
- AssistantModelPickerView.swift
- BenchmarkView.swift
- CameraPreviewView.swift
- CodeModeView.swift
- CodePanelView.swift
- CodingAssistantView.swift
- CompareView.swift
- CoreAIModelManagementView.swift
- DiagnosticsView.swift
- DiffView.swift
- DocumentScannerView.swift
- FileAttachmentChip.swift
- FileAttachmentPicker.swift
- FixRepoSheet.swift
- GlassEffects.swift
- GlobalKeyboardBar.swift
- HFSearchView.swift
- HFTokenSheet.swift
- HomeView.swift
- ImageGenerationView.swift
- KeyboardToolbar.swift
- KnowledgeBaseView.swift
- KoduComponents.swift
- LensDebugOverlay.swift
- LensPromptPresetSheet.swift
- LensTaskPanel.swift
- LiquidPinkBackdrop.swift
- LiveOCROverlayView.swift
- LiveParserBar.swift
- LocalModelDocumentsImportSheet.swift
- MacroChainView.swift
- MarkupCanvasView.swift
- MicDictationButton.swift
- ModelDownloadCenterView.swift
- ModelsManagerView.swift
- ModelStorageCleanupView.swift
- OnboardingModelPickerView.swift
- OnboardingView.swift
- OverlayView.swift
- PersonaPickerView.swift
- PhotoPickerView.swift
- PlumDuskSplashView.swift
- QualityEvalView.swift
- SettingsView.swift
- SetupBannerView.swift
- SnippetPickerView.swift
- SystemStatusView.swift
- UnsupportedDeviceView.swift
- UserGuideView.swift
- VisualModelComparisonView.swift
- VisualModelPickerView.swift
- VoiceConversationView.swift
- VoiceLibraryView.swift
- VoiceModelPickerView.swift
- ContentView.swift
- CrystallizeDownloadCard.swift
- HFTokenSettingsView.swift
- Info.plist
- IOSLocalLLM-Catalyst.entitlements
- IOSLocalLLM-PCC.entitlements
- IOSLocalLLM.entitlements
- IOSLocalLLMApp.swift
- LASDesignSystem.swift
- LASOnboardingView.swift
- LASTheme.swift
- ModelDownloadsView.swift
- OnDeviceDebuggerView.swift
- PrivacyInfo.xcprivacy
- RuntimeTerminalView.swift
- mirrors.json
- Package.resolved
- contents.xcworkspacedata
- IOSLocalLLM.xcscheme
- project.pbxproj
- README_XCODE_SETUP.md
- Package.resolved
- contents.xcworkspacedata
- Info.plist
- IOSLocalLLMShareExtension.entitlements
- ShareViewController.swift
- AppBridgeSecurityTests.swift
- ApplePrivateCloudTests.swift
- AudioQueueTests.swift
- AudioVisualClockTests.swift
- BridgePairingStoreTests.swift
- CoreAIModelStoreTests.swift
- DeviceTierAdvisorTests.swift
- DiagnosticsTests.swift
- FastVLMPromptBuilderTests.swift
- HighRiskServiceTests.swift
- Int64FormattedBytesTests.swift
- KaraokeTimelineTests.swift
- KittenRuntimeTests.swift
- LanguageDetectorTests.swift
- LASAppIdentityTests.swift
- LensVoiceNarratorTests.swift
- LocalAIFoundationTests.swift
- LocalAPIServerTests.swift
- ModelCategoryInferenceTests.swift
- OnDeviceEmbedderTests.swift
- ReasoningCompletionGuardTests.swift
- ReasoningStripperTests.swift
- ScorerAndToolTests.swift
- SemanticChunkerTests.swift
- SpeechAlignmentTests.swift
- SpeechTimingTests.swift
- StoredConversationTests.swift
- TextChunkerSanitizerTests.swift
- ToolRunnerTests.swift
- TurnEndpointerTests.swift
- URLSafetyValidatorTests.swift
- VoiceCatalogTests.swift
- VoiceProfileRegistryTests.swift
- VoiceSettingsStoreTests.swift
- VoiceSoakHarnessTests.swift
- VoiceStatusPillTests.swift
- WebSearchServiceTests.swift
- WipeKeychainTests.swift
- AppBridgeSecurityTests.swift
- ApplePrivateCloudTests.swift
- AudioQueueTests.swift
- AudioVisualClockTests.swift
- BridgePairingStoreTests.swift
- DeviceTierAdvisorTests.swift
- DiagnosticsTests.swift
- FastVLMPromptBuilderTests.swift
- HighRiskServiceTests.swift
- Int64FormattedBytesTests.swift
- KaraokeTimelineTests.swift
- KittenRuntimeTests.swift
- LanguageDetectorTests.swift
- LensVoiceNarratorTests.swift
- LocalAIFoundationTests.swift
- LocalAPIServerTests.swift
- ModelCategoryInferenceTests.swift
- OnDeviceEmbedderTests.swift
- ReasoningCompletionGuardTests.swift
- ReasoningStripperTests.swift
- ScorerAndToolTests.swift
- SemanticChunkerTests.swift
- SpeechAlignmentTests.swift
- SpeechTimingTests.swift
- StoredConversationTests.swift
- TextChunkerSanitizerTests.swift
- ToolRunnerTests.swift
- TurnEndpointerTests.swift
- URLSafetyValidatorTests.swift
- VoiceCatalogTests.swift
- VoiceProfileRegistryTests.swift
- VoiceSettingsStoreTests.swift
- VoiceSoakHarnessTests.swift
- VoiceStatusPillTests.swift
- WebSearchServiceTests.swift
- WipeKeychainTests.swift
- VoiceModeUITests.swift
- Apple-Sample-Code-License.txt
- Package.resolved
- contents.xcworkspacedata
- CoreAIOnDeviceLAS.xcscheme
- OnDeviceLAS.xcscheme
- project.pbxproj
- Package.resolved
- contents.xcworkspacedata
- marketplace.json
- bug_report.yml
- config.yml
- model_request.yml
- workflow_feedback.yml
- ci.yml
- Components.swift
- CoreAIComponentError.swift
- CoreAIDenoiser.swift
- CoreAIDiffusionModelFunction.swift
- CoreAILatentCodec.swift
- CoreAITextEncoder.swift
- ResourceManaging.swift
- Flux2Pipeline+Resources.swift
- Flux2Pipeline.swift
- Pipeline.swift
- PipelineConfiguration.swift
- PipelineDescriptor+CoreAI.swift
- PipelineDescriptor.swift
- SD3Pipeline+Resources.swift
- SD3Pipeline.swift
- StableDiffusionPipeline.swift
- NumPyRandomSource.swift
- NvRandomSource.swift
- RandomSource.swift
- TorchRandomSource.swift
- DiscreteFlowScheduler.swift
- DPMSolverMultistepScheduler.swift
- PNDMScheduler.swift
- Scheduler.swift
- SchedulerMath.swift
- BPETokenizer+Reading.swift
- BPETokenizer.swift
- DiffusionUtilities.swift
- SegmentationOutputs.swift
- SegmentationPostprocessor.swift
- SegmentationVisualization.swift
- CLIPTokenizer.swift
- ImageSegmentationEngine.swift
- ImageSegmenter.swift
- PointQuery.swift
- SegmentationRuntimeError.swift
- TextQuery.swift
- ModelPaths.swift
- LanguageBundle.swift
- LanguageConfig.swift
- ModelBundle+Language.swift
- ConstrainedDecodingStrategy.swift
- ConstrainedGenerator.swift
- ContinuationEvaluation.swift
- DecodingStrategy.swift
- VanillaDecodingStrategy.swift
- ConstrainedGenerationSession.swift
- TokenizerInfo.swift
- XGrammarWrapper.swift
- CoreAIPipelinedEngine.swift
- CoreAISequentialEngine.swift
- CoreAISequentialVLMEngine.swift
- CoreAIStaticShapeEngine.swift
- EmbeddedInput.swift
- EngineFactory.swift
- GenerationToken.swift
- InferenceEngine.swift
- InferenceOutputSequence.swift
- KVCache+CoreAI.swift
- KVCacheShared.swift
- ModelConfig.swift
- TensorStorage+CoreAI.swift
- TokenHistory.swift
- CoreAILanguageModel.swift
- CoreAIRunner.swift
- ThinkTagParser.swift
- LogitsWriter.swift
- InstrumentsProfiler.swift
- PerformanceMetrics.swift
- Timing.swift
- CompositeSampler.swift
- MPSGraphSamplers.swift
- SamplingConfiguration.swift
- TokenizerLoader.swift
- PromptProcessing.swift
- TextGenerator.swift
- ModelShapeConfig.swift
- ToolCallParser.swift
- DetectionOutputs.swift
- DetectionPostprocessor.swift
- ObjectDetector.swift
- BundleKind.swift
- FunctionMap.swift
- ModelBundle.swift
- CGImageUtils.swift
- ImagePreprocessor.swift
- Logger.swift
- ModelStructure.swift
- NDArray+Helpers.swift
- MelSpectrogram.swift
- SpeechBundle.swift
- SpeechDecoder.swift
- SpeechModel.swift
- dlpack.h
- module.modulemap
- xgrammar_c_bridge.h
- xgrammar_c_bridge.cpp
- BenchmarkMain.swift
- DiffusionRunnerMain.swift
- ImageSegmentationRunnerMain.swift
- ArgumentParserExtensions.swift
- LLMRunnerMain.swift
- ObjectDetectionMain.swift
- SpeechRunnerMain.swift
- CGImageUtilsTests.swift
- ImagePreprocessorTests.swift
- ModelBundleTests.swift
- ComponentTests.swift
- DiffusionPipelineTests.swift
- MultiOutputModelFunctionTests.swift
- PipelineDescriptorTests.swift
- SchedulerTests.swift
- SD3ParityDataTests.swift
- ConstrainedGenerationSessionTests.swift
- GenerationLoopTests.swift
- TestUtilities.swift
- ImageSegmentationEngineTests.swift
- ImageSegmentationTests.swift
- tokenizer.json
- tokenizer_config.json
- CancelAPITests.swift
- CompositeSamplerTests.swift
- ContinuationEvaluationTests.swift
- CoreAIPipelinedTests.swift
- EngineOptionsTests.swift
- GenerationStopReasonTests.swift
- GraphSelectionTests.swift
- KVCacheStrategyTests.swift
- KVCacheTests.swift
- LanguageBundleTests.swift
- LogitsWriterTests.swift
- MinimalTokenizerTests.swift
- ModelConfigHandlerTests.swift
- ModelPathsTests.swift
- MPSGraphSamplerTests.swift
- PerformanceMetricsTests.swift
- PipelineGateTests.swift
- ProfileSpanTests.swift
- PromptProcessingTests.swift
- PublicInterfaceTests.swift
- SamplingConfigurationTests.swift
- StopSequencesTests.swift
- TestUtilities.swift
- ThinkTagParserTests.swift
- TimingTests.swift
- TokenizerIntegrationTests.swift
- UnifiedGenerationAPITests.swift
- VLMProtocolTests.swift
- ObjectDetectorTests.swift
- Utilities.swift
- coreai-models-Package.xctestplan
- .gitignore
- .pre-commit-config.yaml
- .python-version
- .spi.yml
- .swift-format
- LICENSE
- ONDEVICELAS_PATCH.md
- Package.resolved
- Package.swift
- pyproject.toml
- README.md
- Placeholder.txt
- VoiceOrbShaders.metal
- VoiceAgentOrb.swift
- VoiceAgentOrbTheme.swift
- VoiceOrbAccessibility.swift
- VoiceOrbAnimationCoordinator.swift
- VoiceOrbAudioModel.swift
- VoiceOrbDemoView.swift
- VoiceOrbEnergyField.swift
- VoiceOrbPerformancePolicy.swift
- VoiceOrbRenderer.swift
- VoiceOrbSignpost.swift
- VoiceOrbState.swift
- VoiceOrbTests.swift
- LICENSE
- NOTICE
- Package.swift
- README.md
- llama.cpp-ios-only-xcframework.patch
- build_catalyst_slice.sh
- build_whisper_ios.sh
- build_native_frameworks.sh
- download_voice_models.sh
- export_fastvlm_coreml.sh
- FASTVLM_EXPORT_NOTES.md
- package_background_assets.sh
- patch-mlx-metal-warning.sh
- validate_altstore_source.sh
- validate_dco.sh
- validate_open_source.sh
- VOICE_MODELS_NOTES.md
- LICENSE
- llama.cpp
- whisper.cpp
- .gitattributes
- .gitignore
- .gitmodules
- AGENTS.md
- AIDER_SETUP.md
- ARCHITECTURE.md
- ASSET_PROVENANCE.md
- CHANGELOG.md
- CITATION.cff
- CODE_OF_CONDUCT.md
- codemeta.json
- CONTRIBUTING.md
- GOVERNANCE.md
- LENS_PIPELINE.md
- LICENSE
- llms.txt
- MAINTAINERS.md
- ON_DEVICE_LAS.md
- PHASE7_VISION.md
- Podfile
- Podfile.lock
- PRIVACY_POLICY.md
- project.yml
- PROVENANCE.md
- README.md
- REUSE.toml
- ROADMAP.md
- SBOM.spdx.json
- SECURITY.md
- SETUP_INSTRUCTIONS.md
- SUPPORT.md
- THIRD_PARTY_NOTICES.md
- TRADEMARKS.md
- USER_GUIDE.md
# Use via CDN
jsDelivrjsDelivr serves any public GitHub repository as a CDN with zero setup. Pick a version and a file to get a ready-to-paste link and snippet.
Link
Example
// repository documentation
Was this content helpful?
(0 ratings)