azure-ai-search-multimodal-sample

(★ 66)

A sample app for the Multimodal Retrieval-Augmented Generation pattern running in Azure, using Azure AI Search for retrieval and Azure OpenAI large language models to power Q&A experiences.

File Explorer

Download Latest Version (.zip)

- devcontainer.json
- - codeql.yml
- CODE_OF_CONDUCT.md
- CONTRIBUTING.md
- dependabot.yml
- ISSUE_TEMPLATE.md
- PULL_REQUEST_TEMPLATE.md
- SECURITY.md
- extensions.json
- launch.json
- settings.json
- 2024-State-of-AI-Change-Readiness-eBook.pdf
- - app_depl_success.png
  - E2E_multimodal_flow.png
  - image-cite-1.jpg
  - image-cite-2.jpg
  - marketplace_error.png
  - sample_snap_1.jpg
  - sample_snap_2.jpg
  - sample_snap_3.jpg
- - main.bicep
- - appservices.bicep
- - searchService.bicep
- - role.bicep
- - storage-account.bicep
- abbreviations.json
- main.bicep
- main.parameters.json
- portal-2-app.ps1
- prepdocs.ps1
- prepdocs.sh
- roles.ps1
- - app.py
  - citation_file_handler.py
  - constants.py
  - data_model.py
  - grounding_retriever.py
  - helpers.py
  - knowledge_agent.py
  - models.py
  - multimodalrag.py
  - prepdocs.py
  - processfile.py
  - processing_step.py
  - prompts.py
  - rag_base.py
  - requirements.txt
  - search_grounding.py
- - .gitignore
  - .prettierrc
  - eslint.config.js
  - index.html
  - package-lock.json
  - package.json
  - README.md
  - tsconfig.app.json
  - tsconfig.json
  - tsconfig.node.json
  - vite.config.ts
- start.ps1
- start.sh
.gitignore
azure.yaml
LICENSE
README.md

# Installation Guide

1. Get the code

git clone https://github.com/Azure-Samples/azure-ai-search-multimodal-sample

Downloads the entire project code from GitHub to your computer.

cd azure-ai-search-multimodal-sample

Moves into the project folder you just downloaded.

2. Node.js

Easy Recommended

Prerequisites

Git Needed to download the project code from GitHub.
Node.js Node.js must be installed to use npm. The LTS version is recommended.

⚠️ This is a large repository, so this method may point to an internal sub-package rather than the actual core product. Check the full README as well.

cd src/frontend

This project's files live in a subfolder, so move into it first.

npm install

Downloads and installs the libraries listed in package.json.

npm start

Starts the development/run server.

✅ After running the command, open the address shown in the terminal (usually something like http://localhost:3000) in your browser.

3. Python

Easy

Prerequisites

Git Needed to download the project code from GitHub.
Python 3 On Windows, be sure to check 'Add Python to PATH' during installation.

⚠️ This is a large repository, so this method may point to an internal sub-package rather than the actual core product. Check the full README as well.

pip install -r src/backend/requirements.txt

Installs the Python libraries listed in requirements.txt (or similar).

python <실행할 파일명>.py # README에서 정확한 실행 파일명을 확인하세요

Runs the Python script (or module).

✅ If it runs without errors and prints output in the terminal, it worked.