secret-llama - GitLite

KO | EN

gitlite — search

#python #hacktoberfest #typescript #go #golang #rust #docker #macos #java #awesome-list #vue #pytorch #security #ios

secret-llama

(★ 2,678)

Fully private LLM chatbot that runs entirely with a browser with no server needed. Supports Mistral and LLama 3.

파일 탐색기

최종 버전 다운로드 (.zip)

- FUNDING.yml
- favicon.png
- - CodeMessage.tsx
  - DebugUI.tsx
  - Message.tsx
  - MessageList.tsx
  - ModelsDropdown.tsx
  - ResetChatButton.tsx
  - UserInput.tsx
- - useChatStore.ts
  - useTimedToggle.ts
- - utils.ts
- App.tsx
- index.css
- main.tsx
- models.ts
- vite-env.d.ts
- worker.ts
.eslintrc.cjs
.gitattributes
.gitignore
components.json
index.html
LICENSE
package-lock.json
package.json
postcss.config.js
README.md
tailwind.config.js
tsconfig.json
tsconfig.node.json
vite.config.ts
yarn.lock

# 설치 가이드

1. 코드 내려받기

git clone https://github.com/abi/secret-llama

깃허브에서 프로젝트 코드 전체를 내 컴퓨터로 내려받습니다.

cd secret-llama

방금 내려받은 프로젝트 폴더 안으로 이동합니다.

2. Node.js

쉬움 추천

사전 준비물

Git GitHub에서 프로젝트 코드를 내려받으려면 필요합니다.
Node.js npm 명령어를 쓰려면 Node.js가 설치되어 있어야 합니다. LTS(장기지원) 버전을 추천합니다.

yarn

package.json에 명시된 라이브러리들을 내려받아 설치합니다.

yarn build-and-preview

배포용으로 코드를 최적화해서 빌드 파일을 생성합니다.

yarn dev

개발/실행 서버를 켭니다.

✅ 명령어 실행 후 터미널에 나타나는 주소(보통 http://localhost:3000 형태)를 브라우저에서 열어보세요.

이 레포의 README에 적힌 실제 명령어를 그대로 가져왔습니다.

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Secret Llama

![secret llama](https://github.com/abi/secret-llama/assets/23818/0bf43a95-4fe5-4c53-87bc-b558e5c4968f)

Entirely-in-browser, fully private LLM chatbot supporting Llama 3, Mistral and other open source models.

- Fully private = No conversation data ever leaves your computer
- Runs in the browser = No server needed and no install needed!
- Works offline
- Easy-to-use interface on par with ChatGPT, but for open source LLMs

Big thanks to the inference engine provided by [webllm](https://github.com/mlc-ai/web-llm).

Join us on Discord

[![](https://dcbadge.vercel.app/api/server/QkVzykMc9V)](https://discord.gg/QkVzykMc9V)

https://discord.gg/QkVzykMc9V

## System Requirements

To run this, you need a modern browser with support for WebGPU. According to [caniuse](https://caniuse.com/?search=WebGPU), WebGPU is supported on:

- Google Chrome
- Microsoft Edge

It's also available in Firefox, but it needs to be enabled manually through the dom.webgpu.enabled flag. Safari on MacOS also has experimental support for WebGPU which can be enabled through the WebGPU experimental feature.

In addition to WebGPU support, various models might have specific RAM requirements.

## Try it out

You can [try it here](https://secretllama.com).

To compile the React code yourself, download the repo and then, run

```
yarn
yarn build-and-preview
```

If you're looking to make changes, run the development environment with live reload:

```
yarn
yarn dev
```

## Supported models

| Model                     | Model Size |
|---------------------------|------------|
| TinyLlama-1.1B-Chat-v0.4-q4f32_1-1k | 600MB      |
| Llama-3-8B-Instruct-q4f16_1 ⭐         | 4.3GB      |
| Phi1.5-q4f16_1-1k                   | 1.2GB        |
| Mistral-7B-Instruct-v0.2-q4f16_1 ⭐    | 4GB        |

## Looking for contributors

We would love contributions to improve the interface, support more models, speed up initial model loading time and fix bugs.

## Other Projects by Author

Check out [screenshot to code](https://github.com/abi/screenshot-to-code) and [Pico - AI-powered app builder](https://picoapps.xyz)