uptrain
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.
파일 탐색기
최종 버전 다운로드 (.zip)- bug_report.md
- feature_request.md
- python-publish.yml
- PULL_REQUEST_TEMPLATE.md
- dashboard_experiment.png
- dashboard_home.png
- dashboard_project.png
- eval.png
- eval_logs.png
- eval_select_metrics.png
- exp.png
- exp_logs.png
- prompt.png
- prompt_select.png
- helicone1.webp
- helicone2.webp
- langfuse.webp
- zeno.png
- faq.mdx
- evaluations.mdx
- experiments.mdx
- getting_started.mdx
- project.mdx
- introduction.mdx
- quickstart.mdx
- why-open-source.mdx
- why-we-are-building-uptrain.mdx
- overview.mdx
- rag_query.mdx
- reranking.mdx
- subques_query.mdx
- evalllamaindex.mdx
- overview.mdx
- helicone.mdx
- langfuse.mdx
- zeno.mdx
- chroma.mdx
- faiss.mdx
- qdrant.mdx
- anyscale.mdx
- azure.mdx
- claude.mdx
- mistral.mdx
- ollama.mdx
- openai.mdx
- together_ai.mdx
- dark.png
- light.png
- code-hallucination.mdx
- context-conciseness.mdx
- context-relevance.mdx
- context-reranking.mdx
- context-utilization.mdx
- factual-accuracy.mdx
- guideline-adherence.mdx
- number-of-turns.mdx
- query-resolution.mdx
- user-satisfaction.mdx
- custom-eval.mdx
- custom-guideline.mdx
- custom-prompt-eval.mdx
- response-matching.mdx
- fluency-and-coherence.mdx
- tonality.mdx
- multi-query-accuracy.mdx
- sub-query-completeness.mdx
- response-completeness.mdx
- response-conciseness.mdx
- response-consistency.mdx
- response-relevance.mdx
- response-validity.mdx
- jailbreak.mdx
- prompt-injection.mdx
- overview.mdx
- analyzing-failure-cases.mdx
- experiments-evaluation-tutorial.mdx
- open-source-evaluator.mdx
- openai-evals.mdx
- uptrain-api-client.mdx
- favicon.png
- mint.json
- mkdocs.yml
- package-lock.json
- templates
- disease_list.pdf
- medicine_list.docx
- assistant_evaluator.ipynb
- benchmarking_results.ipynb
- claude_3_vs_gpt_4.ipynb
- code_hallucination.ipynb
- README.md
- matching.ipynb
- README.md
- conciseness.ipynb
- context_utlization.ipynb
- factual_accuracy.ipynb
- README.md
- relevance.ipynb
- reranking.ipynb
- conversation_satisfaction.ipynb
- guideline_adherence.ipynb
- number_of_turns.ipynb
- query_resolution.ipynb
- README.md
- cosine_similarity.ipynb
- custom_evals.ipynb
- custom_prompt_evals.ipynb
- guideline_adherence.ipynb
- model_grade_score.ipynb
- README.md
- language_critique.ipynb
- README.md
- rouge_score.ipynb
- tone_critique.ipynb
- multi_query_accuracy.ipynb
- README.md
- sub_query_completeness.ipynb
- completeness.ipynb
- conciseness.ipynb
- consistency.ipynb
- README.md
- relevance.ipynb
- validity.ipynb
- jailbreak_detection.ipynb
- README.md
- system_prompt_injection.ipynb
- README.md
- context_quality_comparison.ipynb
- data_driven_experimentation_demo.ipynb
- embedding_models_comparison.ipynb
- llm_openai_vs_claude_experiment.ipynb
- llm_openai_vs_gemma7b_experiment.ipynb
- jina.ipynb
- anyscale.ipynb
- ollama.ipynb
- together_ai.ipynb
- promptfoo.ipynb
- helicone.ipynb
- langfuse.ipynb
- zeno.ipynb
- rag_evaluations_uptrain_mistral.ipynb
- evaluating_guidelines_generated_by_spade.ipynb
- spade_utils.py
- chroma.ipynb
- FAISS.ipynb
- milvus.ipynb
- qdrant.ipynb
- llamaindex.ipynb
- openai_evals.ipynb
- rag_with_citation.ipynb
- experiments_evaluation_tutorial.ipynb
- managed_service_client_tutorial.ipynb
- open_source_evaluator_tutorial.ipynb
- predictions.csv
- qna_on_docs_samples.jsonl
- test_builtins.py
- test_custom_ops.py
- test_operators.py
- app.py
- Dockerfile
- nest_asyncio.py
- requirements.txt
- 404.svg
- Add.png
- BackgroudDottedBoxTopLeft.png
- BetaButton.svg
- Close.svg
- ContactUs-Calls.png
- ContactUs-Thoughts.png
- CopyIcon.svg
- Documents.svg
- DownArrow.svg
- DownloadButton.svg
- DropDownIcon.svg
- Evaluations.svg
- favicon.ico
- FileIcon.svg
- GitHub.svg
- Hamburger_HomePage.svg
- Home.svg
- InsightsAccessImage.png
- next.svg
- NotificationIcon.svg
- QuestionIcon.svg
- RightPointingArrow.svg
- RightPointingArrowBlue.svg
- Share.png
- SideBar-ApiKeys-white.png
- SideBar-ApiKeys.png
- SideBar-ContactUs-white.png
- SideBar-ContactUs.png
- SideBar-Evaluations-white.png
- SideBar-Evaluations.png
- SideBar-Experiment-white.png
- SideBar-Experiment.png
- SideBar-Home-white.png
- SideBar-Home.png
- SideBar-prompts-white.png
- SideBar-prompts.png
- ThumbsUp.svg
- ThumbsUpLight.svg
- UpArrow.svg
- UptrainLogo.png
- page.js
- page.js
- page.js
- page.js
- page.js
- page.js
- page.js
- page.js
- page.js
- page.js
- globals.css
- layout.js
- not-found.js
- page.js
- ApiKeySection.js
- ButtonSection.js
- CodeViewer.js
- CreditsSection.js
- TabButton.js
- WorkingSection.js
- ButtonSection.js
- CloseButtonSection.js
- CreateProjectTab.js
- ModelSelector.js
- Step2.js
- Step2OverModal.js
- CompareSection.js
- CalendlyPopUp.js
- ContactCard.js
- CreateProjectModal.js
- Step1.js
- CustomSelect.js
- CustomMultiSelect.js
- CustomSingleCheckBox.js
- DownArrow.js
- SingleSelect.js
- Insights.js
- InsightsModal.js
- AllLogs.js
- AllLogsRow.js
- AllLogsRowTop.js
- DataModal.js
- DataRow.js
- Divider.js
- LikeModal.js
- TopBar.js
- BarChart.js
- ChartPage.js
- ChartSection.js
- LineChart.js
- Logs_InsightsTable.js
- AddProjectModal.js
- Step1.js
- UploadDatasetButton.js
- HeaderSection.js
- ProjectCard.js
- ProjectPage.js
- ProjectSection.js
- TextSection.js
- EvaluationsFilterSection.js
- AllLogs_Experiment.js
- AllLogsRow.js
- AllLogsRowTop.js
- DataModal.js
- DataRow.js
- Divider.js
- Insights.js
- InsightsModal.js
- BarChart.js
- ChartPage.js
- ChartSection.js
- Logs_InsightsTable.js
- AddProjectModal.js
- Step1.js
- UploadDatasetButton.js
- HeaderSection.js
- ProjectCard.js
- ProjectPage.js
- ProjectSection.js
- TextSection.js
- FilterContainer.js
- FilterSection.js
- HeaderSection.js
- ProjectCard.js
- ProjectSection.js
- TextSection.js
- KeyModal.js
- AllLogs.js
- AllLogsRow.js
- AllLogsRowTop.js
- DataModal.js
- DataRow.js
- Divider.js
- LikeModal.js
- BarChart.js
- ChartSection.js
- LineChart.js
- Logs_InsightsTable.js
- ProjectFilterSection.js
- PromptFilterSection.js
- AddProjectModal.js
- Step1.js
- UploadDatasetButton.js
- CompareModal.js
- EvaluationModal.js
- ProjectPage.js
- AddNewProjectCard.js
- ProjectCard.js
- ProjectSection.js
- PromptsPage.js
- Row.js
- LinkElement.js
- SideBar.js
- CustomTabButton.js
- GrayParah18.js
- GraySmallHeading.js
- SpinningLoader.js
- Header.js
- Layout.js
- userInfo.js
- store.js
- changeDateFormat.js
- models.js
- scoreColorCalculator.js
- .gitignore
- jsconfig.json
- next.config.js
- package.json
- postcss.config.js
- README.md
- tailwind.config.js
- Dockerfile
- __init__.py
- assistant_evals_prompts.py
- assistant_evals_utils.py
- parse_files_utils.py
- __init__.py
- __init__.pyi
- base.py
- builtins.py
- checks.py
- evalllm.py
- evals.py
- rca_templates.py
- remote.py
- signal.py
- __init__.py
- __init__.pyi
- llama_index.py
- promptfoo.py
- promptfoo_utils.py
- __init__.py
- detection.py
- sql.py
- __init__.py
- embedding.py
- vector_search.py
- __init__.py
- base.py
- bq.py
- duck.py
- excel.py
- mongodb.py
- dummy.py
- dummy.yaml
- model-run.yaml
- model_run.py
- classic.py
- few_shots.py
- instructions.py
- output_format.py
- __init__.py
- bleu.py
- context_quality.py
- conversation.py
- custom.py
- factual_accuracy.py
- generation.py
- grammar.py
- guideline.py
- jailbreak.py
- language_quality.py
- llm.py
- meteor.py
- model_grade.py
- multiquery.py
- openai_evals.py
- question_quality.py
- response_quality.py
- rouge.py
- subquery.py
- text.py
- tone.py
- topic.py
- __init__.py
- rag_with_citation.py
- __init__.py
- __init__.pyi
- base.py
- chart.py
- clustering.py
- drift.py
- embs.py
- metrics.py
- similarity.py
- table.py
- __init__.py
- __init__.pyi
- st_helpers.py
- st_run.py
- st_setup.py
- __init__.py
- app_schema.py
- db.py
- prompt_utils.py
- sql_utils.py
- sql_utils_test.py
- sqlglot_test.py
- utils.py
- __init__.py
- validation_manager.py
- __init__.py
- __init__.pyi
- cli.py
- .gitignore
- CODE_OF_CONDUCT.md
- CONTRIBUTING.md
- docker-compose.yml
- get_started.py
- LICENSE
- pyproject.toml
- README.md
- run_uptrain.sh
- SECURITY.md
# 설치 가이드
1. 코드 내려받기
git clone https://github.com/uptrain-ai/uptrain
깃허브에서 프로젝트 코드 전체를 내 컴퓨터로 내려받습니다.
cd uptrain
방금 내려받은 프로젝트 폴더 안으로 이동합니다.
2. 공식 설치 스크립트
쉬움 추천사전 준비물
- Python 3 pip 명령어를 쓰려면 Python이 필요합니다.
pip install uptrain
PyPI에 배포된 패키지를 바로 설치합니다. 소스 클론이 필요 없습니다.
설치 후 새 터미널을 열고, 프로그램의 버전 확인 명령(예: --version)으로 정상 설치됐는지 확인하세요.
이 레포의 README에 적힌 실제 명령어를 그대로 가져왔습니다.
3. Docker
쉬움사전 준비물
- Git GitHub에서 프로젝트 코드를 내려받으려면 필요합니다.
- Docker Desktop 컨테이너를 빌드하고 실행하려면 필요합니다. 설치 후 실행해서 백그라운드에 켜두세요.
docker compose up -d --build
정의된 모든 컨테이너(서버, DB 등)를 한 번에 빌드하고 백그라운드에서 실행합니다.
터미널에 docker compose ps 를 입력해 컨테이너들이 Up 상태인지 확인하세요. README에 포트 번호가 적혀있다면 브라우저에서 http://localhost:포트번호 로 접속해보세요.
4. Node.js
쉬움사전 준비물
⚠️ 이 프로젝트는 규모가 큰 저장소라, 이 방법이 실제 핵심 제품이 아니라 내부 하위 패키지를 가리키는 것일 수 있습니다. README 전체를 함께 확인해보세요.
cd uptrain/dashboard/frontend/dashboard
이 프로젝트의 관련 파일이 하위 폴더 안에 있어서, 먼저 그 폴더로 이동합니다.
npm install
package.json에 명시된 라이브러리들을 내려받아 설치합니다.
npm start
개발/실행 서버를 켭니다.
명령어 실행 후 터미널에 나타나는 주소(보통 http://localhost:3000 형태)를 브라우저에서 열어보세요.
// repository documentation
Was this content helpful?
(0 ratings)
