sinavideo - GitLite

KO | EN

gitlite — search

#ai-agents #artificial-intelligence #proxy #sql #data-science #nlp #android #react-native #csharp #windows

sinavideo

(★ 9)

sina legacy videos archive program (bilibili&acfun related) c2026-5

파일 탐색기

ZIP 다운로드

- - publish-image.yml
- - logging.go
  - logging_test.go
  - main.go
  - main_test.go
- - main.go
- - api.go
  - api_test.go
  - archive.go
  - cdn.go
  - dedupe_test.go
  - job.go
  - job_test.go
  - probe_test.go
  - warc_exchange.go
  - warc_exchange_test.go
- - worker.go
  - worker_test.go
- analyze_probe.py
- probe_sources.sh
- sample_vids.py
- vl.go
- vl_test.go
.dockerignore
.gitignore
Dockerfile
go.mod
go.sum
info.md
parser.py
README.md
sina_api.md

# CDN으로 사용하기

jsDelivr

jsDelivr는 공개 GitHub 리포지토리를 별도 설정 없이 CDN으로 즉시 서빙합니다. 버전과 파일을 고르면 웹페이지에 바로 붙일 수 있는 링크와 예시 코드가 만들어집니다.

버전

파일

링크

예시

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

https://wiki.saveweb.org/sinavideo

Project finished, Thank you!

<img width="2560" height="1312" alt="image" src="https://github.com/user-attachments/assets/1fc1e368-10fb-4264-a24f-4022ff04f6dc" />

```
jobs dispatched: 1,015,769
archived valid videos: 941,539
WARCs produced: 28.9TiB
```

## Setup instructions

1. Go to https://hq.saveweb.org/ to register.
2. Leave a message in our group so we can activate your account. (TG: https://t.me/saveweb_chat, IRC: stwp-chat:hackint.org, Matrix: #saveweb_chat:matrix.org)
3. Once your account is activated, create a machine token on the HQ.

4. (Optional but recommended) Use Watchtower to automatically update our containers:

```bash
sudo docker rm -f watchtower
sudo docker run -d \
  -v /var/run/docker.sock:/var/run/docker.sock  \
  -e 'WATCHTOWER_CLEANUP=true' \
  -e 'WATCHTOWER_POLL_INTERVAL=3600' \
  -e 'WATCHTOWER_INCLUDE_STOPPED=true' \
  -e 'WATCHTOWER_REVIVE_STOPPED=true' \
  -e 'WATCHTOWER_UPDATE_ON_START=true' \
  -e 'WATCHTOWER_LABEL_ENABLE=true'   \
  --label=com.centurylinklabs.watchtower.enable=true \
  --name watchtower --restart unless-stopped \
  dhm.saveweb.org/nickfedor/watchtower
```

5. Set `HQ_MACHINE_TOKEN`

```bash
curl -fsSL https://hq.saveweb.org/auth/machine-token.sh | bash # The HQ_MACHINE_TOKEN will be automatically set in the child bash process.
```
or if you do not like to run unknown script, you can set the environment variables yourself.

6. Run the warrior

```bash
if [[ -z "$HQ_MACHINE_TOKEN" ]]; then
    echo "WARN: HQ_MACHINE_TOKEN must be set"
    exit 1
fi

sudo docker rm -f saveweb_archivesinavideo
sudo docker run -d \
  --name saveweb_archivesinavideo \
  --restart unless-stopped \
  --stop-timeout 120 \
  --log-driver json-file \
  --log-opt max-size=50m \
  --label=com.centurylinklabs.watchtower.enable=true \
  -e HQ_MACHINE_TOKEN="$HQ_MACHINE_TOKEN" \
  git.saveweb.org/saveweb/sinavideo:latest
```

## Notes

- Use clean internet connections.
- Do not use proxies or VPNs.
- Unless otherwise specified, please run only one archive instance per machine; do not run multiple instances.
- A single `HQ_MACHINE_TOKEN` can be used for multiple machines.