sinavideo

KO | EN

gitlite — search

#cross-platform #graphql #claude-code #large-language-models #data-science #video #tailwindcss #mysql #gpt #developer-tools

(★ 9)

sina legacy videos archive program (bilibili&acfun related) c2026-5

File Explorer

ZIP Download

- - publish-image.yml
- - logging.go
  - logging_test.go
  - main.go
  - main_test.go
- - main.go
- - api.go
  - api_test.go
  - archive.go
  - cdn.go
  - dedupe_test.go
  - job.go
  - job_test.go
  - probe_test.go
  - warc_exchange.go
  - warc_exchange_test.go
- - worker.go
  - worker_test.go
- analyze_probe.py
- probe_sources.sh
- sample_vids.py
- vl.go
- vl_test.go
.dockerignore
.gitignore
Dockerfile
go.mod
go.sum
info.md
parser.py
README.md
sina_api.md

# Use via CDN

jsDelivr

jsDelivr serves any public GitHub repository as a CDN with zero setup. Pick a version and a file to get a ready-to-paste link and snippet.

Version

File

Link

Example

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

https://wiki.saveweb.org/sinavideo

Project finished, Thank you!

```
jobs dispatched: 1,015,769
archived valid videos: 941,539
WARCs produced: 28.9TiB
```

## Setup instructions

1. Go to https://hq.saveweb.org/ to register.
2. Leave a message in our group so we can activate your account. (TG: https://t.me/saveweb_chat, IRC: stwp-chat:hackint.org, Matrix: #saveweb_chat:matrix.org)
3. Once your account is activated, create a machine token on the HQ.

4. (Optional but recommended) Use Watchtower to automatically update our containers:

```bash
sudo docker rm -f watchtower
sudo docker run -d \
  -v /var/run/docker.sock:/var/run/docker.sock  \
  -e 'WATCHTOWER_CLEANUP=true' \
  -e 'WATCHTOWER_POLL_INTERVAL=3600' \
  -e 'WATCHTOWER_INCLUDE_STOPPED=true' \
  -e 'WATCHTOWER_REVIVE_STOPPED=true' \
  -e 'WATCHTOWER_UPDATE_ON_START=true' \
  -e 'WATCHTOWER_LABEL_ENABLE=true'   \
  --label=com.centurylinklabs.watchtower.enable=true \
  --name watchtower --restart unless-stopped \
  dhm.saveweb.org/nickfedor/watchtower
```

5. Set `HQ_MACHINE_TOKEN`

```bash
curl -fsSL https://hq.saveweb.org/auth/machine-token.sh | bash # The HQ_MACHINE_TOKEN will be automatically set in the child bash process.
```
or if you do not like to run unknown script, you can set the environment variables yourself.

6. Run the warrior

```bash
if [[ -z "$HQ_MACHINE_TOKEN" ]]; then
    echo "WARN: HQ_MACHINE_TOKEN must be set"
    exit 1
fi

sudo docker rm -f saveweb_archivesinavideo
sudo docker run -d \
  --name saveweb_archivesinavideo \
  --restart unless-stopped \
  --stop-timeout 120 \
  --log-driver json-file \
  --log-opt max-size=50m \
  --label=com.centurylinklabs.watchtower.enable=true \
  -e HQ_MACHINE_TOKEN="$HQ_MACHINE_TOKEN" \
  git.saveweb.org/saveweb/sinavideo:latest
```

## Notes

- Use clean internet connections.
- Do not use proxies or VPNs.
- Unless otherwise specified, please run only one archive instance per machine; do not run multiple instances.
- A single `HQ_MACHINE_TOKEN` can be used for multiple machines.

sinavideo

Owner Repos

File Explorer

# Use via CDN

Was this content helpful?

Recent Feedback

sinavideo

Owner Repos

File Explorer

# Use via CDN

Was this content helpful?

Recent Feedback

Download README