stopes

(โ˜… 311)

A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB team.

File Explorer

Download Latest Version (.zip)
  • .gitignore
  • .pre-commit-config.yaml
  • CHANGELOG.md
  • CODE_OF_CONDUCT.md
  • CONTRIBUTING.md
  • LICENSE.md
  • package-lock.json
  • package.json
  • pyproject.toml
  • README.md

# Installation Guide

1. Get the code
git clone https://github.com/facebookresearch/stopes

Downloads the entire project code from GitHub to your computer.

cd stopes

Moves into the project folder you just downloaded.

2. Official Install Script

Easy Recommended
Prerequisites
  • Python 3 Python is required to use pip.
pip install fairseq==0.12.2

Installs the package published on PyPI directly โ€” no need to clone the source.

pip install -v --no-cache-dir --global-option="--cpp_ext" --global-option="--cuda_ext" \

Installs the package published on PyPI directly โ€” no need to clone the source.

โœ… After installing, open a new terminal and run the program's version command (e.g. --version) to confirm it worked.

Pulled directly from this repo's README.

3. Node.js

Easy
Prerequisites
  • Git Needed to download the project code from GitHub.
  • Node.js Node.js must be installed to use npm. The LTS version is recommended.
npm install

Downloads and installs the libraries listed in package.json.

npm start

Starts the development/run server.

โœ… After running the command, open the address shown in the terminal (usually something like http://localhost:3000) in your browser.

4. Python

Easy
Prerequisites
  • Git Needed to download the project code from GitHub.
  • Python 3 On Windows, be sure to check 'Add Python to PATH' during installation.
pip install fairseq==0.12.2

Installs the package published on PyPI directly โ€” no need to clone the source.

pip install -e '.[dev,mono,mining]'

Installs the Python libraries listed in requirements.txt (or similar).

pip install -v --no-cache-dir --global-option="--cpp_ext" --global-option="--cuda_ext" \

Installs the package published on PyPI directly โ€” no need to clone the source.

โœ… If it runs without errors and prints output in the terminal, it worked.

Pulled directly from this repo's README.

Today's picks

rtk โ˜… 76,925

CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust

Rust
moby โ˜… 71,991

The Moby Project - a collaborative project for the container ecosystem to assemble contain

Go
gpt4all โ˜… 77,396

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

C++
mall โ˜… 84,558

mall้กน็›ฎๆ˜ฏไธ€ๅฅ—็”ตๅ•†็ณป็ปŸ๏ผŒๅŒ…ๆ‹ฌๅ‰ๅฐๅ•†ๅŸŽ็ณป็ปŸๅŠๅŽๅฐ็ฎก็†็ณป็ปŸ๏ผŒๅŸบไบŽSpring Boot+MyBatisๅฎž็Žฐ๏ผŒ้‡‡็”จDockerๅฎนๅ™จๅŒ–้ƒจ็ฝฒใ€‚ ๅ‰ๅฐๅ•†ๅŸŽ็ณป็ปŸๅŒ…ๅซ้ฆ–้กต้—จๆˆทใ€ๅ•†ๅ“ๆŽจ่ใ€ๅ•†ๅ“ๆœ

Java
syncthing โ˜… 87,847

Open Source Continuous File Synchronization

Go
app-ideas โ˜… 96,976

A Collection of application ideas which can be used to improve your coding skills.
// repository documentation