ml_from_scratch

KO | EN

gitlite — search

#python #hacktoberfest #react #llm #go #android #linux #nodejs #java #windows #kubernetes #security #pytorch #ios

ml_from_scratch

(★ 9)

Repository of latest machine learning algorithms including large language models and generative AI, implemented from scratch in PyTorch

ml_from_scratch Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# ML From Scratch

Repository of latest machine learning algorithms in the fields of large language models,
and diffusion models, all implemented from scratch in PyTorch. Hence it serves as an excellent reference
for students, ML engineers and ML practitioners alike. This repository is inspired by the
[minGPT series](https://github.com/karpathy/minGPT), and adds on top by following industry best practices
like clean and well documented code, modular and well tested components, following standard PyTorch APIs
like Datasets and DataLoaders. The repository also aims to expand beyond pretraining, and include other algorithms too
like LoRA finetuning, distillation and RLHF alignment.

## Algorithms implemented in this repository

### Large Language Models
1. [Pretraining of GPT models](https://arxiv.org/abs/2005.14165).
2. [Finetuning of GPT models using LoRA](https://arxiv.org/abs/2106.09685).

### Diffusion Models
1. [Latent diffusion models](https://arxiv.org/abs/2112.10752).

## Disclaimer

THE SOFTWARE IS PROVIDED “AS IS”, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

The views and opinions of authors expressed herein do not necessarily state or reflect those of their employers or any agency thereof.

ml_from_scratch

ml_from_scratch Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

ml_from_scratch

ml_from_scratch Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README