Popular repositories

1. llm.c llm.c Public

   Forked from karpathy/llm.c

   LLM training in simple, raw C/CUDA

   Cuda

2. minbpe minbpe Public

   Forked from karpathy/minbpe

   Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

   Python

3. LoRA LoRA Public

   Forked from microsoft/LoRA

   Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

   Python

4. gptq gptq Public

   Forked from IST-DASLab/gptq

   Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".

   Python

5. flash-attention flash-attention Public

   Forked from Dao-AILab/flash-attention

   Fast and memory-efficient exact attention

   Python

6. xformers xformers Public

   Forked from facebookresearch/xformers

   Hackable and optimized Transformers building blocks, supporting a composable construction.

   Python