GPT Experiments

This repository contains various experiments and prototypes to get use to working with GPT-like models and being creative with them.

Overview

Experiments in notebooks

1. Simple Text Generation with GPT-Neo using Huggingface: Loading GPT-Neo and doing some basic text generation. Here I just followed this tutorial to get an understanding of how to use EleutherAI's GPT models with Huggingface and test different prompts to get a feel for the model's capabilities.
2. Fine Tuning GPT-2 with HuggingFace: Fine-tuning GPT-2 with Elon Musk tweets.
3. GPT fine-tuned on AI Safety resources.