📒 Fine-tuning Notebooks

Below are our notebooks for Google Colab categorized by model. You can also view our Kaggle notebooks here.

Llama Notebooks

Model	Type	Colab Link
Llama3.1 (8B)	Alpaca	Open in Colab
TinyLlama (1.1B)	Alpaca	Open in Colab
Llama3 (8B)	Alpaca	Open in Colab
Llama3.2 (1B and 3B)	Conversational	Open in Colab
Llama3 (8B)	ORPO	Open in Colab
Llama3 (8B)	CSV	Open in Colab
Llama3.1 (8B)	Inference	Open in Colab
Llama3.2 (11B)	Vision	Open in Colab

Phi Notebooks

Model	Type	Colab Link
Phi 3 Medium	Conversational	Open in Colab
Phi 3.5 Mini	Conversational	Open in Colab

Mistral Notebooks

Model	Type	Colab Link
Mistral v0.3 (7B)	Alpaca	Open in Colab
Mistral Small (22B)	Alpaca	Open in Colab
Mistral Nemo (12B)	Alpaca	Open in Colab
Mistral v0.3 (7B)	Conversational	Open in Colab
Mistral v0.3 (7B)	CPT	Open in Colab
Mistral (7B)	Text Completion	Open in Colab
Pixtral (12B)	Vision	Open in Colab

Qwen Notebooks

Model	Type	Colab Link
Qwen2.5 (7B)	Alpaca	Open in Colab
Qwen2 (7B)	Alpaca	Open in Colab
Qwen2.5 Coder (14B)	Conversational	Open in Colab
Qwen2 VL (7B)	Vision	Open in Colab

Gemma Notebooks

Model	Type	Colab Link
Gemma2 (2B)	Alpaca	Open in Colab
Gemma2 (9B)	Alpaca	Open in Colab
CodeGemma (7B)	Conversational	Open in Colab

Other notebooks Notebooks

Model	Type	Colab Link
Zephyr (7B)	DPO	Open in Colab
Unsloth Studio	Unsloth Studio	Open in Colab

📒 Kaggle Notebooks

Click for all our Kaggle notebooks categorized by model:

Llama Notebooks

Model	Type	Kaggle Link
TinyLlama (1.1B)	Alpaca	Open in Kaggle
Llama3.1 (8B)	Alpaca	Open in Kaggle
Llama3 (8B)	Alpaca	Open in Kaggle
Llama3.2 (1B and 3B)	Conversational	Open in Kaggle
Llama3 (8B)	ORPO	Open in Kaggle
Llama3 (8B)	CSV	Open in Kaggle
Llama3.1 (8B)	Inference	Open in Kaggle
Llama3.2 (11B)	Vision	Open in Kaggle

Phi Notebooks

Model	Type	Kaggle Link
Phi 3.5 Mini	Conversational	Open in Kaggle
Phi 3 Medium	Conversational	Open in Kaggle

Mistral Notebooks

Model	Type	Kaggle Link
Mistral Small (22B)	Alpaca	Open in Kaggle
Mistral Nemo (12B)	Alpaca	Open in Kaggle
Mistral v0.3 (7B)	Alpaca	Open in Kaggle
Mistral v0.3 (7B)	Conversational	Open in Kaggle
Mistral v0.3 (7B)	CPT	Open in Kaggle
Mistral (7B)	Text Completion	Open in Kaggle
Pixtral (12B)	Vision	Open in Kaggle

Qwen Notebooks

Model	Type	Kaggle Link
Qwen2 (7B)	Alpaca	Open in Kaggle
Qwen2.5 (7B)	Alpaca	Open in Kaggle
Qwen2.5 Coder (14B)	Conversational	Open in Kaggle
Qwen2 VL (7B)	Vision	Open in Kaggle

Gemma Notebooks

Model	Type	Kaggle Link
Gemma2 (2B)	Alpaca	Open in Kaggle
Gemma2 (9B)	Alpaca	Open in Kaggle
CodeGemma (7B)	Conversational	Open in Kaggle

Other notebooks Notebooks

Model	Type	Kaggle Link
Zephyr (7B)	DPO	Open in Kaggle
Unsloth Studio	Unsloth Studio	Open in Kaggle

✨ Contributing to Notebooks

⚠️ Important: This repository is a subtree of the main unsloth repository, specifically for notebooks. Please submit your pull requests to this notebooks repository (unslothai/notebooks) rather than the main unsloth repository. Changes in notebooks repository will be synchronized with the unsloth repository.

If you'd like to contribute to our notebooks, here's a guide to get you started:

1. Find the Template: We've provided a template notebook called Template_Notebook.ipynb in the root directory of this project. This template contains the basic structure and formatting guidelines for all notebooks in this collection.
2. Create Your Notebook:
   • Make a copy of Template_Notebook.ipynb.
   • Rename the copied file to follow this naming convention:
     • LLM Notebooks: <Model Name>-<Type>.ipynb (e.g., Mistral_v0.3_(7B)-Alpaca.ipynb)
     • Vision Notebooks: <Model Name>-Vision.ipynb (e.g., Llava_v1.6_(7B)-Vision.ipynb)
     • Example of <Type>: Alpaca, Conversational, CPT, DPO, ORPO, Text_Completion, CSV, Inference, Unsloth_Studio
3. Place in original_template: Once your notebook is ready, move it to the original_template directory.
4. Update Notebooks: Run the following command in your terminal:

   python update_all_notebooks.py

   This script will automatically:
   • Copy your notebook from original_template to the nb directory.
   • Update the notebook's internal sections (like Installation, News) to ensure consistency.
   • Add your notebook to the appropriate list in this README.md file.
5. Check Your Changes: Before submitting your changes, make sure to check that your notebook is correctly displayed in the README.md. After making sure that your notebook is correctly displayed, you can finalize it by calling :

python update_all_notebooks.py --to_main_repo

5. Create a Pull Request: After that, just create a pull request (PR) to merge your changes, making it available for everyone!
   • We appreciate your contributions and look forward to reviewing your notebooks!