GPT Fine-tuning with node.js. Easy to use with scripts 🔥
This project use pnpm
as package manager.
pnpm i
- Create
.env
in the root to useOPENAI_API_KEY
env variable. - You can create your own API KEY in here.
- Create jsonl file in root.
data-preset.jsonl
- Check data format here.
pnpm upload
- Upload data to OpenAI.
- After uploading, a
fileId
is created and stored infile-id.js
.
pnpm tuning
![Screenshot 2024-04-06 at 4 12 25 PM](https://private-user-images.githubusercontent.com/29726020/320190443-793d74a8-abfd-4e69-a7a9-c0dfcce91ee4.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3Mzk1OTU0NzMsIm5iZiI6MTczOTU5NTE3MywicGF0aCI6Ii8yOTcyNjAyMC8zMjAxOTA0NDMtNzkzZDc0YTgtYWJmZC00ZTY5LWE3YTktYzBkZmNjZTkxZWU0LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjE1VDA0NTI1M1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWRmZjJmOTA4ZDIwM2NhMzUwYzU4MmJlOTM2NjQ1Y2I0MmY3ODhjYTM0OTczMzIxOTI1ZTM4ZWU1NDdhMGZkZWYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.EdAlVS7399ftTiz8ZUkx-N22YBqW_6QUwFuuULjw9fw)
- Fine-tuning starts based on the uploaded file.
- Also, you can check the progress on the OpenAI platform website, and easily access the website by clicking returned URL.
pnpm complete
![Screenshot 2024-04-06 at 4 17 21 PM](https://private-user-images.githubusercontent.com/29726020/320190458-e65b60b0-1ae5-4c03-b5c5-3b06f6e95908.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3Mzk1OTU0NzMsIm5iZiI6MTczOTU5NTE3MywicGF0aCI6Ii8yOTcyNjAyMC8zMjAxOTA0NTgtZTY1YjYwYjAtMWFlNS00YzAzLWI1YzUtM2IwNmY2ZTk1OTA4LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjE1VDA0NTI1M1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTBjMjIyN2ZlNTNhYzdjYjdkZjIyM2I5MmI1YmEwMDY5NGViZTg4MDE4MTQ0YTA2YTdiZGZjNjBhZjkwOGMyOWYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.Ou60bI5RA-iv6steE_xMmNjUOh-3b3pXCcGE7WMrehs)
- Finally, when fine-tuning is completed, the results will arrive at the email you logged in to gpt.
- Check ‘Output model’ in the URL and copy.
- Paste the 'Output model' in the
create-completion.js
model field. - Enter your questions in
content
field.
Check the results to see if your tuning was successful 😁.