Skip to content

v7.2.2 - Mistral/Deepseek confab

Latest
Compare
Choose a tag to compare
@BBC-Esq BBC-Esq released this 01 Feb 18:49
· 35 commits to main since this release
3dd1bff

Release notes largely repeat the ones for v7.2.0 because this is a patch release...except for adding the new Mistral model.

Bug fixes

  • v7.2.1 - Thanks to @NQDM-paul-sinclair for pointing out the single flipping missing comma, which caused v7.2.0 installation to fail!

73e9ab8a38f818174d335edcf6686a01--grammar-jokes-teaching-grammar

  • v7.2.2 - Also fixed the new stella-400M embedding model

Deprecation Notices

  • The longstanding "instructor" embedding models have finally been superseded. They've been removed from the Models tab so you can no longer download them. Make sure to recreate any vector databases you've created with them because support will be removed in the next release.

Upgrade Instructions

For first time installation follow the github readme

INSTRUCTIONS FOR UPGRADING FROM A PRIOR VERSION

To upgrade from a prior version while still keeping your databases and models that were downloaded, perform the following steps:

  • In your directory that contains all of the files currently...delete the Include, Lib, Scripts folders. (pertain to your virtual environment)
  • Delete the pyvenv.cfg file. (pertains to your virtual environment)
  • At this point, any and all files pertaining to your virtual environment are gone.
  • Delete the Assets and CSS folders. (new ones will be provided in their entirety further below)
  • Extract all the files from the .zip file for this release v7.2.2 and go into the src folder.
  • Copy all files and folders EXCEPT THE CONFIG.YAML FILE into the aforementioned folder where you virtual environment USED TO BE. If there are any prompts indicating that files will be overwritten, CLICK YES since we're only updating necessary files now.
  • EXCEPT THE CONFIG.YAML FILE!
  • EXCEPT THE CONFIG.YAML FILE!
  • last time...EXCEPT THE CONFIG.YAML FILE!

Afterwards, open a command prompt and run the installation instructions on this repository's page, namely:

python -m venv .
.\Scripts\activate
python setup_windows.py

Embedding Models.

Change Details Notes
Added stella_en_400M_5 Superb lightweight model, arguably the best English-only small model.
Added Alibaba-gte-modernbert-base High context limit based on new "Modern Bert" architecture.

Chat Models

Change Details Notes
Added Deepseek R1 - 7b New introspective model.
Added Deepseek R1 - 14b New introspective model.
Added Deepseek R1 - 32b New introspective model.
Added Mistral Small 3 - 24b Outperforms 3x-sized models, plus permissive license.

Ask Jeeves!

image

  • Updated Jeeves knowledge.
  • Do not forget to set the proper permissions for the Kobold backend, as described in this repository's readme.

Metrics Bar

  • Added an "arc" option. Right-click to change the visualization.
  • In case you missed it, here are the current available options:

Bars

image

Sparkline

image

Speedometer

image

Arc (new)

image

Updated Dependencies

  • Too many to mention...