v1.5.0
What's Changed
- Added JsonEval by @vivek-athina in #65
- Added reason to JsonEval validations by @vivek-athina in #67
- Add retrieval nodes by @akshat-g in #62
- Fix/json eval text validation reason by @vivek-athina in #68
- remove supported models check by @akshat-g in #69
- Added support to pass dataset id in run eval suite flow by @vivek-athina in #70
- Fix/add conversation coherence eval by @akshat-g in #71
- fix logger issues by @akshat-g in #72
- add chat history to faifulness by @akshat-g in #73
- Added code execution and jsonpath extract steps by @vivek-athina in #74
- Custom code eval by @vivek-athina in #75
- JsonEval split into two evals by @vivek-athina in #76
- Minor fixes in import by @vivek-athina in #77
- Improved custom code handling by @vivek-athina in #79
- Fix ragas aspect critque metrics by @akshat-g in #78
- Added re package support in custom code. Bumped version by @vivek-athina in #81
- bump json schema version by @akshat-g in #83
- Fix/litellm version specified by @vivek-athina in #84
- Version fixes by @vivek-athina in #85
- non boolean custom evals by @akshat-g in #82
- fix ragas aspect critique issues ATH-1641 by @akshat-g in #86
- Minor fix for error message in JSONSchema Eval by @vivek-athina in #87
- Tools support in evals by @vivek-athina in #88
- Error handling in dynamic columns by @vivek-athina in #89
Full Changelog: v1.4.3...v1.5.0