A port of 'Inspect', a widely adopted 'Python' framework for large language model evaluation. Specifically aimed at 'ellmer' users who want to measure the effectiveness of their large language model-based products, the package supports prompt engineering, tool usage, multi-turn dialog, and model graded evaluations.
| Version: | 0.2.0 |
| Depends: | R (≥ 4.1) |
| Imports: | cli,dplyr,ellmer (≥ 0.4.0),glue,httpuv,httr2,jsonlite,purrr,R6,rlang,S7,tibble,tidyr,withr |
| Suggests: | ggplot2,here,htmltools,knitr,magick,ordinal,rmarkdown,testthat (≥ 3.0.0),vcr (≥ 2.0.0) |
| Published: | 2025-12-01 |
| DOI: | 10.32614/CRAN.package.vitals |
| Author: | Simon Couch [aut, cre], Max Kuhn [ctb], Hadley Wickham [ctb], Mine Cetinkaya-Rundel [ctb], Posit Software, PBC [cph, fnd] |
| Maintainer: | Simon Couch <simon.couch at posit.co> |
| BugReports: | https://github.com/tidyverse/vitals/issues |
| License: | MIT + fileLICENSE |
| URL: | https://github.com/tidyverse/vitals,https://vitals.tidyverse.org |
| NeedsCompilation: | no |
| Materials: | README,NEWS |
| CRAN checks: | vitals results |