fmeval is a library to evaluate Large Language Models (LLMs) in order to help select the best LLM for your use case. The library evaluates LLMs for the following tasks: Open-ended generation - The ...

Preprocessor and Translation logic is sourced from external packages, which I also designed, see Kairyou and EasyTL for more information. Windows is assumed for the rest of this README, but the ...