Popular repositories Loading

1. confabulations confabulations Public

   Hallucinations (Confabulations) Document-Based Benchmark for RAG

   HTML 65 2

2. writing writing Public

   This benchmark tests how well LLMs incorporate a set of 10 mandatory story elements (characters, objects, core concepts, attributes, motivations, etc.) in a short creative story

   32 1

3. divergent divergent Public

   LLM Divergent Thinking Creativity Benchmark. LLMs generate 25 unique words that start with a given letter with no connections to each other or to 50 initial random words.

   24

4. deception deception Public

   Benchmark evaluating LLMs on their ability to create and resist disinformation. Includes comprehensive testing across major models (Claude, GPT-4, Gemini, Llama, etc.) with standardized evaluation …

   15 1

5. generalization generalization Public

   Thematic Generalization Benchmark: measures how effectively various LLMs can infer a narrow or specific "theme" (category/rule) from a small set of examples and anti-examples, then detect which ite…

   15

6. ChessCounter ChessCounter Public

   Estimate the number of legal chess positions

   C++ 11