DaoEval v0.1 — An Open Evaluation Framework for Taoist-Knowledge LLMs

DaoEval is the first open evaluation framework specifically targeted at Daoist-knowledge large language models. v0.1 includes: 10-chapter whitepaper (full text), 500-sample JSONL schema with sample examples, ABCD confidence grading, base-text and ID conventions, and a three-model cross-validation annotation protocol. Existing evaluation suites (MMLU, CMMLU, C-Eval) cover Daoism very thinly and only via multiple-choice questions. DaoEval is the first structured open framework covering scripture provenance, cross-sect interpretation, and ritual fidelity — three dimensions essential for any serious humanities application of LLMs in Chinese religious studies. This deposit serves as the first formal citable archive of the DaoEval framework, complementing the GitHub repository at lius-cc/lius-cookbook and the live whitepaper at https://lius.cc/llm/whitepaper. License: CC0 1.0 Universal (public domain dedication). Project home: https://lius.cc/llm Whitepaper: https://lius.cc/llm/whitepaper Cookbook: https://github.com/lius-cc/lius-cookbook