One paper got accepted in AAAI 2025.
We introduce causal epistemic consistency to evaluate LLMs’ self-consistency in causal reasoning, revealing significant challenges and proposing metrics and internal token probability improvements.
We introduce causal epistemic consistency to evaluate LLMs’ self-consistency in causal reasoning, revealing significant challenges and proposing metrics and internal token probability improvements.