Illusion of Thinking and ORCA
Overview
This talk reviews key claims around reasoning illusions and ORCA-related methods, including what appears as reasoning vs. what is robust capability gain.
Paper 1: The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity
Paper 2: Orca: Progressive Learning from Complex Explanation Traces of GPT-4