Illusion of Thinking and ORCA

Overview

This talk reviews key claims around reasoning illusions and ORCA-related methods, including what appears as reasoning vs. what is robust capability gain.

Papers

1. The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity
2. Orca: Progressive Learning from Complex Explanation Traces of GPT-4

Slides

• Download PDF