Toward Collaborative AI: A Framework for the Transition from Autonomous Agents to Adaptive Human-AI Partners

Agentic AI systems that reason, plan, and act on complex goals have advanced rapidly across software engineering, scientific discovery, drug development, healthcare, finance, and social simulation. Across these domains a single failure pattern recurs: current systems can execute tasks competently but often struggle to determine when to act, when to pause, when to change strategy, and when to involve a human. Existing reviews catalog agentic architectures, taxonomies, and limitations, but none specify what capabilities these systems must acquire to support dynamic human-AI collaboration. We address that gap. We define collaborative AI as a class of systems that combine generative exploration with autonomous action and calibrate between them based on context, uncertainty, and task demands. We identify four required capabilities: metacognition, contextual mode-switching, uncertainty-aware action, and adaptive human collaboration. We relate these capabilities to established multi-agent systems foundations, including belief-desire-intention architectures, adjustable autonomy, mixed-initiative interaction, and decentralized decision-theoretic control, while specifying the distinct challenges that LLM-based agents introduce. Across the six domains reviewed here, these gaps appear repeatedly and are not solved by current architectures, which positions collaborative AI as a concrete near-term research objective.