Perception to Cognition: Patent Value Assessment Based on Large Language Model Semantic Enhancement and Ensemble Learning

Abstract Purpose To address the limitations of traditional patent metrics in capturing technical substance and the high cost of expert review, this study proposes a hybrid evaluation framework integrating Large Language Models (LLMs) with machine learning to achieve automated, highly accurate identification of high-value patents. Design/methodology/approach Adopting a “Virtual Assessor” paradigm, we constructed a dataset based on the China Patent Gold Awards. The study integrated semantic scores from three diverse LLMs (DeepSeek, Qwen, GLM) under zero-shot and few-shot prompt strategies into a Stacking ensemble learning model (combining XGBoost, Random Forest, and SVM) to predict patent value across nine comparative experimental setups. Findings Direct LLM evaluation revealed a “Knowledge Injection Paradox,” where explicit expert prior knowledge caused negative transfer and reduced accuracy due to over-conditioning. However, the Stacking model successfully rectified these biases, transforming subjective LLM evaluations into robust predictive features. The hybrid model achieved over 97 % accuracy in identifying high-value patents, demonstrating strong robustness even in high-noise environments. Research limitations The study relies on a binary classification of extreme samples (Gold Award vs. non-awarded), potentially oversimplifying the continuous distribution of patent value. Furthermore, the interpretability of the “black box” feature fusion mechanism requires further exploration. Practical implications The proposed framework offers IP managers and policymakers a scalable, cost-effective tool for automated patent screening, effectively bridging the gap between qualitative expert intuition and quantitative data precision. Originality/value This research introduces a “Semantic Enhancement + Algorithmic Rectification” paradigm. It empirically demonstrates how machine learning can correct LLM hallucinations and biases, marking a significant shift from data-driven perception to AI-driven cognitive decision-making in patent valuation.

Authors

Institutions

Publication Details

Journal
Journal of Data and Information Science
Published
2026-05-27
DOI
https://doi.org/10.1515/jdis-2025-0455
Primary Topic
Intellectual Property and Patents
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Perception to Cognition: Patent Value Assessment Based on Large Language Model Semantic Enhancement and Ensemble Learning

Xiaoting Chen, Chongjun Xi, Dongmei Ye
Journal of Data and Information Science
Intellectual Property and Patents
article

Perception to Cognition: Patent Value Assessment Based on Large Language Model Semantic Enhancement and Ensemble Learning

Xiaoting Chen, Chongjun Xi, Dongmei Ye
article en

Abstract

Abstract Purpose To address the limitations of traditional patent metrics in capturing technical substance and the high cost of expert review, this study proposes a hybrid evaluation framework integrating Large Language Models (LLMs) with machine learning to achieve automated, highly accurate identification of high-value patents. Design/methodology/approach Adopting a “Virtual Assessor” paradigm, we constructed a dataset based on the China Patent Gold Awards. The study integrated semantic scores from three diverse LLMs (DeepSeek, Qwen, GLM) under zero-shot and few-shot prompt strategies into a Stacking ensemble learning model (combining XGBoost, Random Forest, and SVM) to predict patent value across nine comparative experimental setups. Findings Direct LLM evaluation revealed a “Knowledge Injection Paradox,” where explicit expert prior knowledge caused negative transfer and reduced accuracy due to over-conditioning. However, the Stacking model successfully rectified these biases, transforming subjective LLM evaluations into robust predictive features. The hybrid model achieved over 97 % accuracy in identifying high-value patents, demonstrating strong robustness even in high-noise environments. Research limitations The study relies on a binary classification of extreme samples (Gold Award vs. non-awarded), potentially oversimplifying the continuous distribution of patent value. Furthermore, the interpretability of the “black box” feature fusion mechanism requires further exploration. Practical implications The proposed framework offers IP managers and policymakers a scalable, cost-effective tool for automated patent screening, effectively bridging the gap between qualitative expert intuition and quantitative data precision. Originality/value This research introduces a “Semantic Enhancement + Algorithmic Rectification” paradigm. It empirically demonstrates how machine learning can correct LLM hallucinations and biases, marking a significant shift from data-driven perception to AI-driven cognitive decision-making in patent valuation.

Journal of Data and Information Science
Centre National de la Recherche Scientifique (FR), Wuhan University (CN), Sorbonne Université (FR), Groupe d'Étude des Méthodes de l'Analyse Sociologique de la Sorbonne (FR), National Science Library (CN), University of Chinese Academy of Sciences (CN), Renmin University of China (CN)
Peace, Justice and strong institutions
Openalex Percentile: Top 4%
Intellectual Property and Patents
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.