Contextual Fibration Attention

In a query-key-value attention model, the key-value pairing conveys language semantics. Query context also carries meaning. We introduce an abductive fibration attention model that holistically captures both. A fibration lifting, jointly learns from query context and language semantics (that abductively finds a key to best explain the returned value).

Authors

Publication Details

Journal
SPIRE - Sciences Po Institutional REpository
Published
2025-01-01
DOI
https://doi.org/10.13140/rg.2.2.12205.35044
Primary Topic
Color perception and design
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Contextual Fibration Attention

Gary Nan Tie
SPIRE - Sciences Po Institutional REpository
Color perception and design
article

Contextual Fibration Attention

Gary Nan Tie
article en

Abstract

In a query-key-value attention model, the key-value pairing conveys language semantics. Query context also carries meaning. We introduce an abductive fibration attention model that holistically captures both. A fibration lifting, jointly learns from query context and language semantics (that abductively finds a key to best explain the returned value).

SPIRE - Sciences Po Institutional REpository
Openalex Percentile: Top 70%
Color perception and design
DOIOpen Access PDFOpenAlex
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Contextual Fibration Attention — Gary Nan Tie · SPIRE - Sciences Po Institutional REpository (2025) | TGRS Research Map | TGRS