Stable Random Sampling (SRS): A New Method to Refine Causal Masking in Decoder-Only Transformer

In current language modelling, the decoder-only Transformer architecture with causal masking has become a cornerstone, demonstrating exceptional performance across various tasks. However, we have identified two significant limitations: First, causal masking presents a substantial obstacle to further

Authors

Jiarui Li (ORCID: https://orcid.org/0000-0002-2358-0939)
Shuhao Zhang (ORCID: https://orcid.org/0000-0002-0301-5983)
Jiayi Yu (ORCID: https://orcid.org/0000-0002-4204-172X)

Publication Details

Published: 2025-01-01
DOI: https://doi.org/10.4108/eai.21-11-2024.2354592
Primary Topic: Ultrasonics and Acoustic Wave Propagation
Type: article
Field-Weighted Citation Impact: 0.00

Controls

|||

ALL TIME

JAN

FEB

MAR

APR

MAY

JUN

JUL

AUG

SEP

OCT

article

Stable Random Sampling (SRS): A New Method to Refine Causal Masking in Decoder-Only Transformer

Jiarui Li, Shuhao Zhang, Jiayi Yu

Jan 1, 2025

Ultrasonics and Acoustic Wave Propagation

article

Stable Random Sampling (SRS): A New Method to Refine Causal Masking in Decoder-Only Transformer

Jiarui Li, Shuhao Zhang, Jiayi Yu

January 1, 2025article en

Abstract

Openalex Percentile: Top 94%

Ultrasonics and Acoustic Wave Propagation

DOI Open Access PDF OpenAlex

AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Stable Random Sampling (SRS): A New Method to Refine Causal Masking in Decoder-Only Transformer — Jiarui Li, Shuhao Zhang, et al. · (2025) | TGRS Research Map | TGRS