A Sparse Activation Architecture for Green Artificial Intelligence: The Energy Efficiency Optimization Language Model AliceSkyGardenT3 Framework Based on Ternary Parameters {-1,0,1}

This paper introduces AliceSkyGardenT3, a novel energy-efficient language model framework based on ternary parameters {-1, 0, 1}. The architecture implements a 1.58-bit quantization scheme for linear layers combined with Straight-Through Estimator (STE) gradients, achieving 85% weight sparsity while maintaining 97% of full-precision model accuracy. Our framework integrates compression and decompression functions that reduce model size by 6.3× compared to FP32 baselines, requiring only 2.1GB storage for a 7B parameter model. The ternary activation architecture enables energyefficient inference with theoretical 3.8× speedup on specialized hardware. Experiments demonstrate that the model preserves linguistic capabilities while reducing energy consumption by 42% during inference. The integrated compression API allows model deployment with just two commands: model.compress_model_weights() for storage and model.load_compressed_model() for inference. This work establishes a new paradigm for green AI that balances computational efficiency with environmental sustainability without compromising model performance.

Publication Details

Journal
Figshare
Published
2025-01-01
DOI
https://doi.org/10.6084/m9.figshare.29474453.v2
Primary Topic
Green IT and Sustainability
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Sparse Activation Architecture for Green Artificial Intelligence: The Energy Efficiency Optimization Language Model AliceSkyGardenT3 Framework Based on Ternary Parameters {-1,0,1}

Figshare
Green IT and Sustainability
article

A Sparse Activation Architecture for Green Artificial Intelligence: The Energy Efficiency Optimization Language Model AliceSkyGardenT3 Framework Based on Ternary Parameters {-1,0,1}

article en

Abstract

This paper introduces AliceSkyGardenT3, a novel energy-efficient language model framework based on ternary parameters {-1, 0, 1}. The architecture implements a 1.58-bit quantization scheme for linear layers combined with Straight-Through Estimator (STE) gradients, achieving 85% weight sparsity while maintaining 97% of full-precision model accuracy. Our framework integrates compression and decompression functions that reduce model size by 6.3× compared to FP32 baselines, requiring only 2.1GB storage for a 7B parameter model. The ternary activation architecture enables energyefficient inference with theoretical 3.8× speedup on specialized hardware. Experiments demonstrate that the model preserves linguistic capabilities while reducing energy consumption by 42% during inference. The integrated compression API allows model deployment with just two commands: model.compress_model_weights() for storage and model.load_compressed_model() for inference. This work establishes a new paradigm for green AI that balances computational efficiency with environmental sustainability without compromising model performance.

Figshare
Affordable and clean energy
Openalex Percentile: Top 54%
Green IT and Sustainability
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.