Powering Oceans 3.0: the Low Latency Computing Environment Developed by Ocean Networks Canada

Ocean Networks Canada (ONC) operates a comprehensive suite of ocean observatories that continuously stream vast quantities of oceanographic, physical, and biochemical data. A critical component of this system is the need for low-latency computing, particularly when using MATLAB for processing. Traditional approaches proved inadequate for the required low-latency applications. To address this, ONC introduced “MATLAB-as-a-service,” an in-house solution to eliminate MATLAB startup latency by maintaining a pool of running MATLAB instances. MATLAB-as-a-service integrates with ONC's Oceans 3.0, significantly enhancing the responsiveness of data processing tasks, such as automated testing, which is now completed in three hours instead of eight. This paper outlines the key architecture, components, and operational benefits of MATLAB-as-a-service, demonstrating its effectiveness in overcoming latency challenges when using MATLAB for processing.

Authors

Institutions

Publication Details

Published
2024-09-23
DOI
https://doi.org/10.1109/oceans55160.2024.10754074
Primary Topic
Advanced Computational Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Powering Oceans 3.0: the Low Latency Computing Environment Developed by Ocean Networks Canada

B. Biffard, Kristen Meyer
Advanced Computational Techniques and Applications
article

Powering Oceans 3.0: the Low Latency Computing Environment Developed by Ocean Networks Canada

B. Biffard, Kristen Meyer
article en

Abstract

Ocean Networks Canada (ONC) operates a comprehensive suite of ocean observatories that continuously stream vast quantities of oceanographic, physical, and biochemical data. A critical component of this system is the need for low-latency computing, particularly when using MATLAB for processing. Traditional approaches proved inadequate for the required low-latency applications. To address this, ONC introduced “MATLAB-as-a-service,” an in-house solution to eliminate MATLAB startup latency by maintaining a pool of running MATLAB instances. MATLAB-as-a-service integrates with ONC's Oceans 3.0, significantly enhancing the responsiveness of data processing tasks, such as automated testing, which is now completed in three hours instead of eight. This paper outlines the key architecture, components, and operational benefits of MATLAB-as-a-service, demonstrating its effectiveness in overcoming latency challenges when using MATLAB for processing.

University of Victoria (CA), Ocean Networks Canada Society (CA)
Life below water
Openalex Percentile: Top 81%
Advanced Computational Techniques and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.