D3.3 Data infrastructure for metagenomic analysis

This document describes the hardware and software architecture of the specialized data infrastructure for metagenomics analysis, the integration of software processing and reporting tools, and the automatization of the data analysis. The work presented is part of WP3 and in particular Task 3.4: Data infrastructure The document describes the optimization, parallelization, and sequencing mechanisms implemented by the data infrastructure platform. This includes handling of data transactions and commitments when employing multiple databases, data consistency assurance by means of a transaction broker in charge of guaranteeing the consistency and interoperability of the data handled within the pipeline. The platform provides results visualization and interaction with the obtained data, notifies researchers about the status of their analyses, indicating which phase of the studies they are in, and alerts them to any issues that may arise during the pipeline processing. One of the analytical pipelines this infrastructure is designed to support is MeToReS (Metatranscriptomics Toward Ecosystem ResponseS), a Snakemakebased pipeline for soil metatranscriptomics specifically developed by WP3 MOBILES partners.