Enhancing GigaDB: Leveraging Modern Software Technologies for Large-Scale Biological Data Management

GigaDB, a pivotal resource for large-scale biological datasets, has undergone significant advancements through the integration of contemporary software technologies. This presentation will elucidate the methodologies and tools employed to upgrade the GigaDB platform, emphasising improvements in data accessibility, security and performance.By adopting advanced containerization solutions like Docker, leveraging modern software approaches like CI/CD and IaC, GigaDB ensures a robust and scalable infrastructure. These technologies streamline the development process, enabling seamless updates and efficient management of extensive datasets. Furthermore, the implementation of automated testing frameworks guarantees data integrity and system reliability, crucial for maintaining the high standards expected by the scientific community.This poster/talk will provide an in-depth overview of the architectural enhancements, including the migration to a microservices-based design and the utilisation of state-of-the-art database management systems.Our objective is to demonstrate how these technological advancements facilitate more efficient data handling and foster greater collaboration within the scientific community. Ultimately, the upgraded GigaDB serves as a model for other large-scale biological databases, showcasing the benefits of integrating modern software technologies to enhance data management and accessibility, and more importantly to make a bioinformatics application more resilient.