Comparative Study of Digital Sibling Video AI Platform

Portrait animation is a hyper-realistic video synthesis that produces talking human video with the use of a static image and driving audio. Portrait animation technology can be implemented as a visualization for Digital Sibling AI, an AI-based platform that may replicate someone as a digital representation that’s able to communicate like an actual human being. Having realistic portrait animation is important to enhance the level of immersive on digital sibling, hence some criteria need to be identified to grade a "good" portrait animation generator. Then, this portrait animation generator will be applied as an integration design to the digital sibling platform. This research defines criterias for basic provisions, credibility, performance, and visualization as the main criteria that will decide the feasibility of a portrait animation model as a digital representation visualization. Based on the testing conducted as well as the analysis using Multi-Criteria Decision Making (MCDM), it is found that the SadTalker model is the best portrait animation model in accordance to the defined criteria. After that, the model will be developed into an API and deployed as a container using Azure Container Apps services. The model will be inferenced via API request, where the API will return a url containing the portrait animation video output. Last but not least, this research suggests the ideal VM specification with NVIDIA A100 GPU, 1 vCPU Core, and 7 GB memories.