Handwritten Data Extraction Using OpenAI ChatGPT4o and Robotic Process Automation

This paper proposes to create an Robotic Process Automation style application that can digitalize and extract data from handwritten medical forms. The RPA robot uses OpenAI ChatGPT4o model to extract handwritten medical data and transform it into typed data. The handwritten data is transcribed correctly at a rate of 100%. The data interpretation is accomplished by the UiPath machine learning API. By creating new nonstandard form templates and associated taxonomies the system can be scaled as desired. After the data extraction process the saved data can be sent to a database, spreadsheet. The access to this medical data is restricted to the physicians and medical nurses employed at the medical facility.