Comparing Web Browsing Behaviors with High and Low Information Literacy: A Case Study for Fact Check Against GPT Generated Fake News

Generative AI has introduced significant concerns about how people interact with information in society, particularly regarding the potential harm caused by fake news. To address this issue, it is critical to understand how people perceive fake news and how their information literacy can be improved. Our research tackles two key questions: "Can we estimate the level of information literacy from participants' web browsing behavior?", and "What characteristics can be observed when comparing participants with high and low information literacy?". We recruited 20 university students to read and evaluate the veracity of generated news. During this process, participants used web searches to verify the news, with their browsing logs collected using the open-source browser extension TrackThink Camera. The study achieved a 73.8% accuracy in estimating participants' ability to detect fake news based on their web browsing behavior. Notably, we observed that web search time ratio is higher, the number of searches are more, and the average scrolling speed is faster for high information literacy participants.