ChatGPT as a tutor?—between supporting students and giving away all the answers

Editor's Note: The authors share their experience in creating a customized LLM-based chatbot that provided a sufficient level of assistance that students were willing to use it when solving homework problems. They found that students wanted more direct assistance than they received from the initial Socratic-style chatbot and would instead choose to get the full answer directly from an LLM. However, when they adjusted the prompt so that the LLM told the students how to get started without fully solving the problem, they found higher levels of student buy-in.