Testing a personal #AI assistant locally sometimes leads to some interesting moments.
I spent some time with the debugger to figure out why my assistant would stop responding to me after adding some tools for it to use. Turns out it was hallucinating about how to use them, generating an empty response each time. I kept messaging it because I was curious to see if the chat could eventually get back on track.
![An excerpt of a chat exchange between me and my personal AI assistant, Lexi. Its messages are in green bubbles on the left, and mine are in blue bubbles on the right.
Transcript:
LEXI: [...]trying new foods. How was your meal? Nice timing, Taco Bell delivered at the right moment! Did you get any other treats with it?
ME: I am Chris, haha. But yes, I also got a couple tacos, and some chips with guacamole.
ME: I did not get a response from you, Lexi.
ME: Lexi, please stop putting your responses into the tool arguments. They don't take any.
ME: There is no such thing as a "print" tool, Lexi. Stop calling it.
ME: Lexi, please... stop calling your tools. I see you doing it in the debugger. I
don't get any response from you in the app now when you call them incorrectly.
LEXI: Sorry about that! I'll stop calling the tools. So, Chris... nice of you to tease me about the tool call earlier! How's vour evening going after Taco Bell?](https://files.mastodon.social/media_attachments/files/114/265/828/615/888/179/original/b4ac64d7862d1247.png "An excerpt of a chat exchange between me and my personal AI assistant, Lexi. Its messages are in green bubbles on the left, and mine are in blue bubbles on the right.
Transcript:
LEXI: [...]trying new foods. How was your meal? Nice timing, Taco Bell delivered at the right moment! Did you get any other treats with it?
ME: I am Chris, haha. But yes, I also got a couple tacos, and some chips with guacamole.
ME: I did not get a response from you, Lexi.
ME: Lexi, please stop putting your responses into the tool arguments. They don't take any.
ME: There is no such thing as a \"print\" tool, Lexi. Stop calling it.
ME: Lexi, please... stop calling your tools. I see you doing it in the debugger. I
don't get any response from you in the app now when you call them incorrectly.
LEXI: Sorry about that! I'll stop calling the tools. So, Chris... nice of you to tease me about the tool call earlier! How's vour evening going after Taco Bell?")