Apr 13, 2023 19:00:00

What happens when a group chat between best friends is reproduced entirely with AI?

Interactive AI has made remarkable progress in recent years, and services that allow users to enjoy simulated friendships and romantic relationships with interactive AI have already appeared. Meanwhile,

Izzy Miller , an American software developer, worked on a project to reproduce the whole 'group chat between best friends' with AI, and reported on the process and results.

Replacing my best friends with an LLM trained on 500,000 group chat messages
https://www.izzy.co/blogs/robo-boys.html

Miller shares an iMessage group chat with five of his best friends from college and has been actively exchanging messages for the past seven years. One day in March 2023, Miller started playing around with reproducing group chat with a large-scale language model.

In creating the language model this time, Miller decided not to create a model for each of his five best friends, but to create one model that mimics the conversation of the entire group chat. Miller explained that he felt it was easier and cheaper to capture the essence of group chat context.

A total of 488,000 active messages can be extracted from group chats. To train a language model on these messages, Miller had to categorize who said each message and split the messages into sections of a series of conversations.

Mr. Miller created a project to extract and fine-tune messages from iMessage with Hex, a data analysis service, and converted the messages into a format suitable for language model training. The Hex project created by Mr. Miller is open to the public and can be used by anyone, but from a security perspective, Mr. Miller recommends working by copying it locally instead of on the platform.

And Mr. Miller created a language model that mimics group chat using the model 'Alpaca', which Stanford University fine-tuned the 7B model of Meta's large-scale language model 'LLaMA '. They rented four NVIDIA A100s for training, and used Modal to deploy their models, which allows them to deploy local code to the cloud without managing infrastructure or configurations.

Stanford University has released a model 'Alpaca 7B' that can build a chat AI comparable to GPT-3.5, and it can be reproduced inexpensively with open source - GIGAZINE

Below is the conversation reproduced by the model ' robo boys ' that actually imitates group chat. We're having silly conversations about the American Bill of Rights in a rough, friendly tone.

Mr. Miller tried to show 'robo boys' to his friends, but he said that simply pasting a screenshot like the one above was not enough. So Miller decided to build an interface that mimics a real iMessage group chat.

There have been plans to use services such as

Twilio to actually create iMessage group chats, but this was very complicated and expensive. So Miller tweaked the `` clone of iMessage '' on GitHub and created his own clone of iMessage . In addition, the clone created by Mr. Miller was created in just 45 minutes without thinking about future development work, etc., and it seems that its quality cannot be guaranteed.

The group chat of 'robo boys' actually created by Mr. Miller is below.

You can also post messages yourself.

In response to the question 'Who of our friends you think is actually an extraterrestrial in disguise?', One of my friends said, 'I think Wyatt may have been an alien in a past life (Wyatt may have been an alien in his previous life)'. To which another friend responded, 'I think that's strong take. I've had that thought before.' (It looks a bit like

a gray alien ),” and the ridiculous conversation between friends was reproduced.

Originally, Mr. Miller was considering creating an embedded database to improve the recall of his friends, but the learned group chat messages contained a huge amount of information about his friends, so he modified it. Said it wasn't necessary. In the screenshot below, the 'robo boys' are having a conversation about a past episode that only friends know about, 'Who drank Henry's beer?'

Mr. Miller believes that the meaningless and complex project of ``recreating a group chat between friends with AI'' is a perfect subject for understanding AI. 'It's a great entry point into AI, and a way to get up close and personal with a technology that's terrifyingly big and devastating for everyone,' said Miller.