I decided to test DS's ability to act as a DM. I have a small campaign that I had an outline for.
First, I ran the outline through DS and had it create a campaign out of my outline.
I next uploaded the outline and had DS run as DM. I played 2 characters. DS added a ton of flavor in there. Names, some general backgrounds and attitudes, names of places, etc.
The interactions were pretty good. It acted out the interactions with my characters. The interactions stayed in character, relevant to the world, relevant to the character's background, and relevant to the current events that had happened both in world and with my characters.
I ran it as 1 continuous chat. No parsing. No summary. I wanted to test the limits of DS and see how far I could push it until it majorly stumbled and went completely off the rails.
To my surprise, I was able to finish the entire campaign (short)! There were a couple of stumbles. Mainly in initiative order. I had to remind it a few times who's turn it was. There were 2 other places that I noticed outside of combat. All instances of stumbles only occured later in the campaign.
It started to try and voice for my characters. I reminded it not to and it didn't again.
When I returned to the beach of the island I landed on, the ship I came on was wrecked. That one I'm on the fence on. The waters around the island were treacherous, and it is completely within reason that the ship could have beached itself while I was gone on the island.
There is a story I had written that I had it make into a campaign. That one is a bit longer but still short compared to many other campaigns. I will try to run that one next. I'm downloaded all of the LLM sizes right now. I am probably going to try that locally hosted with the 158g one. I'm going to end up adding 128g ram soon. I will try the larger size DS LLMs after that.
I'm really curious to see just how far I can push it until it completely breaks down.
Let me tell you a little story about The Fenhalloway River. About a year before I moved to that area as a kid in the early 80's, some reporter came to report on it. Some locals assaulted her buy burning her with cigars and cigarettes, then pouring the river water into her burns.
I remember wandering some places with my step brother. One spot was along that river. The spot was out there, but still on a decently used dirt (sand) road. We got to the end and to an area we heard was a swimming hole. This was before we heard the river was badly polluted. It was littered with empty bullet casings, KKK signs and nazi symbols. We noped the fuck out of there quick.
While I lived there, at one point, the EPA provided everyone who wanted it with cases of bottled water. We lived close enough to see the sign over highway 19. A 30 second walk and I could just read it. Our well water stunk of the paper mill and you couldn't see the bottom of a 5 gallon bucket. The EPA water program lasted about a year. Then...nothing. The river wasn't any cleaner. It was still black coffee. Still smelled of satan's farts. I just now get the irony of living there and watching Captain Planet.
The mill shut down last year. It will probably take some time before the pollution from it will fade. Decades.