A quick follow up to this meet.
Sing Li gave a bit of background on himself and his journey to Rocket.Chat
We then did some background on AI and LLMs.
A couple of key points. Think of a LLM as a tightly packed ZIP file of words. The clever bit really is the packing!
Current LLMS are essentially rubbish.
They were never really meant for real world usage. They aren't even Alpha code really. Still research level engineering.
But OpenAI needed more horsepower to pack more info and didn't have it. The business side overtook the development, as is often the case -> History !
LLMs 'hallucinate' - love that word. A lot. They are very good at regurgitating lots of strings of words that look human generated.
Until you check whether they are actual factual or not.....
So they are actually pretty good with regurgitating code, but not everything
Treat their answers with extreme caution at all times!
Brian and Mark piled in with some questions and an hour seemed to pass in 5 minutes.
A couple of things for certain. Development of Koozali SME v11 is actually being assisted with AI - Brian loves it!
We'd love to see how else we could utilise AI in Koozali. Possible plugins that can say access ChatGPT to give admins or even users answers to questions. Imagine a user panel with an AI panel built in!
We'd love to have more of our own knowledge base accessible for admins as well.
What would you like to see?
That brought us to GSoC and Sing gave us a precis of it.
I have mentioned elsewhere that I am a mentor on two Rocket.Chat AI GSoC AI projects this year and I firmly believe that we as Koozali should try and run one or two projects ourselves next year. It will attract new young developers and help us write more code.
So Koozali SME Server GSoC 2025 !!
If anyone might be interested in that, or knows someone who might be then let us know.
More generic info can be found here:
https://summerofcode.withgoogle.com/A big thanks to Sing Li at Rocket.Chat for his time, and also to all the people their for our Enterprise licence for Koozalis Rocket.Chat server.
15 Replies
1063 Views