Video14 min watch

FREE: Lobechat AI Agent Open-Source Local Ollama Models! 🤖 Multi AI Provider, TTS & SST, Image Gen!

Links from the video

Transcript

2,156 words

What's going on everybody Josh pook here and in today's video we're going to be taking a look at lobe chat unlock the superpower of your brain pioneering the new age of thinking and creating build for you the super individual this is an open-source tool that allows you to basically connect all your local llms your any llm really whether it's local uh open AI anthropic um whatever the case may be it can do TTS St uh stt visual models um really anything

You can create agents it has a agent Marketplace a plug-in Marketplace you can self-host it on your uh Home Server home computer or on a VPS or a server we're going to show you how to do it let's Dive Right [Music] In all right guys so this is the GitHub repo I'll leave a link in the description down below and this is the website here so as you can see um could try out their Cloud version I don't know if uh

Okay so it does look like if you sign up for their Cloud Server they do charge either n bucks 20 bucks or 40 bucks I'm not even going to go over the pricing plans or anything like that because I'm going to show you how to host it locally but for some reason if you ever did want to try out their Cloud you could test it out um but we're not going to do that we're going to do it for free so

Anyways um of course you know if you're using non-local models you got to pay through the API credits like anthropic or open AI but you could just use olama as well that's really cool about this tool so I'm going to quickly go over um some of the features here and then I'm going to actually show you to self-host it get it installed and up and running so um it's a pretty long GitHub but we'll just quickly skim through it so local

Model support model Vision recognition TTS and stt voice conversation uh text to image generation plug-in system for function calling which is pretty cool um so you can shows some different uh plugins here there's a bunch different of different ones agent Marketplace so like gpts support local and remote data uh database Clerk and next off and then Progressive web app um mobile device adaption um I guess you could it's uh mobile optimized and then custom themes and yeah that's pretty much it

So you could Deploy on one of these platforms such as versus cell or anything like that but we're just going to use Docker so first things first you're going to need Docker installed so you can go to doer. if you don't have that installed so if you're running this command on a Mac or Linux you could uh pretty much just use this exact command for me I'm currently uh using a windows so if you're on Windows for example um you're going

To want to run this Command right here and I'll leave this in the description down below if you run this it won't work so it's actually very simple to get up and running you're literally just going to run um that command and it's going to start pulling right here the containers and it's going to get that up and running so simply just run this command or this command if you're on Linux or Mac and also too um there is some additional

Like configurations you could do for deployment like if you want to uh run use open AI service through a proxy you can do it this way and there's also a detailed um deployment guide right here in their docs right so I'll leave a link to their docs as well if you want to do different types of deployment you can check some of this out you'll see all the different ways to deploy but um this way that I'm showing you is probably

The most uh simple way to do things um and then once you get things going you'll basically have uh lob chat like let me just show you it's going to be Port local it's going to be your local host and then Port 32 uh one0 so 3 2 1 zero and then you'll see once it loads going to look something like this well actually you're going to have like a little welcome page you can just click continue and then it's going

To bring you to the chat interface like we see here so I'm just going to go over some of the interface features so if we go up here to session settings this is where you'll be able to do all your configurations well a lot of them so we can see like comment settings we can see different themes of course we're going to go with the Dark theme um we can see language font size different colors Etc access password you can reset

Settings clear uh clear all session me memory um this is system assistant so you can change to different assistants for different types of things and then language model this is where you're going to want to go to change what uh model you're using so right now just for um you know keeping things simple I just put an open AI API key but you could change either use this you could use um change some different you know configurations here here if you

Want to use different models you can just select them here now if you're going to want to use olama or something like that you could um basically just use that right here olama and you'll see you can just add your different models you can do the same thing for Microsoft Azure Google Gemini anthropic uh Amazon a uh AWS Bedrock grock open router together AI deep seek mistal Ai and then I guess there's a bunch of Chinese ones here so you really

Get to pick there's pretty much uh any one that you could think of and then text to speech I believe um the main one is open AI uh yeah so if you're going to do text to speech or anything like that you're going to need to open AI API key and then you can select default assistant here and I'll show you about assistant in just a second all right so they also do have this file section right here now my current

Deployment is is in um is not supported for file management so the current deployment in instance is in client database mode and file management features are not available please switch to server database deployment or use low chat Cloud directly so if you want to do that I'm not going to cover that right now but you could check out this link right here and it's going to show you how to do that if you do set that up then you're going to

Be able to do things like multifile text parsing uh Vector semantics and knowledgebase retrieval um so that's pretty cool that's very powerful I really like this tool for kind of like a all en companying um chat interface for your llms here in Discovery is where you'll actually be able to see the community of different agents so we can see like all agents and these agents are like specifically prompted and programmed for um you know specific things like if I go to

Growth coach let's just say for example let's say add assistant oh add assistant and Converse um then we can start talking to our growth coach right here here and we can see actually The Prompt right here you know you are a growth coach blah blah blah there's bunch of different points right here and um we can just start talking hey help me grow my business please and then it should start talking what specific um results do you want to achieve and

Then you could start telling it about you know your obviously your personal um you know situation now here is where you can select the different models so we have open AI here ol and you know if you connected other apis or or turn those on then you'll be able to see them there you can upload images um this is the file section which we don't have this is the randomness uh level right here um this is unlimited history message count um

And then this is voice input so uh you would have to use um open AI for that and then this is the extensions and then we're going to cover that in just a second and then here is kind of just like a overview of your chat so you can see context details rule settings Pro uh plugins used chat messages total use remaining available um for for uh context or tokens and then you can clear current session and make it bigger and

That's pretty much it so in the extensions if we go here you can actually check out the plug-in store and there's a bunch of different plugins there's Google search plugins there's steam there's current time there's uh DM toolkit um so I don't know you know i' haven't looked at all all these there's a bunch you could check some of them out mid Journey um some of them may or may not fully be you know 100% functional per se I don't know

Um but I did have some issues with a couple ones but there are some that definitely work like for example let's go ahead and turn on dally turn on weather GPT and let's just say what is the weather tomorrow in Toronto and if everything goes well we can see that it is using a function call for weather GPT to check the weather and we can see that the weather right here is you know whatever and you can find more details here

Now let's say please generate me and image showing me what it will look like and then it should use the Del function call and there's different image generation extensions that you can use not just di I'm just using that just for the case of this video but as you can see it generated a a prompt right here a beautiful outdoor scene in Toronto with clear sky showcasing the iconic Skyline in the background and then the forecast features a vibrant Ark with

People enjoying the day sitting on benches and walking blah blah blah blah blah and boom here we go we got our image right here looking be I mean I was going to say looking beautiful but it's looking interesting for sure um you know kind of I mean looks okay you know but anyways so that's pretty cool regardless you can create assistance create um extensions you know leverage the community's extensions as well as their assistance and um yeah it's pretty powerful I

Think it's uh going to be continuously developed upon and uh yeah let me know what your thoughts are in the comments down below regarding L chat if you used it before you have any other tools you want me to do videos on let me know in the comments down below if you have any questions or issues about uh installing it let me know and I'll do my best to assist you also too guys if you're new to the channel we upload

Videos every single day on AI growth marketing uh coding um really anything along those type of lines with the newest Cutting Edge technology that I find I'm going to be sharing with you guys as well as different strategies tools tutorials Etc so you got some value here uh and you want to stay a part of the journey make sure to smash that like button smash that subscribe button also too guys if you haven't already joined our free community stri community.com link

For that will be in the description down below we got a free Facebook group and free Discord Channel 100% free you can network with other like-minded individuals uh AI Enthusiast business owners entrepreneurs coaches agency owners whatever the case may be as well as myself and also too guys if you haven't already checked out my book client acquisition code a uh very in-depth guide about using AI to grow your business get uh appointments on autopilot definitely check that out link for that

Will be in the description down below other than that guys I will see you in tomorrow's video keep hustling keep grinding and of course guys accelerate your stride take care

Latest from the blog

View all