FREE: Khoj AI Second Brain RAG Agent Open-Source GUI!🤖 (Ollama, OpenAI, Anthropic, HuggingFace)
Links from the video
Transcript
2,559 wordsWhat's going on Josh pook here and in today's video we're going to be looking at COD AI where you can merge AI with your brain Co is the open- source AI co-pilot for search easily get answers without having to sift through online results or your own notes you want to build an AI second brain let's dive right into [Music] it all right guys so coach AI this is the link to their website um you can see connect your knowledge replace your
Search engine work handsfree come straight into context um engage anytime anywhere Etc so there is a um there is a cloud version and a uh self-hosted version I'm going to show you how to get set up self-hosted and there's a Discord GitHub here if you want to check it out links for this will be in the description down below all right they also have a desktop app as you can see right here like hey how's it going right and you can
Talk to the cji right here now keep in mind with the desktop app it is using the uh Cod Cloud so I think there's a free version uh I guess it's actually yeah so there is a free version right here then there's uh additional paid versions I'm not going to be buying this tool but uh if you want I mean for whatever reason you could but I'm going to show you how to self-host it so uh if you saw my video
Yesterday we covered a tool called lob chat I've covered a few tools that may be similar to this but lob chat is another tool that is essentially an uh AI second brain it's pretty cool tool definitely recommend checking that out in my video yesterday but uh if you saw that and you're wondering what is better between these two I'll kind of give you uh somewhat of a comparison not that this video is meant to be necessarily just a comparison video um
And yeah if you didn't see that video then you'll kind of get a sense of which one maybe would be right for you okay so here's the GitHub repo as you can see here you can share your notes and documents to expand your digital brain your AI agents have access to the internet allowing you to incorporate realtime info uh Cod is available on desktop uh you can share PDF markdowns org mode notion files and GitHub repos you'll get fast accurate semantic
Search on top of your docs your agents can create deeply personalized images and understand your speech and it is open source and self helpable as always all right so here's kind of what the user interface looks like chatting with it and I'm going to show you how to set uh things up so links to the uh docs will be in the description down below um as you can see here we're just going to go to self host and you can self
Host this with Docker so I mean there's different options you could do pip um and I think there's some more options but we're going to use Docker just because it's very simple so if you don't already have dock Locker installed go install it I think there's a link right here to help you with that but it's fairly simple and then you're just going to get clone the repo um so you're going to go to your terminal and you're going to run
Get clone and then the repo link which will look like this all right so I'm in my repo and or I'm in my uh terminal going to grab this link and I would go get clone right here all right so you're going to run that and I'm not going to do it just because I already have it but once you do you would go CD Co all right that would just change directory into Co and then what you would do is
You would simply you would actually just dock or compose up now before you dock or compose up I will say one thing if you do open up the um if you open up the file or the folder right here for example this is the folder as you can see um I'm opening up the docker composed. yaml file right here and let's just see here so you could change a few things here if need be you don't you don't have to but
For example this is your Cod admin email and password so if you actually want something a bit more secure obviously then username and at example.com and password you can do that but just for um you know just for these purposes right here I actually just use this so if you don't change it you're going to use that to sign in and then all you're going to do is run the docker compose up right here and that is going to spin up
Your Cod um instance on your Port 4 2110 okay so it's going to take a couple minutes once it's done you can access it here so once you access it here um you can log in now there's a front end side and then there's a back end back and side so the administration um side hosted with d Jango so let's just see here what you're going to do is you're going to configure your admin uh so if you scroll down you'll
See configure so it gives you different um settings that you can configure so just right off the bat to be quite honest like just from doing a video of lob chat yesterday and now this um this part of it is something I just truthfully I really don't like like if I was to use one of these tools on a day-to-day basis just for this purpose alone where it's like you have to do this extra part in the back end it's kind
Of annoying to me maybe uh maybe some people don't mind it whatever the case may be but basically like and from having to you'll see in just a second when I show you what you have to do but this part is just not as as uh easy to do as something like L chat where you can easily just connect it and then you can change the model there so that's what I like about L chat opposed to code right here but
Uh if you go to Local Host pin uh 42110 SLS serveradmin this is what you're going to get it's going to look like this you're going to see all the different stuff you're going to see your agents your chat model options your client applications conversations entries gith Hub configs notion configs open AI processor processor conversation configs um Server chat settings search model configs and bunch of different options right and like this is the thing like to to use um a lot
Of these or most of these you have to kind of go back in here and start changing configs around so like so for example if we go to open AI processor conversation configs you can see this is what you would have to do you would go add open AI processing conversation configs then you would name it and then you would put the API key here and then you would put the API base URL here right so if you're familiar with like
Connecting um any sort of uh AI whether it's anthropic Claude olama whatever the case may be this is what you would put here so for example if I go here with AMA you can see the base URL is Local Host po11 434 um and in the uh docs right where is it the docs right here you can actually see it goes over um so configure open AI chat so go to open AI settings um add the open AI processor conversation config
This is where you will set your API key and API base URL the base URL is optional it's only relevant if you're using open AI compatible proxy server go over to configure your chat model so you would go right here okay and then once you go here um set the chat model field to supported chat model uh of your choice so I'll leave this specific link down below as well this is the specific olama setup so if you want to use
This with olama models um you can basically you know use any offline model essentially so um essentially all you would do is go to ama.com of course install it make sure you have Ama installed as well as whatever model you want and then you would create an open AI processor conversation config in your Cod ad admin panel so you would name it o llama API key can be any string uh API base URL is right here so default for o llama
And then create a chat model option in your Cod admins so then you can name it like for example llama 3 replace with your local model and then model type and then the open AI config right um so that this is where you would select the config right here that you just made Max prompt size you don't need to do um or this is the ma Perl with the max prompt size of your model so that's what you would put and
Create a server chat on your coach admin panel and then default model would be the one that you just created and the one that you just created and then uh go to your config and select the model you just created in the chat dropdown so I showed you the open AI processor conversation configs then you would go to the chat model options like it just said you go to add chat model option and then this is where you would put that
Information you can do like uh hugging face chat you can do AMA depending on what you're using and then you would select this Con openi processor config whatever one that you set up and depending on what you're using it would be open AI offline or anthropic and then you would just click save okay so as you can see there's it's just doesn't for me it just doesn't seem as efficient as some of the other tools that we've cover on this channel
Um it's kind of annoying for me personally to have to go back into this admin panel to do all this and it just kind of over complicates things I find but then after that maybe maybe that's just me you can let me know what you guys think um after that you can go to so after that you can go to server chat settings and then you can change the defaults to whatever one that you just selected and then click save and
Then you would just go back into your front end side of things and you would scroll down to in your settings into so settings is up here you go here and you would go to your chat and you would change it to whatever model you selected okay and just to cover a few of the other features besides chat we got agents and we have automations so I'm not going to dive and I I believe there's search too so I'm not going
To dive deep into showing you how to set all that up there is docs right here you can see setting up agents on the self-hosted version creating agents in the admin panel but as you can see for me personally having to create everything in the admin panel just isn't as efficient um on the uh self host or on the cloud version I believe it's a lot easier of course but um I'll leave links below for that but the one if you
Do create agents you I mean it's pretty basic as to say what agents are you know tailored agents for specific use cases and then um and then automations are essentially um basically automations that help you structure your time by automating tasks you do regularly build your own or try our presets get a results straight uh to your inbox so these are kind of cool you can design automations create automations there's some dummy ones here that you can test out such as
Weekly Newsletter daily bedtime story front page of Hacker News U Market summary so these are if you're um wanting to set up automations that run on the regularly dayto day or every Monday or every Wednesday so that's kind of cool and also too guys if you do use something like obsidian if you're familiar with obsidian it's sort of like a a note taking tool where you can have it uh hosted offline in your Vault um Cod does have an integration with
Obsidian so it could help as well for uh to build more of a uh in-depth second brain so yeah I'm not going to go over how to actually get it up into your obsidian but it looks fairly simple you just run this pip command and then install the cach plugin into your obsidian Vault and then there you have it so I'll leave a link to this as well if you are an obsidian user and you want to try out Cod All
In All I think it's a pretty cool tool honestly for me personally just with my first impressions and using it for a bit um I probably if I had to choose one I would probably choose L chat just because of the ease of use of it it's a little bit nicer UI in my opinion and I don't like having to go back into the Django dashboard to or the Django admin panel to have to change everything let me know what your
Thoughts are in the comments Down Below guys just wanted to share this tool with you guys real quick um and yeah if you got some value from this video make sure to smash that like button smash that subscribe button if you're new here we upload videos every single day on AI tools AI automation open source uh AI coding um Marketing sales business growth Etc so make sure you want to stay tuned um hit that subscribe button to stay up uh stay
Tuned with the daily uploads other than that guys if you haven't already checked out and joined our free community stri community.com link to our free Facebook gr and Discord channel will be in the description Down Below guys other than that I will see you in tomorrow's video if you have any trouble with this or you have any questions or you want me to do a video on a separate tool let me know in the comments down below keep hustling keep grinding
And of course guys accelerate your stride take care