NEW Agent Zero Insane AI Agent That Does Everything! [UPDATES]🤖 Search Web & Write Code Local LLM
In this video
- 00:00Introduction: Overview of Agent Zero Updates
- 00:28Agent Zero's Rapid Growth and Community Resources
- 00:57Previous Review of Agent Zero and Initial Issues
- 01:21Agent Zero's Dynamic and Organic AI Framework
- 01:54New Web UI vs. Previous CLI Interface
- 02:29Key Resources: GitHub, Community, and Documentation
- 03:02Agent Zero's Advanced Features and Recent Updates (0.7 and 0.7.1)
- 03:43Installation Prerequisites: Git, Docker, Python, and API Keys
- 04:28Installation Process: Setting Up Conda and Docker
- 05:47Configuring API Keys and Environment Variables
- 06:13Running Agent Zero's Web UI Interface
- 06:56Web UI Features: Chat Reset, Preferences, and More
- 08:03AI-Powered Appointment Setters by Stride Agents
- 08:33Core Features: Agent Hierarchy, Memory Systems, and Extensions
- 10:28Agent Zero's Memory System: Categorizing and Storing Data
- 11:16Knowledge Management: Default and Custom Knowledge Files
- 12:52Instruments: Custom Tools and Docker Integration
- 13:23Extensions and Modular Structure in Agent Zero
- 14:00Reflection Capabilities: Enhancing Agent Thought Process
- 15:18Custom Prompts and Adjusting Settings for Better Organization
- 15:47Agent Zero vs. Other AI Tools (Agent E, Agent Q, Crew AI, etc.)
- 16:14Testing a Task: Downloading YouTube Videos with Agent Zero
- 17:30Troubleshooting: Web Browsing and Download Issues
- 18:07Iterative Problem Solving: File Name and Download Adjustments
- 18:53Web Browsing Capabilities: Issues with Bot Restrictions
- 19:31Known Issues: Web Searching Limitations and Upcoming Fixes
- 20:24Running Python Code in Agent Zero: Writing a Pong Game
- 21:49Testing Prompt Adjustments and Code Execution Challenges
- 22:58Future of Agent Zero: Exciting Updates and Community Growth
- 24:10Closing Remarks: Thanking Subscribers and Future Plans
Links from the video
Transcript
4,857 wordsWhat's going on everybody Josh pook here and in today's video we're going to be taking a look at another AI agent framework SL tool and this one is really good now we have covered Agent Zero on this channel before when it first came out but fast forward a couple months down the line and this tool is slowly becoming a very unique AI agent that has features and capabilities that a lot of other AI agents don't the founder just released version 0.7.1
And there's some crazy stuff that we have to cover they also have a active rapidly growing school as well as Discord community and I even put together a document /resource for you guys that you can go over to make sure you get this up and running as fast as possible going over all the different updates and everything possibly you would want and need to know regarding Agent Zero this one's going to be a good one let's dive right into [Music] it
All right guys so as you can see we covered Agent Zero two months ago on this channel right when it came out I believe the day after and I'll leave a link down below for this video if you do want to check it out we went over kind of where it was at starting you know two months ago and it was very new it still is very new but uh you know there were a few issues with Agent Zero um in
Terms of you know it getting caught up in loops and this and that and the founder has been improving this uh tool as you can see here there has been a bunch of different releases since that point and we'll go over some of the main ones and even the last month there has been some crazy releases so 0.7 and 0.7.1 have been some really really cool releases and we'll dive into these in just a second all right so just to give
A quick overview of Agent Zero for those of you who don't know about Agent Zero so uh it's a personal and organic AI framework so Agent Zero is not a predefined agentic framework it is designed to be dynamic organically growing and learning as you use it Agent Zero is fully transparent readable comprehensible customizable and interactive it uses the computer as a tool to accomplish its slou Tas and you can see here it now has a beautiful web UI that when I
Did the video it did not have a web UI it was all CLI and I really like this web UI we'll get into that in just a second all right so let's dive into this document so at the start here we have a few key links so we have the GitHub repo we have the school Community the Discord Community we have the docs right here we have a video from Agent Zero YouTube page about the update 0.7.1 as well as 0.7
Which I still would recommend checking out even after this video as well as an installation guide so pretty much all the main videos you would want from the original uh Agent Zero YouTube page as well as running local models on Agent Zero you can pretty much run any model you want with Agent Zero which is one thing I really like about it it's very very customizable but let's dive into it so Agent Zero is an advanced AI framework designed for extensibility
And customization created by yon um can't say his last name but he's a you know pretty uh hardworking guy he's commented on the last video I did so since then he's made a lot of improvements and I'm actually very impressed to see it um and it's not a simple application but a comprehensive system that allows users to create modify enhance AI agents for various tasks so here are the recent updates so 0.7.1 so pre-install binaries persistent conversations improved documentation better expression
Handling and then 0.7 which had some really really cool updates so revamped UI enhanced memory system Knowledge Management instr instruments features and we're going to cover all these in more in-depth in just a second extensions framework and then prompt improvements all right so few few prerequisites you need before starting this installation process get because you know you want to get clone it uh most likely Docker you're going to need that python it's technically you don't need it since uh you know
It's recommended to use cond um and then K too I don't have that here but uh it's right here so you're going to need cond as well I'll just add that in cond so this is um what you're going to be using for the virtual environment the cond environment okay so and then you're going to need an open AI API key or anthropic Gro perplexity Google mistro open router somba Nova even which is pretty cool Azure hugging face olama and LM
Studio are all different uh Integrations that can work with Agent Zero okay so the installation Pro process is pretty straightforward you're going to need to download miniconda right here okay once you download that you're going to need to download Docker then you're going to need to download Agent Zero so you can either download it right here or you can just get clone it so you can run this specific command get clone and then the URL in your command line so once
You run that you're going to want to change directories into Agent Zero so run CD Agent Zero and then you're going to want to set up a cond environment so you're going to um basically just run all you have to do is just run this Command right here cond create and then activate the cond environment so you can run this command um once you do that you're going to want to pip install dasr requirements run that if you're running into any
Issues just so you know as a FYI it could be because maybe you have Global uh packages you know turned on in your clor environment so just ask chat GPT how to disable that or whatnot and then you're going to configure agent zeros so you're going to I would copy the EnV um and you're going to have a copy of the example EnV and you're going to rename that Tov and then you're going to add your open AI API key as
Well as other any other API key that you want in that uh environment variables right there so you'll see here I got the EnV file that I already copied which has my actual uh API keys in there and this is this is the example okay so as you'll see we got open AI anthropic all the different ones that you can use which is something I really like about agent zeros that they have all these different models so uh yeah you're going
To want to copy that change it put your keys in and then you're good to go from that point on you're going to want to open Docker on your desktop so make sure Docker is running but other than something like open interpreter where it actually just runs these commands on your actual local desktop environment uh Agent Zero runs it within a Docker container so it's a lot more safe in terms of if you're running it and you can execute the command
And python run.py this will start the web interface or if you want to use the CLI like I showed in my first video you would just run this command now we're going to use the UI interface because I didn't cover this yet and it's really nice once you run that it's going to set up the UI interface and you can access it at this port right here Port 50,000 And1 all right so this is what the web UI looks like as
You can see we got the send button here we got the pause button we have the time up here the we have the status showing connected we have a sidebar here that we can make smaller or bigger we can reset chat do a new chat load chat save chat we can see our different chats right here we can delete chats we can enable these different preferences so auto scroll dark mode light mode show thoughts show Json show utility messages all these
Different capabilities and this is something really cool that I haven't really seen another uh AI agent tool that we've covered with a really nice web UI like this so this is a huge upgrade just this alone for Agent Zero are you tired of pouring thousands of dollars into appointment Setters only to watch leads slip away imagine having a team of elite sales agents booking qualified appointments for you around the clock no more wasted time on training no more frustration with performance
And no more draining your budget on inconsistent and expensive call centers introducing stride agents AI powered appointment centers that work 24 seven never get tired and book appointments while you sleep trained on thousands of successful conversations our AI agents outperform human teams at just on10th of the cost join the ranks of businesses that doubled their appointments and booking rates in just a matter of weeks don't get left behind in the AI Revolution visit stride agents.com now and transform your entire sales
Process with cuttingedge AI technology it's time to accelerate your stride with AI agents I just want to quickly go over a few key features and components as to how Agent Zero works so you get that understanding of it so the agent hierarchy so this allows for task delegation among multiple agents you have tools so this is pretty standard custom built tools like web search code execution Etc and I'd suggest checking out the docs so you can see all the different tools
We have memory systems so long-term storage uh prompts knowledge base instruments and I'm going to dive into some of these in just a second more in depth extensions Docker integration so this is secure code execution and isolated containers and then customization options and then agen Zer architecture so like I said I would suggest checking out the docks right here this architecture read um markdown file right here is very good and it pretty much covers everything in terms of the architecture Core
Concepts the different types of you know the hierarchy and communication how that works the interaction flow memory systems the different tools so call subordinate code execution knowledge tool response tool memory tool web page content tool the instruments knowledge different prompts right here um the key files all right such as the agent. py you know the Run CLI um the directory structure so bundle Docker explaining the whole entire structure so you get a really good sense of how you can work around
Agent Z and customize it yourself because this is definitely a tool that you do want to customize and it has that flexibility for you this diagram just illustrates the hierarchical relationship between agents and their interaction with tools extensions instruments prompts memory and knowledge base so the main agent right here is the agent. piy file and then the memory system right here this is the path to the memory right here so python slh helpers memory.i and this is the tool that it's
Using memory load so memory loading happens at the start of each session so this is relevant memories are automatically loaded and injected into the system prompt allowing for the agent to utilize pass interactions effectively and then the memory structure so the memory is categorized into four distinct areas so storage and retrieval of user provided information so this is like names API keys and then fragments so this contains pieces of information from previous conversations updated automatically and then Solutions so this is
Stores uh this stores successful solutions from past interactions for future reference and then M metadata so each memory includes metadata so the IDS timestamps enabling effective uh efficient filtering and searching based on specific criteria all right so here in Python and then helpers you can see memory. piy right here and we can see the different uh segments so main fragments Solutions and instruments and then Knowledge Management so the path location right here is/ knowledge so the tool is knowledge unor tool
And there's two subfolders so there's default and custom so so default is for general knowledge files and then custom is for files that are ignored by GitHub so this will allow you to store personal data without pushing it to the repo so this is the path right here and then automatic Imports of files the files uploaded to these folders are automatically imported into their corresponding memory areas when the memory database is initialized and then organize subfolders so subfolders correspond to memory
Areas main Solutions Etc determining where important information is stored in memory okay so here's knowledge right here the knowledge folder and you can see we got custom and we got uh default right here and then we have the sub categories such as Main and solutions right here so that's where you can add different knowledge so instruments are custom tools executed inside the docker container users can create instruments by adding markdown files under the instruments folder they can be shell scripts Python
Scripts or even JavaScript executed in node.js and then the framework automatically injects instrument instructions into the prompt when relevant so you can see instruments folder right here we can see custom default and you can see this one right here YouTube download it's an example and this is one right here so we can see Problem download a YouTube video solution if folder is specified CD to it and then run instrument bash SL instruments default YouTube download uh this bash script right here
For the URL of the that you input and then wait for the terminal to finish so we can see the bash script right here and then it's pseudo appt and then YT download so it's basically a script to download the YouTube file and this is good because if you just say download a YouTube file it could use any sort of library that and some may not work so this is specifying exactly how you want to solve a particular problem all right
That's the instrument right here next is extensions so here's the path for extensions so new extension system has been implemented for better organization so it has a modular structure so different subfolders correspond to various stages of the agent's message Loop and then the execution order so files within each extension folder are executed in alphabetical order extensions handle tasks such as preparing prompts recalling memories and memorizing new information and this this is one thing to note that Yan said so in future
Most of the code in Agent Zero framework will be in the form of extension tools and helpers to keep the main agent. piy file clean and simple okay so that's the direction that he's going okay so prompts so the path for prompts is right here so file inclusion prompts can now include other files using the syntax with these curly brackets and then um you include the path to the file so this allows splitting the system prompts into sections better organization you
Don't have to include it all in one and then users can create custom prompts by replacing only specific files rather than copying the the entire default folder and then the reflection capabilities so new prompts have been added to enable reflection so Chain of Thought the agent can use a step-by-step reasoning process and then reflection so the agent can review and revise its initial thoughts before providing a final response so it can reflect on its previous thoughts so you can specify the
Different subdirectories to enable or disable reflection capabilities so to enable reflection you can edit the initialize dop file to change the prompts subdirectory to either this one right here or this one right here or you can add your own custom prompt folder with you know Reflections enabled and you can also adjust different settings in this file right so I left a screenshot right here all you would simply do is go to the initialize dopy and you will see on currently line
Line 34 we have um actually line 33 we have prompt subdirectory you would just uncomment that out and you would just change the default to this one right here so if you go to your prompts directory right here you can see defaults which is the default prompts you can check some of these out you could even customize them too and then you can also see the dioa right here as well as the XL but if we go to some of these
Prompts we can see the process is thought and then it has ref flection here so did I provide sufficient context and clear instructions is this the most efficient approach so it asks itself that after it thinks all right and here's a screenshot of reflection in action as you can see thoughts then reflection then revised thoughts and then it uses the tool and then provides this output okay so also within the doc I included um Agent Zero versus Agent e vers agent
Q vers open interpreter so for those of you who are wondering kind of when you should use these different tools cuz I know I've covered a lot of different AI agent tools and they all have kind of different use cases and then I also included Agent Zero versus crew AI vers autogen versus Lang graph and I think a lot of these are really great tools and I do think Agent Zero is a great tool too I just think you need to
Kind of know when to use Cent ones for example agent e and agent Q are really good for web browsing and I am excited for 0.8 with Agent Zero to see how improved the web browsing capabilities are all right so like I said this document will be down below so you can check it out go through it more thoroughly make sure you understand everything and let's go ahead and just test a very simple um a very simple task so I'm just
Going to grab a video here this will be the video that I made yesterday on GPT me and I'm going to say please download this YouTube video in as an mp4 so we're going to run this so it's actually searching its memories because we actually I actually did download a video before um and you can see so it has three memories found download video right here we can see the query zero instruments use one solution found cuz it did download a
Video previously successfully so it saved that as a solution we can see here thoughts tool name that it used so code execution tool runtime terminal we can see the code that it ran so it's using YT DLP and we can see its thoughts okay we can see that it used it all right um so let's see externally managed environment error okay so the environment is externally managed okay so it had an issue here the installation failed because it's being externally managed
I will attempt to install D using the package manager okay so I just paused it here which is a really nice feature that you can literally pause and play it so I can play it it's going to continue it said that it had an error just because there were the video has a special character in the title so it's fixing that it's iterating upon itself which is really nice so now you can see it's like changing the title name right here
All right the download still fails due to the file name being too long which causes issues with the file creation I will shorten the output so it's doing all these iterations like these are all things that you would have to manually do and manually find out and go back and forth and as you can see it's all doing this very fairly quickly all right so I'm asking at what's the time zone in Sydney Australia and what's the weather and time right
Now all right so it's using the knowledge tool and it's checking online sources and then it's searching what is the current weather what is the current time cing on weather.com okay so here it got the current uh you know time zone right here and then it said it was unable to retrieve the weather and time at the moment and I said can you try again I tried a couple different things and then it was able to actually get the um time
Right here so it's Australian eastern daylight time the current weather in Sydney is clearing showers with slight chance of shower in the morning the okay so it got the weather I'm going to ask it for the exact time okay so I've actually been troubleshooting a couple things for the last 30 minutes um and I found this in the Discord Channel basically uh I was trying to download a YouTube video as well as even just a few couple things with the web
Searching and you'll see here that this guy had the same issue he was encountering 403 errors um and you know for certain things for either downloading URLs or videos we're trying to visit URLs um I can see the video from the browser while not on a VPN so it doesn't look like my country restricted and then Yan said right here he said 403 is common when web pages block Bots 0.8 will be about web tools so this will be addressed okay
So there is still seems to be some issues at least for me you know that uh with you know searching certain things with the web um I as of now um it seems like a lot of my stuff is getting blocked and that can be sometimes be due to the fact that you know if you're just letting Agent Zero run it can potentially you know get rate limited or this or that or maybe seem like a bot so that's one thing
I will say be careful with I did download uh I use ytl uh YT download to download the YouTube video before the video and it worked perfect it actually worked really really well really really smooth and I really do like um the whole interface and how everything works and it seems to be working really well that was one issue that I seem to be facing though with some of these prompts here was the 403 error 0.8 should hopefully address some of
Those issues all right I'm going to do a prompt right here write me the pong game in Python and run it okay so I think it's noticing that P game isn't installed so it's going to have to install P game okay so here is the pawn game that it wrote I could tell it to add some uh scoreboards right here but you know I'm not going to go through all that right now um a few things to note you know it
Did write it at first it wrote it like this which is perfect um I was having some issues trying to run it I don't know if it can necessarily run it since it's all in a Docker container I don't know maybe it could maybe it can't I don't know so then here I was just like don't run it cuz I was trying to run it just save it and then you know I had was trying to save it with everything being
Written on the same line I'm like write it properly and it was having an issue with that so I think you got to play around with it and be kind of precise with your prompts obviously this is something that's going to be running um continuously so if you kind of let it run down a path that isn't correct it's a little bit more challenging than to fix it I think a pull from like if I just start a new chat um
Sometimes I find that's easier and if you do let it run down a wrong path um you can't edit your messages up here to change it so it may like kind of be stuck in a weird context I think um and try the same thing okay so let's try this tell me how many subscribers Josh poak has on YouTube okay so I did a search here okay so 404 client error again on the web page yeah so I even tried running
Like the same sort of commands in the docker container right here and getting the same issues and uh you know then I can run it in my own command line and it will download it but I get why this is an issue it's not necessarily agent Zero's fault um but like he said he is planning on improving this part hopefully in the coming versions so um you will face less of these issues before this video it was working perfectly so I'm
I wish I could show you guys that but unfortunately now I'm kind of reaching these 404 or 400 403 errors for a lot of these uh searches so maybe we'll just take a little bit of time until it gets unblocked but um I still do really think this is a really great tool and I am extremely excited for what I've seen with these upgrades you know Yan has been working really hard here pumping out these upgrades and I think that Agent
Zero is becoming a more and more established tool as these upgrades come out they have a really good enthusiastic Community like I said on school and Discord so if you're looking to use this tool I would definitely recommend joining those uh the community there checking it out um I think people are contributing and whatnot and adding cool things so I'm really excited for the future with this tool like I said guys the resource down below will be here it took me
A while to put this together and really wrap my head around the concept of some of these up upgrades so I hope this can kind of shortcut that process for you get you to really understand everything easily find how you guys can customize this tool for your liking if you guys have any questions about that let me know in the comments Down Below guys and let me know what your thoughts are around Agent Zero do you like Agent Zero do you
Have some issues with Agent Zero how do you think it compares to some of the other tools that we've covered on this channel if you're new to the channel we upload videos every single day on AI automation Marketing sales business growth so if you like that type of content and you got some some value here make sure to smash that like button and subscribe to stay up to date with the daily uploads if you're new here guys and you haven't already
Joined our free community stric community.com our free Facebook group and Discord Channel I'll leave a link down below so you can join for free thank you guys so much for the recent 9k subscribers we're on the road to 10K I know we're going to hit that shortly I'm really grateful for everyone who watches these videos also too guys if you run a business and you need help with your systems your marketing your sales your operations all that good stuff as well
As implementing AI into your business we have ai appointments that book appointments for you automatically while you sleep check out stride agents down below or book a call at executiv stride. c/a with myself and my team and we can see if it's a good fit or not if there's any other AI tools AI agents or anything you want me to cover in another video topic let me know Down Below guys other than that I will see you in tomorrow's video keep
Hustling keep grinding and of course guys accelerate your stride take care