Video18 min watch

FREE: The Best Open-Source AI Agent Open Interpreter (Use Cases)🤖 AI Controls Your Computer! Insane

In this video

  1. 00:00Introduction: Exploring Open Interpreter - The Best Open-Source AI Agent
  2. 00:32Overview of AI Agents: Agent Zero, Agent K, and Installation Challenges
  3. 01:36Open Interpreter Overview: Local Code Execution for Python, JavaScript & Shell
  4. 02:20Installation Process: Simple Setup with pip install Open Interpreter
  5. 02:56Open Interpreter Documentation and Unique Features
  6. 03:30Comparing Open Interpreter to Other AI Agents: Stability and Performance
  7. 04:14Advanced Features: OS Mode, LLM Control Over Your Computer
  8. 05:35Demo: Analyzing CSV Data with Open Interpreter
  9. 06:47Creating Charts: Bar and Pie Chart Example
  10. 07:52Downloading, Editing, and Translating YouTube Videos with Open Interpreter
  11. 09:09Translating Audio and Embedding Subtitles in Videos
  12. 10:13Setting Up API Keys for Open Interpreter: OpenAI and Local Models
  13. 11:13Composing a Mozart-Style Piano Piece with AI
  14. 11:34Demonstrating Open Interpreter’s File Conversion Abilities
  15. 12:44Closing Thoughts: Requesting Feedback on AI Agents and Future Videos

Transcript

2,668 words

What's going on everybody Josh poock here and in today's video we are going to be looking at potentially the best AI agent open source that's out there right now we tooken a look at Agent X as well as other AI agents now we're going to be looking at open interpreter showing you how to install it locally and show you what it can actually do let's dive right into it [Music] all right guys so if you're not familiar with open interpreter we'll

Do a brief overview before we get into it like I mentioned at the start we've done videos on Agent Zero as well as a few others I was actually going to do a video just as a sign out on Agent K you haven't heard of it um I was there's a few other ones I was going to I may do videos on but long story short I was having an issue with installing Agent K um and it was kind of just

Really just annoying because you know if you saw my video on Agent Zero um it's it's okay I know you know the found it's a newer project the Founder's been improving it so good on him uh looks like they just added some updates with the UI haven't tested that out yet maybe I'll test it out and if it's worth another video maybe I'll do an update but with these other tools um you know Agent K I mean it's you know I

Couldn't even install it because this there's some issues with the current repo dependencies and whatnot so it's not being updated as frequently um yeah it's just kind of the you know Annoying right right and even when we do do some tests with a lot of these models you don't actually get the desired output now I'm very excited about open interpreter and we're going to go ahead and start using it here but open interpreter essentially lets llms run code python JavaScript shell

And more locally you can chat with open interpreter through chat GPT like interface in your terminal by running The Interpreter um command after installing so this provides a natural language interface to your computer's general purpose capabilities so you can create edit photos videos PDFs ETC control a Chrome browser to perform research plot clean and analyze large data sets Etc not you'll be asked to approve the code before you run it here's a little demo here we're not going to watch the

Whole thing but you can check this out link for the repo will be in the description down below and it's very simple to actually install it that's that's what I really like too is like lot of these other tools um you know it's just sometimes it's a little bit more complex to install sometimes they don't even work but this one's very very simple you literally just run pip inst pip install open interpreter and if you have any issues with it just

Maybe ask chat GPT if you do get any issues just with maybe certain dependencies or uh things you need to update and then after that you just simply run interpreter okay now there's a couple other uh ways you can start this up and I'll show you that in just a second so I'll leave a link to their docs and if you're going to be using open interpreter and I I'll probably do more videos on open interpreter as I you know begin

To use it more often but uh I am very excited about this tool and uh you know as I learn new things I'll definitely keep you guys posted so make sure to subscribe to stay up to date but they have some good training and documentation here on the open interpreter docs first off too like this is probably the most at least as of today at that I know of this is the most like established open- Source um llm that can control

Your computer run commands on your computer all the other ones I've used honestly they just I I can't even like use them on the regular because they just there's always stupid bugs that just don't work um and yeah so they just call like so many of these have these big claims like agent case say an auto agentic AGI that is self- evolving and modular now granted I didn't get to fully test it out but like I said a lot of these

Guys have big claims but they don't actually was like hold up to the test so we're going to see how open interpreter does but now there's a couple different ways you can install it and run it so I just covered the first way pip install open interpreter so you would want to run that in your terminal all right so once you run that it's going to install everything um and you could also do it this way so there's local mode so

Pip install open interpreter local now this is if you're going to want to use models like llama file ol llama whatever the case may be so you can use this with local models to which is really nice and then there's OS okay there's safe mode too but the cool thing too is OS mode so this is highly experimental mode that allows open interpreter to control the operating system visually through the mouse and keyboard it provides a multimodo llm like gp4 Vision

With the necessary tools to capture screenshots of the display and interact with on-screen elements such as text icons it will try to use the most direct method to achieve the goal like using Spotlight on Mac to open applications and use Query parameters to the URL to open websites with additional information OS mode is a work and progress and blah blah blah you can check out their Discord but to enable it you just basically install it like I showed and then you're

Going to run interpreter with the flag OS okay so we're going to try a few different um tests with open interpreter right now and see what it's actually made of all right so here I'm saying please analyze the file which is a CSV file in the path blank path and create a bar chart and of the data and a pie chart to help me analyze things let's go ahead and run this okay so it's going to say first I'll read the

File and display its content so boom it's reading the file with open path blah blah blah print content would you like to run this code we're going to say yes oops I forgot to put the CSV and I just renamed it just so it's easier and now it's going to run that so let's see it's going to read the file and it's going to understand its structure okay boom and we wow like this is just honestly just even this command alone

Is night and day compared to at least from when I used uh Agent Zero now granted like I said you know maybe I'll do some testing on the new updates because I know he's ruled out some new ones and um nothing against that you know uh project it's a new project this Project's been around for a while I'm just saying this is like this from as of what I know this is like the top notch um tool in this category all

Right so boom CSV has been successfully read and initial and the initial data structure is now visible columns appear to be representative metadata blah blah blah form submissions so it's going to base on these columns okay I'm just going to say yes I'm not going to read the whole thing and it is you know writing the code here and wow look at that within two seconds it was able to analyze this data and plot this data in a graph right here

Wow so now it's like I love how how it's not just messing up like so many of these models will like hallucinate like now it's still remembering to create the part chart pie chart so let's say yes oh wow so I really like this I it actually picked up that the column was blank so now it's just checking for uh another column um so the analysis shows all entries monthly bill usage are mening all right so I ploted something that I

Didn't want it to plot from here so I just said just use something that's not like phone numbers or anything like that so I just plotted this basic data right here but it actually works so that's really cool and it's super fast okay so now we're going to try something a little bit more advanced and let's see how it Stacks up so this is just a clip from one of my favorite podcasts the Allin podcast so David SAS won't let his

Friends use his private jet and we are going to uh say download all right so here I'm saying download this YouTube video right right here cut out the segment of 1 minute to 1 minute and 30 seconds and translate the audio into Spanish and add Spanish subtitles and save it in this location use youtube-dl for this all right so now it's building out the plan with exactly what it has to do I'm going to say yes okay so it says the

Video has successfully been downloaded right here now we are going to trim the video and we're going to trim it from 1 minute to 1 minute and 30 seconds let's go ahead and say yes it's going to use this tool right here hey now we're going to transcribe it into Spanish transcription with whisper so opening eyes whisper model we're going to say yes it's written all the code for that for us okay so it's recognized that the whisper module isn't installed

We're going to say yes install it it's going to run that code automatically okay so it's been successfully installed we're going to say yes transcri or whisper okay so the transcription has been complete now we're going to translate the transcription to Spanish okay so one thing just to let you know guys I was having some issues you want to make sure that you're telling it to save that at least from what I've seen right this uh you want to make sure

That you're telling it to save the files into the file location that you're that you started interpreter in so here is the transcript right here okay so now it's going to translate it okay okay so it's realizing Google translator module isn't installed let's go ahead and say Yes guys I hope you can see already that this is something like there there's is extreme power um there's like crazy things you can do with this guys like this is get on it's actually

Work this is something that actually works okay the other ones that we've covered don't work like this okay now it's going to translate it and boom here we have the Spanish version now it's generating an SRT file now it's going to embed the subtitles into the video all right guys so the final product is done let's go ahead and check this out the trimmed video with subtitles it'll let you borrow the plane if I'm not using it here's saaks the last

Time we went to dinner ready the check comes Miller and Lux lands on the table here's saaks what you're seeing see that you know what that is sack's going for his wallet you can just count it it's want I can't remember the last time I can't remember the last time you picked up a check jcal what do you every time I pick it up on the way in maybe for a slice of pizza come on sax is one of the most

Generous people I know I remember we went to a bar once we barely had time to get a glass of Still Water all right guys so that is you know fully without writing a single line of code I literally just to told open interpreter what to do and it did it pretty crazy stuff one side out guys I forgot to mention is in order to actually use use open interpreter um you can use it with different models like I said you

Could use it with local models whatever the case may be but I'll leave this link Down Below in the description you're going to uh when you first run it if you don't have your environment variable set up in your system it may ask you for your API key for open AI but if not you can set this open aai environment variable key uh on Windows it's going to look like this so you're going to run this command set X open aai

And then your API key here on Linux or uh Mac it's going to look something like this so I'll leave these down below in the description as well as you can check out the docs on how to use it with a llama as well as like Claude Sonic you can just use um a uh something at the end of your interpreter interpreter Dash whatever model Etc so that will be in the docs link down below now I'm saying use an AI

Model to compose a 30-second piano piece in the style of Mozart save it as a m file all right so it's bringing everything up it's you know basically just running the code here all right guys so let's hear this beautiful Mozart synth all right so obviously you know you could uh improve the prompt and make it sound a lot better but it's really cool that we could actually do this you get you can actually get it to do custom actions for

You send emails like I said you can get it to control your computer you can get it to uh convert files such as you know if I wanted to convert this from a CSV to or convert this from a doc to a PDF or convert this from a PNG to a JPEG you literally can just tell it in plain language how to do or hey do this here's the file path whatever and it will do that so you want to do

More videos on open interpreter which I probably will let me know in the comments down below if you want me to do any specific things with it uh if you want me to do a video showing you the the OS feature the operating system feature where it can actually control your computer take screenshots go to certain websites do searches all that good stuff let me know in the comments Down Below guys you got some value here make sure to smash that

Like button smash that subscribe button we upload videos every single day on AI business growth automation open source AI coding all that good stuff so make sure to stay tuned for the daily uploads also too guys if you have a favorite AI agent tool whether that's open interpreter Agent Zero Agent K whatever I mean me personally at the moment I am a mine is open interpreter but if you know anything that is better let me know in the comments down below

And maybe I'll do a video on it other than that guys I will see you in tomorrow's video keep hustling keep grinding and of course guys accelerate your stream ride take care

Latest from the blog

View all