Omni Engineer: OpenAI o1 + Claude Sonnet 3.5🤖o1-preview & o1-mini AI Coding Agent - New Updates

What's going on everybody Josh poock here and in today's video we are going to be looking at how to leverage open ai's newest models 01 and 01 mini in the AI power developer console Omni engineer let's dive right into [Music] it all right guys so if you've been following this channel you may know that we have covered Omni engineer already but it actually came out with a lot of new updates that we will talk about in this video and now them

Along with a lot of other AI pair programming tools such as Claude Dev and a bunch of different other ones are getting 01 support so I'm going to show you how you can use it and build some really cool stuff with it so if you don't know about Omni engineer it's actually made by the same founder as Claude engineer so um basically Claude engineer is kind of like Omni engineer but just specifically for Claude Omni engineer is really great so I'm

Not going to go through this whole GitHub and read everything I'll leave it down below a link but a few things to note we have ai powered responses and streaming output Advanced file management so you can do things like add edit create show content so a lot of cool things such as claw Dev can do and AER and even cursor composer so it can actually edit create files which is really nice I really like that in a AI coding tool and

Then multifile editing support which is really good web searching with duck Dugo integration which is pretty cool image processing thing for local files and URLs undo functionality for file edits convert conversation save and load syntax highlighting for code gift display for file changes kind of like how cursor has that and then AI model selection and switching then it goes through some commands right here we'll get into that in a second but let's dive into the installation so it's actually very simple

To get set up and running all you're going to do is get clone this repo so you're going to go into your command terminal if you don't know how to do that and you're literally just going to copy and paste this command which is get and then clone and then that link okay I'm not going to do it because I've already done that and you're going to want to do it in a location where you're okay with having that that folder

Um there right so I usually put it in my desktop in a folder uh called something like development right and then then you're going to CD into Omni engineer so you're literally just going to change directory into that folder by running that Command right there okay once you do that you're going to install the required packages so you're just going to run pip install dasr requirements.txt it's going to install all the different requirements that OMG Omni engineer needs is what I

Do is I just go um if you have VSS code you can type code Dot and it's going to open that folder directory in VSS code or you can just go to vs code and open that on theengineer folder from the repo that you just cloned and open it in vs code so now that you have it open in vs code one thing you're going to want to do is you're going to have this env. example file and you're going to

Want to copy it and paste it so you can see here I have a EnV file and you're going to want to rename it to that okay then once you go inside you're going to want to enter your open router API key now if you're not familiar with open router I've talked about it multiple times on this channel but essentially it's a unified interface for llms so if you've seen the 01 and 01 mini roll out and you may already know

This for devs and through the API there are limitations so if you're not at tier five in your developer or your API account your platform. openai account then you won't have access to these new Models All right so that's one of the Beauties with open router it connects to pretty much any model you can think of and including these new models and they take a little per uh a few cents or whatever I don't know exactly how much they charge but

It's you know to get to use these new models it's definitely worth it if you don't have access to them so sign up for open router and then paste in your API key into the VSS code area right here and if you go to the main.py file just so you guys know at line 32 and line 33 you'll see the base URL for open router as well as the open router API key referencing from your EnV and then at line 36

And line 37 you'll see the default model and the editor model so so this is really cool because you'll notice that the default model which is used for planning is open ai1 mini the new model right you can change this to 01 preview as well right we'll keep it at 01 mini for now and then the editor model is anthropic CLA Sonet 3.5 now this is really good because just to quickly let you guys know if you don't know about these

Models and kind of where their strong suits are well for open AI 01 and 01 mini it main strength it has is it's really reing capabilities so it's going to reason a lot more think things through uh but it's also going to take a little bit longer so it's good to have this model potentially as a planner model and that's why it's good that it's potentially at the default and you can use these two models like I've talked about too if

You've seen some of my cursor videos where I say I I'll use different models I still use claudet 3.5 and Claud Sonet 3.5 is a lot faster a lot more cost effective and in my opinion it's better for um the just a Dev experience when you're doing doing edits and lots of times you can even use CLA on it even just for planning too it's still a really great model right and it's more cost effective and faster but this is a

Good strategy to Leverage The Best of Both Worlds from these two models and you can also change these to really anything as you can see here you can change it to gbg4 llama anthropic mistal whatever right so what do you do once you're done that well you run the python not Omni doine or- engine. piy don't do that you're going to run python uh and then main.py okay just like the name shows right here python main.py that's going to bring up

The Omni engineer interface so it's going to say welcome to the assistant developer console and then you'll see the different command options so we have ADD edit new search image clear reset div all the different options that I covered before you'll have access to them here and you can simply just type this and you'll see all the different options you can add edit so we could go ahead and say add a file to your ai's knowledge base or edit an existing

File or create new files so we'll go ahead and do a prompt right now right so one thing to note is if you wanted to do something like for per se like with cursor where you just tell composer hey this is what I want and it starts going creating the files doing everything in a nice seamless way well this is good but it's not there okay I'm I mean I'm a fan of a huge fan of cursor but right so we're

Going to use new and then index.html and then we created that and it's going to ask us if we want to edit it we're going to say yes and then I'm going to paste this in so create a modern Task Manager application using JS CSS and HTML the user should be able to create new tasks create new camand boards add notes and more make it function very well make it look very professional all right as that's running you'll see I also

Ask the same question up here and if you just ask it it's going to provide like a project structure as you you can see here and it's going to give you the code and and this is using the 01 model and you can see here it's very descriptive we got the JavaScript code we got the data structure pretty much everything you could think of different functions and then even additional notes at the end on how to enhance it or add additional

Features like drag and drop libraries responsiveness enhancements user authentification styling improvements okay so you can see here that the index.html has been successfully edited and saved and we can see that's right in our file right here here so let's go ahead and check this out all right so we can see here that it actually didn't put the CSS and JS into the HTML file so I'm going to edit it and ask it to change that please put all the CSS JS

And HTML in this file with a professional modern feel obviously you wouldn't want all your code in one file but this is just for testing purposes okay so we can see it's making the changes right now all right so this looks a lot better okay we can add a new board here let's go ahead and put test and boom okay this is actually really like I know it's not really nice but it's a lot nicer than what it just was so

Let's add a task let's do a test task test description boom wow okay so let's add another Board Test two crate can oh wow so we even have dragon drop functionality I didn't even ask for that so this is actually pretty uh impressive yeah I'm actually very happy with what we got so far let's go ahead and even try to improve it a bit more all right so here I'm saying looks great please add due date fields in new task option

And make it even look more modern like a Fortune 500 software company get creative and add new features that I didn't even think of try to really impress me and go above and beyond with your creative coding talents let's see what we get here okay so this is strange I don't know if this is I'm assuming this is open AI but look at what we get here errors in streaming response error message invalid prompt your prompt was flagged as potentially violating

Our usage policy please try again with a different prompt all right guys I don't know if it's glitched out or if it's just taking very long but I've literally been waiting for about 10 minutes for this prompt to generate don't know if it's open AI 01 just thinking but I've never had it take this long so so I may just end it off here other than that I think this is a really good useful tool on the engineer and a good

Combination with 01 and Claude no I personally don't think it is as good as something like cursor um I think cursor is just a really good Dev experience and I'm going to do more videos on cursor showing you guys how to build out more intricate builds if you want me to do a video on any specific topic let me know in the comments Down Below guys all right guys so that's pretty much it for this video if you're new here we

Upload videos every single day on AI automation business growth sales marketing Etc so if you want to stay up to date with the daily uploads make sure to smash smash that like button smash that subscribe button and comment down below what's your favorite AI pair programmer is it cursor is it Claude Dev continue Dev AER clad engineer Omni engineer what is it have you tried Omni engineer yourself if so let me know in the comments down below how you think it

Stacks up to some of the other ones and other than that guys I will see you in tomorrow's video thanks so much for the recent 6,000 subscribers road to 6 7K and then of course 10K on the way if you haven't already checked out our free community stri community.com link for that will be in the description down below our free Facebook group free Discord Channel other than that see you in tomorrow's video keep hustling keep grinding and of course guys accelerate

Your stride take care