FREE Google Gemini Flash 2.0 Realtime Is Insane!🤖 Beats OpenAI GPT?! Multimodal LLM Audio & Visual

What's going on guys Josh poock here now on this channel we've covered many different AI coding tools as well as different llms and new llms more advanced llms more capable llms have been coming out we've seen open source ones we've seen closed Source ones and recently of course we've been seeing open ai's 12 days of open aai where they've been releasing a new feature each and every day and they also just released their basically their feature where you can actually take

Your phone you can talk to open Ai and you can actually share your screen on your camera and it will see your face and you can ask you questions about where you are what you're doing how many figures you're holding up whatever the case may be and just when opening eye releases this Google's new model Gemini flash 2.0 releases with real time capabilities as well as a bunch of other really cool features we're going to dive into it show you exactly

What some of these new features are how to use them and how amazing this actually is I'm extremely excited for the future with AI guys it's getting crazy out here finishing off 2024 and 2025 let's dive right into it all right guys so everything I talk about in today's video will be linked down below here is the Gemini 2.0 introduction blog post right here our new AI model for the a gentic era and not going to go through read through all

Of this uh blog post here and I'm not going to go over every single nitty-gritty feature with Gemini's uh new release because there are a lot of cool features guys the main one we're going to be focusing on in today's video which is the real time feature okay but as you can see Gemini flash uh 2.0 right here experimental we're looking at the benchmarks right here we can see comparative to 1.5 uh 02 Flash and then 1.5 Pro it is pretty

Much beating it in every single metric so a huge Improvement you know Gemini flash has been known for basically being almost essentially free or you know even uh free to some extent um in the API and whatnot it's super super cheap super affordable and pretty high quality so so obviously right now we're in the AI race all the biggest companies in the world are putting all their money behind Ai and we're seeing open source models come out closed Source models come

Out open AI CLA anthropic whatever and I've always said don't count Google out of the race I know they had a few fumbles early on with some of their image stuff and image models and this and that but at the end of the day guys this is the company that owns the biggest search engine in the world Google and they also own all the different Google Suite so you know all the email app use Gmail Google Drive Google Docs all that

Good stuff right so much data as well as you're already deeply integrated into Google so um yeah definitely don't count Google out plus at the end of the day they've been at the start of AI development with Google Deep Mind and and initially they were pretty much ahead of the game and then they just decided not to kind of release anything to the public and then open AI of course was the one that took the lead but um yeah they definitely

Are not someone to count out but anyways just to quickly show you uh or mention some use cases before we Dive In agents in games and other domains so Hey listen I'm about to start a game and I want to make sure I uh complete the weekly quests um can you see them yes I can see them looks like you need to pick up 300 gems and dust 10 boss monsters you've already got a head start on the 300 gems cool

Um I'll ask you to remind me about it during the the game cuz I keep forgetting about it absolutely I'll keep an eye out and remind you about the quests hey so I'm planning to go on an attack uh but first I need to train an army so maybe you could recommend troop composition for my Army based on your available troops and their quantity in the top left of the screen we should train a mix of giants barbarians archers and wizards

The focus should be on using Giants to absorb damage while Wizards can take out high damage defenses and barbarians and archers can deal with the weaker buildings all right um that sounds good hey I'm about to pick a character um can you do a quick search and Reddit what is the meta as in like what are the best characters can set the price and amount you want to sell then wait for buyers okay so a few examples of using it for

Games which obviously can be useful if you're into playing games now here's a couple examples on Twitter so we have that gaming example we just went over live coding tutor by sharing screen and uh talking uh through it right here the audience here so what I'm going to do here is I'm actually going to have it walk me through as like is as if it's a code tutor here um I'm listen to me okay there we go Google set absolutely you

Can open up your terminal in versus code and type python main.py to run your python script okay so do you see that result yes I can see the result your program printed the random number 83 you are now generating a random how could I make that print as green that's a great idea to print the number in green you can use an's eye Escape codes okay so you get the point there um help with cocktail recipe with liquor stash AI assistant

To help you use tools uh virtual realtime piano teacher help with recipe by just showing your your refrigerator it's kind of cool um AI research assistant by screen sharing and talking to it so right now they currently don't have like the phone app I believe just like how open AI has it but you can just go to AI Studio on your phone and Sh uh you know put the camera on so you can share your actual screen like your uh desktop

Screen and you can also use your camera obviously since I'm using the camera right now on the webcam we won't be able to Showcase that feature but I was using it earlier I could like wave to it it's going to work the exact same way as AI research agent by sharing screen and talking to it um AI visual assistant this is great for you know blind people or disabled people in some sort of way um speak with an incredibly strong Tex

Accent like John Wayne um AI book ready reading buddy okay so bunch of different uh examples there here's one right here using Gemini 2.0 real time to that this guy helped him edit a video and Adobe Premiere Pro using the screen recording feature right here here here this person said they're absolutely mind- blown they recorded a screen capture of a task looking for apartment on Zillow Gemini was able to generate selenium code to replicate that task and described everything I did

Step by step this is actually really crazy it even caught um that my threshold was set to 3K even though I didn't explicitly set it this code will open a brow uh Chrome browser navigate to Zilla enter all the ETC so you can see there um it explaining it but that's really a really cool use case all right so we're we've been advancing so quickly I've been using some tests with this of course we saw Claude computer use not too long

Ago a couple months ago and now we're seeing you know this which we did see previewed by open AI a while ago but they just now are releasing it but this right here imagine coupling this with computer use you essentially wouldn't have to use your mouse or your computer keypad right here I'm wearing this right now um a wrist brace because I'm on the computer so much and my wrist get sore so using a mouse pad is actually very inefficient I

Find like it's it's you know I don't think humans are going to have to do that with like with computers the way we're going to interact with computer is the AI agent is going to be using it I believe and then the human is going to oversee it that's the you know we're headed to in the short term I believe in the long term AI the AI agent will just be going on its own doing a certain task and what not

Um there'll be a little bit less human interaction most likely but yeah that's my thoughts right there just you know with surrounding these type of uh you know innovations that we're seeing let me know what your thoughts are in the comments down below um but before we dive into turning on the real time right here there's a few options on the right hand side I really like um the Google AI Studio it's pretty cool you can change your model right here

Which is just Gemini 2.0 flash you can change the output so you can do audio or you can do text we're going to keep it audio for now but you can also do text and this is good too in certain ways I'll show you that in a second voice so you got Puck Chone and these other ones right here so you can choose whatever voice um you got tools here so this is actually very useful as well so you can do

Code execution you can enable this you can do function calling right here so if I enable function calling you'll see we have a code editor right here enter a list of function declaratives for the model to call upon see the API documentation for examples and then visual editor add function declaration right here um add a parameter description um or you can go here and you can actually just do try an example right here so you'll see this one is called get

Weather description get to the weather for a requested City and you can just do like that save and then automatic function response and grounding search results and provide links to relevant sources so this is obviously using Google search which is actually really useful now let's go ahead and start using real time so over here we have um we can start recording with voice or select video source so I'm going to select video source and I'm going to do screen cuz like

We can't use my camera cuz I'm using it right now I'm going to select the screen right here and then click allow okay it sounds like you're setting up screen sharing and need to allow access yeah I actually just did that where am I right now on my computer you appear to be on a Google AI Studio page specifically the stream real time section that's correct can you I'm actually doing a YouTube video right now on the Google AI Studio real

Time um feature that you got guys just launched can you briefly explain it and how I should use it and showcase it give me some ideas sure the stream realtime feature in Google AI Studio allows you to interact with an AI model in real time using audio or video input so you can have a conversation or give commands to the model and receive immediate responses you can select a model output format voice and choose if you want to use code execution

And grounding features to show how to use it you can start a new stream by clicking on the button with a plus sign next to stream real time then speak to the model and see its response okay what am I doing right now right now it looks like you are sharing your entire screen and your shared screen is a blank dark page can you see what what am I what am I what app am I in right now currently you're in

A code editor specifically Visual Studio code and you have a window open prompting are you sure you want to delete the following 16 files and you're also on a Google AI Studio window okay I actually just deleted those files and I'm actually cursor not Visual Studio code but very similar um I want you to teach me how to write some python code can you teach me I'm like a complete beginner can you walk me through step by step just give me

Some basic concepts tell me exactly what to write out and explain the code to me step by step as you watch my screen and teach me okay I can do that first create a new file named test.py by clicking on new file in the left panel now in the file type backup print hello hello world backquote and this is how we can print text in Python that's great you've typed in backquote print hello world backquote in the test.py file the autocomplete

Is a helpful feature of the code editor now let's run the code to see it in action how do I run it to run the code click on the terminal tab at the bottom of the screen then type back python test.py back back and press enter okay it ran great you can see that the output in the terminal says hello world this is how you run python code okay teach me something a little bit more little bit more like in beginner

Intermediate friendly just something a little bit more useful and not Advanced but useful okay let's learn about variables a variable is like a container that stores a value in the file test.py delete the existing line and type the following back quote name equals Alice back quote back quote print hello plus name backquote this code creates a variable named name and assigns it the value Alice then it prints hello Alice yes that is correct now go to the terminal and run the

Code again by typing backquote Python test.py backquote and pressing enter you should see hello Alice printed in the terminal okay give me something more advanced okay let's try using a loop delete the current code in test.py and type the following code backquote for in range five back quote quot back quote print I backquote this code uses a four Loop to print numbers from 0 to four note that the second line is indented with four spaces indentation is important in python as

It determines which lines of code belong to the loop now run the code to see what it does hey what do I type in again oops I see a mistake on my previous instructions the correct code should be back quote back quote backquote python for ION range okay well can you stop saying back quote sure I will refrain from saying back quote from now on is there anything else I can help you with yeah tell me the code okay please type

The following code into your test py file back quote backquote backquote python for I and Range Five print I back quote back quote back quote okay I understand I will avoid saying back quote from now on is there anything else I can assist you with well tell me the code without saying back quote okay please type the following code into your test py file back quote for right in range five back quote back quote print I back quote remember that the

Second line has four spaces of indentation in the beginning okay so I don't know why I couldn't get it to stop saying that that was kind of annoying for me but uh yeah it's annoying when you know you tell the model one thing and then it just does it the same thing it won't listen or whatever the case may be um I don't know if I'm doing doing something wrong let me know in the comments down below but let's go ahead

And just actually try um I you know I don't want to spend too much time I want to just showcase a few different things and you know you guys can explore it yourself but all right so now I'm going to Showcase it using um Adobe Premiere Pro this could be used with Photoshop this could be used with really anything regards to editing like cap cut um but let's go ahead and share screen right here and go here and select screen one

Click allow hey how's it going okay I'm doing well thanks for asking how about you good what am I doing what does it look like I'm doing right now it looks like you are using Adobe Premiere Pro you have a video project open and are currently in the editing view okay um I'm trying to uh you know do some cool like edits here like teach me something as if I'm a beginner editor like teach me maybe some transitions or effects or

How to apply them or do some like uh you know remove background noise or stuff something like that teach me a few different things step by step walk me through it as a a beginner um and tell me exactly where to click sure I can help you with that you're looking to learn some basic video editing techniques in Premiere Pro you'd like to know about transitions effects removing background noise and how to apply these you would also like a step-by-step guide

And specifically to know where to click is that correct yeah okay let's start with adding a transition first you'll need to make sure you have two clips next to each other on your timeline then click on the effects tab is that something you see in the program you are using um where's the effects tab okay I see the problem it looks like you are in the info tab on the top left panel you will see tabs named info effects markers and

History please click on effects do you see it now yeah I see it I clicked it great now that you are in the effects tab you will see several folders there should be one that is named video transitions click that do you see it uh yeah video Transitions okay good now expand that folder and you will see different categories of transitions select one such as dissolve and drag it onto your timeline between two video clips does that work dissolve um okay

It's a folder though ah yes my mistake expand the dissolve folder and then drag cross dissolve between two clips on your timeline do I drag it on the left or the right with a clip you want to drag it between the two clips so it overlaps both of them does that make sense it's not overlapping okay I see what's happening okay I see look I got it to overlap awesome are you seeing the transition now in your video Let's see okay

Next let's move on to adding an effect go back to the effects panel do you know how to get there okay I got the transition to work right now what's next great now let's add an effect go back to the effects panel and this time look for video effects do you see that folder yeah I'm was already in it okay perfect expand that folder and you'll see a wide variety of effects pick ones such as blur and sharpen then choose gaussian

Blur and drag it onto the clip you want to modify on your timeline blur look at look at my screen I don't see blur or sharpen okay it looks like the effect has been applied but it's not visible yet no that's cross disolve that's cross disolve I don't have blur like where is where are you seeing that you are right my mistake I apologize you need to go back to the effects panel and this time expand the blur and sharpen folder

And then drag gausian blur sharpen where is that I'm sorry again I keep making mistakes you need to First expand the video effects folder then expand the blur and sharpen folder there is no blur and sharpen folder you are absolutely right again I apologize inside the video effects folder you will need to find blur and sharpen as its own folder it is not within another folder as I previously said can you locate blur and sharpen now okay I found blur and

Sharpen great now expand blur and sharpen and then drag gaussian blur onto your clip is it working now yeah great now you know how to add effects and transitions do you want to learn how to remove background noise now okay what's the gausian blur do though how do I like change things for it good question after adding an effect you should see the effect controls tab next to the info tab click on that and you will see options to adjust the

Effect for gaussian blur you should be able to adjust the amount of blur do you see it info uh the info is down here effects control is up here is that correct yes you're absolutely right the effect controls tab is indeed located at the top of the window next to the info tab okay now my apologies now that you are in the effect controls tab you should see settings for the gaussian blur effect you added one of the options is blurriness

By adjusting the numerical value next to blurriness you can change how much blur is applied to your clip can you see that oh yeah now it's getting blurry okay great so now you know how to add Transitions and effects and how to modify those effects are you ready to learn how to reduce background noise okay so pretty good stuff there um it's not perfect obviously like it's not it's not as the model itself uh it seems It's maybe like hallucinates a

Bit more than you know something maybe like GPT 40 or clots Sonic 3.5 um but you know the concept of the stream real time is such a really cool concept and it works um and it still does work like you can get some really good value from this especially just when you're doing things and if you already have a bit of understanding to it and you kind of can just fill in the gaps and use it as a helper for certain

Things like say like I already know a good amount of a decent amount of editing if I need a specific thing like okay well let me do this with the audio or do that I think it's really useful now obviously it does take a bit of time going through each and everything back and forth um to actually get some real good quality use cases out of it so I would definitely recommend you guys go out and try it on your own

I think this is a huge step for AI Innovation and I think we're going to like I said before see more um in ation aligned with this aligned with you know clog computer use AI being able to control your computer you being able to just oversee it or talk to it like and I think that's um you know going to be aligned with uh AI agents in the future that we're going to see in 20125 coming soon we're going this is

Going to be a huge year for AI agents guys so um that's pretty much it for this video guys I'm going definitely going to be doing more videos on Gemini 2. flash let me know what your thoughts are in the comments down below about this mon model as well as this stream real time feature there are still a lot of other features that I didn't get to go over in today's video um because Google did a pretty big release so definitely

Stay tuned I'll do more videos on it coming soon all right guys so that's pretty much it for this video if you're new to the channel we upload videos all the time on Marketing sales ai ai agents automation so if you like that type of content you got some value here make sure to like the video comment down below and subscribe to stay up to date with the uploads also too guys if you haven't already joined our free Facebook group stri

Community and our free Discord Channel leave a link down below you can check that out and then also too guys if you haven't already checked out our stride AI Academy this is a new Academy that we're launching right now I've been actually spending the whole week getting uh it prepared the last couple weeks actually it's um filming new content there's going to be course content right here guys I I'm getting prepared for you there's going to be a lot of Engagement

In the community as well as just so much value packed in here you're going to be able to network with it myself as as well as other like-minded individuals guys so definitely check that out right now I will be launching the content coming soon and making being very active in this community with a bunch of free resources and all this stuff so I already have a lot of it all planned I have like documents and training and I've been recording so

Uh stay tuned I will be rolling that out fairly uh soon so and then also too guys if you run a business and you need to help with Marketing sales AI agents implementing AI appointment CS Ai call center into your business that book a call down below at executiv st.com apply and you can speak to my myself and my team and see if it's a potential fit or not other than that guys I will see you in the next video let

Me know what your thoughts are about Google's real time in the comments Down Below guys keep hustling keep grinding and of course guys accelerate your stride take care