Video16 min watch

NEW: DeepSeek Coder V2 Is Insane!πŸ€– Open-Source Continue Dev Setup (Github Copilot FREE Alternative)πŸš€

Links from the video

Transcript

2,397 words

What's going on everybody Josh pook here and if you haven't heard of the new deep seek V2 coder uh mure of experts model we're going to be diving into that today show you I can start using this model and leveraging it in your coding projects or just in general for whatever the case may be this project or this Co this model has been um hitting some really impressive benchmarks we'll dive into all that in just a second it could potentially be

One of the first open- Source Rivals to some of these uh Frontier models that we're seeing such as GPT 4 o GPT 4 Turbo as well as Claude Sonet 3.5 I'm going to show you I set it up so you can use it in your coding environment and we're going to look at the actual numbers let's dive right into [Music] it all right guys so everything I go over in this video links will be in the description down below so you

Can follow along but just to get right into it um here's deep seek if you're not familiar with deep seek they're a Chinese uh company um it's essentially supposed to be like an open source um model right and you can see here here I'm just going to go over some benchmarks real quick I'm not going to go in depth but you can see this right here of course is on their website so it's made by the actual makers of it so

You you sometimes may want to take certain things with a grain of salt but I mean it looks pretty somewhat accurate I would say at least from what we're seeing from Cross referencing these other resources that I'll show you in just a second but we can see here deep seek V2 um is doing performing better in a lot of things like coding reasoning math uh arith arithmetic uh knowledge uh English General then we have Chinese General and you can see here

It's the open source yes and all these other model aren't except for the ones down here um and even has okay so it doesn't have quen 2 it doesn't have some of the ones that are like very um neck and neck with it like it doesn't have CLA Sonet 3.5 on here it does have Claud Sonet 3 on here and Opus uh three but um you can see it's pretty impressive just at looking at this now I'm going to go over

To this is big code bench I'll leave all these uh metrics you know links to these in the description too if you want to check these out and these are just websites I'm going over that are essentially like leaderboards for these uh open for these models in general just open close whatever the case may be basically like a competition to see where they stack up with each other based on a bunch of different tests so you can see here on big

Code bench we got gp4 turbo at the top then Claud sonit 3.5 and then we have deep seat coder V2 instruct um and then we have deep seek uh V2 chat right right then Gemini 1.5 Pro um and then all these other ones right so um pretty pretty I mean pretty cool and then let's take a look at AER so if you're not familiar with AER um this is basically kind of like a co-pilot um that you can use within your

Well you know uh coding uh environment and I've done videos on ader before I'll continue to do more and basically they do uh it's a really good tool it's a really useful tool anyways they did a comparisons and coding with llama 3.1 new deep seat coder and mistal large so basically just summarize kind of what they are sh here and um basically what they show is that like deep seek um deep seek uh deeps V2 coder uh performed substantially better than

They thought comparative to like models like uh quad 3.5 Sonet and these other top models that they didn't even uh really expect like let's go to AER leaderboard here and we can see um their benchmarks so we got Claude Sonet right here at the top and then they have deep SE coder V2 at the second place right here and there's a bunch of different tasks right there's code refactoring leaderboard um this one is code editing leaderboard and deep seek okay so

It didn't end up on this one but yeah you can check this out and they basically like were pretty surprised about um how good deep seek did and a lot of people are quite surprised to be to be honest and then here's the LM CIS leaderboard chat uh chat bot leaderboard Arena this is on hugging face or lmis but hugging face also has it on here and you can see here we got um where is it deep seek I believe this

One's a bit lower yeah deep seek V2 API um so yeah just showing you that they've been pretty much performing on all these different leaderboard charts all right so now that we got that out of the way and also too guys you want me to make a video like showing you how to use it with AER let me know um I may do that anyways but I'm going to show you how to use this with continue uh dodev there's a bunch

Of coding assistance continue dodev is basically an alternative to GitHub co-pilot open source so you don't have to pay for it um and it's actually really really good and really useful I use it all the time so anyways this is also their uh kind of research paper right here um their article on uh deep seek V2 I'll leave a link to this it's on archive but um yeah it kind of goes over the mixture uh of experts you know model and

Kind of just how they trained it and and whatnot and all that good stuff so as well as just benchmark Mar and coding benchmarks and programming so um pretty interesting also too guys it is on AMA I'll still leave a link for this but you're pretty much not going to be able to uh self-host it unless it's like a smaller model but for the V2 coder um I'm going to show you just how to use it with the API so link

To the API docs will be in the description down below which are right here and if you're familiar with continue dodev um link for that will be in the description down below you're going to want to download that you can use it with vs code with jet brains once you download that it's going to be like an extension so here's my vs code and I don't know why all my stuff closed but there's my vs code right here and as you

Can see once you install it so you're just going to go to uh your extensions right here search for continue and continue dodev will show right here you're going to install that once you install that um I drag L over to the right hand side it will it will show up right here I just dragged it over here and you'll be able to see like your chat right so I'm not going to do an in-depth dive through continue. Dev I've covered

It in many videos and I'll continue to do tutorials with it but um basically over here it looks like they actually just got a a little bit of up uh update so it's a little bit of a different UI here but you click here you can add you can select different models you can add models and you can also go to um let me just see uh so if I go here add model so here's where you can add different models

So you can start with a provider or select a specific model you got open AI anthropic a your mistro AMA coh here grock deep seek oh oh wow okay so I didn't even know they had inter just a native deep seek right here so they have that pretty cool um together AI uh we use that LM studio so a bunch of different stuff but um let's see so deep seek you go here you would paste in your API key so the

Way you get your API key is you just simply go to your platform. deep seek.com so you're going to need to make an account and you're going to need to top up your balance uh you could start with like five bucks whatever the case may be also too just to go over a bit of the pricing here here is what the pricing looks like so it's pretty uh cost effective comparative to a lot of other models uh especially with this type

Of quality but that's what you're looking at for the uh input price and output price so we got 14 cents per million tokens input 28 cents per million output and uh yeah so also too this is the base URL right here which is api. deep seek.com so um basically once you got all that you have your API key you can paste it in here but I believe um you want to go to click on this gear icon to configure the settings

It's going to open up this which is uh your config.js right so as you can see I got a bunch of models like I got gbt 40 mini and um yeah you can if you want to like it's pretty self-explanatory like once you get the once you kind of know how to add models you can kind of add different models but this one right here is a deep seat coder so what you're going to do you're just going to once you

Add the API key actually here and then you say uh save it and you go to there's config you may actually see you should probably see some sort of deep sequ one uh within here so I'm pretty sure um basically if it doesn't look like this already just make sure it does so your API base is this right here https colon sl/ api. seek.com uh completion operations doesn't matter uh at least for this model deep seek dcoder API key this is

Where're you're going to paste your key and then provider open Ai and then title deep seek dcoder okay once you do that you can basically um let's go back to our continue dodev right here we'll go to new chat and we can just say hey write me some python code for scraping a website I'll just put that it's pretty broad but sure scraping our website we're going to use Library like request fetch HTML content beautiful sub PS4 packages to parse and

Extract data there's a simple example to get you started all right pip install beautiful soup and then here's the python code pretty basic obviously you would need a little bit more than this but but um yeah so this as you can see this is using deep seek now um speed it's not the fastest not like grock by any means I mean you can't really expect a model to be like that but keep in mind this is quote unquote like an open

Uh an open source model deep SE I mean this is something you could host on your system potentially if you had a powerful enough system through Lama you can host smaller models on your system so really impressive stuff that this um Chinese company is doing and uh interesting to see how they continue to um Advance their model all right we have some really good open source models like quen um deep seek you know even llama 3.1 is you know somewhat up

There um so yeah this this is actually very exciting for coding and as these models especially that are open source um start keep advancing with uh with their you know their coding capabil ities and whatnot so other than that guys let me know what your favorite coding model is in the description down below me personally I mean if I want the best results I still favor Claud on at 3.5 I just personally get the best but deep seek I mean this

Is pretty interesting ader has them as second for some things you know they're pretty high in the leaderboards for open source um but yeah let me know in the comments Down Below guys also if you're new here we upload videos every single day on AI automation coding marketing business growth Etc so you're a coder developer entrepreneur business owner SAS founder whatever the case may be make sure to smash that subscribe button smash that like button if you got some value here

And you want to stay up to date with our daily uploads we upload every single day and uh yeah we're just going to keep on stacking the value keep on improving the content so any suggestions let me know in the comments down below also if you haven't already joined our free community stri community.com link for that will be in the description down below we have about 750 to 800 members on our free Facebook group free Discord channel so you can join

Network with myself as well as other like-minded entrepreneurs AI uh Enthusiast coders whatever the case may be and other than that guys I will see you in tomorrow oh also too guys if you haven't already checked out my book client acquisition code link will be in the description down below you can get a copy of that to help you grow your business pack your calendar with warm qualified leads leverage AI in your business um other than that guys I will see

You in tomorrow's video keep hustling keep grinding and of course guys accelerate your ride take care

Latest from the blog

View all