NEW Lama 3.3 70B Meta AI Best Open Source LLM!?🤖 [TESTED] Beats Lama 3.1 405B?!
In this video
- 00:00Introduction to Llama 3.3: Meta's New 70B Open Source AI Model
- 00:39Overview of Meta's AI Models: Llama 3.1, 3.2, and 3.3
- 01:05Performance Benchmarks: Llama 3.3 vs. Llama 3.1 and Closed Source Models
- 01:28Llama 3.3 Evaluation Highlights and Benchmark Comparison
- 02:24How to Access and Download Llama 3.3 Model
- 02:45Running Llama 3.3 on Hugging Face and GLHF Chat
- 03:30Python Function Test: Generating Fibonacci Numbers
- 03:52Batch Script Test: Creating Multiple Files Automatically
- 04:07SVG Generation Test: Creating a Tree Illustration
- 04:41Testing Counting Accuracy: 13 Sentences with 10 Words Ending in "Monkey"
- 05:11Building a Pong Game with Python: Pass or Fail?
- 05:42Creating a Beauty Store Landing Page with HTML/CSS/JS
- 06:09Logical Puzzle Test: Light Bulbs and Switches Solution
- 06:36Bear Riddle at the North Pole: Correct Answer Explained
- 07:25Word Count Test in Model Responses: Pass or Fail?
- 08:15Truth-Telling and Lying Riddle: Identifying the Safe Door
- 08:38Correctly Labeling Boxes of Apples, Oranges, and Mixed Fruits
- 09:24Solving Math Derivatives and Systems of Equations
- 09:55Calculating Speed and Normal Distribution Statistics
- 10:18Python One-Liner: Numbers Divisible by Seven
- 10:49Responsive Grid Layout with HTML and CSS Test Results
- 11:29Final Thoughts on Llama 3.3: Open Source AI Advancements
- 12:00Free Stride Community and AI Academy Announcement
- 12:28Stride AI Agents for Business Automation
- 12:45Closing Remarks: Accelerate Your Stride!
Links from the video
Transcript
2,658 wordsWhat's going on guys Josh pokok here now recently meta just released their new llama 3.3 open-source AI model and this new state-of-the-art 70b model is supposed to have similar performance to llama 3.1 405b model open source models are progressing rapidly and we're seeing them getting closer and closer to actual Clos Source models we're going to dive into it today show you how you can use it and run some tests and see what it's made of let's dive right into it all
Right guys so all the links in this video will be linked down below so if you want to take a deeper look at this mono you can definitely check that out I'm not going to be able to go through each and every little thing today but I'll start by giving you an overview if you haven't heard of this model all right so the main models that meta currently has is llama 3.1 which they had the 8B the 405b and they had
Llama 3. 2 which is a lightweight model which is like 1B and 3B and then 11b and 90b and now they have llama 3.3 which is a 70b model and they've been pushing something which they call the Llama stack now if we look at the Llama 3.3 EV valves we can see that they are very impressive obviously I'm not going to go through each and every little one here as you can see LL 3.3 70b comparative to llama 3.1 70b it
Is beating that uh that model in many different benchmarks as you can see here as well as the 405b model it is um just below it in certain areas and it's even above it in other areas so we can see human eval it's just one below uh math we can see that it's actually Four ahead or three ahead of of the 405b model reasoning it's at 50.5 when the 405b model is at 49 and you can also see it compared to
Gemini Pro 1. 5 uh GPT 40 encl Sonet 3.5 here all right so benchmarks definitely don't mean everything by any means you know when you actually start testing it sometimes you'll get a better sense which we're going to get into in just a second but as you can see these are definitely some pretty impressive benchmarks you know in certain areas it's actually sometimes a little bit above quad son 3.5 or below quad son 3.5 in other areas so it's impressive to
See these open source models catching up now there's a few main different places you can actually access this model if you want to download this model you could go to llama.com L downloads right here I'll leave a link down below and you can request access to this model like so and get it right away you could go to hugging face right here and we can see the Llama 3.3 instruct model right here we and we can also go to O llama
Right here we can see llama 3.3 right here we can see all the different information on it right here evals new capabilities tool use Etc so pretty cool all you would do is simply just AMA run now you you would need some pretty good Hardware to actually run this locally but you can actually access it on either met. a or gf. chat right here which we're going to be using to actually run some tests all right so here are some of
The test questions we're going to go ahead and ask L with 3.3 let's dive right into it write a python function to generate the Fibonacci sequence up to the 10th number all right so it generated this really fast I'm going to go ahead and run this code all right so here we have the code I'm going to run this and we can see that it got this is correct next I'm going to say generate a batch script to create 10 files
With the names a1. txt through a1. txt all right so now we got that script loaded up that it generated I'm going to run this and boom it created those files so that is a pass next is a question a factory produces widgets at a rate that doubles every 3 3 days if it produces 100 widgets on day one how many widgets will it produce on day 19 explain your reasoning step by step and boom it got the answer correct rect
Which is 6,400 widgets and you can see all the different reasoning steps right here which is actually really good next is generate an SVG of a tree okay I pasted the code here and as you can see this is a pass all right next I'm going to ask it a pretty hard question that I haven't seen really any L pass just because they're not really that great at counting specifically generate 13 sentences that have 10 words and end in the word
Monkey okay so this is kind of interesting this is like one of the only ones that I at least remember um that actually generated it seems at least for my account each and every phrase or sentence has about nine words in it and they do end in the word monkey but then I said okay these have nine words it should have 10 and then they said here are 13 new sentences with exactly 10 words that end in the word monkey and
From what I can see it literally just gave me the exact same output so so this is a fail but I mean it was almost kind of impressive that it got nine like it did each one having nine most of the models I've done this test on will have like 10 11 even 13 8 right so it's a fail though next is generate me the pawn game using python all right so now I got the code in here I'm going to
Run it and boom we got the pawn game here it has a scoreboard at the top this is definitely one of the better Pawn games that um one of the models has generated it pretty much has everything working well out of box the scoreboard is working so this is definitely a pass all right next is a question a man stands on the rivers side his dog on the other the man calls his dog who immediately crosses the river without getting wet
And without using a bridge or a boat how did the dog do it the answer is that the river was frozen that's correct next is create a landing page using CSS JS HTML it should be a website for a beauty store that has a header Banner features testimonials and checkout section make it look professional and very modern all right so I got the code here let's go ahead and check this out okay so here is the beauty store we got the
Home Home Products about us contact us we got a banner a featured section right here a customer testimonial section a checkout section so all in all it's definitely not beautiful it's you know not the greatest store by any means and I personally wouldn't use it but it did get this question correct so that is a pass all right next question you are in a room that has three switches and a closed door the switches control three light bulbs on the other
Side of the door once you open the door you may never touch the switches again how you definitely tell which switch is connected to each of the light bulbs all right so it said turn switch one to the on position for 5 minutes this is to heat up the corresponding light bulb turn switch one to the off position and turn switch two on to the on position immediately open the door and observe the light bulbs the light bulb that is on
Is controlled by switch two the light bulb that is off but is warm is controlled by switch one and the light bulb that is cooled is switch three that is correct right next is I left my campsite and Hike South 3 miles then I turn East hike South uh East for 3 miles then I turn north hike for 3 miles at which point I came across a bear inside my tent eating food what color was the bear all right so it
Realized that the only way you can actually hike um down right and then up and be at the same spot is the North Pole which would mean it is a polar bear which would mean that it is white so that is correct all right so next is an answer that most llms have gotten wrong it is how many words are in your answer here let's see what it gets okay so it says the conversation has just begun and I'm going to
Try again and say how many words are in your response here all right so it said in my response there is one word that is incorrect there is 1 2 3 4 5 6 7 so that is another fail all right next question in a room there are two men one lies and one always tells the truth you don't know which is which you may ask one question to one of the men to determine which room which door leads to freedom
And which it leads to death which question do you ask so solve this I would ask one man if I were to ask the other man which door leads to Freedom what would he say if I asked the truth teller he would tell me that the liar would point to the door that leads to death if I as a liar he would tell me what the truth teller would say and say and point to the door that leads to death so
Regardless of who I ask the answer will steer me away from the door that leads to freedom I can safely assume that the opposite door leads to Freedom so that is correct all right next question you have three boxes labeled apples oranges and apples and oranges each box is labeled incorrectly you can open one box and look inside how can you label all boxes correctly by opening only one box all right so it said since all the labels are incorrect the
Box labeled apples and oranges cannot actually contain both apples and oranges it must contain either apples or oranges let's say I open the box and find only apples inside this means the Box labeled apples cannot contain only apples since it's labeled incorrectly it must contain oranges the Box labeled oranges must contain both apples and oranges since the other two options are taken if I open the box and find only oranges inside the logic is similar the Box labeled oranges contains apples
And orang oranges and the Box labeled apples contains oranges all right so this is correct all right so next is find the derivative of FX = x ^ 3 subtract 3x ^ 2 + 2x subtract 1 all right so it said that the answer is FX = 3x ^ 2 subtract 6 x + 2 which is correct next is solve the system of equations 2x + Y = 5x subtract y = 1 all right so this answer is x = 2
And Y = 1 which is correct next is a car travels 100 m in 5 seconds what is the average speed in me/ second and kilm per hour and it got 20 m/ second and 72 km/ hour which is correct all right next is the heights of a group of students follow a normal distribution with a mean of 170 cm and a standard deviation of 10 cm what percentage of students are taller than 180 cm and it got approximately 15.87% of
Students are taller than 180 cm which is correct all right next is write a python oneliner that creates a list of numbers a list of all numbers from 1 to 100 that are divisible by seven all right so I got the code here I'm going to run it and you can see that we got all the different numbers that are divisible by seven here so that's another pass next is create a responsive grid layout with HTML and CSS that displays four
Items per row on on large screens two items per row on medium screens and one item per row on small screens okay and here is our code live let's go ahead and shrink the screen here so we got four items on a medium size screen we got two and then on a small screen we got one so that is correct again all right so there are all the questions uh honestly I definitely need to get harder questions now that these open
Source models are getting a lot more advanced but as you can see I mean it did the similar type um results as 01 and Claude Sonet 3.5 um it did a little bit better than deep seek 2.5 at least when we did the test here deep seek failed on a couple um so all in all guys I think llama 3.3 is a pretty great model and it is exciting to see these open source models catching up in some regard to these
Clos Source models I think we're going to see a huge boom in open source models in 2025 and just the AI space in general it's so crazy right now what's going on in so many different areas a lot of new updates are happening I'm going to make sure to fill you guys in we upload videos all the time on Marketing sales AI open source tools text so if you like that type of content you got some value here make sure to
Like the video comment down below and subscribe to stay up to date with the uploads also too guys if you haven't already joined our free community stri community.com for our free Facebook rib and Discord Channel I'll leave a link down below and then also too we actually just launched our new stride AI Academy I've been working really hard on it this week I've been filming course content and doing a bunch of stuff to get it ready for you guys so definitely
Join right now while it is free there may be a price tag to it in the future and it is going to be jam-packed with a bunch of different free resources resource Vault courses you're going to be able to network with myself as well as other like minded individuals so definitely check that out below right now and then also do guys if you run a business and you need help with Marketing sales implementing ai ai agents Ai call center into your
Business to call your leads book appointments for you on autopilot while you sleep and book a call down below at executive.com slapp and we can see if it's a fit not other than that guys I will see you in the next video let me know what your thoughts are about llama 3.3 have you tested it do you think it's better than llama 3.1 405b do you think it's the best open source model out there or do you think another model is
Better I will see you in the next video guys keep hustling keep grinding and of course guys accelerate your stride take care