NEW: AI Youtube Scraper - Scrape UNLIMITED YouTube Video Transcripts!π€π·οΈ Apify + Make.com + Airtable
Links from the video
Transcript
5,563 wordsWhat's going on everybody Josh poock here in today's video I'm going to show you how you can extract and scrape YouTube video transcripts and automatically have them uploaded into air table all right guys this is some very powerful stuff because once you actually extract the transcript full transcript of any single YouTube video as well as I'm going to show you how you can extract the top 20 comments on the top YouTube videos in your industry so you can do sentiment analysis
Analyze them with chat GPT a bunch of cool stuff come up with content ideas you name it the possibilities are really endless so let's Dive Right In okay guys so there are a couple different ways you can do this I'm going to show you one way right now I have um some really really valuable videos planned this week that I'm going to be doing so if you're not subscribed yet and you want to stay up to date for that make sure
To smash that subscribe button smash the like button and uh if you want something specific comment down below let me know but I have some stuff ready for you guys that involve make.com airtable chat GPT automations really good stuff even go high level so we'll uh we'll get into that later on and these are going to be more in-depth builds walking you through step byep St showing you like real some really ninja uh stuff trust me like trust me when I
Tell you this um I hope you're ready but anyways I want to show you something right now like like I said YouTube transcript how do we get that what do we do I'm going to show you how you can do it um you can use this in multiple different ways of course and there are there is a couple other ways that um that you I'll probably show you like I said in future videos but for now I'm going to show you
A really really cool way that and it leverages this tool called zero code kit all right so like I said there are other ways to do this um which I haven't seen too many people you know talk about even this is pretty I guess somewhat lowkey so I'm going to give you the exact python code too in the description so yeah I'm not even going to gep that or just show you the code now keep in mind too guys like I
Didn't I'm not really a coder I do know a bit of code but um realistically like you don't need to be a coder to use make and do all these automations first off if you do encounter something where you need to build like some custom code or like a pattern or whatever I mean you have ai it's like you have a coding expert at your hand um so be resourceful all right be resourceful be resourceful be resourceful you have ai use
AI ask it the right questions that's what I do to build this stuff out basically gets me to gets me to be able to build out Advanced automations and advanced stuff if I ever run encounter any issues I simply just ask AI all right that's usually my go-to um and then of course you know looking on on line YouTube Etc but so I'm just going to quickly explain this workflow I'm not going to like build like I'm not going to show
You every single thing and you need to build this exact workflow I'm just going to show you kind of what it does you can take these principles and apply them to your build like I said we're going to be doing in-depth builds this week here's an example so right here we just have some YouTube videos so these ones are actually already transcribed I'm just going to remove these um okay and I'm going to remove those transcriptions so I just all I
Have here is the link for the YouTube video all right and you know this has a bunch of different fields in this table but really all you're going to need the main thing you're going to need is a link excuse me a link all right so as you're going about your workflow you find a YouTube video hey I want to transcribe this what would you do with the transcription after well you could do like a summary you could do a timeline
You could get uh key key Concepts pulled from there you could do a lot of stuff and of course I'm saying when I say you I'm saying you connect J gbt to analyze transcript and you can pull out different content ideas Maybe different learning resources like so many different things key Concepts you can do this with podcast whatever doesn't matter and few things before I was doing it this way and I I do do it also like I said a different
Way too but this way is really good and before I was doing it like this I thought oh you're going to have to download the YouTube video upload it transcribe it all this you don't need to do any of that um YouTube like already has the the captions and stuff once you upload YouTube so don't have to like actually download it or like have it downloading in your scenario that just liter like you can't do it because YouTube videos are so
Long and it it would use up all your data um data data that you have for the month and and all that good stuff so what we're doing here and if you're not familiar with How I build out automations and scenarios with air table and make when I'm using those two I don't do like I I mean sometimes but I rarely rarely like I I very rarely like to start my automation with a watch records just because like you have less
Control in my opinion what I like to do is I like to go over to my automations within air table and which one are we doing transcribe YouTube video as you can see I have a lot of stuff cooking up here so I'll be sharing some of the these things with you um but um yeah so yeah I got some good stuff coming for you guys uh anyways literally all you all you need need to do you have a trigger so
My trigger right here is transcript right status has changed to transcript what's that going to do is run a script all right I always just like to do run a script you could put this as a button where you click it in the data table I just like doing it like this like because it's like you can move it through stages it's the best that I found sometimes in specific scenarios if I need to do a button I could do that
But and if and if like I'm saying some stuff like off like right now and you don't know what it is don't worry CU I'm all you have to do is follow along with exactly what I'm doing if you don't if you're very new to air table or make or whatever and you don't know certain things that I may like reference don't worry about it I don't want you to get overwhelmed if you just follow this step by step it's going
To be very very easy for you um once you actually do it I'm literally giving you the code too so don't have to be a coder like I said but this is just literally uh basically going to trigger a web hook since a table doesn't have like a native integration with um or like a really it doesn't they don't have a really good trigger within make um so yeah this is just saying let URL and then we're putting the uh air
The web hook URL right here so I'm simply copying that pasting it over here and then I I actually did a video like I I mentioned again yesterday I did a video like 3 days ago going over I literally give you this code I'll try to put this code as well in the description this is the web hook code but I did a video explaining the web hook thing so if you need like to actually know how this is and you
I would suggest doing it this way for your for for your scenarios go check out that other video but realistically you actually only need you actually only need to pass one variable through realistically and that's just a record ID I for some reason I just always pass the base URL as well as sometimes I'll pass like a one two uh other variable simple you just add Vari you can delete them here and then you just change the the variable like right
Here this is just building a string for the URL so it's literally just fetching the URL adding the string you only need the record U ID though but yeah if that doesn't make sense you don't how to set that up like I said go watch that other video it's a very short one showing how to set that up okay what that's going to do is yeah so one that status is triggered within our video database right here our YouTube video database
It's going to this is why you really only need the record ID because you can just get record right after with the air table um you can do a air table module to get record and get it by the record ID this works way better and it makes way more sense than passing like I used to when I built these out I thought I would have to pass like multiple variables like and then I would have to like change the code
All the time or whatever then I started only doing like a one two but then I realized oh you actually just need to pass the record ID only because um because then you can just do a get record and what that's going to do as you'll see I'm able to literally pull uh like every single record that I or every single field that I need and this is good too because if you're like once we get this transcript and then if
You want to pass it back through a web hook and like have like a different scenario with um chat GPT or you could include that within here but what I'm basically saying is if you have a long piece of text and you're trying to pass it through a variable here it's not going to work it's going to be slow that's CU a air table so if you get the record ID this way you can grab everything and it's like instant instant
So this is how you want to do it next appify guys if you don't know about appify I basically probably just changed your automation life right now yeah you can just thank me by subscribing if if you get value from this but this is a great tool I'm not going to do a deep dive right now but like I use this a lot and I do a lot of really cool things with it and I'm going to show you even more
Like if you think this is cool what I'm about to show you if you think that oh after you watch this video If you think you got value from this I have some stuff that's literally like 10 20 times more valuable that you're going to see but basically I'll give you a quick like rund down and show you some use cases right here basically appify long story short there's a store here you can create an account there is like a free
Version that gives you $5 a month and you can create like two workspaces so you get like 10 bucks right there I it like if you're using automations just trust me like just just buy it it's like 50 bucks a month it's it's really crucial to do these things it's it's awesome like we have a Tik Tok scraper cial scraper Instagram scraper lot of lot of cool stuff and um yeah you don't need to know anything about coding you don't need
To be able to like you don't need to understand Puppeteer or or or or any of those scraping uh languages you literally just use these apps some of them are like uh the ones that are maintained by applify are like free but you you have like credit it's a credit system as you can see I spent 19 bucks this month out of 49 so like pretty good um and I've used it quite a bit um but some of like it's like
Either like a some of them you rent them or some of them it's like a charge per basis so this one right here I'm using in the scenario is a YouTube comment scraper it's this one by API Dojo it's pretty good um so let's see let's go back to our scenario here right here okay so all I'm doing is I'm running an actor so that's what they're called actors because like like an actor reads off a script these a like these
Scrapers obviously run off a script all I'm doing is I selected my actor right here which is the YouTube common scraper then I'm inputting this Json text right here oh oh no don't get scared about the code you don't have to write this all you do is you go over so once I use like decide what actor I'm using um this is like an example of a URL like that you can put in you could bulk Ed it Etc um don't
Yeah it's very simple you just put a URL in and sort latest or top options I did like I think I did 14 14 and um and then Json right here you can just click on Json copy this over and then you literally just paste in that Json right here and then you just switch out the link or the variable in your air table database right and guys you don't have to use this comment act commentor with an appify I'm just
Showing you this scenario you know you made like this isn't the transcript part um this is just like an additional thing that I had transcript Parts over here we're going to get to that in just a second but um obviously with comments you can get like sentiment analysis you can like be able to see what the overall consensus is about like a video um let's say like a lot of people in the comments you know comments are a great way to
Gauge how an audience maybe on a popular video is receiving it what questions they have this can give you like you can use this for many different things like you could get uh video ideas or topics from different comments on some top videos in your industry right now what we're going to do anytime you run an actor you're going to want to to actually get those results you're going to want to set another module and for this module we're not going
To use the Run actor module because we just did that we're going to use the get data items data set items very simple all you're going to do is you're just going to click here and you're going to add that variable of the data set ID all right that would have been in in uh you can like search it you can just search data set ID and default data set ID that that right there and once you have that too if
You ever need to like be testing it you could just like copy this and you can do this with anything if you need to test it so you guys know if you're new to make you can run this module only paste this in and then boom you can see here we got results right so what this is doing right here is these are pulling different bundles and what I'm like about to show you guys I mean like I said if you're
Not doing the comment this whole comment thing you don't have to worry about this this is like I guess a bit more not even Advanced but it's like it's just a little bit more technical I guess but it's not really all right it's just like if you don't know it's it could be technical but it since I'm showing you it's very simple like you literally just do what I show you if you're trying to do this all you do is when
You pull something like this these are like different bundles um right and this this happens like a different times in make depending on what your module is um so like if what we want to do is we want to um put these together all right so like we want just to I want to take all those bundles put them into one text string and then put that in our air table base instead of like having all these different bundles right but
All we do is we just add an array aggregator and I did a video on array aggregators text aggregators and uh iterators like I said a couple videos back as well so if you need like want to go more in depth on that check that out I'll show you exactly what to do for this all right and these same principles can to be applied if you're doing something similar with a different build um in the future all you're doing is you're
Doing an array aggregator your source is going to be the the one recent the most recent appify G data set all right cuz we're getting those comments then you're just going to select the uh items that you want which for us it's just the text which is the comments if you wanted to you could do like count reply count whatever there is publish time and author but I just want the comments that's all I really care about boom and you're going
To see we get this little like gray thing right here what this does so you know as well now like these there's actually two um this one's going over here and then there's as I do the same thing at text aggregator this one goes over here and I'll show you that in a second but just so you know anytime you use something like this it's basically making this data like these modules exclusive so I can't pull over here in my zero
Code or my uh air table I can't get this data anymore since it's only between these two these two are like basically exclusively together just like these two modules they're kind of like dating or or whatever and thing with this I guess it's like uh they're having like some you know yeah multiple partners what but anyways um yeah so text aggregator boom what I'm doing here is I'm going to have to double check to make sure this is 100% working um
Once we run it but just because I'm a nice guy just because I don't want to fully like I'm going I'll just leave this code in the description so you guys can literally just copy it all right but this is basically what you're going to do and and this help and you can do this anytime you're using an array I'll move my head a bit here so you can kind of see it's literally just array uh and then zero and then
This is the right here this is that so we're getting the first comment and it just you put zero and then you go get one the second comment 2 3 4 5 6 7 8 9 10 11 12 all the way to 19 we're grabbing 19 comments here all right so that's the commenting part that's cool next is a transcription um so like I mentioned before there's there are a couple different ways to do this um this is a good way
Though um and this like either way there zero code kit so this zero code kit they give you about I think 25 free runs and then I think it's about 10 20 bucks a month for like 5,000 something like this don't quote me on it but it's a really cool uh tool basically what this allows you to do is it allows you to run code within your make scenario so like if I go to zero code kit you can see here
We get like a bunch of different options which is really awesome um we can run JavaScript code we can run python code we can do PDF OCR we can like I mean honestly guys I haven't even you know went touched went to the tip of the iceberg with this this tool this module right here definitely going to be exploring it and building more stuff with it um in the future like like this week next week forever cuz it's an awesome Tool
Uh you know look at all these things you can do it like there's so many different options with this actually um kind of a diamond in the r uh you know on the rough or whatever um so yeah let's see so all this is is all you really need to know is this is just python code importing um YouTube transcript API YouTube transcript API uh import Json actually we don't I don't even need this actually this is from something else I
Could actually remove this I'll just leave it just because it works because we don't even need the Json formatter but um all this is is oh another thing uh um in your air table what you're going to need to do and like you we could have built this python so it just is the URL and then converts it to the ID but just just the way I built it is it's going to grab I believe the uh let's just show you
Real quick video ID boom so the video ID all it is is cck here this is just the air table formula which is grabbing that YouTube link and then basically only grabbing the uh a video ID at the end of it all right so yeah just copy this um you know what yeah I'll put it in the description for you guys just cuz yeah who cares right I'll literally give you everything so uh make sure to smash that subscribe button if
You guys are enjoying this so yeah all this code will be in the description if I whatever if I left anything out or whatever just let me know but you should be good and then yeah just copy this put it in here and after that all you're going to need to do is just update your air table so you just go here you add a uh update uh module update record you're going to reference the the same record ID that we
Got you can either reference it from the web hook or from the search uh get a record and then we're just going to put that transcript from uh you know ozero code and then we are going to um what else oh yeah comments so here we'll go this this is it sign up for free this should be good let me just save it and we're going to test it all right sometimes let just so you guys know sometimes there's issues sometimes
There's bugs so I don't get it right the first time we're going to troubleshoot it but I think it should be good go ahead and just run this so everything works out well we just move this here then here we're going to do this one to start start off okay let's see what we got here we got the YouTube okay we got now we're running the actor to get the comments the only thing that I'm potentially don't know if it will
Work perfectly is the comment one so everything worked out we see these little sech things so that's good um let's check the air table so as you can see it's now at okay so now it's so we got this transcript right here the whole YouTube video transcript boom um that's 16 uh 1,78 characters right there so it's pretty long and now the Moment of Truth okay look at that Bravo I'm going to give myself a pat on the back and if
You followed everything to the t2 where we're at right now give yourself out a pat on the back you know what matter of fact give yourself a round of applause because you just buil something that um like probably like 80% of people don't know how to build stuff like this and don't just stop here take the principles you learned in this video and think about how you can actually apply them to real life things that you would use in your business
Or your personal life whatever there's so much you can do once you start understanding this guys um I really hope you think of like your brain should be going through all the possibilities with this stuff using apify using scrapers using air table building out like very good robust infrastructure um and yeah you can it's really crazy guys like for example like some of this stuff that that you see here like I said I have a lot more crazy stuff coming so
Make sure to stay tuned subscribe but I've been working for example like with with the Philippines um you know Philippine workers for Last 5 Years you know we help our clients get some of those uh placement into their business as well and like some of them like we still obviously we still do that like we still work with them and like there's certain things you need them to do but like just any general employees but we usually would use some of
Them like general assistance or like um admin assistance to do a lot of this like data entry or this or that you know going to manual websites looking at info or whatever the case may be and you're spending anywhere from like you know two to five bucks an hour depending on what the task is right just fine it's you know it's a lot cheaper than uh you know someone in Canada or the US just for like data entry tasks right but
Um with these automations I mean this has replaced so many different tasks that we would have needed to Outsource or give to some certain employees right so yeah you can save so much money like I mean really all you're doing what you're spending here is you're paying for your make.com subscription you're paying for air table if there is a free version so you don't even need to pay but if you're on a budget but then you're paying appify or you're using
A free version like I said everything technically has like almost a free version except for make which the lowest is 10 bucks um and then there is technically a free version here but you know if you're going to be using it a lot you're going to get pay like 10 bucks so and then if you're going to do stuff with this data like getting the transcript is great and getting the comments is great um and I I'll I have plans to
Show you guys how you can even get more data how you can scrape data because I know you guys love that there's certain things you want me to show you on where you can get data from or how much data you can get whether it's Instagram Tik Tok YouTube or like specific websites whatever let me know in the com down below but even once you get that data it's really about what you do with that data so we have systems I've
Been building out really cool systems complex systems but once you actually see them and I explain them to you you'll get you'll get them they're easy Once you understand them starts getting your mind thinking like this this certain way but certain tools to to analyze that data automatically because once you get that data that's one thing and that's great but then if you didn't use other automations and tools and all this stuff you would actually have to like go through the
Data look through it yourself that's like a very manual task no we want to use AI to do all the like the front end of an analysis and all that stuff and then like you you can kind of do more of like a uh quality control or like an approval process to make sure everything's good and and at a certain stage so that just saves you so much time and I'm going to show you guys how to do more advanced stuff
Like that and build that out but for now I wanted to give you guys this value on a nice Sunday I hope you guys had a great week and are going to you know have a very exciting busy um fruitful week ahead all right um tomorrow for all my AI fans out there we have the Apple event the announcement so most likely we've been hearing that they're going to um most likely like have that partnership with Chad gbt and and uh
And Apple so we'll see we'll see what comes out of that it's going to be interesting I'll definitely do some coverage on that as well as like I said I have some really really cool stuff for you guys in regards to everything we just showed you walked you through so um and this is like top tier stuff trust me when I say that like I'm my plan is to give like really show you guys some really top tier stuff on YouTube
I want to I want to turn this channel into something where you come to it and it's like wow I got so much value for free this is awesome and and we can build a really good Community here so other than that guys if you aren't in our free community currently it's free I've been definitely thinking about you know starting a paid Community uh not yet but um definitely join our free community while it's still while you you can while we
Have a free one it's in link will be in the description stric community.com we have about 700 members in our Discord and Facebook group and then um also too guys uh this is a hefty book I wrote on client acquisition it's called client acquisition code leveraging AI uh systems automations a bunch of stuff to escape the guru Matrix and it's really packed like it's not about like there's no fluff it's not like one like a just a AI generated ebook or
Anything like that that you know a lot of people are putting out this is something like I spent I spent over two year uh two to three years planning this and then like getting data and then actually uh like sitting down and making it putting it all together and all that stuff um so I have put my blood sweat tear in this and my heart and my soul it's only 27 bucks and there's a money back guarantee so you can get
The digital copy the car copy link will be in the description Clan acquisition code and then other than that guys hope you enjoyed this video um I will see you in tomorrow's video we upload every single day here so if you're new to the channel subscribe so you can stay tuned turn on post notifications like the video if you got value from it and you know help boost the algorithm here we're trying to really put our all into this Channel and
See it grow and I hope you guys can be a part of it so other than that I will see you in tomorrow's video keep hustling keep grinding and of course guys accelerate your stride take care