n8n RSS Feed Automatically Scraping YouTube Videos Daily w/ Apify 🤖 n8n Automation

What's going on everybody in today's video I'm going to show you a concept of actually using RSS feeds for YouTube videos or you could use them for anything whether it's blog post whatever the case may be to actually automatically scrape that content every single day and then you can take that data and use it to get the actual data scrape that data whether it's like a YouTube video Etc and then um leverage that data and other stuff down the line let's

Dive right into it [Music] all right so I actually built this out using n8n um you can do a similar thing with make.com you can do the same thing pretty much I'm not going to dive through this whole in-depth build if you want me to do something like that let me know but this is pretty much built on the video I did like two days ago if you want to know more about that uh check that video out it's called um

It's the YouTube n8n video two days ago it's 47 minutes long I show you in- depth how to actually set up the appify authentification and the HTTP request but it's like the same thing this one's going to a different actor this is going to the YouTube scraper actor which [Music] is let me just show you what it looks like this one right here so let's go to this one we're putting the YouTube video link in here we're running that scraper it's

By API Dojo same same guys um and we're just using an HTT to post that and then we're using one to get that data and then get the data as well through the data set ID all of this captions is like pretty much the same um the only difference is I add a filter here since we're scraping these YouTube videos every single day and I have a bunch of other YouTube videos this is a search filter for air table where it's

Checking the link and the Json URL which is the YouTube video that it pulls from the RSS feed to see if it's equal right this is a search one to see if it's there if it is equal we have a filter right here where the Json length is equal to zero so we only want to filter the ones that are zero because that means that it's not equal to something that's already in our base so that's just briefly on the filter

I I'm going maybe a bit quick for you guys I'm going to kind of get into the concept in a second I just wanted to let you guys know if you do want more of an in-depth video on the actual like setting up the authentification with appify because that's the main thing that we do with that data in this Loop in this uh scenario right here afterwards um then I like I said the video that's 47 minutes a couple days ago

I dive into that and show you exactly how Click by click even if you're a beginner and lots of times when I watch automation videos I honestly like just want to see the concept because then I can know that okay this is how he did it I can kind of work my way and figure that out or just take that concept and actually build it um but so I did do that two days ago this one I just want it's kind

Of like an add-on to that concept so basically you're just using multiple RSS nodes these are the triggers and we're putting the YouTube RSS feed here to get that it's just youtube.com/ feeds SLV video.xml and then a question mark Channel ID equals and then the channel ID and you can set when it to run it either every minute hour day week month X time custom Etc so let's say we're doing every you know day and we're doing it at 16 hours

Which would be like 4:00 um and then we're you would just test it would run it it would automatically pull all seven of these RSS feed videos into our YouTube scraper get that data and then we could search it filter it in air table make sure we don't got get it we could get the captions of it and then update that into our a table base and then we're sending an uh a API to add the thumbnail to air table and

I showed how to do that in the the other video as well that's one way you could do it second way is I guess a little bit more it's like could be easier could be harder but we are basically this could be a Cron job I'm not going to show you the like everything for this but we're just running this is just a list so we're putting all the RSS feeds in a list and then we're adding a loop and we're

Doing a get request to those URLs in from the loop and it's just going to Loop through all the URLs in the list and we're converting that to XM XML to Json and then we're appending them merging them like that and then we're doing the same thing all right so um but yeah this way is very easy uh to be honest this way is super super easy you just do the J uh the RSS trigger and it will pull the most

Recent one so you could literally be scraping the YouTube video every single day and it's going to go um into your appify actor you could just put it D like you could that's that's really it um you don't have to have this filter you don't even have to have the captions but like I said if you want more indepth check out that other video um I hope this gives you some that idea of the concept um but honestly I literally covered

Everything in the video two days ago so um in terms of like this stuff like setting up CU this stuff is the same you're literally just going here you're setting up your appify authentification you're sending the same headers and then you're just changing the Json so this is the only thing that would change and this is what you get from if I go to appify you just go to your actor and you go to the Json you copy this and then

You're just replacing this with the YouTube variable Link in n8n like so okay so that is pretty much the concept on doing this if you want like me to actually really go in depth on it let me know but I know uh like I literally just made one a couple days ago and as well like I said when I'm watching these videos this is kind of just a concept I didn't know how to do like I didn't even know you could

Really do it I mean I I knew you could do anything right but I just didn't fully know um exactly how to do it so the one thing I like about NN is that you can have like multiple triggers at the start of a of a scenario or whatever you want to call it you can't really do that in make.com least to my knowledge so uh I'm really loving n8n if you don't know about N I would definitely suggest checking out

I did like three videos in the last week uh one the one I would highly recommend is the I think it's 40 minutes setting na an up on your own BPS because then you have unlimited executions and it's you like your own hosted domain it's pretty awesome really loving n8n slowly becoming my new favorite automation tool so other than that guys if you're new to this channel um you know we upload videos every single day so if you want to stay

Up to date with AI tutorials automation tutorials um you know improving your business improving your personal life Etc productivity make sure to smash that subscribe button smash the like button if you got some value from this if you want me to go more in depth on this build or show you some other builds or if you have any questions specifically let me know in the comments down below and then also to guys if you're new to this Channel and you haven't

Already joined our free community stri community.com make sure to check that out we have about 750 in our uh members in our free Facebook group and Discord channel so link for that will be in the description Down Below guys and then also too if you haven't already checked out my book client acquisition code showing you how to get clients for your high ticket Business e2b Service based business coaching marketing agency Etc leveraging AI um then you're definitely going to want to

H uh check that out but other than that guys I will will see you in tomorrow's video keep hustling keep grinding and of course guys accelerate your stride take care