NEW: AI TikTok Video Scraper - Scrape Unlimited TikTok Videos π€π· Apify & Make.com
Links from the video
Transcript
3,947 wordsWhat's going on everybody Josh here and in today's video we're going to build out an AI content scraper for Tik Tok this will allow you to pick a desired user and scrape every single video on their Tik Tok page you could even transcribe it if you want you could do this for the top competitors or industry players in your Niche build at a database where you can replicate different scripts for short form content or you could leverage different ideas for your
Content creation process let's dive right into it [Music] all right guys so there's a few different moving parts for this uh build all right it's not too advanced or anything like that it's um pretty basic once you get the the general concept just wrap your head around the general concepts of just how you set things up and if you've watched any of my other make.com slappy aable videos on scraping um first of all if you haven't I would suggest to go
Check some of those out I cover Tik Tok scra or I cover Instagram scraper Facebook page or profile scraper um I cover Instagram re I cover a few different scrapers oh Twitter scraper and I'm going to be building out more different in-depth builds that actually show you how what to do once you scrape the content so if you're new to this channel make sure to subscribe but this will be a fairly similar type of process and workflow just utilizing different uh
Scrapers right and it's a it's a little bit different so what we're going to be using is air table if you're not familiar with air table it's like the Google Sheets on steroids for databases it's really really powerful I've used other tools like notion and all these other tools air table is the best for this kind of thing second we're going to be using appify if you know any other better scrapers than this let me know but this is the best
One I found and it's super awesome it has its own built-in proxies and you don't have to like log into these social media apps with cookies or anything some of them do require that most of the ones I've been showcasing on this channel don't though so you don't have to worry about like all the workarounds and all the hassle that comes with scraping different social platforms so this is really really useful really really awesome and they give you $5 free credit
Free trial when you sign up so app ay.com awesome and then it's like 50 bucks a month if you do and it's like a credits feature um I've used 27 this month and I've been just blasting through creating scrapers Etc so the credits last pretty long and then third is a make.com so if you're not familiar with make.com it's essentially like zapier but it's built even more it's better from like the all the no code Builders and most you know you
Have a little bit more uh customization I find was with make and you get more executions in zapier it's cheaper Etc so make.com is my my personal favorite so um first off I'm not going to go like through this whole this first build right here so this is what really it consists of an air table right two main things all right uh Tik Tok videos and Tik Tok profiles T I just call it Tik Tok and Tik Tok vids So within
Tik Tok vids or just Tik Tok um all I simply do is I put in a Tik Tok URL and then I would go like this to status and click scrape profile and then that's going to cause it to scrape the profile and get all this information here all right I'm not going to show you how to build this part out I'm just going to it will be the same process as what I'm about to show you and I'll just show
You what scraper I use so if I go to appify here um Tik Tok scraper let me just double check is this the right one um output so this is the video scraper I believe this is the one I'm going to be building right here in front of you if I go to runs here um so the two scrapers we're using are Tik Tok scraper pay per result this is for the videos and then Tik Tok user scraper paper result they're
Both by API Dojo so uh they make really great actors and it's very cheap it's 10 cents 1 th000 users for this and you're scraping one at a time so this is the actor I use for the user side all right and same exact process that I'm about to show you within um creating the video side so you want to do the user side just replicate this I'm not going to walk through the whole thing but let's just build out the
Video side and I know that's what most of you will really want anyways like you technically don't need the profile one but um it is definitely useful as well I would definitely recommend it um recommend both if you yeah just this doesn't take too long so you should have you do have the time anyways automations so yeah Tik Tok scrapers for the profiles already here I'm just going to duplicate this and um what you're going to do in automation so this
Is our Tik Tok video scraper okay and this is going to run when the status is turned to scrape videos and this script right here I'll leave it in the description I've talked about it many times on this channel all it is is sending a web hook to make.com so you're going to create your first module as a web hook and you're going to copy that address you're going to come over here you're going to paste that in and then over
Here you're going to want to make sure you input a variable and just call it record ID and then select the air table record ID here I'm going to delete this and you're going to see that's going to pass that variable right here when we run the web hook all right so when that sends the information to the web hook URL it's going to send that UTM parameter of record ID which is going to allow us to catch that in make.com
So if I turn this on go into Data then let's just do a test for example um let's just do a test right here I'm going to run this I need to set this up here save run okay so it's running and if I go here go to scrape videos we should get that right about now there we go right on schedule after I always do a web hook I just get a record and just going to pull up my base
Here oh actually wrong base there we go and then okay sometimes it's glitching let me just do this one more time get record select the base right here and then we're going to select a table the table is going to of course be Tik Tok record ID right here and then what that's doing so this is music for Tik Tock this is Tick Tock grape trigger all right I'll just rename it so you guys can follow along here right here we
Are getting the data so that's why I only just pass over the record ID parameter variable just because that's all you need and then you can just do a get record and that works the best because then you can get all the records very easily and instantly all right when you pass it through the web hook it can take a bit longer if it's a long string of data or text anyways now now we're going to run an actor and the
Actor we're going to run is our Tick Tock scraper right here we're not going to run it um we're just going to click no here and if I go over we're going to need to input some Json so what we're going to do is we're going to go to that Tik Tock scraper and I am going to um um I always just put in typically what I want here so maximum number let's just for this purpose let's just say now actually
What I will do to be honest is so this showcases I'm going to go here add a number and go like this go like this one two and then maximum output we'll use this once we get to that you'll see what I mean in just a second I'll just put it a th here I put in a URL sample here and now I'm going to go to Json I'm going to grab this text here and then I go what I usually
Do is I just um paste it over into like a text uh thing here because then it maintains the formatting and then I just copy that and I paste directly here you can just paste that in a notepad and then copy and paste it over if you don't do that it just basically like makes it so it's all like this it removes the uh the new lines so I think it's it still works that way but um I just like it
Looking nice cuz then I can read it in the nice Json formatting so we're going to remove the URL of course and we're going to put in our URL field from Air table and then for Max items let me just uh grab this real quick going to get that the so I'm going to run this module only so I can get that new maximum output field that we uploaded and then I'm going to go here and we are going to select
It should have grabbed it oh no it's cuz I didn't put any data in there so going to put uh since for example my Tik Tok only has 13 videos so I only need to do like 15 or I could just put 13 but I'll just do that for whatever um now let's click run this only put that record ID grab that now we'll go back to Max items here and maximum items let me just make sure okay yeah there's no
Okay so that's good we'll just click okay so this is basically starting the scrape so start Tick Tock scraper okay now since this is a video since this is videos that's why I'm not putting it on running it in the same execution sequence now when I'm scraping like a user I'll always just click yes here and then I'll keep it all in one but when it's videos it could have someone could have a thousand videos and that could take longer than
The maximum 2 minutes 120 seconds here that it will allow it to wait for it will wait until the applify uh actor has done running this is videos I'm just going to save this we can turn this on and you'll see this is one out of two so I'm going to go back and I'm going to create a new scenario so we'll go to here great new scenario and we're obviously just going to call this number two out of two and
What we're going to do is wait until actor is done running and we'll just call This Ti Tock rape video rper and we'll go to Tik Tock scraper save and then click okay all right so this is when the Tik Tok video scraper is done okay um then what we're going to do we are going to get the data set items and we're going to click here for the data set and we're going to fill this in with default data set
ID you could change the limit here if you want this is how much it's going to pull let's just put like a thousand right um so cool and then this is getting the [Music] data get data and then from that point on we are going to um we are going to let's see create a record but before we do that I'm going to actually just um get the data over here so let me go back here so I actually ran this
Before if I if I if you haven't ran it you can run it and then you can like run it through your module the first module and then we'll start the second module you can test it but I'm just going to go to my runs here or you could just run it in the appify web app and then do what I'm about to do here I'm going to go to storage get that data set ID and I'm just going to run
This through here so that I can get the data actually wait I need to change this like this and put this o what did I just do okay there we go boom and I'll just run it you'll see here we got some bundles all the bundles of the videos perfect now that we did that I can put this back over here put this here put the data set ID back to here and I'm just really trying to speed through this for
You guys to get you know to I don't want to make this video too too long if you're having trouble following like all these steps one you can watch it back again and two in some of my other videos I definitely explained it a lot more but this process is very similar so I just want to show it to you guys um I don't want to waste time waste your guys' time waste my time so next we're going to of course
Go back to the same base and we are going to select our Tik Tok videos table and I'm just literally mapping out the fields here that we got so we got ID title right here post URL would be um where is it Channel no not there video actually no it is okay so we do have a thumbnail I need to add that field um let me just search URL hm okay I'll come back to that I think that's somewhere let me
Just search post is this it post page I think that's what it is post page um let me just double check real quick so let's go to output and post URL yeah post page is what it's called so we're good on that um okay now we're going to map everything else so views likes comments okay actually need to add shares because I don't have that in but we'll do bookmarks oh hashtags he that's something looks like this is an array too
So that will be a little bit it could be a little bit more complex not really though it's very simple um but I'm just going to skip that for now we don't really need the hashtags it's not like a huge thing um uploaded format okay what you could do let me see what format this is um let me go here date [Music] format um where is it oh here we go format date let me make sure this is the right form
I think this is if it's not then we'll just uh keep it normal but where that day go here H okay okay this is kind of annoying I'm just going to I don't want to waste time doing this but yeah you can form out a date here I'll probably do that after um just so it looks a bit better and then it's really not important though like you can read the date I mean it's not that important um channel name this
Stuff like I already have so it's not really that useful but I'm just going to input it in again anyways actually let me make sure the Avatar and then this has name kind part is kind of tedious just typing in the different things here um following videos like look at all the data we got too it's really awesome the scraper you get the song even the song ID the song title the song artist the song album and if you don't want
Any of these uh specifically you can obviously just not input them I just put them all just because why not and if I don't want any of them I can just hide that field or if I if I want I could remove it later no big deal all right so here title and then we're almost done here so with height ratio duration all right we're going to also add the video URL this is obviously one the pretty much the most important
Thing so right here so this is the URL file name just call this U title I guess and then I got all the fields I think I have and the one so I'm going to just save that real quick and I know I was missing a couple so I'm going to add those real quick um one was shares call this shares and then I believe I was missing the thumbnail video thumbnail and I would organize these um in a better order
I would definitely put the video on the thumbnail closer to the left hand side but doesn't really matter for the sake of this video now once you once you change those any anytime you an update in the table you're want to refresh so you can grab those new fields we got our shares here and last but not least we got our video thumbnail right here be the thumbnail file [Music] URL and we can actually just call this ID an ID here
Here that's really it I mean this should work um we're going to test it and see to make sure it works there may be a few issues so update dat talk videos okay so we're going to save that and I'm just going to turn this [Music] on all right so now that we're done that I'm going going to trigger it over here let's go here and click on scrape videos so now there should trigger Tick Tock scraper the first one should
Have been triggered I'm actually just G to watch the second one here and while that's loading we should be able to check here in our runs yeah this one's running so once that's done running this should trigger the make scenario right here all right so it actually just finished took a little bit longer than expected took about 2 minutes we can see we got 13 results so let me just pull up here we go now it's running and it's actually already
Putting those in so it actually already finished um let me go over to Tik Tock boom there we have it so let me just delete these three blank ones that's what that was there before and um I'm going to bring these ones I'm going to organize these better after but I'm going to bring these over definitely going to be trying to grow my Tik Tok a bit more too so make sure to follow that this one got pretty good I got
A million views on that uh that was just like a funny one though um so yeah here we got that date which we could format we got all the different captions titles we even have the video so with the video guys um I covered this in my Instagram video so I would check out that one it's it's probably about 7 days ago I show you like once you have that video it's very simple I'm not going to Rego over it in
This video right now but you would just basically go like this HTTP get file and we would select that video URL right here this would download it and then you would go to chat GPT and you would go create transcription with whisper and then you would select the file from the git HTTP and then you would just tell it hey give me a transcript of this just don't put any words in front of it just give me the exact output word
For word of the transcript that's the only prompt you would say here just so it doesn't give you like hey this is the transcript blah blah blah blah and then you would get that output of the transcript and then you would just you probably want this over here like that and then the output from this transcript you would just put here and you would make a field in your air table called transcript very simple but I covered that in my other
Video on Instagram few days ago so uh check on my channel you'll see it subscribe Etc you got value from this make sure to subscribe I'm going to be doing a lot more in-depth Advan builds this is definitely a little bit more beginner friendly it's something that really anyone can do you just click these buttons and you will be good to go rewatch this if you need to um share with a friend if someone if you know someone that needs t
Uh help with Tik Tok and other than that guys let me know what type of builds you want to see um I'm going hard on this YouTube channel we upload videos every single day so make sure to subscribe if you got value and uh yeah we're trying to build a like-minded community of entrepreneurs AI enthusiasts business owners Etc if you haven't already joined our free stride Community Link for that will be in the description stri community.com we have about 700 people
Right now in our Facebook and Discord Channel I think it's even more now um we we have some people pending so probably admit you guys who are pending um this week but other than that uh join that while you still can while it's free and then also too guys my book client acquisition code is uh available now you can get a copy of it link for that will be in the description clientacquisition code.com we have a full chapter just on ai
Ai prompting and a bunch of other chapters there's about 13 chapters I believe very very in-depth no fluff just pure value showing you how to run meta ads YouTube ads cold email prospecting Facebook prospecting building communities doing YouTube Etc it's all covered in that book um loads and loads of value definitely overd delivered there so I know you'll love it um go check out that now and other than that guys I will see you in tomorrow's video let me know what
Your thoughts on in the comments down below if you have any questions I'll respond to every single one of you and then keep hustling keep grinding and of course guys accelerate your stride see you tomorrow