AI Instagram Profile Scraper Apify & Make.com Scrape Unlimited Instagram Profile Information 🤖

What's going on guys in today's video I'm going to show you how you can create an Instagram profile scraper in make.com as well as utilizing appify and air table all right so it's automatically going to scrape any single Instagram profile data you need and then put it into air table you don't need to know how to code let's dive right into it [Music] all right guys so I've done many videos on this channel utilizing make.com if you're not familiar with make.com

It's a really great automation tool it is basically like zapier if you're familiar with zapier but it's more for I would say like us no coders um you know people who you like to use no code tools and um let me just pull up my tab here and yeah it's super super awesome I definitely recommend checking it out I have a bunch of different videos on make.com appify appify as well I've covered this in many different videos we did a Twitter

Scraper yesterday um where we scraped tweets we've done different types of scrapers and you know I'm going to be doing more in-depth videos very soon where I show you what you can do with the data once you scrape it because that's where really the magic comes in where you can start getting creative with it all right but these are just showing you how to actually build these scrap ERS and you can take this information go to appify appify is about 49

Bucks a month they give you like a free account with $5 in credits so you can actually try it out for free and you can even make a second Organization for free so you get about 10 bucks there and then after a week you could make a third one you just go up here and create organization and you could technically have like 15 bucks a month for free I believe so yeah test it out but they have a really cool actor

Store which are essentially just no code uh scrapers and I'm just using this Instagram one right here and it's one of the most popular ones it's by apify so if I go here to my actors um here we have the Instagram scraper and this is the one we're going to be using in this video and I'm just going to get right to it so you can get this built really quick I don't want to waste time for you guys so let

Me just go here Instagram so this is what we're going to be building out all right so essentially what this will look like is if I go to here this is what we're going to have you can see here we have different Instagram profiles and basically they are being scraped so like for example Alex rosi we're getting all the username the bio um the category the URL as well as the follower count the following like pretty much all the data you

Could think of okay and yeah this is good for building like a list of potential um whether it's competitors or where it's just people that you like their content you want to model their content whatever the case may be this is really useful and we're use then we're using this tool air table this is essentially like um Google Sheets on steroids this is a very very powerful tool I've used tools like notion I've used tools like clickup I've used tools like

A on monday.com and you know personally for my just project management alone I like to use clickup but um air table is just so so powerful and it's it's I I like it I I use notion for a long time I still use it for certain things but this is a database okay so if you're not familiar with like databases and relational uh relation uh relational databases this is very very powerful cuz it's like you can build an almost like an

App essentially right if you really start um building things out they have automations here and they also have interfaces I'm not going to do a in-depth uh air table guide in this video but just giving you guys some quick background before I show you of all the tools we're using and then now I'm going to show you exactly how to build it so the workflow is going to be very simple so say you're you find an in a person that you

Really like there you like their Instagram profile um all you would do and you can this is what I do like I'm on my phone I have the air Table app and I just boom I put the URL in there anytime I'm just on the Fly I like to have it incorporated into my daily workflow um so anytime I am on social media I don't like to just scroll social media media mindlessly and look at like entertaining videos or whatever I'm

Usually just scrolling it if it's work related or a lots of times I'll be getting targeted by ads or I'll see different like unique um content ideas and maybe I want to remember that profile or I want to utilize like different strategies that they're using I'll take that link and all you're going to do is you just put it right here so let's just say I put this one right here and it would actually show up as this so this is

Just a um a field that basically is a single select so let's just say this was not scraped all you would do is Click SC here let me just make sure this is running so run this is what's going to happen I'm going to click like this and go scrape and what's going to happen is we're sending our information to make.com through a web hook right so as as long as this is working well we should see this web hook populate

In just a second nothing a little troubleshooting won't fix though see yeah it was kind of glitched out here so we're going to turn this on and yeah sometimes it's just going to like oh it's actually done it already it's kind of funny but as cuz I have two screens here so I'm looking over on the right side it actually just scrapes this users it should scrape this users now but let's see if I can watch it okay so yeah it's

Going on right here so appify just went and then this okay so this is actually an issue oh okay so we don't want this and this should be user boom let's save that okay and just double check refresh sometimes you're going to if you make changes in the air table side you may sometimes have to refresh things cuz I'm going to show you what it's supposed to do let's go here and let's go scrape and let's run this oh goodness let's

[Music] go here run this a table okay so it just ran and basically what it did what I just changed there is so look what it does it brings in the name the user we got the profile we got the bio got the business category we got the follower count following post count got the link that is in their bio we [Music] got this is something else this is something else and we got also this is really cool we got their

Related profiles reason why I really like this and um this is probably like the most let me just make sure you guys can see I know my My Talking head is in the way there but yeah we got the related profiles we got the links the uh the full names the IDS Etc this is cool because even if you don't know let's just say you're like trying to find profiles in your Niche you find like five then this system is going

To give you like right here I think it gives me like let me just see some of these give it gives like 80 different related profiles so that's really cool cuz if I go here we also have two tables so we have an Instagram table which is our profiles and then I also made this related IGS so you can see here we got the related Instagrams it's automatically linked back to the user that it's related to one other thing that I'm

Actually going to do is I'll show you what I'm going to do here I'm going to have it count how many profiles it's related to so like the way you do that is you would just go insert left here and to click roll up we're going to select related profile name and we're going to do count a value every singular value now we'll be able to see how many related profiles it pulled so we got 35 here 40 here and then

You could potentially like go through these and I'm also going to set up like a little flow here this is fully done but I'm just like um maybe I'll show you the updated flow in a future video but you could but you could just manually take this let's say I wanted this guy to scrape his profile next and then you could go and put it over in your Instagram so you're get constantly getting a a a new automatic um list of

Potential users that could be in your Niche or that are related to that same page so this is really really cool and really powerful because like you don't have to just always go search okay well okay now I got this cool scraper let me think of a list of 10 people and then you create the list and you're like okay what's another 10 people well no you're constantly farming new related profiles so I think that's really cool and really awesome now

Now that you know how it works um or what it looks like in action I'm going to show you exactly what to do all right we're going to walk through each one of these modules and first off you're going to need to go to autom ations and I tell you guys this every single video but so if you're new to this channel I'll reiterate it one more time I like to use the web hook function with air table and make because

It's just I'm just going to I explained it in other videos it's just the best though my opinion all you're doing is you're going to create a trigger for when the IG status is changed to scrape profile then it's just going to run a script I'll leave this script in the description you're just going to have to change this URL out with your make.com web hook and then you're going to need add to add two variables here you actually only need

To add one which is record ID and then you're just going to you I'm leaving the script in the description so you literally can just leave it the same all you're going to have to do is change out this link and put a record ID here and then just put so you would just go like this add input variable you would type record ID like I have it here and then you would put the variable as uh record I record air

Table record ID like that all right I'm going to delete this obviously you're going to finish editing you're going to make sure it's turned on and then you're good for that right next is you're going to create a web hook well this is you would need the web hook created already cuz you're going to grab this URL that's where you're going to put in your air table or you're going to create a custom web hook for your first module next module

Is you're going to create a module connected to your base connected to your Instagram table and you're going to put that so you you may have to once you make this web hook you're going to want to test it and you do that just by sending obviously um putting out a scrape thing over and you can also just go here and uh edit code and then test right here and make sure you're running the module like this not going to do

It right now next so like I said we're grabbing it we're putting the record ID here and this is getting a record all right what this does is it instead of having to it it just basically pulls all the air table records over it's very simple second you're using the appify Instagram scraper all right so this is the code I have the Json and the way I get this is simple I just go over and I'm going to try to show

You guys how to build this quick so just because don't want this this is I don't want this to be too too long for you guys I want you to get be able to watch this build it implement it all I'm doing is in appify I just put username here in the Instagram scraper or the the URL I'm going to select you can do other things you can scrape posts you can scrape comments I'm just scraping details of a profile and

Then my maximum item is one because I'm running it at once here I just put scrape users and that's it and then you just go to Jon on you copy this I always go to like um like here and I paste it in because if you don't it it kind of gets like just all clumped up I like to keep the formatting the same you could put put put paste it in a notepad whatever or you can just paste it in

Here it really doesn't matter you paste it in here and then you just change this out for the URL from your air table so that would be the Instagram URL here and then you would click okay I'm not going to click it right now um also too you're going to need to click run um you're going to have to click yes right here all right so basically what this does it's going to wait until the actor has finished and the maximum

Timeout for this run is 120 seconds so 2 minutes so you can do this if you're doing an actor that you know is going to be done in 2 minutes if you're scraping like a thousand records or something like this you probably need to set up a second um like a second execution scenario that um and I've done this in other videos but yeah you don't need to do that for this so don't worry about that and you just like yeah

Don't need to do that anyways after that we're watch We're creating a get data set items and this is another appify module and the data set ID is very is literally just the data set ID default data set from scrape profile and the limit like it doesn't matter I just have it as 100 but we're only grabbing one so it doesn't matter next we're using an array aggregator all right so you just and like guys if you don't know what these

Stuff does don't even worry too much just literally just click what I'm telling you to click and you'll build this so the source module is going to be the get data right here um that data set item and then aggregated Fields you're just going to click on related profiles now we're having a router all right so you can get all these like Right Here Right add router and then we're having a text aggregator here okay so you put a text aggregator

Now for this one I could actually probably change it CU I'm actually only pulling 27 so this one like you may not always actually like you may not even like you I don't know I just have this here you don't even necessarily need it right because we actually are using an iter iterator here and creating all the related IGS in a other table and then we're linking that back to the Instagram table but just for because I didn't do that at

The start I had it in a specific field and I I guess I'll just leave it for now I did it this way it's a kind of bit tedious to be honest and I could add like cuz some of them pull up like 40 related profiles so I could even add like um up to 40 um like this so I mean all I'm really doing here this is like kind of um yeah it's kind of like I guess tedious to even

Do let alone explain but all I'm doing is I'm going to the array I'm going to the related profiles and just to show you like I'm just clicking on the want Fields I want so you can see here I wrote username clicked on the username array field wrote link and then I just added instagram.com arrray and then I use the username here and then I put full name and then the full name uh one right here and then ID and that's

ID here and then I just put the numbers one in between here so like if I click on full name it's going to look like this you just put one like that and then I did that for each and like I did that for two I did that for three four five Etc all the way down so it's kind of tedious and it's not 100% needed but I just did it initially and I probably will leave it um and I may

Even add more like up to maybe 50 even though not all of them have 50 but either way you don't necessarily need it because we are using this iterator which I'll get to in a second next since since we did the get data here and this is within an array and a text aggregator it's like sectioned off and it's exclusive data only for the array and aggregator so we need to get the data again so it's the exact same module you

Could literally just clone it by right clicking and click clone and drag it over and then we're just updating the field of our Instagram um table so we're adding that record ID the same one we got from the web hook for the Creator we're putting the full name this is from our git data we just created we're putting the username for the username for the profile HD we're putting the profile URL HD a profile pick HD I just put the full

Name for the for the pick HD I also have a pick in lower quality CU Instagram has it so I actually hit it in my air table but I still put it in there anyways you'll see in a second I changed the IG status to ready to scrape post if I want to scrape their post after um bio this is for the bio business C atory business category follower count so you're really just mapping the fields they're all right here so

I I shouldn't have to explain every single one but I will briefly fall in count highlighted real Count post count external URL um external URL shimmed which is just in wrapped in Instagram's um tracking mechanism related profile so this is the text that I use a text aggregator for and then this is the profile SD so lower quality I just put the profile pick URL here and the full name you don't necessarily need to do it and then profile ID all

Right so you're just mapping the fields that you want we're going to click okay here I did have an ignore uh error Handler right here I don't even know if I ran into many errors but I I guess I just had it there so I may have and then in this other router I just have an iterator so this is like the second part which is very simple you just add an iterator and we're actually just going to map the related

Profiles like this of the array so that related profiles from the array aggregator and then we're just going to in our related ig's table we're adding the full name from the uh array the file URL for their picture and what I like about air table is it automatically just down downloads it and puts in the picture or the videos and stuff so you're not using uh data from your make um plan so you don't have to like waste a bunch of

Data all right username field and then record ID and then Instagram link we just did the instagram.com website username all right so very very simple actually very simple it's like I would say pretty be this is very beginner friendly so if you're new to make this is like perfect to get you going um and yeah if you're if you're more advanced and you're like yeah this is easy okay cool hopefully you got some sort of value from here maybe with how

The build works or whatever don't worry I'm going to be doing a lot more advanced stuff on this channel it's just I want to I want to um make I honestly just want to make sure there's enough like demand I'm going to be posting some really valuable stuff and I have it in the works I also have been like really developing my back end of content creation like I upload a video set every single day I want to have a lot

More moving Parts in terms of just like short form content and stuff like that as you guys could probably see from this video I've been building out like this very comprehensive um air table base I call viral stride content OS so you have like a creators table channels table YouTube videos table Instagram related ig's reals Tik Tok Tik Tok vids scripts Facebook Facebook posts Twitter tweets books like a bunch of stuff it's very comprehensive and whatnot so definitely I'll be making

More videos on that to help you guys Implement some strategies like that as well as just in general I'm um yeah I just have a lot of value leveraging that same system where allows me to be more productive with my content creation process so stay tuned for that if you want to be on the lookout for that make sure to subscribe like the video if you got value from it because um yeah most I checked my analytics the other day most

Of people watching this aren't actually subscribed it's like pretty much every YouTube channel so yes I'm going to be one of those guys and just be like yeah subscribe subscribe subscribe it definitely helps me out I'm really trying to grow this channel um and I appreciate it we're building a community on here and I want to be develop this channel into one of those ones where you just find it and you're like damn why is he just giving away like so

Much value for free and like this is stuff that some people charge thousands of dollars for and like a course or a program or a coaching program whatever um so yeah it's good I'm plan on keeping up ramping the the value I really like when I say I got some really good stuff planned I do for you guys so yeah I want to give you guys a lot of stuff for free anyways so yeah and then also if you haven't joined

The stride Community it's free at the moment stri community.com free Facebook group free Discord Channel I'm going to be putting even more exclusive stuff in there so we have about 700 members right now people in AI uh enthusiasts business owners entrepreneurs coaches Consultants agency owners go high level um users whatever ever the case may be they're in there and then also I just launched my book client acquisition code this thing is over what is this one 600 Pages something like that

Um it depends on like what format you're looking on it whether it's like hard cover um or ebook or whatever so that's it's anywhere from 500 to like 700 Pages depending on the format and it's super value packed it's not one of these like ebooks that are just generated by AI this is something that I've spent years um actually like researching and building and writing and over time and uh there's a lot of very practical stuff there it's kind of like

A client acquisition code Bible if you run a business as well as it does have a full chapter just dedicated to like chat gbt prompting and giving you exact prompts I give you templates for cold emails I give you how to set up Facebook ad campaigns how to deal with like any Facebook ad banss or profile issues yeah I think I even touch on multiple profile setups if you're running paid paid uh media buying it's crucial to ensure all a lot

Of really cool stuff is in there like I was even writing it I'm like damn why am I just giving it away for fre like so low it's very very low it's just Cost of a typical book investment so uh link for that will be in the description clientacquisition code.com there's a moneyb guarantee if you don't actually get any value from it but just I did that because I know it's pretty much impossible but uh yeah go check that out if

You're in if you're like into business and into if you need more clients and just want to optimize your systems and all that stuff anyways that is it for this video let me know what your thoughts on in the comments down below let me know what type of make build or what type of videos you want to see in the future if you have any questions about this build or need any support or advice whatever either let me know in the

Comments down below below or in the stride community and I will see you in tomorrow's video guys keep hustling keep grinding and of course accelerate your stride take care