CANCEL Make.com, n8n & Zapier?!?🤖 FREE Kestra Coolify Self Hosted Open Source Workflow Automation

What's going on guys Josh poock here and on this channel we've covered many different workflow automation platforms we've covered n8n we've showed you how to self-host n we've covered zaper we've covered make.com we've shown you how to build custom workflows in different scenarios for each one of these different apps we even covered trigger. deev a free open source alternative but in today's video I got a really good one for you we're going to be taking a look at kestra a unified

Orchestration platform to simplify business critical workflows and govern them as code and from the UI with this tool you can orchestrate and schedule code in any language and run anywhere there's 500 plus different plugins and Integrations and this is a free open- source alternative to tools like zapier rund de camunda airflow and more now by the end of this video you're going to easily know how to set this up locally using Docker and do this all within 2 to 3 minutes

And I'm also going to show you how you can self-host it in a production ready instance and give you the exact Docker composed file so you can get this running on coolify let's dive right into [Music] it all right guys so every link that I cover will be in the description down below so make sure to check that out first things first though I just want to quickly skim through cestra's website here just one because to give you guys some background

And as well just because it is a really nice website as we can see here declarative workflow creation scalable multi-tenant architecture Run Anywhere code in any language in built-in editor fast deployment cycle simple deployments API first design with a rich plug-in ecosystem and deploy anywhere with no single point of failure so there's an all-inclusive dashboard with auto completion and syntax validation no setup required build workflows directly from the UI embedded code editor with Git push and sync so KRA allows language

Agnostic workflows at any scale so you can Define your workflows using the Y syntax like so and we'll dive into that a bit in just a second you can integrate with your current stack you can execute your workflows you can monitor and optimize your workflows and they have a large community they have over 12,000 stars on GitHub you can join their slack Community right here as well as you can potentially contribute you can check out their socials right here Twitter and

YouTube I definitely recommend watching their YouTube videos because guys this tool there is a lot to learn and just so you guys know in this video I'm mainly going to be showing you how to get set up with it and showing you some of the basics and giving you a brief overview and if you would like to see me dive deeper in future videos and maybe build some different custom workflows and give you guys them in templates and all these different

Stuff let me know in the comments down below all right guys so here is the GitHub right here now you will notice that I actually forked this GitHub repo and I will leave the original repo as well as my forked version in the description below so the reason I forked this is because first things first is I included a Windows version for the docker Command right here all right so I will show you how to set this up locally on your

System using Docker so go make sure you have the prerequisite of Docker installed you can go to doer. set that up and make sure it's running on your system and then to get it set up it's very simple all you do is either run this command if you're on Mac or Linux or run this command if you're on Windows all right so the original repo did not have this Windows command right here so I got that for you guys there and

Then also too once we get into the self-hosting within kulfy uh you're going to want to most likely have your own forked version of it so that you can customize the docker compose if need be and I'll show you where you can actually get those different configurations in just a second but let's go ahead and actually set this up locally first all right so as you can see mine is actually already running here but all you're going to Simply do is

Just copy that one command and you'll see I just ran this command make sure you have Docker open on your system once you run that it's going to pull all the different containers right here it's going to pull the image and then it's going to actually set that up and it's going to be running from that point on if you go to Local Host 8080 so it's going to be port 8080 you will see that you have the actual kestra dashboard

Set up now if you just run this one command this Docker command first things first is it's not persisting into a database and there is ways um that you can just basically do this locally you could pretty much just use a the same Docker composed that I'm going to show you within kify pretty much just use that and just compose that up on your system and then you would actually have it uh saved and persist into a database so right now

If you were to just you know make a flow for example and then close it you wouldn't have access to that same flow once you actually opened up and and restarted Docker uh the actual container so obviously you're not going to want to be using this in production but if you just want to get up ready real quick and start testing kestra and kind of see the ins and outs of the dashboard right here then you can go ahead and run

That command all right now that we got that out of the way I'm going to show you how you can actually self-host it with coolify so this will pretty much apply even if you're not using coolify but for those of you who have been following this channel you will know that I personally love using kify it's essentially a free open source alternative to tools like verel and all you need to do to actually get set up with it is it's super

Super simple you just click here on selfhosted and then you just run this command so say if you have a VPS you can simply just run this command and then it will actually set up coolify for you if you're having any trouble searching up coolify just search up Josh poock and kify on YouTube and you can check out some of my other videos on this channel about how to set up kify but it's pretty straightforward once you have coolify set up

You can go to your projects here and create a new project so I'm in this project called kestra and then you're going to want to add a new resource so once you click on add new resource you're going to want to click on public repository once you click on public repository you're going to want to paste in the URL of the repo right here now you could actually Fork my repo and then if you want to add some customization to the

Docker compose that will allow you to you're just going to click on check repository change this from build pack to uh Docker compose right here and then you're just going to remove the A out of Docker compose yam and then you're just going to click on continue okay once that loads up you'll see that you have everything right here your configurations you'll also see that the docker composed file is automatically reloaded right here now the main things you're going to want

To do is go to environment variables like right here and you're going to want to click on developer view okay here you'll see your environment variables okay so these are the environment variables you're going to want to paste in here and I'm going to leave these environment variables in the description down below now of course you can change your C password right here as well as you can change your username right here so you can change this to your email you

Could change your postr uh postr DB password and username if you would like and then also to um right here your CER URL this is the URL that you're going to want to point to your VPS server so let's say your VPS server is 9.34 whatever blah blah blah you're going to want to set up a subdomain let's say kestra do um you know uh mydomain.com or whatever the case may be or automation. mydomain.com and then put that URL right here

If you don't know how to point a domain to a VPS IP address just as GPT it's very simple right you're going to want to paste this in the production environment variables as well as the preview deployment environment variables and you're going to want to click on save all environment variables once you do that you're going to go ahead and click on deploy now I'm not going to do this because I already have it deployed but that should actually start spitting

Up the docker containers and you know get downloading the images Etc now I'm looking in the docker compos file right here and I'm not going to go through it all um if you want to check it out you can definitely check it out you can see the different Services we're setting up such as post grass the environment variables right here we have some different uh stuff right here we have kestra the image and we have the configuration right here so we

Can see now if you don't want authentication for whatever reason you can put this to false right here where it says enabled uh of course I left it as true and that would be your kestra username and password and I'll leave a link down below to the kestra docs because if you go to the docs right here and then you go to configurations under reference docks right here this is all the different configurations that you could actually change and use for

Your kestra instance right here within your Docker compose so of course there is a lot and I'm not going to go through them all in the one that I'm actually giving you guys the fourth version I just kept it very very basic it's pretty much their standard one I just customized it for coolify for you guys also too guys just in case I don't even know if you have to do this but I would just paste in your domain for CER

Right here and then click save just to be safe and anytime you make changes to the environment variables or the docker compose you're going to have to redeploy just as a heads up okay now that you got everything spun up and you deployed on kify you should be able to access your KRA dashboard at the URL that you inputed in your environment variables and now I'll quickly go over some of the key features in this tool all right so here we

Have the dashboard this is going to go over pretty much a high Lev overview of all your different executions your success ratio your fail ratio how much flows you have in your account how many triggers and you can filter by different things all data user data system data you know specific time frames you can filter by name spaces up here okay um a bunch of different stuff I'm not going to go through at all and then flows we'll come back to

Flows in just a second here but this is basically all the different flows the workflows that are in your account are you tired of pouring thousands of dollars into appointment Setters only to watch leads slip away imagine having a team of elite sales agents booking qualified appointments for you around the clock no more wasted time on training no more frustration with performance and no more draining your budget on inconsistent and expensive call centers introducing stride agents AI powered appointment centers that

Work 24/7 never get tired and book appointments while you sleep trained on thousands of successful conversations our AI agents outperform human teams at just on10th of the cost join the ranks of businesses that doubled their appointments and booking rates in just a matter of weeks don't get left behind in the AI Revolution visit stride agents.com now and transform your entire sales process with Cutting Edge AI technology it's time to accelerate your stride with AI agents all right you'll be able to

See a bird's eye overview of the executions right here the labels of the um workflows and the IDS last execution you know execution status you know triggers all that good stuff here we have execution so this is going to be your execution history right here so you can filter by you know all the different filters right here um and see a bird's eyee overview then here we have logs so this is going to show the actual in-depth logs between each execution

All right name spaces this is where we can go you can set up different name spaces to essentially kind of organize um your uh flows and all that good stuff so you know here right now we have some dummy um ones that were provided just by default all right and then blueprints so when you're first getting started I would highly recommend you know really just to get a understanding of kestra checking out these uh These Blueprints right here all right um

This is something I'm definitely going to be doing because this is a newer tool for me and I'm very excited to use this tool because I'm used to using n I'm used to using all the other ones that we mentioned and I think this one is really cool and it has a lot more you know you can pretty much do almost anything with this which is really exciting but there's also you know a little bit more of a learning curve I

Would say so going through These Blueprints here as well as watching some of the official castra YouTube videos and tutorials and reading through the documentation will definitely help you get started but here we can actually filter by different tags for blueprints you know I'm not going to go through them all CU you can obviously see there's so much but we have S3 CLI getting started you know variables namespace files we have R we have trigger right here so you can see

We have like Integrations with like slack python Docker JavaScript you know pretty much anything you could almost think of you know red is here get all right you can see all the different Docker blueprints you can see the different pip blueprints right here so run a SQL query on data bricks output the result to a CSV file and read that CSV file in a python script with pandas we got post grass all right so I think you guys get the point

Here we got a lot of different stuff and we even have ai so we have chat with your elastic search data using open AI plugin rag we got some we8 stuff down here all right so I think you get the point about blue prints it's pretty much just pre-built templates and then plugins so plugins are building blocks for your workflows you can search for tasks and triggers to build your flow so there's over 556 plugins you can also build your own

Plugins we're not going to get into that though um but you can see here there's so many different pretty much Integrations so for example we could go to we could go to airflow right here all right and then we could see a trigger right here for airflow we can see examples of it being used the properties right here base URL um outputs right here pretty much anything you would need to know and then here we can scroll down on the leftand

Side and go to different ones as well so we have get here so we have get clone get push you know push flows push namespace files sync so here you know clone a repository showing different examples of how to do that and yeah there's a lot of you know cool stuff in these plugins of course and a lot of different ways you can customize it all right next is the built-in docks right here so you can actually just access the docs

Directly in your dashboard which is really nice and you can see it's very comprehensive we have pretty much anything um that you would want to know about you know kestra right here in the docks and then Administration so um a lot of this stuff is locked in case you are in the Enterprise plan which of course isn't free but then we just have our triggers right here and then we have our stats so you can see we're on the open source

Edition right here there's the Enterprise plan we can see our name spaces and all the different overviews of our usage right here here and then if you go to settings you can see your main configuration you know your default name space um theme preferences so of course we're on Dark theme you can change uh the chart color scheme you can change some of the font sizes you know all that good stuff and you can also export all your flows in case

You ever you know want to do that now let's go ahead into flows and let's just see some basic flows and actions so this is actually a blueprint that I got right here this one is called generate SEO summary so when you're in a flow you have you know bunch of different ways to monitor the specific flow so we kind of have our own little flow dashboard right here and overview we can see all the different stats within our flows our

Executions our successes and failures we can filter by you know specific things we can go to the topology View and this is pretty much like a uh kind of like an N View it's simil like kind of using I don't know if it's using react flow but it's something similar to that um this drag and drop UI interface so this is nice if you don't know how to code and this is also nice to if you maybe are working with other

People that don't know how to code right so this is really nice that they have this you have your executions here you have your editor right here so within the editor there is a few different things we'll come back to this in just a second all right you have your revision so only one revision exists for this flow you have your triggers so to access this you would need to add a trigger for your first uh for your flow at the

Start you have your logs you have your metrics and you have your dependencies so right now we don't have any dependencies you can check out the dependencies doc um to learn more about dependencies and then concurrency so no limits are set for this flow you can read more about concurrencies here all right so I'm going to come back to the editor here and just as a side note guys if you ever get lost you can search for stuff up here they

Have a nice clean uh search interface that you can easily use now that we're in the editor here I'm going to go over some of the main things so here we have the different views so you can go through Source right here so the source is pretty much the direct yaml schema yaml code right here that you can actually write you can do the source and uh documentation so the cool thing with this is if I highlight something in the source

Like if I highlight this it's actually going to go to that place in the documentation so we can actually learn about that area in the documentation so as you see now I'm highlighted on logs and it automatically pulls to the log section of the documentation so this is really nice and they have a really nice uh interface for kind of working um here learning along the way with the dogs and then also too you have the source and topology view right

Here so this is where you can see the source as well as the gooey UI right here the topology and you can actually click over here in the topology and click on edit for example and then once you click on edit you'll be able to see kind of like a form view right here so you could actually filter by type right here right types are basically all the different you know types of methods for the plugins right so each plugin has

Different types like let's say you know git has get clone get push Etc like we showed this is where you'll see all those different types for the different plugins okay here we have the ID so right now this ID is just called Fetch article because that's what we're doing we have a URI right here so this is the fully qualified URI that that points to the HTTP destination and we have a bunch of different other values right here I'm not going

To go through them all um I would definitely recommend reading some of the Docks but you can customize them right here in this nice little gooey and then just click save task at the bottom right which is right below my head so you can't see it here you can click on add tasks so you can add new tasks also too I forgot to mention when you're in that specific task there is a form view right here there's also the direct source

View for this specific task and then there's a documentation so you can see that all within this view as well there you also have just the topology view so if you just want to view topology you can click this all right so you can toggle this show name space or hide name space right here the files button right here and over here you'll be able to see you can create folders to organize things like we have a test folder right here

So that's the parent folder and then you can have different files right right here now I'm not 100% sure yet what the exact use case of these is in a real life example but uh I'll definitely you know do some research and I'll feel you guys in if I do another video on this tool and then you also have the source and blueprints view right here so this is where you can see the source code as well as different blueprints right

Here so you can actually copy over blueprints very easily into here so it's pretty nice that they have that and then you have actions up here so you can delete copy add Global air handler add trigger add metadata Etc all right so just to quickly walk through what this uh flow is doing we have our ID right here for the flow so this is generate SEO summary we have our name space right here so company team and then we have our

Inputs so we have ID article uh URL so this is a basically you can Define inputs at the start here I would recommend checking out the docs so you can do things like string integers arrays booleans floats select multi select date time date really like almost anything like Jon secret the yaml these are all the different inputs that you can have basically for that flow and for us we have a flow right here of a string which is the article URL

That we will be using for this flow and you can set a default right here so the default is just this right here um and I'll show you that in a second this will be uh you'll see this once we actually try to execute this flow so that's where you define the inputs and then the tasks right here are defined so we have first task which is the fetch article we have our type right here so this this is using the

Plug-in core right here to the HTTP one to download the article as you can see right here in our topology view this is downloading the article um the URI right here is the inputs. article URL so this right here is being downloaded right here and then our next task is the generate SEO summary so this right here we're using the type of the kria plugin for open AI chat completion okay and you're going to see here our API key is I

Removed it but I'll add it of course once we actually execute you'll see Max tokens right here of 500 you'll see model which is gp40 mini and like I said you can check out the docks and you'll be able to actually add more different um you know values right here under each specific uh type you know if you wanted to do things like top P or top k whatever the case might be you could do that all right so here we

Have our prompt write a short Max 200 words SEO optimize summary for the following articles and then this is read outputs. fetch articles URI which is right from the uh previous task and then here we're using the uh ID of log output and the type is literally just log and the message is the output of the generated SEO summary um choices of the message content right here for first and that's pretty much it guys I just wanted to show you a

Basic setup here but you know that should kind of give you an understanding of how this actually works a little bit of the the schema like I said you're going to want to go to the actual documentation when you're building this out as well as using the blueprints and checking out the different plugins and you'll be able to actually customize this for your specific use case for example we could actually take this summary instead of actually just logging it for test

Purposes we could either like put this into an air table database right uh or we could send this as an email or we could send this as a slack notification that possibilities are really endless but I just want to show you a simple example here so now if we go ahead and actually run this all right so I put our API key back in now I'm going to execute this and as you'll see this is our default URL I could put

Any URL right let's say I went to opening eyes website right here and I got there learning to reason with llms this is their blog that they posted for their 01 model right here and we'll use this blog just for testing purposes so now I'm going to paste in this article right here there's also Advanced configuration options right here that you could schedule a date right here you could use a curl command and I'm just going to click on execute once

Starts executing you're going to see this Gant view right here so you can pretty much see all the different all right so opening eyes actually failed for some reason it was forbidden and that can tend to happen anytime you're like scraping things or whatnot but let's go ahead and actually use anthropics new computer use blog post all right so I'm going to paste in the article URL right here and then we are going to execute and you will see this Gant

View right here and as you can see it's showing the different seconds and execution time for each specific uh task right here we can see the generate uh fetch article right right here the generate SEO summary which took the longest it took 6.7 seconds and then we can see the log output right here so if we go ahead and click on each individual one like right here we can see the fetch article URL right here then we can see the generate

SEO summary right here so we can see the success and then if we click on the log right here we can actually see the output so we can see anthropic has unveiled significant updates featuring The Claw 3.5 Sonet and the introduction of the Claude 3.5 hiou model the 3.5 Sona B blah blah blah blah blah you get the point right but as you can see we got a summary right here and the execution worked we can see an overview of our

Execution right here you can set labels replay change state do a bunch of things see the Gant see the logs see the topology see the outputs of each individual thing right here you can see every single thing in a very granular level and then you can see the metric so all in all guys that's such a brief overview of KRA showing you how you can self-host it locally either using Docker or use it in a production ready instance with in kify

Like I said guys all links will be in the description down below including our Fork version of the GitHub repo if you have any questions let me know in the comments Down Below guys and let me know what your thoughts are on kestra are you new to this tool or have you been using it for a while and if so how do you think it compares to some of the other automation tools out there such as zapier make naden uh trigger

Dodev you know I've done videos on all these different tools and I'm very excited to continue using KRA because you can do so many different things with it you can run python code you can really customize it to whatever use case you want and it has a really nice UI dashboard all in all I think it's a great tool and I'm excited for building some really cool stuff let me know in the comments down below if you guys want to see

More videos of this tool me building different things giving you guys maybe free templates or if you have any ideas of cool things you want me to build let me know as well in the comments down below if you're new to this channel guys we upload videos every single day on AI automation Marketing sales business growth if you like that type of content and you got some value here make sure to like this video comment down below and subscribe to stay

Up to date with the daily uploads also too guys if you haven't already joined our free community stri community.com what are you doing it's our free Facebook group and Discord Channel I'll leave a link down below and then also too guys if you run a business and you need help automating it you need help with your system processes you need help with doing outbound prospecting paid advertising or maybe you need help implementing AI agents AI appointment CS Ai call centers into

Your business to completely streamline your appointment setting as well as your sales process then book a call down below at executiv strive.com slapp and we can see if it's a good fit or not other than that guys I will see you in tomorrow video keep hustling keep grinding and of course guys accelerate your stride take care