Video14 min watch

FREE: Farfalle AI Local Perplexity Alternative🤖Groq, Ollama, OpenAI, (Perplexica, Morphic)

Links from the video

Transcript

2,125 words

What's going on guys Josh poock here and in today's video I'm going to show you how you can cancel your perplexity subscription you don't have to be paying for a AI powered search engine when you can use the opsource tool for farlay and you can set this up locally it's 100% open source 100% free you can use it with local models you can use it with uh non-local models such as grck open AI um whatever the case may be we're going

To show you how set this up in under 5 minutes let's Dive Right into [Music] it all right guys so for those of you who aren't new to the channel um you may know that we've covered multiple different opsource um perplexity Alternatives so yesterday we even covered local search L uh L local search we've also covered um some other ones such as perplex morphic llm answer engine bunch of different ones um we even covered uh there's a Stanford uh un uh

Stanford University tool that's uh similar to perplexity as well covered a bunch I'll leave links to a lot of those videos as well as tools and GitHub repos down below so if you want to investigate and see which perplexity alternative is the best bet for you for your specific use case or maybe you want to try all them try different ones whatever the case may be you can do so down below as well as the repo for for farlay will be

Down below so um here is perplexity yeah I'm going to show you an alternative to it so here is for farlay um as you can see this is I believe the founder he posted on here hey all I built an open source AI powered engine called for farlay it's self hostable front end nextjs backend fast API python uh search API can either be used with tavali um or you can use uh uh search search engine X whatever the heck it's called

Um and I believe you can also use there's a few other options I'll get into that in just a second um but yeah it's pretty cool here is the actual um Cloud version of it that you can go try right now without having to self host it at all and guess what guys it's 100% free to use so I'll leave a link down below I would definitely recommend testing this out before you even self host it you can go here um

You can access the cloud model so open AI GPT 3.5 turbo uh GPT 40 powerful or um hyper which is Gro uh llama right here oh this is actually yeah yeah this is grock right here so um I literally have I've seen this uh Shad CN um component before but any anyways um yeah let's go ahead and just test something like what happened to uh okay so actually the cloud hosted one has disabled gpg 4 or 40 which kind of makes

Sense you know they're probably getting a high usage of that so they're leaving the 3.5 one this is 100% free so that makes 100% sense but you can see here just even with the results and I'm going to show you how to set this up and we'll dive a little bit more into it on the self hosted version but it looks really good really clean Sim very similar to perplexity you have new chat up here um we have light mode dark

Mode it's actually a very nice design I think the developer did actually a really good job I was looking at the code it's a well put together project I mean there can always be improvements but um based on like some of the other tools that we've done reviews on I'd say this is definitely one of the best um uis there I I don't know 100% if it's the best but it's it's definitely up there that was my first impression on it

I really like the UI the interface I like the um related things down here I would suggest it you can press uh um you know toggle which one you want to go to next all that good stuff um there's also an expert mode which is only available on the Local Host plan or on the self hosted plan so I'm going to show you how to do that right now um so first things first of course if you do want to use

Local models you can go to a llama and download the models of your choice um and yeah you can use local models or you can use um non-local models like I said so I'm not going to go through the whole GitHub repo you can check it out if you want okay here are are the potential optional things that you can use the um different that can connect to uh for farlay so we got tavali serper open AI Bing and Gro and

Those are yeah those are the main ones so it's actually very simple to um get things uh set up so all you're going to do is you're going to literally just run these commands so you're going to get clone the repo all right so you would go into your command uh you know command prompt and you would just go here boom I'm not going to run that I already did that and then you would CD into for farlay and then copy

Um CP copy environment template and we're going to name that to environment uh justv all right and then from that point on you can modify the uhv and I'll show you that right here so this is the EnV so this is where you could you actually don't need to necessarily add in um environment variables if you're using the local models but if you're using um just Cloud models you can add your API Keys here boom boom boom you can add you

Can go ahead customize different stuff here um as well as add a custom model and if you're using tavali serper or Bing you would put that API key here but it's um has a self-hosted version of search n NG um so yeah you can actually just use that 100% for free so let me go ahead actually we I already spun this up but then you're just going to run Docker compose DF Docker compose Das uh do uh Docker compose dodev doyo

And then up- D okay so you just simply run this it's going to spin it up if you already have something on Port 3000 then you would want to just change that in the uh Docker compose file you could just put like for me I put it to a different port because I'm currently using Port 3000 so once you get it spun up this is what it's going to look like um so this is the selfhosted version on Port 3040 and

As you can see now I do have expert mode unlocked so this is kind of like perplexities Pro search okay and let me just go back here okay so we can go to Cloud local here on local you see llama 3 Gemma mistol 53 custom model you can go over here if you have the API of the clouds plugged in you can do um open AI uh GPT 3.5 turbo now we could do the GPT 40 so like if I did

That same search like um uh here let's just do this what is for farlay well for farlay is like a pasta okay so this is really cool with the power expert mode this is doing the exact same thing that uh perplexity does like this is literally um the exact and it the UI looks really nice I'll give them that like it looks really nice I mean it's pretty much just a clone of perplexity at the end of the day but that's

Kind of like what I would want if I go here this is I have the pro version of perplexity as you can see it's literally doing the same thing okay so this is let's see a comparison okay so here we got a little bit of um what do you call this like a uh I forget the word but yeah kind of like the Google thing that have at the top the knowledge panel yeah we got like a little know Knowledge Graph

Right here knowledge panel um and then we got you know some stuff right here this is using I believe I'm using gpg 40 within perplexity here and then here um we can see the different I really like this like this this is actually really nice look at all the different um things we scraped or well it went through with uh search engine next do the search now the answer is not as um long I guess as the perplexity one I mean

That just length alone doesn't necessarily determine quality but I mean it does look you know I mean it looks pretty a little bit more in-depth of an answer maybe on perplexity um but yeah I really like it it pulls the images too now I don't see it doesn't have a section for video which perplexity does and perplexity does have to generate images too and they also have other stuff like pages and whatnot so all in all I think this is like

Really one of the topnotch perplexity alternative tools that I've covered so far um I don't know necessarily like you know they all have their own strengths and weaknesses so I definitely if you are looking for an open source one I recommend checking out the other videos down below but um all in all like me personally for me at least perplexity it's like I don't mind paying 20 bucks or whatever I'm already paying a bunch for all these other tools so uh

For me personally it's not like something that I'm going to cancel just cuz I like having all the different tools as of now um I still get benefit from perplexity and it does have some its own unique things but I do like using these open- Source models as well and having them in my my toolkit and I know a lot of people like just only like using open source models or only like using local models um basically just you know maybe

For privacy maybe just for whatever the case may be maybe they just don't like paying an extra 20 bucks a month Maybe they just want to do some use it for free so in that case you can still get access to high quality AI using these models so if you're new here we upload videos every single day on topics like this on Open Source on AI on business growth um how to grow a business also you know especially lately a lot

Of videos on like coding and development a lot of I know a lot of you guys are working on projects and stuff like that so pretty cool stuff um if you're new here and you like this type of content make sure to smash that like button smash that subscribe Buton button let me know what your thoughts are in the comments down below I know I've done like five different complexity Alternatives if you tried any of them or if you tried all

Of them let me know which one is your favor if you have any others to suggest to do a video on may as well do them at this point because I've covered so many may as well try to find out what the best perplexity alternative is so if you know any let me know down in the comments down below um also too guys if you're new here and you haven't already joined our free community stri community.com link for that will be

In the description Down Below guys our free Facebook group free Discord Channel um where you can connect with myself as well as like-minded individuals in the whole AI Business Marketing sales space and yeah we're trying to grow this community trying to grow this channel so other than that guys if you have any other ideas for future videos let me know and I will see you in tomorrow's video guys keep hustling keep grinding and of course guys accelerate your stride take care

Latest from the blog

View all