Video22 min watch

FREE: LLM Answer Engine FREE Open-Source Alternative ๐Ÿค–๐Ÿš€ (CANCEL PERPLEXITY?!?) - Groq Powered

Links from the video

Transcript

3,340 words

What's going on everybody Josh pokok here and in today's video we're going to be looking at how you can cancel your perplexity subscription you're paying 20 bucks a month to use perplexity we're going to look at an open source completely free selfhosted option and this tool is called llm answer engine all right here's the GitHub repo we're going to dive right into it as you as you can see number one GitHub trending Repository of the day they got that some sort

Of day I believe let's dive right into it all right guys [Music] so an AI powered search engine and the second was morphic okay so if you haven't watched those videos go check those out too because if you are looking for a perplexity alternative you're going to want to see what all your options are right and these tools morphic and perplex are good tools and from what I've seen so far with llm answer engine it's actually a very good tool as

Well and I'm very excited for it so we'll quickly go over then I'm going to show you how to self host it install it and set everything up all right guys that's really annoying I just recorded a 20-minute video and then once I went to edit it pretty much caught off so that's let just start from where we left off and if you're new here and you got some value from this video make sure to smash that subscribe button because we're

Recording another 20 minute video at 1:00 a.m. on a Friday anyways back to the uh llm answer engine let's look at the Technologies used here briefly before we dive in on how to install it so got xjs just like all the other ones that we covered pretty much for perlex alternatives to built on xjs using tail 1 SS CSS versel AI SDK Rock and mixol Lang Chang JS Brave sech serper API key open AI bet and betting Cheerio olama uh up

Stash rdus rate limiting optional and up stash cemented cach optional prerequisites you need to have node.js installed so download node.js search that up on Google node.js if you don't have it already obtain API keys from open AI grock Brave search and serper so it gives you the direct links right here so all links will be in the description down below including this repo so you can just go here and get those API keys if you don't already have them all right

What we're going to do to install this is you're going to want to go to um your terminal all right and you can go to whatever location you want to install it whether that's your desktop make a directory on there then basically you're going to get clone you're just going to run this command get clone and you're going to clone this repo in there right this the llm answer engine repo okay from that point on you're going to install the required

Dependencies you can either do this through node which is npm install um or you can do this through bun all right so if you're going to do it through bun of course you got to make sure you have bun installed I did this through npm so yeah whatever you want just do it through that method okay okay now you're going to need to configure your environment variable okay so way you do this is when you open up your um your llm

An uh llm answer engine when you open up that file you'll see and I'll just quickly show you here llm llm let's just show you where llm answer engine is right here okay so I open this up and you'll see I have an environment variable here this was actually called example. environment uh NV e uh EnV I believe something like example or whatever so I simply instead of creating a new one like it says here I just renamed it and when

You open it it's going to give you a bunch of different kind of uh options well it's going to look like this basically um it's going to look a little different cuz I I just removed these API Keys just so I can show you guys but basically just kind of go over this quickly we got our grock API key here openingi API key here serper API key and brave surf SE then we got o uh option for olama base URL and

Then we got some options here now I believe when it first like when I first opened this it it had one of these it just had either reddis or vector um I don't know exactly which one it had I can't remember but basically I you're going to need both well actually you're going to need Vector for sure that's 100% I don't 100% know if you need the reddest one you can either just add the vector one or if you're running into

Issues either rdest one or do them both at a box either one works or so yeah either way you do that works but you're going to need Vector I was getting an issue before because I didn't have the I was trying to I don't know but you're going to need Vector I know that and maybe redus I just did both though so you can test that out and see which works but anyways that's how I have it set up here um

There's also other options like you can configure such as Google search a uh search API Key Port key API key Spotify client ID and all that stuff uh AWS uh bedrock and then F fou AI so stabil diffusion 3 um so got a bunch of different options and then it even mentions to here you go to the config dotx uh TSX within the app uh I believe yeah and within the app and then uh app folder directory you'll see that there's

Options that you can toggle to true or false or whatever the case may be and some stuff like AMA inference embeddings search provider so you can change it to serper or uh Google serper is default whatever the case may be inference model you got here and all this other stuff right so once you're done that with the environment file you're going to save it and then you're simply going to obviously you know make sure you're within that folder and you're going

To either npm runev or or bun runev okay so depending on what you're using of course here it just talks more about the uh configurations and whatnot and function calling support is in beta so maps and locations shopping Etc uh AMA support partially supported and then road map so it's kind of interesting they got like add document upload for reg and document search retrieval also too guys one thing I want to mention if you um if you watch my video on

I believe it's uh moric moric requires I believe um upst stash here it says like within here in the GitHub repo I believe it's I mean from what I I just read maybe it says somewhere else about this but it kind of says it's optional for up stash and maybe it is maybe you can like toggle it on or off I I was getting an arrow without it without running this so at least I just found it simpler just to include

It so um yeah at least for me what I was Finding was it was required but maybe there's a way to configure it off whatever the case may be but uh moric required it and if you already have this set up up stash then you can it will be pretty easy but it's still easy it's very simple it's free you just simply um go to ups.com link will be in the description down below and to create a redus you just go

To redis and you create a database and it won't let me create another one because I already have one I'm on the free tier so yeah it's free but um once you do that you create the database and you literally just click into it I'm not going to do it just cuz I don't want to show that information but you click into it and you'll literally see your uh URL um for your database for your R database and your a and

Your key for it right so you would just copy that paste it in your environment uh variables and for Vector it's little bit different same thing basically you just create an index name it whatever choose whatever region okay you're going to need to select an embedding model okay you this is like mandatory so you can select really whatever one you want from what I believe I think I use like smaller base right here just because and um you know you can

Click on C documentation right here get more information on the up stash embeddings if you want to see like the dimensions the SE sequence length all right and the different scores on the MTB right so yeah if you want you can check that out we have like the um the models and all that but really anyone will should work but uh and then yeah so once you get that um all and you just run npm run Dev what you're going to

Get is this um we're going to get our nice answer engine well llm answer engine okay so what do we do from here well let's go ahead and test how it compares to a perplexity search Okay so let's go Ahad head and just use how is Apple stock doing these days okay and boom so I'm not shocked right now because I just like I said I recorded this video already so I know exactly what's going to happen plus I've used this

A bit but when I first recorded I was kind of like whoa wow oh it even has like an embedded chart right here and if I was like a you know stock Trader that likes to analyze charts and stuff and I'm looking using this as um an llm to search like this is pretty cool because I can literally analyze the chart right here this is like something like you would see in I yeah this is trading view so this is like

What everyone uses to analyze charts and whatnot um so yeah I think that's pretty cool and then over here on the right we got pictures I do like this interface because we got pictures up here and it's like a nice user interface where you can just kind of Click through and see the different images then we have videos right below it so I do really like this user interface um here of course we have our sources so similar to perplexity we

Have the sources and it's a very simple user interface so that that's definitely like good um definitely could be improved upon like it's not perfect but uh anyways let's look at the response because that's what really matters so we got Apple stock performance we got overview we got financial performance we got analyst ratings we got news and Trends dividend and yield technical indicators right so pretty decently sized overview response and uh then of course we could copy this we could regenerate

This to get a new uh answer or we could answer or basically have a chat and do uh followup questions and you can see this one is powered by grock so it's inference time is going to be fast and that's great you know I really do like grock um using the lpus and POS from the gpus anyways so yeah so then what's the latest news uh driving Apple's so prices you could ask that whatever it's going to give you some potential

Answers or you could just type in a message right so let's take a look at perplexities option for that exact same question here is what we get so first off um yeah we get Pro this is with the pro search too so we can see our searches here or our sources right we can see a bit of information about the company we do get a little stock graph here but it's it's uh it's not as good like maybe it looks kind

Of cool with the dark mode but it's not as good as like the trading view one that we get over an answer engine this is like a fully interactive one through trading view it's literally like an embedded thing through trading view so you could use it to some degree pretty awesome here it's just kind of a chart so I'd say answer uh engine actually wins in that regard and I actually really like that that actually kind of shocked me the first

Time using it I was like damn that's cool cuz I'm used to perplexity I I haven't seen that before even in the ones I mean I didn't ask the ones I did um morphic and perplex I didn't ask them this question this specific question so I don't know if they would give the embedding of trading view but I do like how this one does okay here we just have like perplexities so performance re uh recent performance financial highlights Market reaction key

Factors analyst Outlook all right I believe I'm using gp4 Omni here for the generation so I mean uh Gro I believe it's using like uh one of the open source models so it's prob I mean it's probably not as high quality as gb4 Omni just because of the model but um but yeah in terms of the generation and the how how uh answer engine is doing I I really like it you can see obviously with perplexity we have our related questions

Here you know your search images search videos and so you you do have to click that button to get access to that um but you can also generate images so that's kind of cool but other than that guys um that's pretty much it in terms of installing answer engine and and using it um let me know in the comments down below what you guys prefer are you going to use answer engine are you going to use still perplexity or are you

Going to use some of the other uh open-source tools that we went over in the last few days such as morphix such as perplex have you already checked those out if not check out those videos uh you can just go on my channel and you'll see the the like most recent videos perplex and uh morphic and I'll even leave those two videos Linked In the description down below so if you do if you are someone that wants to use a perplexity

Alternative you can be sure that you are picking the best one for your needs and check out all the different options and I'll do some more as well on this channel so make sure to stay tuned smash that like button smash that subscribe button but you know we are seeing that uh a lot of these open- Source models for are pretty pretty good comparative to perplexity perplexity I still say does have its strong suits like I do like the pro search

Just because like sometimes if you're doing a lengthy search that's maybe a bit complex you can see it goes through different options and like different searches and queries and I personally like kind of like that um but you know at the end of the day we are seeing one the open source rise and and they're it's everything with open source is getting much more powerful on the other end too we also have like open AI that that's basically releasing search GPT

Now at least in beta or Alpha whatever so that's a direct competitor to perplexity and I'm already paying for open Ai and perplexity and like CLA so if open AI has something that becomes just as good if not better than perplexity then I could just cancel my perplexity subscription and just pay for only Claud and open Ai and whatever whatever other ones I want to pay for right so that's kind of how it's looking for perplexia I do say that they

Do have it like strong suits at the moment it's definitely has an advantage in the Market at the moment but um yeah with everything like uh improving so quickly we'll see if perplexity can stay the top search AP AI in the next year or so right so that'll be interesting let me know what your thoughts are in the comments down below but uh other than that guys I think that's pretty much it I'm trying to remember if I talked about anything

Uh in my first video but I don't think I did so if uh oh yeah also two guys what I will say um and I did mention this when you are talking to uh any llm whether it's open source uh or perplexity or open AI prompting is key you really got to make sure you're prompt engineering properly you're like trying to do it to get the best results it's something I do on a daily basis I mean I use these AI

Models every single day for my business for me personally as well as for my clients so um definitely check out some of the other videos on the channel I've done videos showcasing different ways to prompt for different use cases and you can probably get some good ideas there also too guys I have a full chapter in my book client acquisition code talking about prompting in depth so definitely check that out if you haven't already link for that will be in the

Description down below also too guys if you're new here we upload videos every single day on AI automation business marketing growth whatever the case may be so if that's something that you're interested in if you got some value here then definitely smash that like button smash that subscribe on definitely show support to the channel cuz uh yeah we're we uh are definitely trying to improve the quality and everything on these videos and uh give you guys the most value possible I

Got some really good stuff on the way coming for you guys and then also too guys if you haven't already joined our free community stri community.com we have about 750 to 800 members on our free Facebook group free Discord channel so you can join Network connect with myself as well as other like-minded entrepreneurs AI enthusiasts agency owners coaches Consultants business owners coders developers all that all those awesome people are in the stride community so it's 100% free link for that will

Be in the description Down Below guys and everything I talked about is in the description down below so definitely check that out to uh make sure you followed along properly and got you know this installed so if you had any questions or any issues with this let me know in the comments and I'll help you out and then if you have any suggestions with future videos let me know and uh maybe I'll do one on just that so other than that

Guys I will see you in tomorrow's video thank you for watching keep hustling keep grinding and of course guys accelerate your stride take care

Latest from the blog

View all