FREE TurboSeek.io Open Source Perplexity AI Alternative!🤖 Together.ai Self Hosted Llama 3.1 70b & 8b
In this video
- 00:00Introduction to TurboSeek.io: Free Open Source Perplexity AI Alternative
- 00:32Diving into TurboSeek and Setup Overview
- 00:44Tech Stack Overview of TurboSeek
- 01:25TurboSeek Workflow Explanation with Together AI and Llama 3.1 Models
- 02:03Live Demo of TurboSeek Cloud Version Functionality
- 02:35Exploring TurboSeek Search Results and Context Generation
- 03:14Self-Hosting TurboSeek: Cloning the Repo and VS Code Setup
- 03:38Setting Up .env File and API Keys for TurboSeek
- 04:17Installing and Running TurboSeek Locally
- 05:03Sponsored Segment: Stride Agents AI-Powered Appointment Setters
- 05:47Exploring TurboSeek Future Development Plans
- 06:23Comparison Between Hosted and Self-Hosted TurboSeek Performance
- 07:04Demo of AI News Retrieval Using TurboSeek in November 2024
- 07:33Limitations and Considerations When Using TurboSeek
- 08:12Best Practices for Getting Quality Results with TurboSeek
- 08:45Final Thoughts on TurboSeek and Community Engagement
- 09:23Community Links and Business Optimization with AI Tools
- 09:48Closing Remarks and Channel Promotion
Links from the video
Transcript
2,016 wordsWhat's going on guys Josh pokok here and we've covered many different perplexity free open source alternatives on this channel from open perplex local search perlex morphic you name it we've covered it now in today's video I have another free op Source perplexity alternative for you this one is called turbos seek. and it is powered by together. a and I'm going to show you in the next couple minutes how you can easily set this up locally and I'm also going to show
You how you can use this 100% free on their Cloud version so without Ado let's dive right into [Music] it all right guys so all links we talk about in today's video will be linked in the description down below so first things first is the GitHub right here so let's quickly go over the tech stack of Turbo seek we got a nextjs app router with Tailwind we got together AI for llm inference we got llama 3.1 8B and 70b for the
Llms we got Bing slurper API for the search API we got helicone for observability and then plausible for web analytics so the way it works is you query it with a question it makes a request to either Bing or serer API to look up the top six results and show them and then it scrapes the text from those six links and sends them back and stores it as context and then it makes a request to llama 3.1 70b with the user's
Question plus context and streams it back to the user and then makes another request to llama 3.1 8B to come up with three relevant questions that the user can follow up with now I'm going to show you how you can get this set up locally in just a second but before I do you can actually come up here to turbos seek. and you can actually try it 100% for free you don't have to put in your API keys or anything like
That so for example if I go over to their website right here to their Cloud version we can see here that there is three different prompts right here I could click on one of these or I could ask it pretty much anything if I go ahead and ask it can you explain theory of relativity we can go ahead and search and you'll see it has a nice UI right here we have our question showing up here we have our six specific
Sources that it's pulling from as you can see right here we got like Reddit Kora Wikipedia NBC News Etc then we have the answer right here which we could copy right like so by just clicking that button and then we have our similar topics right here here that are generated from the 8B model and then this is from the 70b model okay so as you can see here we got a pretty decent answer and it was pretty quick of course this
A power by together AI so it's going to be pretty quick for these open source models and then of course you could click on a similar topic right here like how does this uh how does a theory of relativity affect time and space and it's pulling those six um sources right here and giving us another answer okay so now you've seen it in action let's go ahead and get this selfhosted all right so first things first is you're going to want
To fork or clone the repo so we can actually just copy this URL right here and we can go over to our terminal and you're simply going to run get clone and then this URL right here for the repo that's going to clone the repo in that directory that you chose and then you're going to run CD turbo seek to change directory into the turbo seek folder then what you're going to do is run code dot to open this in vs
Code all right once once you have it open in vs code you'll notice that there's a example. EnV file you're going to want to make a copy of this and rename it Tov okay within thatv file you're going to add your together API key you're going to add either your Bing API key or your serer API key you can add either or okay and then you're going to add your helicone API key now I don't know if this one's required or
Not uh this is for observability but you're going to need the Bing and the serer for one of those two for sure as well as the together API key now within the repo here you can see that it links out to all those specific resources so together AI right here you're going to need that and then either serer API and you do get some free credits when you sign up or the Bing search API right here and then helicone right here
So once you get all those accounts set up or whatever ones you're actually using then you're going to add those API Keys into your EnV once you do that you're simply going to run npm install to get everything set up and then npm run Dev once you run npm runev you'll see that it is started on Local Host Port 3,000 are you tired of pouring thousands of dollars into appointment Setters only to watch leads slip away imagine having a team of
Elite sales agents booking qualified appointments for you around the clock no more wasted time on training no more frustration with performance and no more draining your budget on inconsistent and expensive call centers introducing stride agents AI powered appointment centers that work 24/7 never get tired and book appointments while you sleep trained on thousands of successful conversations our AI agents outperform human teams at just one tenth of the cost join the ranks of businesses that doubled their appointments and booking rates in
Just a matter of weeks don't get left behind in the AI Revolution visit stride agents.com now and transform your entire sales process with cuttingedge AI technology it's time to accelerate your stride with AI agents and right before I pull that up you can actually see here they got some future tasks right here that they're going to be doing to actually improve this project which is nice I'm not going to go through all of them right now but you can see some
Pretty cool stuff like more in advanced rag techniques authentication with clerk postgress Prisma bunch of different stuff here so that's pretty cool that they're going to be improving this project and for those of you who have been following the channel I've done many different uh videos on tools that uh together AI has built and they've built some pretty cool tools like llama coder bunch of different ones so check some of those out as well as well they always build some pretty
Quality tools now let's actually check out the self-hosted version okay so we can see it's exactly the same we' got our three questions right here how can I get a six-pack in 3 months we can go ahead and actually just run this and you'll see here it's pulling those six sources and this is lightning fast it's actually got this even almost faster than the hosted or the cloud version that we just used and we can see our different sources here and
We can see our answer we could copy this we could SE a similar topic right here so let's go ahead and okay so this search is let please do in-depth research on the most recent AI news in 2024 November and write an in-depth report so this is a more bit more specific let's go ahead and search this so we can see here that is pulling the AI news right here for our sources and as you can see since I asked it
To give a bit more of an in-depth report it's uh as you can see a little bit longer so we got advances in NLP natural language processing uh increase adoption of AI industry so we got xai right here advances in uh computer vision bunch of different stuff now okay now the one thing I will mention here is it looks like it's cuz you know we're using an L llm now this could either just be based on how the app is built
Maybe you know the rag techniques it's using or the the way it's pulling the context from these sources maybe it's not the best or maybe it's just the model since it's llama 3.1 you know it's not like we're using Claude or open AI here but as you can see here it's saying that it's contact or that it's training data only goes up to December 2023 even though that it should have the context of these sources right here um I've noticed you
Know sometimes you may get answers that aren't perfect all right it's not going to be as good as perplexity uh just because if you're using Claude 3.5 Sonet or open AI GPT 40 you're not going to get the most quality answers but this is a good alternative for um you know self-hosting using something like llama 3.1 or even if you don't want to self-host it and use your own API Keys you can go ahead and actually use the uh Cloud version
On turbos seek. so what I would recommend for that is you know just like always be very specific with your prompts and keep that in mind that you aren't using the most upto-date you know Advanced close Source whatever models so you're going to have to be very specific with your prompts if you're actually trying to get um you know really quality results maybe for a specific thing especially when you're dealing with time like this recent news Etc but other than that
Guys I just wanted to share this tool with you because I know a lot of you guys love different perplexity Alternatives different open- Source ones whether that's morphic perplex Etc and together AI tools that we've covered have always been pretty pretty quality stuff so I wanted to share this with you guys let me know what your thoughts are in the comments down below if you've used turbo seek if you haven't even if you're not going to self-host it you know if
You don't want to use your API keys or you don't want to go through the trouble definitely try it out at their free Cloud version right here you can literally just try it out don't have to put your API keys in there so I think that's pretty cool and that's pretty much it guys if you're new to the channel we upload videos all the time about AI Marketing sales business growth so if you're new to the channel and you like that
Type of content make sure to like the video comment down below and subscribe to stay up to date with the And subscribe to stay up to date with all the uploads also too guys if you haven't already joined our free community stri community.com I'll leave a link down below to our free Facebook Facebook group and Discord Channel and then for those of you that run a business and need help optimizing your systems or getting more leads with paid advertising marketing or
Implementing AI agents like AI appointment centers Ai call center whatever the case might be into your business and bog a call down below at executiv st.com slapp and we can see if it's a good fit other than that guys I will see you in tomorrow's video keep hustling keep grinding and of course guys accelerate your stride take care