Train OpenAI Assistants with Any Website Data: Unlock with Oculus Proxies
Other Videos📅 2024-09-17
Transcript
[00:00] let's go ahead and learn how we can train an open AI assistant on any type of data that we would want to find on the internet to Showcase this we're going to be using Aki this proxies when leveraging AI this proxies we're going to turn that website data into llm ready data that's going to allow us to train these open AI assistants sound good let's jump in welcome back y'all today's video is sponsored by Oculus proxies now some of y'all might be like Corbin what even is a proxy here's what's super cool about proxies and more specifically Oculus proxy which is probably the most cost effective prox in the market right
[00:30] now is it gives us the ability to grab data from any website any website Corbin any website now some popular examples of this is stack Overflow Reddit Discord everything like that with aculus proxy we can goad and scrape the data from any website so let's go and leverage that in today's video we'll be training our open AI assistant on Amazon listings of backpacks we're going to go Ahad and create three different files to train from such as backpack backpack for men backpack for travel the workflow and the method I go about doing this you can apply to any context any website and
[01:00] train your open AI assistant on let's go ahead and get going here you can click the link down in the description down below to get started for free on Oculus proxies let's go ahead and try for free once you created your account and you're good to go come up here to your little profile here and save my proxies now the specific type of proxy we're going to use in today's video is going to be the ISP all you need to do simply is hit add proxies ISP and proceed once you have it hit configure now for obvious reasons some of this is going to be blurred out just because of the fact that this will be my IP all we need to do though is
[01:31] simply hit detect my IP once you do that it will show up right there in that little box I know all you see is I know all you see is gray okay but that's my IP once we have that though we're going to hit add once we added it it will show up right here and all we have to do is hit save and generate click with that added let's go and add a Chrome extension here that's going to allow us to activate this proxy coming over to the Google Chrome Store simply type in BP proxy switcher add to Chrome with that added come up here to copy proxies we're going to come up here to our Chrome extension here right here we're going to go ahead and click edit and go ahead and paste the
[02:03] proxy list that we just copied once you hit okay what you'll notice is now we have the ability to switch to our proxy step one done let's go ahead and enable this proxy that's going to allow us to scrape our data that we found here on Amazon to enable the proxy all we do is come over to proxy and hit proxy Ulus proxy.com and we're going to go we are live we are currently using a proxy let's go ahead and get that data from Amazon I'm going to go ahead and go to every single one of these Amazon p pages and copy the link and paste it over let's hit enter we are getting data
[02:34] perfect so we got the result for the first file here this is for the search query of backpack once we get a result here it's very important that we download the Json version this is what's going to allow us to train our open AI assistant so simply hit download results Json I'm going to go ahead and name every single result that I get the specific search query so this first file here I'm going to name backpack the second file I'll name backpack for men and then the third file will be backpack for travel link number two we are getting the data with that proxy download results for number two and let's go and get it for our last file
[03:05] here run we're going to go ahead and make sure we still download the Json response here but just for context basically what's incurring here is that we're getting all the data found on that Amazon page the images the text the copy Etc download the result here we go so we got all the relevant data that we scraped using AES proxy here let's go and begin by creating our assistant for you you're going to Simply hit create assistant for me I've already named it so we're going to go with Amazon expert let's do Amazon backpack expert and let's start off here by just choosing the most competent model as of now which will do gbt 40 and then here is going to
[03:37] be the file search this is where we're going to upload the data that we just got so we're going to enable this let's go to add our files here add file first one I'm adding is going to be the pack pack. Json backpack search query second one I'm adding is going to be backpacked for men and the third data set we're adding is going to be backpacked for travel all good hit attach with this attached we're going to have open AI index it so we can actually read the data using open Ai and what you'll notice is that this all comes together here to one nice little Vector file of our relevant information that we took from Amazon knowing all this we have the
[04:07] data attached now we're going to add some instructions here you are an Amazon expert say context let's go and expand this so let me show you the real power of using assistance trained on data here so we're going to say contacts you're an Amazon expert based on the product data provided from Amazon I'll put the best performing keywords for backpacks optimal product titles patterns notices with the products pricing average outline liers relevant links to Amazon Pages for more context so we're throwing it all out there we want to see as much as we can of these data sets this can obviously be applied to any context
[04:38] though right you scrape a Reddit page stack Overflow whatever it may be you can really train these assistant models on this data for very specific types of answers with that done though I can back out and proceed here I'm going to go ahead and say give me your analysis based on the data we provided run here we go y'all so based off the three data sets that we trained it on here are our answers and it's going here so the first answer here is best performing keywords for backpacks travel backpack water resistant expandable laptop backpack
[05:08] lightweight school bag I mean this this makes sense here USB charging port weekend trips next we get optimal titles from that data set classical travel backpacks for school water resistant book bag lightweight College laptop backpack for men and women with USB charging port vintage backpack travel laptop backpack with USB charging port for women and men next we got some in-depth analysis here patterns noticed sustainability certifications functional features Comfort considerations and gender neutral designs diving into one USB charging water resistance and
[05:40] expandable compartments are frequently highlighted features next pricing averages so I took all that data and was able to give us a range and some pricing averages so Prices range from $15 to $70 with the average price being 35 coming down here we got high end prices reaching up to $200 in some cases and then the other outlier on the other end would be the budget friendly version of this which would be $15 now we're going to go ahead and let this give us actual links found in the data set of good optimal backpack listings while it does that let me show you something cool here
[06:10] what you'll notice is that some of these outputs have specific one two 3 4 five 7 and what these represent is where it actually got that data from so for example if we want to know where number two came from I come up here and we talk about sustainability certification where is that coming from what are you talking about we come down to number two oh it's from the data set for backpack Fort travel. Json I mean this is going all the way here I mean this is still generating y'all so on top of that relevant links to Amazon Pages for more
[06:41] context this is where it got some of its information from so if I click one it will take me to the specific page that it grabbed the underlying data from so for this example we got a classic basic travel backpack there we go start grabbing data from anywhere on the internet using Oculus proxies right away in your workflows start training open AI assistant mod with it if you feel like you learn something today make sure to leave a like it's completely free I'll make sure to leave a link down below for Ulus proxy and I'll see you in the next video these videos are based off the clicks and the way you've been engaging with
[07:11] YouTube the top one doesn't look that bad I kind of like the top one I'll see you in the next video by