How To Create a Web Scraping AI Agent
Let's build with Zapier and AI (100+ videos)📅 2024-11-08
Transcript
[00:00] therefore let's use this workaround to start leveraging a Chad gbt search API as we know Chad gbt now has the ability to search the internet but the question is can we access this through API therefore leveraging a feature that allows us to search the internet get results and get value in today's video let me show you a possible workaround that could apply to your use case of how we can access the internet through API and CH gbt sound good let's jump in welcome back y'all today's video is sponsored by zapier as you already know they've been calling me up and they're like yo we got to do a bunch of cool videos together I'm like let's do it and one video I wanted to do was our ability to access the internet specifically with
[00:30] Chad gbt and its API as I've seen the comments I've seen the reactions around this new feature people want to access this people want to access this now so let's do it therefore let me give you a possible workaround and use case you can do to do this let's go ahead and create a new zap together we're going to go up here to create zap the name of the game when it comes to Chad gbt accessing the internet and providing value really just comes down to a web scraper EG when Chad gbt is quote unquote looking through the internet and finds an article to give you in reality it's just taking that article all of its data all the text
[01:02] analyzing it and then providing you a sufficient answer what's cool is that we can actually do the same type of workflow within zapier so I'm going to go and rename this to chbt search API to best showcase this workaround I'm going to go ahead and set a trigger of an RSS feed what an RSS feed is going to allow us to do is listen to multiple different websites that we find Value in and then start analyzing it with gbt so for the trigger let's hit RSS feed the steps and flow I'm about to show you though could be applied to anything within automation or specifically API search with gbt trigger event we can choose new item and
[01:33] feed or alternatively new items in multiple feeds which is cool for this video we're just going to do new item and feed for the feed URL basically what I want you to do is search what you care about and see if there's an RSS feed for it so for the example we're going to do today is going to be a market oriented type of analysis EG looking at the stock market new articles information on these topics so if I type in CNN RSS feed I can go to this first one right here and just go to CNN Money whatever you're looking for type RSS feed at the end of it in a search query see if it exists coming over here you have a ton of different RSS feeds to choose from I'm going to choose markets I know this
[02:04] looks confusing don't worry just come up here to your url right here double click copy it with that copied I can come back over here and paste now because CNN RSS fees don't require username and password we're going to go here we're going to hit continue test this trigger what this is going to do for us is this is going to pull in a feed a live feed that is going to update when CNN puts out a news article associated with that category therefore for me to best showcase you how to leverage this kind of tag let's go ahead and add a filter here because maybe we don't care about every single story coming in like some stories are like I don't care therefore let's add a
[02:36] little filter here we're going to do a filter that basically looks out for only articles associated with actual stocks EG Barnes & Noble stock Source 20% comparative to this other article that says pre-market seven things to know before the Bell maybe I don't care about that kind of stuff maybe I only care about stocks therefore we're going to add a block here we're going to do a Chad gbt we going to do an action event of conversation select to your account so it's going to be simple we're going to say based on this article parenthesis let's go and continue with the stock article continue with feed a here continue select a record we click this we'll click that we'll put the little plus button here we'll hit title and then just to add a little bit more
[03:06] context we'll say and description semicolon parenthesis put the description here which is going to be description makes sense and from here we're going to Simply ask chbt to Output either yes or no so we'll go ahead and put generate yes notice I'm putting the quotation marks that's important we just want to see yes if the article has to do with a specific stack and no if it has nothing to do with a specific stock from here just add a memory key 32 random characters this is going to ensure consistent outputs test step and we should see yes here just yes there we go we just got yes what this allows us to do then is add a filter block therefore
[03:38] all we need to do in this filter block which is pretty cool is we're going to say only continue if we're going to go to conversations here we'll go to reply reply exactly matches yes therefore we know it's an article about stocks weit continue here and we should have get a green light there we go now is to prove to you that this works let's go to the new item feed B which has nothing to do with a specific stock here continue selected record continue continue test step this should say no there we go and then this should give us a yellow light here saying like hey is not yes there we go
[04:10] it would have stopped that article perfect now that we know how to filter information coming in so we only analyze this stuff we care about this is where the magic happens right because now we can really leverage our ability to do web searches within zapier which then can translate into a search API like workflow that we wanted actions web parser by zapier action event par web page for configure we're going to go ahead and put the URL here of that article that passed we're going to hit plus here for the new item in feed will come to link output format we'll put
[04:40] plain text everything else looks good here test step and we're going to get all the relevant information from that article and be able to analyze it such as the title the content even as far as the image associated with it pretty good so far come down here we're going to add another step here we're going to add a Chad gbt block we're going to do conversation and this is where the magic happens this is the end point of what we would have wanted anyways on a Chad gbt search on this topic of the internet therefore Proctor that information with whatever you want so for example on this one I'll just go ahead and say this we can go and do something like based on this article title and content Give me a
[05:12] summary any buy or sell consensus same situation here memory key test this step and there we go we got our reply right there and we can go ahead and add a final block here which could either be SMS by zapier send ourselves a text alternatively we could send ourselves an email either through email by zampier or Gmail or Outlook whatever it may be but now we' have successfully created an automation workflow that allows us to leverage a search API like infrastructure in any context therefore let's use this workaround to start leveraging a Chad gbt search API I'll
[05:43] make sure I leave this zpp your Automation in the description down below all you got to do is click it added your account for free if you feel like you learned something in today's video make sure you to leave a like it's completely free it helps me out here and I'll see you in the next video search the internet API Chad DBT search API to random videos that's my face I'll see you the next video