OpenAI Tools For Building AI Agents (web search, responses api & computer use)
Let's build with Zapier and AI (100+ videos)📅 2025-03-18
Transcript
[00:00] open aai has just released responses API in this video we're going to learn everything we should know about it also how to implement it and integrate it into our workflows and what is really cool and something that's very unique about this update that I haven't seen with any other AI company is now we have the ability to finally use the web searching capability anywhere so let's go ahead and learn about these new tools for building agents let's jump in welcome back y today's video we are checking out respons API it is sponsored by zapier because as you already know me and zapier have teamed up and we're doing a bunch of cool videos together so in this video I want to show you what
[00:31] the heck this even is how we integrate it and what we should know about it so right off the bat what is this all responses API is is adding an extra layer of capabilities to our traditional chat completion endpoints what is a chat completion endpoint Corbin that is basically when you send a prompt through the API and you get a response this is really cool and one that really stood out to me and what I'm going to show you in this video on how to do is going to be this web search one this has been gatekeep for the last like 2 3 years in the API Community you have a bunch of crazy stuff when it comes to web
[01:01] scraping and all these third party accesses we don't like that but now they actually give it the ability to web search in a prompt I know people are going to like this one the other capabilities that we'll be able to do in these chat completion prompts now or just conversations is the ability to file search within our dashboard or you know our developer account and computer use I think computer use is there and wait let me take a step back if you don't even know what computer use is that's basically when the AI takes my little mouse here is able to click through and browse the internet I'm actually going to leave a video that shows you how to do this or a demo of of this in the description down below it's
[01:31] like operators I think they definitely did this feature right here cuz they want other people to build like a software that's really good at functionally doing computer use CU right now when you use computer use by opening it's a very very beta like it's not that good but they want some developer obviously to make it software built on top of them that's really good now before I dive into the example today here are two very important things you should know about this new API the first one is that assistance API they're deprecating this this is bye-bye in mid 2026 the reason they're doing that is cuz now kind of leaning towards and pivoting towards his responses API to be
[02:03] a layer for chat completions API if you don't know what I mean by layer think of it this way check out this example this is actually pretty cool as we know from traditional conversations and you'll be able to see this in a not code way with zapier pretty soon here we typically just put an input of a prompt and we get our output and what we've seen in the past is that the model sometimes is like oh I can't give you that answer I'm trained up to October 2023 which can be frustrating and especially when you're trying to do real-time insights for very specific things in workflows sometimes you the internet I think we all need the Internet we're on the internet right now the interwebs
[02:33] www.com the idea though is here we're adding this extra tool layer and this is an example of the web search preview tool layer here so now I want to ask what was a positive news story from today instead of it grabbing its database of like up to 2023 it's actually able to get status quo information using this tool layer I actually like this pivot by open AI here to deprecate assistant API as assistant API had extreme value people liked it but people don't really play with it that a lot I didn't really see a lot of videos on it I didn't really see a lot
[03:03] of people entertaining it so now that they're giving this feature more of a tool ability to the completions API makes a lot of sense if that all sound like mumo jumbo short story is this basically now through API we can web search File search and we can also do some crazy computer use which I'm really interested to see the software products created in that context last thing you should know about responses API which big kudos to open AI I thought they were going to go a little crazy on us and start charging some premium to even use these tools but lucky for us this newest API will make it so that the cost associated with these built-in tools is
[03:36] purely just going to be based on the actual model you use EG responses API is not priced separately tokens are buil at the chosen language models input and output rates therefore you choose gbt 40 right here the input and the output cost exact same if you use a tool like web search pretty big deal I think they could have went a route here where they charged premium on this but it seems like they're opting to just get more capability to end points we already previously Ed in our development workflow I like it okay enough talking let's see it in action one last side
[04:07] note you can go to the playground here play around with it if you want to see it in like a playground Dev environment so I can VI to playground I can choose my tool gbt 40 cool can create a function file search web search we want to see this in action in a real workflow so I'll show you that the steps and processes I'm going to show you is going to be able to work for web search and file search we're going to come over here to zapier here and we're going to create a new zap we're going to title response API because what I'm trying to show you today is just how to use this response API we're going to jump straight to action here and set up our chat gbt block chat gbt the action event
[04:38] here is going to be API request now I assume that in the future when the zap your team gets around to it they're going to add this as its own little specific tool thing and you're going to be able to click it and go that way for now though we're going to do an API request don't worry I'm going to provide the code either in the description or as the first comment in this video select your account plus the code you're about to see is actually very simple it's only a couple lines just a payload so we're going to go and do the HTTP method of post if you want a little context of what that means that means we're just sending data we're making a request we're like yo we have a prompt here we want to do some web searching give me an
[05:09] output the URL this is where we're sending the request to basically like if you ever DM open a on Instagram or something like that do they even have an Instagram they might not have an Instagram I think they do though if you ever did DM open a on Instagram this is our way of dming their API servers for response I'm trying to make this make sense okay y'all then in the request headers this is essentially like we're sending a request we're like hey we need something here we need to have the correct authentication so the first thing we're going to send is going to be the content type essentially what
[05:39] language are we sending our payload in it's going to be in Json we do add value set and then we're going to add the text authorization here this right here is going to be your key which we'll grab but for now this is the body what's great is we can simply just paste the body that we got from the example here which is right here boom notice we don't have to add the extra lines of all this information because Z appier handles that for us so all we really need to do is essentially just give what the heck we want so in this context I'm going to choose the model gbt 40 obviously if you want a different model opt for 01 03
[06:10] mini whatever it may be then we're going to use the tool of web search preview as identified in the documentation which I'll leave in the description down below as well and then our input is going to be our prompt so instead of they're calling it prompt here they just called it input why do they rename it I don't know I don't work at open AI then I'm going to say what was a positive news story from today this is to gut check whether or not I can actually search information and give us status quo information so last step here is just going to be adding your API key which I've done in a ton of tutorials I'll actually link another tutorial at the end here that basically goes over in 22
[06:40] minutes everything you need to know about artificial intelligence when integrating into zapier 22-minute tutorial beginners API Keys all fun an thop Cloud Gemini are you a Gemini are you a Leo you know the vibes okay let's put the API key in once I put this API key in which will start with an SK I'm going to hit continue and we're going to test this step so I'm going to go hit test step and in theory here and you might be like Corbin I see your authorization token don't worry I'm going to delete it you can try it pause the video it's like those videos that used to be like find the random Amazon gift card if you find it it's $50 and it's yours you know what I'm talking
[07:12] about all right test the step I'm going to take this one step further here as well and whatever stories it gives me I'm going to search it on Google and see if it's real like it didn't just hallucinate and made up a news story and the date is March 17th so I should see March 17th here we got our response here how open AI typically does outputs when when doing it in this context it will just give you a ton of data don't worry just scroll down and here we go this is our output here which is today March 17th 2025 correct Asian and European stock markets experienced significant gains reflecting investor optimism in
[07:43] these regions it actually went pretty far here though which is really cool is it it gave the source as well so let's check this out supposedly it's this it did give the source and I'm getting a bunch of little dinosaur that's fine that's pretty nice I think one thing I'm impressed with in this output is I wasn't actually expecting it to give the source at all I was actually expecting it just to give a simple output of just text it does seem like they are giving us access to the direct endpoint that we see with the web searching capability within Chad gbt now and when I say that I mean this capability right here when I
[08:14] click search here I think we're getting access to that probably not the like best version of it obviously because open AI is going to try to gatekeep that but for now that's pretty cool and we set up an automation with no code and access to end point so because we Ed the code from here I'm going to go ahead and just leave this link in the description down below you can copy it directly from this example obviously the input is going to be you know what are you asking for example what is the price of Apple today in order to give you the status quo That Just About Does today's video make sure to leave a like is completely free web search is awesome the amount of demand I've seen for that specific
[08:45] feature has been a lot in the last two years so that's cool that came out now the other one that really piqued my interest is that computer use that right there is an obvious play by open AI to be like you know what we build the tech let's just let other developers create a really cool software that's going to really Leverage The abilities of computer use and what that can do in someone's workflow as that is a whole another situation but without further Ado I'll see you in the next video that right there is that 20-minute video going over everything you need to know about Ai and zapier as fast as possible that's a random video that's my face
[09:16] I'll see you in the next video