4fClczzlgM4
Let's build with Zapier and AI (100+ videos)
Transcript
[00:00] recently open AI has updated gbt 4 Turbo earlier this week I went over the implications of this model when it comes to pricing and everything above the board there but in today's video let's learn how to actually use this model now in order to use a model like this we can either access it in a code way or a no code way but in today's video I'm going to show you a no code way to access this new endpoint that allows us to visually see elements and we're going to test three major elements here we're going to test a picture of two cats next we're going to test a picture of an invoice and finally we're going to test a cover letter let's go and find out the full capabilities of this new endpoint in to
[00:30] start using it in our software in a no code way earlier this week I did a video on gb4 turbo and vision and we went over all the implications of it pricing of it so much so that I even gave an example of how much it would cost to run a platform like this that was one of the examples so you can check out that video right here in today's video though let's go and find out how we can leverage it in a no code way more specifically we're going to use zapier today if you don't know what zapier is basically this is an automation platform this allows us to automate workflow through software check out that video right there if you want to know how to integrate the two you know factors here we're going to see today which is going to be zap here and
[01:00] open AI let's go and begin to test out this new endpoint let's go and create a new zap here we're going to call it Vision AI we're going to try three different types of uh files here I'm going to try the invoice like I said earlier the cats and a cover letter so the trigger I'm going to use today is going to be Google Drive cck Google drive here we're going to do an event of new file and folder continue here continue I'm going to choose the specific folder that I care about here which is going to be test data here and we just is test this action we should
[01:31] find no file so actually before we test that let's go over come over to our folder here and drag in our first file I have dragged in the file here notice how I gave it a crazy name I don't wanted to be able to Leverage The metadata to get more context with the images let's purely use this endpoint so we're going to do our folder of test data here let's find the data point test trigger went ahead and found it right here so we got the file extension of jpeg we're going say continue with selected record our next block here is just going to be a Chad gbt block so now we don't have to deal with making this a web hook dealing with an API endp point we can actually
[02:01] use a native feature that zapier built out for us we're going to do analyze image content with vision continue choose your account let's go ahead and do the image here that we care about we're going to do file exists but not shown and then to gut check the first one we're just going to Simply ask what is shown in this image period here and we're going to use a Max tokens 250 that's fine we're going to continue and test this step so we should get an answer of like two cats here we go y'all it passed test one the image shows two cats side by side on the left there's a cat with dark brown fur on its face ears
[02:32] and tips of its paw like a Siamese or similar breed with striking blue eyes on the right there is a white cat with yellow eyes it's going to confirm this that is confirmed kind of green but mostly yellow white cat and a sese cat blue Huts okay we have confirmed that it can handle and contextualize images can we handle invoices though I'm going go and double click this for y'all this is the invoice we're dealing with today so I'm going to ask a very specific question here let's go ahead and ask for the balance do and the build to information and see if it can actually read and internalize invoices I'm going
[03:03] to say find new record here this is how you find new records that you put into to try to test here and to make my life easy I type in screenshot here we go so if you're really like having a hard time finding through the data you can simply use that search bar right there I know it's called screenshot I know a very good name right and we have it right here so we got it's the extension is a PNG I'm going to hit continuous selected record and we're going to go ahead and use analyze image of content Vision now what's cool about this is that we don't have to actually put the image file itself within the prompt they already have this like nice little feature here and also looks like it can do multiple
[03:34] images here as outlined by this guide right here we can do one or multiple images so there might be a context where you actually want to do something like that it looks like it is able to support PNG JPEG webp and non-animated gifts and a file maximum size of 20 megabits let's go aad and try to ask a very specific question here we're going to say what is the balance do and who is hit build to keep it simple keep it fresh hit retest step let's go ahead and see if this is correct so the first part says the balance due is $2,844 180 double click here 2,844 and
[04:08] 80 okay the invoice is built to Alan Smith Alan Smith 87 private Street Seattle Washington 87 private stre Wasington his email is Allen gmail.com very creative name there right there yeah I know it works pass step two or test two let's go and move to test three which is going to be a cover letter open this up let's ask a couple questions here so we're going to first off ask the individual's name and let's find a very specific data point here that we can reference the data point we're going to reference to gut check this is going to be the completion rate which is 90% come
[04:38] back to our trigger here actually no we're going to come back to test here and we're going to say find new record and then to make my life easy I'm going just search cover as that is the name of the file here say continue selected record continue continue and let's going to do that we're going to say what is the person's name and completion rate obviously I could have proctored this to be very specific to handling any type of cover letter so will find me these key points summarize the cover letter above the board whatever you'd want to use in this context what is the person's name and the completion rate so we should get 90% And we should get the name of
[05:11] Jonathan Draper person's name of the letter is Jonathan Draper he mentions a project completion rate of 90% and a 100% compliance rate with building codes zoning regulations and Industry best practices let's gut check 100% and there you go which has a resulted in 100% compliance rate on all building projects under my supervision pass test three what do y'all think are you going to start using it let me know in the comments of any type of automation you want to see in the context of vision and see if it's even possible maybe I can do a video on that I'm going to leave a playlist at the end here that's going over everything you need to know when it comes to artificial
[05:41] intelligence automation like this it's over 80 videos long now I'm also going to leave a video that I did two days ago which goes over other context for this endpoint that you can start leveraging one really cool thing I did in that video is the context of having a platform where we have thousand individuals they process 90 images a month and what the C cost would be associated with that without further Ado I'll see you in the next video that's the play this is referring to about Ai and automation that video right there goes over the cost associated with creating an application and the value can provide a consumer that's my face
[06:12] I'll see you in the next video