More HACS components - LLM Vision Card, Advanced Snapshots and more
after one week break and yes I'm back alive and kicking it's time for another Hax video today we will be looking at three components one is a front end component but it does have some prerequisites and the other ones are Integrations so we will be restarting our home assistant we'll start in couple of seconds let's get started with the first one you know and I've shown this in a couple of videos already I do love cameras and I have a lot of them some of the cameras are smarter than the others and if they have technology or AI inside of them they can get automatically triggered if they see person pet or a vehicle but for others there are some other options that you can also use too which is topic of another hex component we'll be looking at today but what do I use I use Snapshot that means when the camera gets triggered binary sensor inside home assistant changes from off to on this then triggers the inside service or action called snapshot it creates snapshot of the image from the camera saves it locally and then displays it inside UI for example as this one where we have person images animal images and then Vehicles if the vehicles are captured there is one hex component that can improve on that and today we are going to look at that one it's called Advanced snapshot for home assistant what it does it takes or replaces the built-in functionality with Advanced functionality where we can manipulate where we can save multiple images etc etc what do we do to install this one click on the link open the link and it should open the page where you can install this component click on download the latest version at time of the recording is version 2025. 2.3.3 click download and since this is a component and on the card we will need to restart our home assistant of course you can do it any way you want preferred way for me is to go to the settings click on repairs and just click on submit home assistant will now restart while home assistant is restarting let's check out the documentation quick reminder if you do end up installing this component if you do end up using this component don't forget to say thanks to the author by at least clicking on the start button so that the author knows that you are using using and liking the component now back to the documentation this component will create a new service call or new action this one will be called Advance snapshot take snapshot if we compare it to the original one this one as I've said allows you to manipulate the image that you want to get from the system let's go through each of the configuration options first one we need to specify camera ID this is the camera entity name then we need to specify the name of the file for this specific camera so for example if it's front door then it's front door. jpeg for the backup and yes you can create backups why would you create backups for example if you have camera in front of your house and there is a lot of traffic a lot of movement a lot of captures each new capture will override the previous one when you create a backup image or backup capture it will preserve all the previous images because it will create a file name by using the date and the time for each of the images so each image will be unique and it will not be overwritten just be careful with the space you have on drive and you should be good to go then you have option to crop the image by X and Y coordinates and also by width and height next option is to change the spec ratio of the image do you want to add bar at the bottom of the image yes or no or true or false what text you want to add to left middle or right for example front door outside temperature pulled from a sensor and then date and time you can specify font size color height bar color and also bar position which can be top or bottom for the response you will receive success if it was successful path for the image backup path original resolution final resolution and if there was an error or not and that should be it then you can use this image here or this path here to display that image inside your UI or to send that image via the notification let's go to settings Integrations add integration type in advanced click on Advanced snapshot specify the folder name for the snapshot shot folder name for the backups and the font folder click on submit and this should be it if we now go to the developer tools actions type in advanced you can use the UI instead of writing everything up as a command and do it here but of course you can also use this section inside your automations where you can once again specify everything that we talked just a couple of seconds ago select a camera name for ex example this Neo camera path if you want to specify backup location you can do it here when you copy or create template inside the UI it will automatically convert everything to the yaml so that's why we do not have capability of continuing configuration through the UI click on perform action and it's done we should now have demo camera available as an entity let's go to visual studio code we have folder snapshots and inside folder snapshots we have demo camera jpeg which if we display inside the UI will display that same cropped image then we also have backup snapshots where in the internal folder named by the today's date it's 13th of March 2025 we have another image with a timestamp for that specific image if you want to display it go to Integrations select local file and then just give it a name for example this one here sorry needed to change the path it is configuration folder then ww W because that is the folder where this snapshot folder is located inside snapshots and then this file demo camera click on submit that's it we have one entity demo camera snapshot and this is the snapshot or Advanced snapshot that we just created we have the image that has been cropped we have name demo camera we have unavailable because that sensor is not available and then we have today's date and also time and that's it this is a really awesome enhancement to the internal snapshots inside home assistant and I will be replacing all of my current automations that are using traditional internal integration with this one here and after you've addited as a local file it is available as additional camera inside home assistant you can of course also present it inside UI if we compare it we have the original image which is a camera stream in this case this is a demo camera stream and then we have this one here which is a advanced snapshot don't forget to give this repository star if you did and also if you are liking this video don't forget to give it a thumbs up it means a lot to author for Star but also receiving thumbs up or any of your comments thank you sometime ago I created video on the llm vision and at that time this component was brand new or almost brand new to hacks now this component has grown but we will not be talking about this component we were talking about front end or card that you can get for this L Vision but on the other hand yes you also need to do some additional things so for all of you just a quick recap if you want to install this component you can check out the video I did previously but it's more or less obsolete in terms of installation because the installation process is now more streamlined so what you need to do go to hex install this integration restart your home assistant go to Integrations page click on plus sign click on llm vision and there you can select llm providers but some things that were not previously available and for this component to work you need to have llm provider this is whatever llm engine you're using once again I will be using open AI since I already have account have credits there it's easier for me to play with it but if you're using local one you can also use local llm then we also need to set up events this is something that's new this is not a provider for the open AI or for the llm vision Instead This is a functionality that allows the system to store data about the already processed images so for example let's look at this one here you have a lot of people coming and going to your apartment one of the people that approached your front door was a postman carrying a package and this one was recorded 5 seconds or 5 minutes later the another person arrived then went outside etc etc this previous Postman image was lost in space with the events you are able to track all of the events that were triggered by LM Vision so for example you can have everything in the calendar set up in a way that you can see how many events were there per day and what was the specific of that specific event for example there was a postman carrying a package then later on you can also use this to search for example you could ask assist was there a person delivering package today when was the last time the postman was here when was the garbage collected was the garbage collected yesterday etc etc so what you need to do you need to go once again to Integrations click on plus sign click on llm and there select timeline as a provider this will be keeping timeline of all of the events while you are already there there is one additional functionality which is great and it's called memory but I will not be going into details if everything was set up correctly in the calendar section of your home assistant you will have a new calendar this one will be called llm Vision timeline and here you will be having all of the events recorded by the camera and the specific description for each of the events for example these are the ones that I have for today we now have set providers these are the enges that you'll be using to process the LM Vision on then we have set up timeline which allows us to keep everything in Timeline so that we know what happened and when it happened with the image and description from the llm but you also now have to enable blueprints if you haven't already done so so click on the blueprint in the documentation import the blueprint into your system open the link preview it and import you should now see something like this in the blueprints the latest version time of the recording was version 1.4.0 click on
it and based on this blueprint you can create your automations it can be single automation for each of the cameras or each of the motion sensor triggered or you can create everything in one I'll click on three dots create automation then we can customize this blueprint this is still not the new component we will install new component but this new component requires some of the things working already on the system if you want you can enable this important experimented functionality I wouldn't recommend so then if you have enabled or installed timeline click on this one to toggle it to enable it if you want to use memory remember that memory is used to enhance the functionality of llm by giving certain images or people or pets or vehicles or registration plates the ability for system to know that this is something that you want to get notified especially on so for example if your kid is leaving or approaching home if the registration plate is arriving or exiting the backyard etc etc this is the prompt I didn't touch it I'm using it as is and this is the notification devices you can here specify any or all notification devices that you want to receive notifications on so for example my iPhone and my Google pixel 7 Pro then you have option to specify if you want to have dynamic or Consolidated notifications Dynamic are great ones because they change depending on the where the system is currently at with processing of the data Consolidated are ones that you will receive with a bit of delay but they will be more accurate I am using Dynamic ones camera entities specify here all the cameras that you want to specify so for example let's use this camera here once again if your camera is changing state from idle to recording when somebody's approaching the door you need to specify it here or you can just remove it here and instead of that use any kind of motion sensors for example let's say this door sensor will be the one that will be triggered so anytime anyone opens the door this can be motion sensor presentence sensor door window sensor smoke sensor or what ever and yes as I said then it will use this motion sensor to trigger this automation if you want to have preview as a snapshot or you want to send live preview cool down period remember that you should be careful with the settings because each of the automation calls will be using your tokens so be careful not to use 1 second or 5sec delay the default one is 10 seconds if you want to have tab to navigate you can change it to for example whatever your love LA or dashboard number or path is here and it will automatically allow you to go there when you click on the image duration for the recording 5 Seconds maximum frames 3 seconds provider which is something that you need to select from the list we will go with the open AI one and the model we will be using for me GPT 40 mini then we have Target width maximum tokens and the temperature leave this temperature at 0.1 it should be good enough click on Save give it a name add description category label whatever and this should be it so finally now we can go and install what we wanted to install this video this was just a recap of everything you need to have as a prerequisite for this component to work after some events have been added to your timeline llm Vision timeline we can now add a front end component because this is the missing link and thanks to the author we now have also option to install it so topic of today's video is LM Vision timeline cards and as always if you do end up installing and using these timeline cards don't forget to say thanks to Valentine by at least clicking on the star if you already are not sponsor him or using some kind of donation page to give donation to The auor so what is the llm vision card if you are using llm Vision if you are using your either cloud or local providers to process images if you're using timeline inside llm Vision we now have card that allows us to see all the events click on them and get more data from it as it says prerequisite is llm Vision which we just installed then we have timeline which we just enabled and then also blueprint or automation to add events to the timeline click on open hacks repository click on open link and then inside home assistant click on ADD for this component to be added click on download latest version of time of the recording is version 1.4.0 download and this should be it since this is a front end component we can just press on reload and everything will be ready for us to add this inside home system go to any page where you want to add this card for example P here on the camera page click on edit to edit image and type in llm for the llm vision timeline card everything should be preset already you can specify how many events you want to see in the calendar and what is the refresh interval click on Save now inside UI we will have a list of all the activities or at least five last activities that we've seen you can click on each activity and receive more information if for example there would have been an animal car or person here we would have a description for example person walking carrying something or person running away from here or person approaching the camera or something like that but since these were false positive triggers then we only have the image with description no activity observed and this is it and the last component for today is this one here is it payday so if you are like me and you are very happy when the employer pays you something each month then this component may be good for you what it it allows you to get notification or to get warning or information where your next payday is it's a simple component it doesn't require any cloud services it works fully locally you do not need to provide any Bank details because we will configure everything inside home assistant if you do end up installing this small but really interesting integration don't forget to say author thanks by clicking the star on his repository first we will need to copy the URL since this integration is still not officially part of Hax repositories so we will need to edit as a custom repository copy the url url will be down in a video description inside home assistant click on three dots custom repositories paste the URL for the integration select integration type click on ADD close it we now need to type is it for the is it payday click on it click on download the latest version is version 3.2.0 download and we will need to restart our home assistance since this is not a front end component but instead this is the backend or integration settings repair submit and we need to restart our home assistant which is done automatically for us by the repair after restart go to devices and services add integration type in is it or is it payday click on it and let's start with the configuration we need to give it a name Payday for example this will be my instance you need to select your country why because it is calculating if the day is work day if it's a weekend or if it's a national or public holiday click on submit then you need to specify the payout frequency monthly every 28th every 14 day weekly I have monthly payments if it's last bank day First Bank day or specific day but this is where the country is also coming into play so for example in Croatia it's loaded the employer has to pay employee between the first and the latest date is 15th if the date specific date for example let's say this is the 10th for me falls on the Saturday Sunday or holiday it will be move one day after that one so I will be selecting specific date selecting here 10th that means that my next salary will be on 10th unless it is a weekend or a national holiday click on submit and this should be it finish and we have one device with two entities is it payday which it says it's off because yes today is not the 10th and when is the next payday it is 10th of April and 10th of April is not falling on the weekend or public holiday so this will be the specific dat that I specified if it would be that one it would then be moved to 11 12th or 13th what you need to do now is create automation where this would be triggered for example at 8:00 a.m. is it payday
today so that you can receive notification that today is your payday and that you will receive your salary or you can of course display this inside your UI and inside your UI you could have something like this is it today your payday and when is your next payday and that's it this is it for this hex video I really do hope that you did find something interesting be it this Advanced snapshots the llm timeline card or the information where your next payday is if you have any kind of a comment or a question you can always leave it down in a comment section below if you did like this video don't forget to give it a thumbs up because it really really means a lot and the views have been going down lately not just because I had one week off due to surgery but they just seem to be going down the hill of course if you do end up using any of these components don't forget to give it a star because the authors that way will know that people are liking and using those components and before I end up the video as always I want to say thanks to all those wonderful people that are supporting me and that have become YouTube channel members thank you all for all of your support but let's not forget each and every one of you who has watched shared liked or commented on my videos thank you if you to want to support the channel you can do so by clicking the join button down below and becoming a YouTube channel member for only two or $2 per month or you can go to my merchandise store and get something there last but not least you can also send me super thanks and I will be super thankful for that I will be seeing you next time until then bye-bye and have fun
2025-03-20 14:15
