hi everyone i'm michelle turner senior director of product for google smart home ecosystem thanks for joining us today and welcome to our second smart home developer summit earlier this year at google i o we told you that our goal is to make google the best place for smart home developers like you to build innovate and grow today i'm excited to show you more about all the new ways we're going to help you do that together with partners and developers like you we're transforming the smart home industry to meet the changing needs of users and developers in this new era we're also improving the tools and opportunities that you'll have to build your best experiences with google to help you plan your smart home roadmap we'll be giving you a look ahead at our own in today's keynotes and in sessions throughout the summit you'll learn about how we're expanding our platform and tools to make it easier for you to learn and build devices that do more with google our insights on what users and developers expect from the smart home today our new developer center and new suite of tools to help you build your devices applications and integrations how google is supporting matter and thread across our entire ecosystem including nest and android new automation capabilities including the ability to build suggested routines for your users and finally how will help you differentiate with google connect to more users and help users engage more with your brand and devices we're doing all of this to enable you to build your best experiences with google so that together we can lead a transformation in the smart home one that may feel very familiar it's familiar because in many ways it's similar to the transformation the internet underwent a few decades ago from an early adopter technology to a must-have for every device from one device per house to multiple wirelessly connected devices per home shared by the whole family from proprietary ecosystems to open standards that accelerate competition and innovation in this transition we went from basic ways of interacting with information to limitless possibilities changing forever the way we live and work google helped make all of that possible by aiding users and discovering and connecting to innovations built by a huge community of developers empowering their businesses to grow and with our own innovations that pulled together information from across the open web to make it more accessible and useful to everyone today as the smart home undergoes the same type of transformation google is connecting users to your devices and experiences everywhere and we're increasing helpfulness and engagement in ways that drive new value for you and your users by using automation context and intelligence to make your devices even more helpful and making the smart home so much more than the sum of its parts for google our journey as an ecosystem started five years ago with the google home speaker and the google assistant now that's grown into a powerful platform with new speakers and displays android nest and the google home app and of course an ecosystem of tens of thousands of devices made by partners and developers like you enabling google users to engage with over 200 million devices on our platform the breadth of this ecosystem weaves into the fabric of users homes and lives making google's smart home platform more useful accessible and intelligent today we're bringing all of this together and announcing a new but familiar name for our entire smart home platform and developer program that helps users and developers do more with google google home this doesn't change the nest branding or any other google smart home branding that you're familiar with but bringing our platform and tools together under the same roof gives us a simpler way to talk about why and how integrating your devices with google home makes them more accessible and helpful across the google ecosystem starting today google home will represent all of the capabilities that our ecosystem delivers to meet the needs and expectations of our developers and users users have never been more comfortable bringing home new smart home devices but google and our partners know that users continue to expect more from us they want a truly smart home one that's easy to set up and use on day one and on day 100 that delivers whole home seamless experiences across to all devices and that is helpful proactive and context driven to deliver on this we need to make sure our platform works for you too we've listened to smart home partners and developers of all kinds and we know the things that you care most about building devices and applications quickly and efficiently so you can focus your resources on innovating and creating differentiated experiences we know that being part of an ecosystem should be complementary to your business not competitive and of course you need tools to grow your business by helping users discover your products and capabilities and increasing engagement to meet all of these goals we're developing a robust set of tools and programs to enable you to build experiences that meet your business and users needs let's start with the new google home developer center launching early next year the new developer center will have everything you need to learn and build smart home devices applications and automations with google it's a total redesign of our developer site and console focused on major upgrades to navigation and new self-serve tools for both developers and their business teams the developer center will have tools for each step of development deployment and analytics including building matter devices customizing setup of your devices in android and the google home app creating automations and routines building android apps with matter testing and certification and new tools for analytics and performance monitoring check out alex sellig's session the google home developer center preview coming up later today for more details on the developer center and visit developers.google.com home to start learning today one of the most important new capabilities we're bringing to our developers is the ability to quickly build and integrate matter devices as you know google and other leading and innovative companies from across the industry have come together to develop matter the new universal open smart home application protocol that makes it easy to build buy and set up smart home devices with any matter ecosystem or app we're adding matter as a powerful new way to connect your devices to google home and android apps to make sure google users are ready for your matter devices google will be updating all capable nest and android devices with matter starting when the standard is formally launched that means when you build devices with matter they can be easily set up and controlled by millions of users everywhere that they interact with google including nest speakers and displays the google assistant and of course android devices to make sure you're ready to build your best matter-enabled experiences with google we're adding support for matter in the google home developer center and announcing new tools for matter development across google home and android including two new sdks the first is the google home device sdk the fastest way to develop matter devices enabling seamless setup control and interoperability the matter specification and sdk to which google is a major contributor ensures that everyone is starting from the same code base but building differentiated quality experiences goes beyond sharing the same connectivity protocol the google home device sdk provides a unified experience to build matter devices that work seamlessly with google including configuring your device with the assistant improving quality with logging and homegraph analytics in the popular vs code editor this helps you build a more responsive reliable experience for users and to make your development easier we're also delivering the google home ide many of you have an existing workflow and we want to make sure it's easy to develop banner devices and connect them to google in a familiar way so for developers using visual studio code to develop smart home devices you can easily leverage our tools in that environment by installing the new google home ide melissa ho will be doing a detailed introduction to the google home ide and her session on developer tools for matter check it out mobile devices are of course an important smart home tool for users and are critical to how users set up manage and control their devices in their home to make application experiences more seamless and help your users experience the magic of your device as quickly as possible we're building matter directly into android and announcing support for matter through google play services one of the key benefits this enables is seamless matter device setup flows in android letting users connect new matter devices over wi-fi and thread as easily as a new pair of headphones and you'll be able to customize that setup flow with branding and device descriptions with just a few taps users will be able to link your devices to your app the google home app and other matter apps that they've installed of course when users connect your device to google it automatically shows up in the app on android controls for smart home devices and will be controllable with the assistant on android without additional development this is great news for you as we've seen a significant lift in usage from devices that are accessible through the android controls we're also creating new tools to help you build and update your apps with matter support using the new google home mobile sdk building a matter native app on android lets users link their smart home devices to your app during the setup process or later in their journey with just a few easy taps no need for account linking you can learn more about mobile development for matter in james romo's session later today one of the most compelling things about matter particularly for device makers is how quickly it's being adopted with commitment from major ecosystems participation from hundreds of device makers and dozens who are already building devices we're well underway building matter integrations with many of the leaders in the smart home industry and helping their matter devices do more with google with many more to follow we'd really like to thank all these partners working with us in the matter work group and our eap program for their leadership and vision it's making our developer program and the smart home overall better for everyone and to help everyone build matter devices we're working with leading silicon vendors to provide silicon support and development tools ready for integration with google all of these silicon vendors can help you get started with matter today whether via matter or existing integration pass being able to easily and reliably connect your devices to google helps users build their smart homes but users expect a smart home to be more than the sum of its parts context-driven intelligence and automation is the multiplier and core to google's unique strengths making homes more proactively helpful is the north star of our vision for the smart home for developers automations allow users to do more with your devices we want to help you easily combine them with other devices into coordinated routines and to use context and triggers to increase their usefulness and engagement with the help of google's intelligence we started that journey with automations that transform devices turning light bulbs into wellness tools with gentle sleep wake appliances into energy and money savers with home and way routines and smart notifications that proactively notify users when they need to take action but you know your devices and how your users engage with them best so in our new developer center will enable you to create your own suggested routines that users can easily discover directly in the google home app your routines can carry your brand suggest new ways to engage with your devices and enhance them by coordinating them with other devices and context signals in the home we'll have a preview of that in the google home developer center session and a workshop early next year to help you get started building suggested routines this is just the start of new ways we're enabling your devices and brands to do more with google home we know that for device makers compatibility with google home is an important way to engage your users but you want to make sure that your brand products and innovations are front and center with your users to help them get the most from the experiences that you've built that's why all of the new tools that we're building help you go beyond just compatibility with google home and empower you to build your best most engaging experiences with google customizable setup flows built into android and google home that let your users experience the magic of your device with just a few taps right out of the box native matter apps on android your users can discover and connect to in one streamlined setup flow suggested routines to help your users do more with your devices new ways for users to discover and use your device's capabilities within the google home app and the new google home developer center that brings developer and marketing tools together in one place to help you and your team quickly bring all of this to market of course when you've built those great experiences you want to tell everyone about them for users that haven't discovered your devices yet we're leveraging the power of google to help users learn about your devices and bring them home earlier this year we launched our new smart home directory on web and mobile this new site gives consumers an easy to use and understand resource for discovering smart devices compatible with google and the experiences that they can create with them whether with a single device or using multiple devices together with automations and routines since launch user engagement has been significant with existing google home users coming to the directory straight from the google home app wanting to learn about how to grow their smart home and new users beginning their smart home journey in the education section visitors can learn about your smart home products by use case or category and then continue that journey through google shopping where they can read reviews and ratings and buy your products at their favorite retailers we're continuing to expand the site with more use cases addressing the needs of both beginners and more sophisticated users looking to grow their smart homes and get more out of them and we're creating more opportunities for visitors to learn about and visit the directory through the google home app search shopping and other marketing channels we'll also be making it easier for you to get your devices into the directory we'll have more to share on this with you soon we're excited to get into more detail on all of these new tools and answer your questions throughout the rest of the summit in the meantime nothing changes for our current smart home developer program you can and should continue to build with the tools that you're using today and your integrations with the smart home api local home sdk and seamless setup will continue to work long into the future together with you our developers and partners we've built a helpful ecosystem over the past five years with integrations covering nearly every category and device we're now embarking on a new era in smart home built on the open standards that we're developing together the innovation and ingenuity you bring to your devices applications and services and the breadth and context-driven intelligence of google as always we really want to hear from you so please send us your questions on the live chat during our sessions engage with the community using the google home summit hashtag and reach out to our support channels at google smart home dash support and check out developers.google.com home to learn how you can build innovate and grow with google thank you hello everyone and welcome to the google home summit i'm marco cavalli a product manager on the google nest team and i'm here with gina a technical solution engineer to talk about the tools and solutions that google provides to make your job as developers easier as you have heard from michelle in the welcome keynote there's a lot of excitement in the smart home industry the market is growing fast with new devices and new test solutions becoming available to make the home more intelligent and useful user expectations are also growing and the smartum is no longer seen as a collection of individual devices that tackle point use cases but rather an integrated and cohesive solution that provides a rich and seamless experience for the entire home today we want to talk about how we enable you to quickly build high quality unique and differentiated experiences for your users with google home taking advantage of the technology and the ecosystem that google provides and we want to tell you how we are making that easier for you by providing tooling and solutions that make integrating with google home fast easy and reliable google provides a rich ecosystem that helps you build experiences that deliver on the promise of a seamless and integrated home at the foundation we rely on core communication technologies that power the smart home and we'll discuss those in a moment by integrating with google home over simple apis you enable interactivity across nest devices android google assistant and the google home app home and away and schedule actions provide users with intelligent actions based on presence and the flexibility to schedule routines making the home more helpful and proactive and finally the google home ecosystem is more than just technologies and devices you our partners are the forefront of the smart home revolution and by working together we can enable that end-to-end experiences that really bring the smart home together as developers technology is what you rely on to build your devices and applications at google we continue to invest in and push forward key technologies that enable new use cases that are reliable and easy to use we all want a smart home that just works but we know we are not quite there yet as users we want the flexibility to purchase devices without the headache of figuring out whether they will work with what we already have at home and once purchased we want to set them up quickly and want them to work seamlessly with the rest of our home as developers we strive for simplicity and want to focus on innovation and differentiation knowing that the foundational technology is taken care of this is what mater is about mata is a new application layer connectivity protocol that intends to improve communication across smart home devices reducing the fragmentation at this load adoption and finally enabling that interoperability and choice users are asking for by aligning on a standard application layer protocol mater alleviates burden and complexity for you and your users thanks to matter users will be able to choose devices based on their unique capabilities and the type of home experience they want to create without having to worry about whether they will work with their ecosystem they will have the flexibility to use them across multiple ecosystems if they wish to and they will benefit from the improved quality and reliability offered by local control device makers and developers can rely on a broadly adopted protocol rather than having to support multiple technologies to reach their customers this will help reduce cost and accelerate innovation there is major industry momentum and enthusiasm behind matter over 200 companies from silicon vendors to device makers across many device categories have been hard at work for two years pushing over 4 000 commits to the open source gita repository to make mater a reality we have been working with early access partners across the industry to ensure we are ready to update your google devices with matter next year when the protocol formally launches we are committed to matter to support more delightful setup and interaction journeys that means that your matter devices will have compatibility with millions of households enabling users to control them with nest devices the google home app android and google assistant these experiences start with you the developer we are excited to share the new tools we have built to support matter as well as our existing apis let's dive deeper into how we are making it easier for you to create innovative experiences quickly and at high quality with google home building smart home solutions and integrated with multiple ecosystems is complex and time consuming your users expect flexibility performance reliability the market is moving fast so how are we helping you succeed in such a challenging environment whether you're building devices or creating applications and experiences for the smart home we want to make it easy and fast for you to innovate with google home what that means in practice is making it easy to find all the resources you need in one place rather than having to navigate multiple sites providing comprehensive documentation use cases sample applications device templates a new web console to integrate with google home new matter apis like the one in google play services on android they make setting up devices fast and easy and tools to help you not only build but test and collect metrics on how your devices and solutions are performing we looked at the entire development journey and are building solutions to help you get started build test certify deploy and analyze your device's performance with google home quickly and reliably the brand new google home development center is the core of the developer experience and is your entry point to find all the resources you need to start building and integrate with google home to accelerate your development with google we are providing sdks for embedded and mobile development on top of the open source matter reference sdk for embedded developers we have visual studio code extensions that complement your workflow to integrate and test with our smart home actions for android developers apis available through google home play services will make it easy to onboard mater devices into your applications with just a few lines of code for developers integrating over our existing apis today and for matter developers in the future we'll provide easy access to logging and monitoring that will enable you to test your devices and integrations ensuring they meet high quality your users expect let's dive into a bit more detail into each area we have heard your feedback that learning about how to integrate with google needs to be more intuitive for you and your colleagues we are building the new google home developer center from the ground up with the development and go to market journey in mind with the goal to make each step clear easy and as fast as possible the google home developer center is structured in two main parts the website where you can learn about tools and integration paths and find case studies to understand how the technology can help you you will find the key information needed for your developers marketers and business colleagues the developer console where you can build and test and launch your integrations in a guided flow with rich documentation throughout and we are making the journey self-serve with an interface that guides you through the flow step by step removing ambiguity so you don't need to waste time guessing but rather focus on doing and building fast and predictably for the first time the console is going to enable you to build test and launch routines letting your users discover more ways to use your devices right from the google home app we will share more details of our routine schema and tools for creating suggested routines next year when we will be hosting dedicated workshops if you want to learn more about the google home developer center alex will provide a deep dive in the session shown here and now i'll end it over to gina who will take you through a journey of all the tools we are building to make your life easier and more productive thank you marco for sharing a preview of the developer center in addition to the developer center we are delivering google home device sdk to invited developers to accelerate their matter development with google home the sdk complements open source reference implementation of matter in github we are currently working with early ss partners to get feedback and make sure it's amazing before sharing it out with all of you please reach out to your google representative or silicon vendor partner if you are interested in helping us by participating in our early ss program once you join the eap you will be started by setting up hardware including googleness hubmax development board and the google home app you will build and flash embedded code to the development board and paired it to the google home ecosystem using the google home app once paired you can control your development board with google via the google assistant google home app and more the device sdk currently supports a number of device types including color lights on-off lights locks with initial support of bridges and we are always adding more device types as the device sdk evolves i encourage all of you to join don darling's workshop to see how we are incorporating matter into the google home ecosystem by building the google home device sdk so you can begin planning your future integration in this workshop don will show you step by step details of how you start matter development at google we want to empower developers with amazing tools so you can build great meta products as part of the google home device sdk we are building extensions and developer tools for the most commonly used ides such as visual studio code so integrating matter devices with google fit seamlessly into your existing workflow we are excited to launch our early preview release of google home ide you can download google home ide at go.goe google.home.ide and start using it today google home ide a visual studio code extension is designed and created for the embedded developers and it provides you easy access to our existing developer tools within this popular editor as well as adding many more developer tools we know that many of you are already using visual studio code if you are you can just add the google home ide alongside the other extensions you enjoy if you haven't tried video studio code or are not an active user we recommend you to try it out the google home ide since it makes it easier to test and debug your google home integration all the features that we have built not only works for matter projects but also exists in google home cloud integrations and local home sdk in the google home ide you can log into your developer account selecting your projects which enables you to directly access many of the google services as a assistant developer counseling talking to my devices at my desk can get tedious not to mention bothering my family and co-workers we are enabling you to hand type commands directly in the google home ide that you would normally speak to the google assistant you can do things like turn on the light or separate needs to 30 percent or even change the color we are working on an exciting feature that enables you script-batched commands and even executes testing assertions directly in this extension as an embedded developer very challenging to get logs from your iot devices in the google home ecosystem we use google cloud logging formerly known as stackdriver to make it easier for you to get access to the valuable debugging information and analytics during development cloud logging gives you access to the additional detailed debugging information in production cloud logging can help aggregate key metrics and even gives you insights on the entire fleet directly in the google home ide you will see real-time google cloud login messages from your iot devices right next to your embedded code during troubleshooting you can click on any of the logs to see the full payloads and filter the logs from the ui we are planning many more features in the google home ide and look forward to sharing them with you soon check out melissa hall's talk where she goes through all the features that we have already built in the google home ide and our roadmap besides the google home device sdk we are working on an intuitive and easy to integrate google home mobile sdk for application developers to simplify implementation in your android apps for a better device commissioning and sharing with the matter apis in google play services you can easily extend your app with matter support and it also gives a consistent standardized device data flow and sharing experience you can use the google play services to handle meta device data flows which shows a qr code scanner to complete proof of position and it also has a fallback for setup code where users can manually input any code on the meta devices where boxes once scanned the user will be prompt to connect the device to the user's google account and services will connect the device to the user's network after the device successfully connects the user will be prompt to select the device name and optionally the location in their home when setup is completed we will redirect the user back to your android app so you can update your ui with the new device to make data feel more seamless you will be able to customize the setup flow with branding and descriptions additionally the matter apis in google play services provide a device sharing flow that you can easily integrate to your android app by calling the mirror api the overlay will be displayed with a number of sharing options and the meta service will bundle the device information together and send them to your app if it's the one a user wants to add devices to to get further details please check out james romo's talk about the mobile development for matter gem's role model will give you a preview of the matter apis in google play services and how to use them to simplify your implementation in your android app once development and testing are completed your development journey will be going to the next phase certification which helps you to validate your integration in a thorough manner before your product launch test suite is a web tool that allows you to self-test your implementation and it generates an automated test plan for your devices and executes against your google home integration with the new version of test suite you can login to your google account and you don't have to import a service account key anymore more importantly we want your users to be able to control their devices via the google assistant and google home app in order to achieve this we highly recommend you to implement report state which proactively reports the lattice status of the user's device back to the google home ecosystem once you have report stay ready in your projects you can simply run the test suite again to make sure your query states match defined states reported to google via report state we highly recommend you to round test suite not just right before certification but periodically through your entire development journey especially when you are releasing non-trivial changes to production it will help you to catch potential errors and issues ahead after launch to ensure your devices are running smoothly and correctly it's essential to gather logs in the field aggregate them into metrics and monitor the metrics over time and smart home analytics serve this purpose smart home analytics is a set of tools available on google cloud platform which has cloud logging together logs from your user's devices and cloud monitoring to aggregate and monitor key metrics each time when your users control their devices with google we send the request to your matter device you execute the request on your device and give us back the result if the request fails an error is reported in the smart home analytics and we will increment the metrics and also record an error log in your project we also provide you an error breakdown dashboard to monitor projects so that you can easily find the top errors over the time and then search the error code in cloud logging to get detailed descriptions join itunes workshop google home debugging tools you will learn how to use smart home analytics and test suite to monitor your project reliability and improve the integration quality while we are bringing more functionality and support to the google home ecosystem for users we also want to provide developer tools and resources that can make your life easier for developers who are currently doing cloud integrations with us today over our smart home api we are excited to share plenty of resources and tools with you for learning testing launching and analyzing while all works with program let you connect your devices to the google home ecosystem our device access program enables you to control google nest devices from your application via the smart device management api in this collab you will take a deep dive into how device access works by building a web application handling authentication and making smart device management api calls we are excited to give you a preview of the google home playground which enables developers to create a virtual home and devices with a user-friendly web ui in a few minutes google home playground is a great learning resource with the virtual devices you created just with a few clicks you can try it out and learn the functionalities with google home ecosystem and also google system behavior before writing any code it is also a great debugging tool that you can use as a cross reference with your implementation and compare the behaviors and responses by simply importing your sync responses google home playground shows the log of each api call on home graph which is essentially a logical map of your home so you can easily copy them from the ui and see the differences from your implementations for debugging with webrtc you can add real-time communication capabilities to your app that works on top of as open standard it allows you to build powerful voice and video communication solutions we would encourage any of our camera partners to look into switching over to webrtc and making sure that your integration is up to date we also want to make your webrtc testing and debugging easier so we are providing a webrtc validator tool which allows you to test your implementation quickly in your web browser this will enable you to find and debug issues quickly and easily in addition to the device access collab google home playground and webrtc validator tool that we just covered we have more tools for you in john fike's talk google home tools and updates will share more details about these tools and we highly recommend you to join and learn how to use these tools to simplify your development training with google we are launching a number of developer tools to help you through your entire development journey with a number of them available for you to download and start using today google home ide a visual studio code extension to help embedded developers to easily test and debug your actions with detailed google home playground enabling developers to create virtual home and devices with a user-friendly web ui in a few minutes so you can quickly try and learn the expected behaviors without writing any code webrtc validator tool which allows you to test your implementation quickly in your web browser and you can find and debug issues easy last but not least test suite with more support to validate your query states match device states that you reported to google via report state we encourage all of you to check out more details at the links on the screen and start using them today we are also giving an early preview of better support with the new apis and tools please reach out to your google representative if you are interested in getting further details and providing feedback to help us in our early access program as always we really want to hear from you so please send us your questions on the live chat during our session engage with the community using the google home summit hashtag and reach out to our support channels at go.goe
slash google.home.support check out developers.google.com home to learn how you can build innovate and grow with google [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] so [Music] [Music] [Music] [Music] hello i'm excited to share a preview of the google home developer center i'm alex salig the pm lead driving this effort you asked and we listened over the past few years you've been giving us the feedback that the google smart home development experience has room to improve you've asked for an easier more streamlined and more predictable experience you want the documentation and tools where you need it when you need it as a result we're overhauling our developer tools and documentation from the ground up starting with matter and routines i'm proud to share that we're building one place for all of google's smart home offerings the google home developer center is focused on making the development process clear and self-serve we've got two main parts to the developer center our website where you can learn about our tools integration paths and understand the what and why you'll find key information needed for your developers marketers and business colleagues to collaborate our developer console which is the second half of the equation is where you can build test and launch your integrations with rich documentation throughout we're making sure each step of development is supported with rich tools to make development easy self-serve and fast as you can see here in our console navigation we're breaking out each step with supporting space with related tools and documentation the developer center will be the best place for you to build test and launch your matter integrations we're giving you the tools to make sure your brand stands out during matter setup just enter the product info on the console and voila you're good to go for the first time the console is going to enable you to build test and launch routines letting your users discover more ways to use your devices right from the google home app starting in spring of next year we're going to host workshops to share the details of our routine schema and the tools for creating suggested routines we can't be more excited to give our developers the power to create whole home experiences with google smart home ecosystem and automation we also hear the feedback that our requirements for certification and badging need to be clear for both developers and marketers we'll be publishing this information on the site for easy reference with technical and marketing resources and checklists for everyone on your team starting next year the google home developer console will be the best way to build matter devices and connect them to google i'm excited to share a preview of the new console in the demo i'll be building my first routine and field trialing it with my co-worker zheng yin we'll get started at the beginning i'm going to add to an existing project in this case it's my august 31st demo project once i hit create i'm going to see an overview of all the various integrations i can add to my project now i'm going to click on project details in the details view i can see all of the various aspects of my project including manage members which can be done using the google cloud platform i'm going to head back now to the overview to create a routine when i click add i'll be taken to a routine schema entry box and this is where i can paste in my new schema and validate it once i do so i'll notice that i've actually had a validation error it says edit data instead of metadata i'll quickly make this fix and validate again and once it's validated i'll click save and i'm done once i'm done i'll actually see an overview of my existing routines that i'm building my next task is actually to start a field trial so i'm actually going to go to the field trial section in my navigation and i'm going to go select my routine that i just created so i'm going to select it hit start and then i'm going to enter in the email addresses of the two individuals that i want to start a field trial with in this case it's me and my co-worker zenyen once i enter those two emails and i click start i'm good to go it's that easy and you can see right here that fuel trial is now started that concludes our demo and there's so much more to come keep an eye out for updates to the google home developer center in the first half of next year thanks again for watching and that's all we've got for now for the developer center preview at google our goal is to provide intuitive easy to integrate sdk for the matter google play services module for device commissioning and sharing we aim to not only simplify development but also to provide a consistent standardized device setup flow and user experience hi my name is james remo on the google nest partner engineering team and in this talk i'm going to discuss mobile development formatter mobile devices are a central interaction point with smart home devices where users can set up and control devices with their favorite apps we want to make mobile development fast and easy with matter on android and are previewing our matter apis in google play services today fabric is a shared domain of trust among devices in the home network that enables them to communicate with each other devices may have one or more fabrics that correspond to a platform app or group of devices interacting together this shared domain of trust is established via common set of cryptographic keys first i will discuss how to commission devices let's take a look at the setup flow for a new matter device in your android app the initial step is for your app to initiate the add new device flow which will redirect to the google play services commissioning flow and starts by prompting the user to scan the device qr code or a setup code if you already have this information it can be supplied as part of the commissioning request data in which case this step will be skipped once scanned the user will be prompted to connect the device to the user's google account google play services will connect the device to wi-fi ethernet and or thread networks as applicable after the device successfully connects the user will be prompted to select the device name and optionally location in their home once the fields are submitted the user will be redirected from the google play services provided ui back to your app let's take a look at the full commissioning flow we just walked through which encompasses the broadcasting of the device through the user setting the device name and room as you can see there are numerous interactions between your app google play services and the matter device in this next section i'll walk through the flow with each step identified with a box in the preview flows shown above the initial step involves commissioning the device using the commissioning client which can be obtained from the matter entry point this can be retrieved either using a context or activity if the device being searched for is known it can be specified via the device info in the commission request and it will be set up during the commissioning process alternatively if you already have proof of possession of the device such as a manually entered passcode or qr code you can provide this in the commissioning request to target a specific device and bypass the need to obtain this information from the user during commissioning to commission your own fabric you must provide an exported implementation of abstract commissioning service which will be notified when the device is ready to have your operational certificates installed on the device the next steps involve establishing proof of possession using a qr code or a manually entered code commissioning the device into google fabric and connecting to the operational network these steps are color coded and match up to the preview flows shown above everything will be provided out of the box by the play services flow with no need for your app to do anything after connecting to the network you'll be able to commission your device into your fabric the on commission request method in your implementation of the abstract commissioning service will be invoked and the manually pairing code will be provided to you so that you can commission the device with your own fabric credentials after you've completed your desired commissioning steps and have issued a commissioning complete command to your commission device you must call send commissioning complete to indicate success alternatively if something went wrong during a process you can call send commissioning failure to indicate the cause in this send commissioning complete response you can also supply a list of room names and a suggestion name for the device both are optional and will be presented to your user to choose from or modify the chosen name will be written to the basic information cluster as the user label and the selected name and room if any will be returned to the commissioning result finally the last step involves redirecting back to your app with the commissioning result containing the user selected room and device name this commissioning result can be obtained from the intent sender result via the commissioning result.from intent next i will discuss operational discovery operational discovery is an api which allows an application to register to be notified of any commissioned matter devices that are discovered on the network via mdns an example could be notifying when users reconnect to wi-fi networks on their phones so ui can be refreshed using the discovery client interface you're able to request or remove device update listeners which contain callback methods that are notified about operational device updates request operational device updates allows your app to request to receive updates in the initial state for operational matter devices in your request you can specify a particular set of service instance names so you can limit the number of updates your app receives the listener will be notified of the initial state and any changes to nearby operational devices as they are discovered or changed after you're finished you can remove a previously registered listener using remove operational device updates i will discuss my device sharing for android apps sharing device involves opening a temporary commissioning flow on the device and either picking the app you want to use or using a provided passcode that can be used to open a connection to the device the process is displayed in the preview flows as shown here it starts in your app followed by this sharing screen which should look familiar if you've used the android sharing screen this will allow users to select from any other matter commissioning app on the phone which registers an intent filter for commissioning alternatively the user will be able to share the manual pairing pass code via plain text or qr code if desired the following diagram steps through this process with the preview flows at the top showing the current place in the flow the current admin in this case is the administrator of the fabric using the shared device function of commission client you are able to share a matter device which you administer for use within another matter fabric or ecosystem you must first open a commissioning window on the device and provide the details including the manual pairing code and window duration in your shared device request this request will succeed if the user chooses a sharing destination if the user cancels or the commissioning window times out at the specified duration without choosing a destination you'll receive a result canceled status and should revoke the commissioning window to register as a commissioner use the following intent filter in your app then when a sharing action is initiated by the user your app will be included in the list unless it is an app initiating the sharing quest the final step involves sending intent with action commission device to chosen commissioner containing a set of intent extras detailing the device that was shared the following diagram and table show all the keys that can be provided via the action commission device when commissioning a device as a commissioner receiving such an intent you can use this information to construct a new commissioning request and use this with the commission device api and with that we have the whole picture for sharing matter devices on android as shown in the full diagram complete with all the steps we discussed and that concludes the mobile development format presentation thanks for joining us and be sure to stay up to date on the latest releases to incorporate play services into your app hello my name is melissa and i'm a technical solution engineer at google next helping developers on smart home integration with google we are excited about how matter simplifies smart home device integration for developers we also want to give you a better experience when integrating your meta devices into the google ecosystem so today i'm here to talk about google developer tools for matter and introduce our new google home ide that streamlines the development processes and workflows in one place let's get started as a developer when integrating your smart home device with matter and google home ecosystem you will start with a developer board and a google next hub your right code in visual studio code were any other editors or command line tools then you build your program and flash onto the developer board next to make your matter devices work with google ecosystem you will be visiting the google's actions console to register configure and deploy a smart home action also analytics are available for developers in actions console after publishing your action during development and testing google cloud logging formerly known as stackdriver gives you capability to see real-time logs from devices with details of your responses to sync query execute requests and notifications so you can view and verify the payload sent from your projects after you successfully set up your devices to google ecosystem device state can be filled in home graph viewer including device type on off state brightness if it is a light and whether the device is currently online or not these are values that your project provided to google in report state last but not least test suite for smart home it's a web application that allows you to self-test your actions before certification it automatically generates and runs test cases based on the devices and trace associated with your account when you complete these tests the results are available in the tool and you can submit them for certification these developer tools are essential and really make developers lives easier on debugging and testing however they are scattered and all created as stand-alone web applications so we want to bring all of them together and streamline your development processes and workflows in one place we are excited to show you a preview of our work on google home ide that brings developer tools together for matter with google ecosystem google home ide is a visual studio code extension to provide you easy access to all developer tools that we just went through and the resources for matter like documentation and samples for developers who are using visual studio code to write code and flash build to your developer boards you can easily leverage our tools by installing google home ide after installing google home ide in visual studio code you can login to your developer account and also import your service account keys with log access from here you will be able to use our assistant simulator to hand type alternatives for testing your device for example turn on my light or set brightness to 30 so you don't have to talk to the device repeatedly during testing and you can even resend the utterance just with one click besides google home ide integrates with google cloud login to show real-time data from your devices so you can fill them in visual studio code for debugging and testing you can click on any of the logs to see the full payloads and filter the logs from the ui it also supports real-time logging which makes testing even easier since you can just send an audience with a system simulator and see cloud logging in one place now let me walk through with you and take a closer look at the features we are developing for the google home ide first thing you need to do is to sign in with your google account that connects with your meta devices after installing the google home ide in your visual studio code you will see a matter icon shown on the activity bar click on the icon to open the sidebar of the ide click on the sign in with google button it takes you to your browser and opens the google sign-in page choose the account that you want to sign into then it displays a consent window that shows the required access for the google home ide make sure you have checked all the check boxes and click continue you will see a code displayed on the page please copy the code and then let's go back to visual studio code to paste it and click enter now you have successfully signed in with your google account make sure that the email address is the one you want to test the integration with your meta devices google home ide uses surface accounts to get access to cloud features of your smart home projects such as viewing your cloud logs so you need to configure which projects you want to access from the ide with their service accounts to create a service account please go to the service accounts page in google cloud console make sure that you are on the right project and click the button to create a service account when creating the service account make sure you grant this surface account the role as logs viewer so that our ide can re-cloud logs of your project after you have created the service account select manage keys from the actions menu to create a new key it then downloads a service account key file that will be used in the ide go back to visual studio code in project configuration select the path where you store your key file once you have configured your key you can open the cloud login window to see the logs from your project if you have multiple projects you want to access from the ide you can add multiple service account keys that associate with those projects once your meta device has been successfully connected and appears in your google home app then it's time to test control of your device with google assistant apart from sending voice commands through your google home app or smart displays you can directly test control with the google assistant simulator in the google home ide click to open the simulator from the sidebar and type in the authors that you want to ask the google assistant for example turn on the light and then you will see the response from google assistant you should also check whether your device has successfully turned down try typing more authors such as is my line on and then turn off the light to see if your device responds correctly if you want to repeat some audiences just simply click on the recent button to save your time meanwhile we also recommended that you should open the cloud login window at the same time when you send your addresses to google assistant so that you can investigate event logs in real time that correspond to those audiences google cloud login formerly known as stackdriver gives you capability to see event logs for your smart home actions including sync execute and notification more importantly arrows are all reported with details in google cloud logging so this is essential for developers and now it is integrated into the ide so you can see logs in visual studio code open the command palette and select google home ide view cloud logs a window will be open to fetch cloud logging generated in the last few minutes you can click any of them to fill the full message and copy it with one click also filters are provided at top to filter logs messages by loggername and severity you can also search the log by typing keywords at the top right corner a button is also provided to refresh logs generated in the last 10 minutes another cool feature is real-time mode developers can enable real-time logging with the taco at the top right corner and it will refresh the logs first and then update the view whenever there are new messages coming in it will also be enabled automatically when you send an authors in assistance simulator so you will see cloud logs triggered by the command and export them in visual studio code and it will be automatically disabled after 10 minutes and you can always enable it whenever you want we are launching the google home ide today with all the great features that are covered in the talk including assistance simulator and cloud logging also we look forward to adding more features to streamline developer processes and workflows further improvements such as downloading a service account key from your google cloud project for accessing cloud logging will not be required one of the features we are working on is the batch authors support on top of assistance simulator with this feature developers can save a sequence of audiences that you can easily run in one click and even use it with your automated testing besides we want to integrate more developer tools into the ide for example home graph viewer which shows you your device state including device type under state and whether the device is currently online or offline also the test suite for smart home is another tool that we plan to integrate into the ide soon with the test suite you will be able to self-test your actions before certification the tasks are generated based on the devices and trades associated with your account and when it's completed developers can submit test results for certification from the ide and actions console that enables you to configure required fields of your smart home actions in the google home ide we encourage everyone to download the google home ide and try it out today check out the link here you can find the latest update and the instructions to show you where to download the ide how to install and the setup to get started i hope you enjoyed the development journey for matter with google thanks for watching hello and welcome to our introduction to matter development with google my name is don and i'm a technical solutions engineer at google nest focusing on iot today i'll be walking you through matter development on a silicon labs mg12 development board and pairing it into google home once that's done your motor device can be controlled in all the ways you've come to expect on your phone a google nest hub max and of course using your voice with the google assistant this session is a preview of the development experience with the google early access program for matter or eap we're still working out some details before we launch it publicly to make sure it's truly amazing before sharing it with all of you with that said i'll be diving into the following areas today initial onboarding into the google early access program for matter hardware setup for your development board google nest hub max and your android phone getting your development environment set setup building and flashing an existing lighting sample application for your mg12 development board adding development devices into google home different ways you can control your device current google platform features for matter and then we'll wrap up with some final thoughts when you join the google early access program your team will receive an email from your technical account manager that looks similar to this it guides you through the initial steps of enabling eap access for your team's email accounts onboarding your google nest hub max and android phone and finally it directs you to our eap website to get you started on actual device development when you click on this link it'll take you to the landing page for the google developer program on this page you'll find a brief description of matter a link to the public matter repository and finally at the bottom there is a getting started with matter button which takes you to the nuts and bolts of google ecosystem integration here you'll find the instructions for developing matter devices and pairing them into google home this document walks you through everything you'll be seeing in this presentation today i want to highlight that there is a link in this document to our trusted tester agreement team members must accept this in order to get the beta version of the google home app on their phone which will be needed for matter development to get started you'll need to set up your development board the google nest hub max and your android phone we'll start with the mg12 development board at this initial stage there isn't a lot to do except to seat the mg12 module into your wireless starter kit main board if it hasn't been already and then plug the board into your workstation using a mini usb cable that's all you need to do until we build and flash firmware on it next we'll set up your google nest hub max before you plug in your google nest hub max for the first time send the serial number to google and wait for a response confirming that you're ready to go this is necessary to ensure the device downloads the correct firmware build for matter development the serial number can be found either on the box or on the bottom of the unit next up is your phone in this presentation i'm using a pixel 4a running android 11. any android phone running android o or newer with google play services will work ios isn't supported yet but it will be added later on so ensure you've accepted the trusted tester agreement i mentioned before and then install or update the google home app on my phone the google home app came installed by default so i'm going to go look for an update so i'm going to jump into the google play store
2021-10-25