Editor’s Note: The name of NIM Agent Blueprints was changed to NVIDIA Blueprints in October 2024. All references to the name have been updated in this blog.
Before a hospital visit for surgery, patients often have many questions about what to expect – and can be very nervous.
To help minimize pre-surgery stress, Deloitte is enhancing its Quartz Frontline AI solution, a customer service AI solution powered by NVIDIA AI, to now include AI agents to bring the next generation of digital teammates frontline to patients before they even set foot in the hospital. .
“The Frontline AI Teammate offers a new and innovative solution to help combat our healthcare human resources crisis. » — Mathieu LeBreton, digital experience manager at The Ottawa Hospital
These virtual teammates, built with NVIDIA AI Enterprise software platform, can have natural, human conversations with patients, answer a wide range of questions and provide support before pre-admission appointments at hospitals.
Working with NVIDIA, Deloitte has added Frontline AI Teammate to its Quartz platform for use in environments such as hospitals, where the digital avatar can have hands-on conversations – in multiple languages – that give the end user, such as a patient, instant answers to urgent questions. .
“Avatar-based conversational AI agents offer an incredible opportunity to reduce the productivity paradox our healthcare system faces with digitalization,” said Niraj Dalmia, Partner at Deloitte Canada. “This could be a complementary innovation that reduces administrative burden, complements our healthcare human resources to free up capacity, and helps address patient experience issues.”
Next-generation technologies serving digital humans
Digital human technology can provide realistic interactions that can improve the experience of doctors and patients.
Deloitte’s Frontline AI Teammate, built with NVIDIA AI Enterprise and Deloitte’s Conversational AI Framework, is designed to deliver human-machine experiences in healthcare settings. Developed on the NVIDIA Omniverse platform, Deloitte’s realistic avatar can answer complex, domain-specific questions that are critical to healthcare delivery.
Developers can exploit NVIDIA NIMs microservices, which streamline the development of AI-based applications and the production of AI models to create digital humans for healthcare applications.
NVIDIA plans deliver a customizable gold standard AI workflow for creating interactive AI-powered avatars ideal for telehealth – and include usage best practices NVIDIA NeMo Recoverya state-of-the-art integration, recovery and reclassification model that enables rapid responses based on up-to-date health data.
Customizable digital humans – like Jacquesan interactive demo developed by NVIDIA — can handle tasks like scheduling appointments, filling out intake forms, and answering questions about upcoming healthcare services. This can make health services more efficient while improving patient access.
In addition to NIM microservices, James’ interactive demo also uses NVIDIA ACE to provide natural, low-latency responses.
NVIDIA ACE is a suite of AI, graphics and simulation technologies to bring digital humans to life. It can integrate all aspects of a digital human into healthcare applications, from speech and translation capabilities capable of understanding various accents and languages, to realistic animations of facial and body movements.
Personalized experiences for hospitalized patients
Patients can be overwhelmed by the amount of preoperative information. Typically, they only have one preadmission appointment, often several weeks before surgery, which can leave them with lingering questions and growing concerns. The stress of a serious diagnosis may also prevent them from asking all the necessary questions during these brief interactions, leaving them without in-depth knowledge of the purpose, duration, location and necessary documents of the appointment – and which could lead to delays or even postponement of their surgical procedures.
To improve patient preparation and reduce pre-procedure anxiety, The Ottawa Hospital is using AI agents, powered by NVIDIA and Deloitte technologies, to provide more consistent, accurate and continuous access to patient care. information.
With the Frontline AI teammate, patients can enjoy the following benefits:
- 24/7 access to the digital teammate via smartphone, tablet or personal computer.
- Reliable, pre-approved answers to detailed questions, including information about anesthesia or the procedure itself.
- Post-operative consultation to resolve any questions regarding the recovery process, potentially improving treatment compliance and health outcomes.
During user acceptance testing conducted this summer, a majority of testers noted that the answers provided were clear, relevant, and met the needs of the given interaction.
“The Frontline AI Teammate offers a new and innovative solution to help combat our healthcare workforce crisis: it has the potential to reduce administrative burden, giving healthcare providers back time to deliver quality care that our population deserves and expects from the Ottawa Hospital. “, said Mathieu LeBreton, head of digital experience at The Ottawa Hospital. “The opportunity to explore these technologies is timely, given the planning for the development of the new campus, a new hospital in Ottawa. Proper identification of the issues we are trying to solve is imperative to ensure this is done responsibly and transparently.
Deloitte is working with other hospitals and healthcare organizations to deploy digital agents. A pilot project for patients at the Ottawa Hospital is expected to be operational by the end of the year.
Developers can get started by accessing the digital human NVIDIA Blueprint.