Conversational Avatar Agents – an NVIDIA Perspective

By | June 6, 2023
digital avatar NVIDIA

Transforming QSR Order Taking with Digital Avatar Agents

Anand Muralidaran — Head – Global Growth Strategy and AI Business Development (Retail, CG and QSR). This post originally published on LinkedIn and reprinted here without change by permission. Be sure and look at the other 25 articles published by Anand.

QSR industry – at the cusp of major transformation

The QSR (Quick Service Restaurant) industry has undergone one of the most transformational phases in the last 3+ years.

Since the onset of COVID, QSRs are experiencing unprecedented growth in digital orders through phone, web, and mobile channels. Most customers receive their orders through food delivery companies or pick them up at the drive-thru window. Average digital order tickets grew by 15-20% during this phase as reported by all major QSR brands in their earnings calls.

Coming out of the pandemic, QSRs are open for business in stores and through digital channels. Customers are starting to use a hybrid of channels to place orders and pick up food between stores and digital channels. Latest results by all QSRs reflect growth in digital revenue combined with same store sales.

QSRs and other service industries like Retail and Hospitality have been supply challenged in getting quality frontline associates. The cost of labor has been on the rise, taking a toll on the QSR’s bottom line. Associates who are ready to work for low wages have challenges communicating with customers and capturing accurate order information.

As history tells us, a melting pot of these challenges and opportunities is the right setup for an industry at the cusp of leapfrogging into transformation.

QSRs are ready for the next big leapfrog.

Enter interactive avatars, conversational AI, LLMs (Large Language Models) and computer vision technologies to stitch and deliver a seamless, accurate and scalable customer experience to handle this huge opportunity ahead.

Avatar 3.0 – rise of digital human agents

Digital kiosk-driven ordering has shown average ticket size growth of 40-50% in some markets through better customer experience, smart menu choices and better recommendations. Customers are freed up from the social pressure of standing in a line and ordering from a human agent or in a drive-thru compared to talking to a live and interactive digital human.

With the advent of technology like avatars, conversational AI platforms, computer vision solutions and recommender systems, QSRs can put these pieces of technology together to produce a seamless experience for engaging customers when taking orders.

At NVIDIA we have developed a reference application called NVIDIA Tokkio, which can be customized by companies to deliver interactive customer experiences. These lifelike avatars can see, perceive, intelligently converse, provide recommendations, and finalize orders through payment processing and send requests to the kitchen for production. Check out the demo video here.


QSR industry operates in a franchise model with very thin margins. It is crucial to enable this solution via Cloud, so franchises need not invest in expensive edge technology. Which is what we did with NVIDIA Tokkio, which is built on NVIDIA Omniverse Avatar Cloud Engine (ACE) to enable real-time avatar solutions at-scale.

Digital humans/avatars have come a long way in the past few years in being able to see, talk, add gestures and converse on top of the ever-growing LLMs. ChatGPT showed the world what LLMs can do in processing long, complex statements and requests.

Where else can you imagine processing long, complex statements while taking an order? Remember Tom Hanks in “You Got Mail” mimicking a long, complex Starbucks order?

Icing on top – branding and marketing

Beyond solving some of the operational and CX challenges, QSRs have an option to leverage these avatars for themed and seasonal branding and marketing opportunities.

Imagine a Disney/Pixar movie character avatar interfacing and taking orders. Children love to interact with the characters from their favorite movies and the virality of the experience is a big opportunity for the brand.

The ability to create custom avatars to various themes like sports, movies and current affairs could enormously impact how customers relate to a brand and perceive the experience they get. This would give the branding and marketing functions a leg-up in positioning their brands and value to customers in a completely different light.

In closing

We are on a mission to make this valuable technology-led transformation a reality at leading QSR brands. Along with our strategic partners in the cloud, consulting and technology we are laser focused on giving consumers a paradigm shift in experience.

The ROI for this solution is immediate, huge and has several legs supporting it –

1.    Bottomline impact – Optimizing workforce at the store and drive-thru

2.    Topline growth – Driving higher average ticket size per transaction

3.    CSAT/NPS – Grow customer loyalty via branding/marketing activities

4.    Branding – Get the brand identity aligned to this experience and synergize

To learn more about how your company can take part in this transformation, visit our webpage or watch this GTC session on avatars.

Published by

Head – Global Growth Strategy and AI Business Development (Retail, CG and QSR)
25 articles
Sharing a few thoughts on what next for the QSR Order Taking Process. Order capture at a restaurant/drive-thru has been the same for decades, if not centuries. Incremental innovation on order capture via Kiosks and payment methods have happened in the past few years. Given evolutions in technology and challenges in QSR business/operations the time is NOW to transform the order taking process and show customers a fun way to interact, engage and place order! Do read and share your thoughts! NVIDIA#business#technology#restaurant#innovation#QSRs#nra2023#nvidia#ProjectTokkio#Omniverse#Avatar#conversationalai#RIVA#digitalmarketing

More Posts


NVIDIA AI Technologies


Animation AI

Omniverse Audio2Face beta simplifies animation of a 3D character to match any voice-over track, whether you’re animating characters for a game, film, real-time digital assistants, or just for fun. You can use the app for interactive real-time applications or as a traditional facial animation authoring tool. Run the results live or bake them out, it’s up to you.

Learn more about Omniverse


Conversational AI

With NVIDIA’s conversational AI solutions–including NVIDIA Riva for speech AI and NVIDIA NeMo framework for natural language processing–developers can quickly build and deploy cutting-edge applications that deliver high-accuracy and respond in far less than 300 milliseconds, the speed for real-time interactions.

Learn more about
Conversational AI


Vision AI

NVIDIA Metropolis enables the end-to-end computer vision (CV) workflow—from model development to deployment—for individual developers, higher education and research, and enterprises. Start with NVIDIA pre-trained models, TAO, and DeepStream to make the end-to-end computer vision AI development process easier.

Learn more about Metropolis


Recommendation AI

NVIDIA Merlin™ is an open-source framework for building high-performing recommender systems at scale. It includes libraries, methods, and tools that streamline the building of recommenders by addressing common preprocessing, feature engineering, training, inference, and deploying to production challenges.

Learn more about Merlin

More Conversational AI Avatar Posts

Author: Staff Writer

Craig Keefner -- With over 40 years in the industry and technology, Craig is widely considered to be an expert in the field. Major early career kiosk projects include Verizon Bill Pay kiosk and hundreds of others. Craig helped start kioskmarketplace and formed the KMA. Note the point of view here is not necessarily the stance of the Kiosk Association or