At Computex 2024, NVIDIA showcased Project G-Assist, an AI assistant powered by RTX technology that provides assistance for PC games and applications. This new technology demo exemplifies NVIDIA’s commitment to leveraging AI to enhance user experiences in gaming and beyond.
Also Read: Asus Officially Unveiled ROG Ally X, Priced at $799
Project G-Assist, powered by RTX technology is an AI assistant designed to provide context-aware assistance for PC games and applications.
Survival Ascended by Studio Wildcard, Project G-Assist offers game-related insights, answers questions about game elements and personalizes responses based on the player’s session.
Project G-Assist offers insights and answers to game-related queries. Adjusts graphics settings and manages power consumption. Survival Ascended, Project G-Assist answered queries about early game weapons and crafting materials.
NVIDIA unveiled the first PC-based NVIDIA NIM (NVIDIA Inference Microservices) for the ACE digital human platform.
Reduces deployment times for developers delivering high-quality local inference for tasks like natural language understanding and facial animation. Showcased in a demo called Covert Protocol utilizing NVIDIA Audio2Face and NVIDIA Riva for local speech recognition.
New RTX AI PC laptops from ASUS and MSI, featuring GeForce RTX 4070 GPUs are designed for power-efficient AI performance.
Operating System Runs Windows 11 AI. Will receive a free update to Copilot+ PC experiences upon availability.
NVIDIA and Microsoft are enhancing Windows native and web apps with GPU-accelerated small language models (SLMs).
Utilizing NVIDIA RTX GPUs and other AI accelerators. An API preview is expected later this year. The RTX AI Toolkit is a collection of tools and SDKs for customizing, optimizing, and deploying AI models on RTX AI PCs. Launching later this month.
QLoRa Tools is for model customization. NVIDIA TensorRT is for model optimization offering up to 4x faster performance and 3x smaller models.
AI Inference Manager SDK Simplifies ACE deployment and orchestrates AI inference across devices and the cloud.
RTX AI acceleration is being integrated into creative apps enhancing tools like Automatic1111 and ComfyUI for Stable Diffusion.
RTX Remix will be open-sourced, enabling modders to enhance classic games with ray tracing and other advanced features.
RTX Remix Toolkit will be accessible via a REST API and an SDK, expanding its use in various applications and games.
RTX Video, an AI-powered super-resolution feature is now available as an SDK for developers. Includes video editing software like Blackmagic Design’s DaVinci Resolve and Wondershare Filmora, enabling video quality enhancements up to 4K resolution. VLC media player will add RTX Video HDR capabilities.
ACE generative AI microservices are now available, aimed at advancing digital human technologies in customer service, gaming, and healthcare.
NVIDIA Riva ASR, TTS, and NMT is for automatic speech recognition, text-to-speech conversion, and translation.
For language understanding and contextual responses. For realistic facial animation from audio tracks. NVIDIA Nemotron-3 4.5B has a small language model designed for low-latency, on-device RTX AI PC inference.
Also Read: Spacetop G1: Sightful Launches World’s First Screen-Free AR Laptop
ACE, previously available as NIM microservices for data centers is now extended to 100 million RTX AI PCs and laptops.
Models Includes Nemotron-3 4.5B SLM, Audio2Face and Riva ASR on-device models, entering early access soon. Simplifies ACE deployment and orchestrates inference across PCs and the cloud.
An updated Covert Protocol tech demo developed with Inworld AI allows players to interact with digital-human NPCs using conversational language.
Companies like Aww Inc., Dell Technologies, Gumption, Hippocratic AI, Inventec, OurPalm, Perfect World Games, Reallusion, ServiceNow, Soulbotix, SoulShell, and UneeQ are leveraging ACE technologies.
Plans to use Audio2Face for real-time animation of its virtual celebrity, Imma. Using ACE in its Legends tech demo for realistic, multilingual AI NPC interactions.
Enhancing its healthcare AI agent in the VRSTATE platform with Audio2Face. Showcased ACE NIM in its generative AI service agent demo.
Launched the Dell Generative AI Solution for Digital Assistants. NVIDIA highlighted generative AI tools by creating a “digital Jensen” avatar, featuring NVIDIA CEO Jensen Huang’s voice and style in multiple languages, using Synthesia, Hour One, ElevenLabs, and Voicemod’s AI speech technology.
NVIDIA announced the SFF-Ready Enthusiast GeForce Card program for gamers building smaller systems with GeForce RTX 40 graphics cards.
Includes RTX 4070, 4070Ti, and 4070 SUPER. Maximum thickness of 2.5 slots (50mm), 304mm in length, and 151mm in height including a 12VHWPR power cable.
Lists compatible cases excluding ASUS PRIME series but including ProArt cards and all SKUs with the same dimensions such as RTX 4080 SUPER.
Palit’s upcoming Innity 3 series and ZOTAC’s 4070 BLOWER design are also included. RTX 4060 is not included as it is considered a mainstream solution.
NVIDIA ACE NIM microservices including Riva and Audio2Face are now in production for server deployments.
NVIDIA AI Enterprise software provides enterprise-class support. Developers can register for early access to ACE NIM microservices on RTX AI PCs.
Also Read: Google Unveils Fitbit Ace LTE Smartwatch for Kids
Jensen Huang stated, “With breakthroughs in multi-modal large language models and neural graphics provided by NVIDIA ACE to our developer ecosystem, we are moving towards a future of intent-driven computing, where interacting with computers feels as natural as interacting with humans.”
Project G-Assist is designed to make game and system knowledge easily accessible to players. By taking voice or text inputs and combining them with a snapshot of the game screen, the assistant utilizes AI vision models to offer context-aware and app-specific insights.
These inputs are processed by a large language model (LLM) connected to a game knowledge database delivering personalized responses in text or speech.
Input Integration Takes voice or text inputs from players. Snapshot Analysis Uses game window snapshots for context.
AI Vision Models Provides app-specific understanding. Personalized Responses Delivers tailored insights based on in-game actions.
Advises on the best early game weapons and crafting materials. Suggests whether to avoid or tame on-screen dinosaurs. Analyzes skill points and crafting menus to provide tailored gameplay strategies.
Modern games demand peak system performance and Project G-Assist can optimize settings for an optimal gaming experience.
Assesses configuration and performance. Applies NVIDIA app’s optimized settings based on extensive testing. Enables safe GPU overclocking and reduces system latency.
Tracks and graphs frame rates, power usage, and PC latency. Efficiency Improvements Dynamically undervolts GPUs while maintaining performance targets.
System Scanning Ensures full utilization of display capabilities like resolution, refresh rate, HDR, and G-SYNC. Clarifies the impact of settings like DLAA vs. DLSS and Ultra Low Latency Mode vs. NVIDIA Reflex.
Inference Microservices Reduces deployment times from weeks to minutes. Delivers high-quality inference for natural language understanding, speech synthesis and facial animation.
Tools for optimizing and deploying large generative AI models on Windows PCs. Models consume up to 3x less RAM and deliver up to 4x faster performance.
Collaborating with Microsoft to enable GPU-accelerated small language models (SLMs) on Windows PCs.
NVIDIA’s newly announced RTX AI laptops feature up to GeForce RTX 4070 GPUs and power-efficient systems-on-a-chip with Windows 11 AI capabilities. These devices will receive a free update to Copilot+ PC experiences.
NVIDIA also introduced SFF-Ready guidelines for small form factor systems, ensuring compatibility with RTX 4070-class cards.
NVIDIA App Beta Performance stats and one-click GPU tuning available on June 4. RTX Video Integration is Super-resolution upscaling in VLC Video Player and DaVinci Resolve. Open Source RTX Remix Tools is for modding and content creation applications.
Also Read: YouTube Skipping Videos to End for Ad Blocker Users
/cdn.vox-cdn.com/uploads/chorus_asset/file/25474506/G_Assist_Press_Release_KV.png)
