{"id":4492,"date":"2024-05-06T06:44:41","date_gmt":"2024-05-06T06:44:41","guid":{"rendered":"https:\/\/favtutor.com\/articles\/?p=4492"},"modified":"2024-05-06T06:44:43","modified_gmt":"2024-05-06T06:44:43","slug":"chatrtx-gemma-chatglm3","status":"publish","type":"post","link":"https:\/\/favtutor.com\/articles\/chatrtx-gemma-chatglm3\/","title":{"rendered":"NVIDIA ChatRTX Now Supports Google\u2019s Gemma &amp; ChatGLM3"},"content":{"rendered":"\n<p>In February 2024, <a href=\"https:\/\/favtutor.com\/articles\/nvidia-chat-with-rtx-chatbot-pc\/\" data-type=\"link\" data-id=\"https:\/\/favtutor.com\/articles\/nvidia-chat-with-rtx-chatbot-pc\/\">NVIDIA released ChatRTX<\/a>, an experimental AI chatbot for users to interact with their local data with several LLMs to choose from. It has been in the minds of AI enthusiasts since its release because of its amazing features. Now, ChatRTX is expanding its support to even more models, including Google\u2019s Gemma.<\/p>\n\n\n\n<p><strong>Highlights:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>NVIDIA&#8217;s ChatRTX now supports Google Gemma, OpenAI&#8217;s CLIP and ChatGLM3.<\/li>\n\n\n\n<li>These news models add better image analysis and speech recognition capabilities.<\/li>\n\n\n\n<li>ChatRTX works as a personalized  ChatGPT-like bot to ask queries about your own local data, including docs and images.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>New AI Models for ChatRTX<\/strong><\/h2>\n\n\n\n<p>Nvidia\u2019s ChatRTX, previously known as \u2018Chat with RTX\u2019 is an AI chatbot that works locally on PCs with Nvidia GeForce RTX graphics cards. By providing the chatbot with documents, text files, PDFs, and YouTube videos to power its responses, users can ask queries and get answers from them.<\/p>\n\n\n\n<p>One of the key features of it is that it supports several LLMs. Initially, it announced support for Mistral and Llama 2. So using ChatRTX, users can create a personalized chatbot using Llama 2 or Mistral. The responses were also quite positive.<\/p>\n\n\n\n<p><strong>ChatRTX now supports Google&#8217;s Gemma, a lightweight Gemini derivative and ChatGLM3, an English and Chinese LLM built on the general language model foundation.<\/strong><\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<div class=\"jeg_video_container jeg_video_content\"><iframe title=\"ChatRTX Update: New Models &amp; Features | Voice &amp; Image Data Support\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/zMROAxJQ7rk?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/div>\n<\/div><\/figure>\n\n\n\n<p>It makes sense for <a href=\"https:\/\/favtutor.com\/articles\/google-gemma-lightweight-ai-open-model\/\">Google&#8217;s Gemma model<\/a> to be included in ChatRTX given it was created to run natively on potent laptops or desktop computers. The process of running various models locally is made simpler by Nvidia&#8217;s app, and the resulting chatbot interface allows you to select the model that most closely matches your own data for analysis or search.<\/p>\n\n\n\n<p>Here are the features of the newly supported models:<\/p>\n\n\n\n<p><strong>Google&#8217;s Gemma:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Made for high-end desktop and laptop computers.<\/li>\n\n\n\n<li>Local model execution is made simpler by inclusion in ChatRTX.<\/li>\n\n\n\n<li>Users are able to select models according to the demands they have for data analysis.<\/li>\n<\/ul>\n\n\n\n<p><strong>ChatGLM3:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>A huge language model that is open to both Chinese and English speakers.<\/li>\n\n\n\n<li>Built upon the foundation of the universal language model.<\/li>\n\n\n\n<li>Improves the generation and interpretation of natural language.<\/li>\n<\/ul>\n\n\n\n<p>ChatRTX also<a href=\"https:\/\/blogs.nvidia.com\/blog\/ai-decoded-chatrtx-update\/\" target=\"_blank\" rel=\"noreferrer noopener nofollow\"> added capabilities<\/a> of OpenAI\u2019s CLIP (Contrastive Language\u2013Image Pre-training). It trains the model to recognize images by enabling users to look through and interact with local image data.  There is also Whisper that integrates voice-support with its amazing AI-based speech recognition support.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>What makes ChatRTX Special?<\/strong><\/h2>\n\n\n\n<p>It should be noted that ChatRTX is still regarded as a &#8220;tech demo.&#8221; It&#8217;s an illustration of what programmers can create with the TensorRT-LLM RAG open-source reference project, and it might make LLMs more approachable for the typical computer user.<\/p>\n\n\n\n<p>Apart from the locally enabled running features which include documentation and summarizing features, one of ChatRTX&#8217;s advantages is that it doesn&#8217;t require any specialized knowledge, making it easy to train a customized local chatbot. It will motivate programmers to create AI apps that are even better.<\/p>\n\n\n\n<p>Recently OpenAI also launched a <a href=\"https:\/\/favtutor.com\/articles\/openai-fine-tuning-ai-models\/\" data-type=\"link\" data-id=\"https:\/\/favtutor.com\/articles\/openai-fine-tuning-ai-models\/\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">platform to help developers fine-tune their AI assistants<\/a> and deploy them. Maybe NVIDIA is also heading in a similar direction? We are in for so much more with this highly efficient \u2018offline\u2019 chatbot.<\/p>\n\n\n\n<p>But remember that ChatRTX is a local chatbot and it is unaware of the outside world. When we point it to a folder on your PC, we can only pose inquiries regarding the data within.<\/p>\n\n\n\n<p>Its adaptability to various file formats is very impressive in this day and age of online chatbots, which have several disadvantages due to latency, expense, and privacy issues. Since the model is built on LLM, which examines locally stored files across your operating system, you may relax about the confidentiality and integrity of your shared data.<\/p>\n\n\n\n<p>Only Windows 11 PCs can use NVIDIA&#8217;s ChatRTX, which requires an NVIDIA GeForce\u2122 RTX 30 or 40 Series GPU with at least 8GB of VRAM and 16GB of RAM or more.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Conclusion<\/strong><\/h2>\n\n\n\n<p>With these new AI models now being part of NVIDIA ChatRTX, it will achieve more functionalities even when running locally on devices.  Let\u2019s see how the Chatbor performs in the days to come and we can expect support for even more AI models in the future!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>ChatRTX now added support for Google&#8217;s Gemma, and ChatGLM3 AI Models. Find out what they add to NVIDIA&#8217;s local chatbot app.<\/p>\n","protected":false},"author":15,"featured_media":4509,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jnews-multi-image_gallery":[],"jnews_single_post":null,"jnews_primary_category":{"id":"","hide":""},"footnotes":""},"categories":[57],"tags":[56,235,234,65,58,72,87],"class_list":["post-4492","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai","tag-ai","tag-chatglm","tag-chatrtx","tag-gemma","tag-google","tag-llm","tag-nvidia"],"_links":{"self":[{"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/posts\/4492","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/users\/15"}],"replies":[{"embeddable":true,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/comments?post=4492"}],"version-history":[{"count":4,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/posts\/4492\/revisions"}],"predecessor-version":[{"id":4510,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/posts\/4492\/revisions\/4510"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/media\/4509"}],"wp:attachment":[{"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/media?parent=4492"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/categories?post=4492"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/tags?post=4492"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}