{"id":1881,"date":"2024-02-19T06:19:56","date_gmt":"2024-02-19T06:19:56","guid":{"rendered":"https:\/\/favtutor.com\/articles\/?p=1881"},"modified":"2024-02-19T06:20:14","modified_gmt":"2024-02-19T06:20:14","slug":"gpt-4v-rag-clinical-trial-screening","status":"publish","type":"post","link":"https:\/\/favtutor.com\/articles\/gpt-4v-rag-clinical-trial-screening\/","title":{"rendered":"GPT-4V Makes Wonders in Clinical Trial Screening"},"content":{"rendered":"\n<p>For a long time, screening patients individually has been a very costly, labor-intensive task. However, according to a study by a group of researchers on the GPT-4V AI model, we can soon say goodbye to this hassle. Let\u2019s take a further look into the study and understand the AI model\u2019s marvelous potential!<\/p>\n\n\n\n<p><strong>Highlights:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Study shows GPT-4V along with RAG offers numerous benefits in Clinical Trial Screening.<\/li>\n\n\n\n<li>Results show that the model can increase efficiency and reduce costs.<\/li>\n\n\n\n<li>Holds big potential for the future of AI in the medical sector.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>GPT-4V for Clinical Trials Screening Research<\/strong><\/h2>\n\n\n\n<p><strong>To determine whether an AI model could analyze medical records and identify potential clinical trial participants, a group of researchers from Mass General Brigham Personalised Medicine, Harvard Medical School, and Brigham and Women&#8217;s Hospital performed a study.<\/strong><\/p>\n\n\n\n<p>They processed clinical notes and electronic health records (EHR) of possible candidates using GPT-4V, OpenAI&#8217;s LLM with image processing made possible by Retrieval-Augmented Generation (RAG). <\/p>\n\n\n\n<p>A thorough selection process was conducted to select patients who met the criteria for the study. The process consisted of several inclusion and exclusion techniques and entailed having trained personnel search through hundreds or thousands of patients&#8217; EHRs to find those who meet the requirements.<\/p>\n\n\n\n<p>Their current structured data in the EHRs was quite amazing and it allowed them to determine 5 out of 6 inclusion and 5 out of 17 exclusion criteria. The labor-intensive task that the researchers believed artificial intelligence (AI) could help with was analyzing unstructured data in each patient&#8217;s healthcare notes to establish the remaining 13 criteria.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img decoding=\"async\" width=\"682\" height=\"774\" src=\"https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/02\/GPT-4V-for-Clinicial-Trials-Screening.png\" alt=\"https:\/\/www.researchgate.net\/publication\/378119813_Retrieval_Augmented_Generation_Enabled_Generative_Pre-Trained_Transformer_4_GPT-4_Performance_for_Clinical_Trial_Screening\" class=\"wp-image-1882\" srcset=\"https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/02\/GPT-4V-for-Clinicial-Trials-Screening.png 682w, https:\/\/favtutor.com\/articles\/wp-content\/uploads\/2024\/02\/GPT-4V-for-Clinicial-Trials-Screening-264x300.png 264w\" sizes=\"(max-width: 682px) 100vw, 682px\" \/><figcaption class=\"wp-element-caption\">(source: <a href=\"https:\/\/www.researchgate.net\/publication\/378119813_Retrieval_Augmented_Generation_Enabled_Generative_Pre-Trained_Transformer_4_GPT-4_Performance_for_Clinical_Trial_Screening\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">ResearchGate<\/a>)<\/figcaption><\/figure>\n<\/div>\n\n\n<p><strong>They created a clinical note-based question-answering system driven by RAG architecture and GPT-4 and named it RECTIFIER (RAG-Enabled Clinical Trial Infrastructure for Inclusion Exclusion Review).<\/strong> They used the structured assessments completed by the study staff and clinical notes for the past two years as a reference in development.<\/p>\n\n\n\n<p>The study had multiple sectors for the dataset. They used 1894 patient notes as a test set, 282 patient notes as a validation dataset, and 100 patient notes as a development dataset.<\/p>\n\n\n\n<p>For every query and screening technique, they computed the following metrics: sensitivity, specificity, accuracy, and Matthews correlation coefficient (MCC). To determine the confidence intervals for each statistic, they additionally used bootstrapping.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>What did the Results Show?<\/strong><\/h3>\n\n\n\n<p>The results of the study were quite impressive. The accuracy of the responses from RECTIFIER and study personnel varied between 97.9% and 100% (MCC 0.837 and 1), and between 91.7% and 100% (MCC 0.644 and 1), respectively, in comparison to the expert physician replies across all criteria.<\/p>\n\n\n\n<p>The X Factor of the result was that RECTIFIER performed better than the study staff in determining the inclusion character of \u201csymptomatic heart failure\u201d. It completely transcended and surpassed the latter with an accuracy of 97.9% vs 91.7% and an MCC of 0.924 vs 0.721, respectively.<\/p>\n\n\n\n<p>RECTIFIER also didn\u2019t fail to show impressive metric figures across sensitivity and specificity, having 92.3% (CI) and 93.9% (CI) respectively compared to the study staff\u2019s 90.1% (CI) and 83.6% (CI).<\/p>\n\n\n\n<p><strong>The results were overall successful in proving that while retaining accuracy, GPT-4V with RAG could complete the task more quickly than study personnel could.<\/strong><\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>What does this mean for the Future of AI in the Medical Field?<\/strong><\/h3>\n\n\n\n<p>This study gives us a breakthrough for AI in the medical sector. With the rise of potential models such as RECTIFIER, we can expect many more similar models in the future with seemingly more benefits.&nbsp;<\/p>\n\n\n\n<p>For now, let\u2019s explore four ways in which Retrieval-Augmented Generation Enabled Generative Pre-Trained Transformer 4 (GPT-4) can revolutionize the medical field:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>Enhanced Clinical Decision Support:<\/strong> GPT-4V along with RAG could analyze vast amounts of medical literature,\u00a0patient data,\u00a0and clinical guidelines to provide real-time,\u00a0personalized recommendations to healthcare professionals,\u00a0aiding in diagnosis,\u00a0treatment selection,\u00a0and risk assessment.<\/li>\n\n\n\n<li><strong>Improved Efficiency and Accuracy in Research:<\/strong> GPT-4&#8217;s ability to process and synthesize information could accelerate research by Generating summaries of relevant research papers to save researchers time. It can also Identify potential research gaps and suggest new avenues for investigation. Lastly, it can also automate tedious tasks like data mining and literature review.<\/li>\n\n\n\n<li><strong>Drug Discovery and Development:<\/strong> GPT-4 could analyze data on existing drugs,\u00a0clinical trials,\u00a0and molecular structures to identify promising candidates for new drug development,\u00a0potentially leading to faster and more effective treatments.<\/li>\n\n\n\n<li><strong>Streamlining Administrative Tasks:<\/strong> GPT-4 could automate administrative tasks such as scheduling appointments,\u00a0generating reports,\u00a0and processing medical claims,\u00a0freeing up valuable time for healthcare professionals to focus on patient care.<\/li>\n<\/ol>\n\n\n\n<p>Thus GPT-4, a large language model (LLM), holds promising potential to revolutionize how healthcare data is utilized and interacted with, leading to better patient care and medical research.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Conclusion<\/strong><\/h2>\n\n\n\n<p>The researchers concluded that, in comparison to using human personnel, utilizing an AI model like GPT-4V with RAG can significantly reduce costs in the identification of clinical trial candidates. However, they acknowledged that there should be caution when entrusting automated systems with medical care, but it appears that AI would perform more effectively than humans if given the right guidance!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>A new study by researchers shows greater improvement in clinical trial screening of patients using GPT-4V and RAG.<\/p>\n","protected":false},"author":15,"featured_media":1884,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jnews-multi-image_gallery":[],"jnews_single_post":null,"jnews_primary_category":{"id":"","hide":""},"footnotes":""},"categories":[57],"tags":[56,63],"class_list":["post-1881","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai","tag-ai","tag-gpt"],"_links":{"self":[{"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/posts\/1881","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/users\/15"}],"replies":[{"embeddable":true,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/comments?post=1881"}],"version-history":[{"count":2,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/posts\/1881\/revisions"}],"predecessor-version":[{"id":1885,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/posts\/1881\/revisions\/1885"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/media\/1884"}],"wp:attachment":[{"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/media?parent=1881"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/categories?post=1881"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/favtutor.com\/articles\/wp-json\/wp\/v2\/tags?post=1881"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}