Microsoft BioGPT: New AI chatbot released, but what does it mean for us?

Microsoft is currently well-known for the release of ChatGPT, a chatbot developed by OpenAI and was released in November last year. But what many might not know is that, in January this year, Microsoft also announced another artificial intelligence (AI) tool BioGPT which can be used to analyze biomedical research with the aim of answering biomedical questions and can be especially relevant in helping researchers gain new insights.

BioGPT is a type of generative language model, which is trained on millions of biomedical research articles that have already been published. This essentially means that BioGPT can use this information to perform other tasks like answering questions, extracting relevant data, and generating text relevant to biomedical.

According to Microsoft Research, BioGPT performs at the level of human experts on the tasks tested in the benchmarks and outperforms other general and scientific language models. BioGPT can help researchers gain new insights, for example, in drug development or clinical therapies.



In this work, the researchers developed BioGPT, a generative pre-trained Transformer language model for creating and mining biomedical text. The researchers used GPT-2 as their primary model and trained it on 15 million PubMed abstracts before using it in the real world.

When they put pre-trained BioGPT to work on downstream tasks, they carefully planned and tested the prompt and the target sequence format. The researchers used the BioGPT that had already been trained to do biomedical NLP tasks like end-to-end relation extraction, answering questions, classifying documents, and making new text.

While there are still some limitations of platforms like BioGPT, the rise of BioGPT forms part of the wider push towards AI solutions in healthcare and the clinical trials industry. Recently, AI has shown the potential to improving clinical trial patient selection, predicting drug development outcomes, and developing digital biomarkers.

FAQs

1. What is BioGPT?

BioGPT is a type of generative language model, which is trained on millions of biomedical research articles that have already been published.

2. What is the goal of BioGPT?

BioGPT can help researchers gain new insights, for example, in drug development or clinical therapies.

3. How was BioGPT developed?

The researchers used GPT-2 as their primary model and trained it on 15 million PubMed abstracts before using it in the real world.