Funding, Deals & Partnerships: BIOLOGICS & MEDICAL DEVICES; BioMed e-Series; Medicine and Life Sciences Scientific Journal – http://PharmaceuticalIntelligence.com
Eight Subcellular Pathologies driving Chronic Metabolic Diseases – Methods for Mapping Bioelectronic Adjustable Measurements as potential new Therapeutics: Impact on Pharmaceuticals in Use
In this curation we wish to present two breaking through goals:
Goal 1:
Exposition of a new direction of research leading to a more comprehensive understanding of Metabolic Dysfunctional Diseases that are implicated in effecting the emergence of the two leading causes of human mortality in the World in 2023: (a) Cardiovascular Diseases, and (b) Cancer
Goal 2:
Development of Methods for Mapping Bioelectronic Adjustable Measurements as potential new Therapeutics for these eight subcellular causes of chronic metabolic diseases. It is anticipated that it will have a potential impact on the future of Pharmaceuticals to be used, a change from the present time current treatment protocols for Metabolic Dysfunctional Diseases.
According to Dr. Robert Lustig, M.D, an American pediatric endocrinologist. He is Professor emeritus of Pediatrics in the Division of Endocrinology at the University of California, San Francisco, where he specialized in neuroendocrinology and childhood obesity, there are eight subcellular pathologies that drive chronic metabolic diseases.
These eight subcellular pathologies can’t be measured at present time.
In this curation we will attempt to explore methods of measurement for each of these eight pathologies by harnessing the promise of the emerging field known as Bioelectronics.
Unmeasurable eight subcellular pathologies that drive chronic metabolic diseases
Glycation
Oxidative Stress
Mitochondrial dysfunction [beta-oxidation Ac CoA malonyl fatty acid]
Insulin resistance/sensitive [more important than BMI], known as a driver to cancer development
Membrane instability
Inflammation in the gut [mucin layer and tight junctions]
Epigenetics/Methylation
Autophagy [AMPKbeta1 improvement in health span]
Diseases that are not Diseases: no drugs for them, only diet modification will help
Image source
Robert Lustig, M.D. on the Subcellular Processes That Belie Chronic Disease
These eight Subcellular Pathologies driving Chronic Metabolic Diseases are becoming our focus for exploration of the promise of Bioelectronics for two pursuits:
Will Bioelectronics be deemed helpful in measurement of each of the eight pathological processes that underlie and that drive the chronic metabolic syndrome(s) and disease(s)?
IF we will be able to suggest new measurements to currently unmeasurable health harming processes THEN we will attempt to conceptualize new therapeutic targets and new modalities for therapeutics delivery – WE ARE HOPEFUL
In the Bioelecronics domain we are inspired by the work of the following three research sources:
Michael Levin is an American developmental and synthetic biologist at Tufts University, where he is the Vannevar Bush Distinguished Professor. Levin is a director of the Allen Discovery Center at Tufts University and Tufts Center for Regenerative and Developmental Biology. Wikipedia
THE VOICE of Dr. Justin D. Pearlman, MD, PhD, FACC
PENDING
THE VOICE of Stephen J. Williams, PhD
Ten TakeAway Points of Dr. Lustig’s talk on role of diet on the incidence of Type II Diabetes
25% of US children have fatty liver
Type II diabetes can be manifested from fatty live with 151 million people worldwide affected moving up to 568 million in 7 years
A common myth is diabetes due to overweight condition driving the metabolic disease
There is a trend of ‘lean’ diabetes or diabetes in lean people, therefore body mass index not a reliable biomarker for risk for diabetes
Thirty percent of ‘obese’ people just have high subcutaneous fat. the visceral fat is more problematic
there are people who are ‘fat’ but insulin sensitive while have growth hormone receptor defects. Points to other issues related to metabolic state other than insulin and potentially the insulin like growth factors
At any BMI some patients are insulin sensitive while some resistant
Visceral fat accumulation may be more due to chronic stress condition
Fructose can decrease liver mitochondrial function
A methionine and choline deficient diet can lead to rapid NASH development
ChatGPT Searches and Advent of Meta Threads: What it Means for Social Media and Science 3.0
Curator: Stephen J. Williams, PhD
The following explains how popular ChatGPT has become and how the latest social media platforms, including Meta’s (FaceBook) new platform Threads, is becoming as popular or more popular than older social Platforms. In fact, since its short inception since last week (Threads launced 7/07/2023), Threads is threatening Twitter for dominance in that market.
U.S. searches for ChatGPT overtake TikTok, Pinterest, and Zoom
Google searches for ChatGPT have overtaken TikTok in the U.S., jumping to 7.1 million monthly searches compared to 5.1 million
The term ‘ChatGPT’ is now one of the top 100 search terms in the U.S., ranking 92nd, according to Ahrefs data
ChatGPT is now searched more than most major social networks, including LinkedIn, Pinterest, TikTok, and Reddit
Analysis of Google search data reveals that online searches for ChatGPT, the popular AI chatbot, have overtaken most popular social networks in the U.S. This comes when search interest in artificial intelligence is at its highest point in history.
The findings by Digital-adoption.com reveal that US-based searches for ChatGPT have exploded and overtaken popular social networks, such as LinkedIn, Pinterest, and Tiktok, some by millions.
Ranking
Keyword
US Search Volume (Monthly)
1
Facebook
70,920,000
2
YouTube
69,260,000
3
Twitter
15,440,000
4
Instagram
12,240,000
5
ChatGPT
7,130,000
6
LinkedIn
6,990,000
7
Pinterest
5,790,000
8
TikTok
5,130,000
9
Reddit
4,060,000
10
Snapchat
1,280,000
11
WhatsApp
936,000
Since its release in November 2022, searches for ChatGPT have overtaken those of most major social networks. According to the latest June search figures by search tool Ahrefs, searches for ‘ChatGPT’ and ‘Chat GPT’ are made 7,130,000 times monthly in the U.S.
That’s more than the monthly search volume for most of the top ten social networks, including LinkedIn, Pinterest, and TikTok. TikTok is one of the largest growing social media apps, with 100 million users in just a year.
The term ‘ChatGPT’ is now one of the top 100 search terms in the U.S., ranking 92nd, according to Ahrefs data
Searches for ChatGPT have eclipsed other major networks in the U.S., such as Reddit, by millions.
Every day search terms such as ‘maps’ and ‘flights’ have even seen their search volumes pale compared to the rising popularity of ChatGPT. ‘Maps’ is currently searched 440,000 times less than the chatbot each month, and ‘Flights’ is now Googled 2.2 million times less.
2023 has been a breakout year for AI, as searches for the term have more than doubled from 17 million in January 2023 to 42 million in May. In comparison, there were 7.9 million searches in January 2022. There has been an 825% increase in searches for ‘AI’ in the US compared to the average over the last five years.
There is a correlation between the uptick and the public releases of accessible AI chatbots such as ChatGPT, released on November 30, 2022, and Bing AI and Google Bard, released in May 2023.
According to TikTok data, interest in artificial intelligence has soared tenfold since 2020, and virtual reality has more than tripled.
AI has been a big topic of conversation this year as accessible AI chatbots and new technologies were released and sparked rapid adoption, prompting tech leaders like Elon Musk to call for AI regulation.
A spokesperson from Digital-adoption.com commented on the findings: “There has been a massive surge in AI interest this year. Apple’s announcement of Vision Pro has captured audiences at the right time, when new AI technologies, like ChatGPT, have become accessible to almost anyone. The rapid adoption of ChatGPT is surprising, with it becoming one of the fastest-growing tools available”.
All data was gathered from Ahrefs and Google Trends.
If using this story, please include a link tohttps://www.digital-adoption.com/ who conducted this study. A linked credit allows us to keep supplying you with content that you may find useful in the future.
Updated July 10, 2023 9:00 am ET / Original July 10, 2023 7:44 am ET
The launch of Meta Platforms’ Threads looks to have outpaced even the viral success of ChatGPT in terms of signing up users. The next challenge will be keeping them around.
Since its inception on Thursday 7/07/2023, Meta’s new Threads platform has been signing up new users at an alarming rate. On rollout date 5 million signed up, then 30 million by next morning and now as of today (7/1/2023) Threads has over 100 million signups. Compare that to Twitter’s 436 million users, of which are tweeting on average 25% less than a few years ago, and it is easy to see why many social media pundits are calling Threads the new Twitter killer app.
Here are a few notes from the New York Times podcast The Daily
Last week, Meta, the parent company of Facebook and Instagram, released Threads, a social media platform to compete with Twitter. In just 16 hours, Threads was downloaded more than 30 million times.
Mike Isaac, who covers tech companies and Silicon Valley for The Times, explains how Twitter became so vulnerable and discusses the challenges Meta faces to create a less toxic alternative.
Guest: Mike Isaac, a technology correspondent for The New York Times.
Background reading:
Threads is onpace to exceed 100 million users within two months, a feat achieved only by ChatGPT.
Here’s what to know about Threads and how it differs from Twitter.
Here are a few notes from the podcast:
Mike Isaac lamented that Twitter has become user unfriendly for a host of reasons. These include:
The instant reply’guys’ – people who reply but don’t really follow you or your thread
Your followers or following are not pushed to top of thread
The auto bots – the automated Twitter bots
Spam feeds
The changes in service and all these new fees: Twitter push to monetize everything – like airlines
Elon Musk wanted to transform Twitter but his history is always cutting, not just trimming the excess but he is known to just eliminate departments just because he either doesn’t want to pay or CAN’T pay. With Twitter he gutted content moderation.
Twitter ad business is plumetting but Musk wants to make Twitter a subscription business (the Blue check mark)
Twitter only gets a couple of million $ per month from Twitter Blue but Musk has to pay billions to just pay the interest on Twitter loan for Twitter puchase years ago
It is known that Musk is not paying rent on some California offices (some are suggesting he defaulted on leases) and Musk is selling Tesla stock to pay for Twitter expenses (why TSLA stock has been falling … the consensus out there)
Twitter is largest compendium of natural language conversations and Musk wanted to limit bots from scraping Twitter data to do AI and NLP on Twitter threads. This is also a grievance from other companies… that these ‘scrapers’ are not paying enough for Twitter data. However as Mike asks why do the little Twitter user have to pay in either fees or cutbacks from service. (the reason why Elon is limiting viewing per day is to limit these bots from scraping Twitter for data)
Another problem is that Twitter does not have its own servers so pays a lot to Google and AWS for server space. It appears Elon and Twitter are running out of money.
META and THREADS
Zuckerberg has spent billions of infrastructure spending and created a massive advertising ecosystem. This is one of the thoughts behind his push and entry into this space. Zuckerberg actually wanted to but Twitter a decade ago.
Usage and growth: The launch of Threads was Thursday 7-07-23. There were 2 million initial signups and by next morning 30 million overnight. Today Monday 7-10-23 there are 100 million, rivaling Twitter’s 436 million accounts. And as Musk keeps canceling Twitter accounts, angering users over fees or usage restrictions, people are looking for a good platform. Mastedon in too technical and not having the adoption like Meta Threads is having. Mike Isaac hopes Threads will not go the way of Google Hangouts or Plus but Google strategy did not involve social media like Facebook.
Signup and issues: Signup on Threads is easy but you need to go through Instagram. Some people have concerns about having their instagram thread put on their Threads feed but Mike had talked to the people at Meta and they are working to allow users to keep the feeds separate, mainly because Meta understands that the Instgagram and Twitter social cultures are different and users may want to keep Threads more business-like.
Important issues for LPBI: Twitter had decided, by end of May 2023 to end their relationship with WordPress JetPack service, in which WordPress posts could automatically be posted to your Twitter account and feed. Twitter is making users like WordPress pay for this API and WordPress said it would be too expensive as Twitter is not making a flat fee but per usage fee. This is a major hindrance even though the Twitter social share button is still active on posts.
Initial conversations between META and WordPress have indicated META will keep this API service free for WordPress.
So a little background on Meta Threads and signup features from Meta (Facebook) website:
Takeaways
Threads is a new app, built by the Instagram team, for sharing text updates and joining public conversations.
You log in using your Instagram account and posts can be up to 500 characters long and include links, photos, and videos up to 5 minutes in length.
We’re working to soon make Threads compatible with the open, interoperable social networks that we believe can shape the future of the internet.
Mark Zuckerberg just announced the initial version of Threads, an app built by the Instagram team for sharing with text. Whether you’re a creator or a casual poster, Threads offers a new, separate space for real-time updates and public conversations. We are working toward making Threads compatible with the open, interoperable social networks that we believe can shape the future of the internet.
Instagram is where billions of people around the world connect over photos and videos. Our vision with Threads is to take what Instagram does best and expand that to text, creating a positive and creative space to express your ideas. Just like on Instagram, with Threads you can follow and connect with friends and creators who share your interests – including the people you follow on Instagram and beyond. And you can use our existing suite of safety and user controls.
Join the Conversation from Instagram
It’s easy to get started with Threads: simply use your Instagram account to log in. Your Instagram username and verification will carry over, with the option to customize your profile specifically for Threads.
Everyone who is under 16 (or under 18 in certain countries) will be defaulted into a private profile when they join Threads. You can choose to follow the same accounts you do on Instagram, and find more people who care about the same things you do. The core accessibility features available on Instagram today, such as screen reader support and AI-generated image descriptions, are also enabled on Threads.
Your feed on Threads includes threads posted by people you follow, and recommended content from new creators you haven’t discovered yet. Posts can be up to 500 characters long and include links, photos, and videos up to 5 minutes in length. You can easily share a Threads post to your Instagram story, or share your post as a link on any other platform you choose.
Tune Out the Noise
We built Threads with tools to enable positive, productive conversations. You can control who can mention you or reply to you within Threads. Like on Instagram, you can add hidden words to filter out replies to your threads that contain specific words. You can unfollow, block, restrict or report a profile on Threads by tapping the three-dot menu, and any accounts you’ve blocked on Instagram will automatically be blocked on Threads.
As with all our products, we’re taking safety seriously, and we’ll enforce Instagram’s Community Guidelines on content and interactions in the app. Since 2016 we’ve invested more than $16 billion in building up the teams and technologies needed to protect our users, and we remain focused on advancing our industry-leading integrity efforts and investments to protect our community.
Compatible with Interoperable Networks
Soon, we are planning to make Threads compatible with ActivityPub, the open social networking protocol established by the World Wide Web Consortium (W3C), the body responsible for the open standards that power the modern web. This would make Threads interoperable with other apps that also support the ActivityPub protocol, such as Mastodon and WordPress – allowing new types of connections that are simply not possible on most social apps today. Other platforms including Tumblr have shared plans to support the ActivityPub protocol in the future.
We’re committed to giving you more control over your audience on Threads – our plan is to work with ActivityPub to provide you the option to stop using Threads and transfer your content to another service. Our vision is that people using compatible apps will be able to follow and interact with people on Threads without having a Threads account, and vice versa, ushering in a new era of diverse and interconnected networks. If you have a public profile on Threads, this means your posts would be accessible from other apps, allowing you to reach new people with no added effort. If you have a private profile, you’d be able to approve users on Threads who want to follow you and interact with your content, similar to your experience on Instagram.
The benefits of open social networking protocols go well beyond the ways people can follow each other. Developers can build new types of features and user experiences that can easily plug into other open social networks, accelerating the pace of innovation and experimentation. Each compatible app can set its own community standards and content moderation policies, meaning people have the freedom to choose spaces that align with their values. We believe this decentralized approach, similar to the protocols governing email and the web itself, will play an important role in the future of online platforms.
Threads is Meta’s first app envisioned to be compatible with an open social networking protocol – we hope that by joining this fast-growing ecosystem of interoperable services, Threads will help people find their community, no matter what app they use.
What’s Next
We’re rolling out Threads today in more than 100 countries for iOS and Android, and people in those countries can download the app from the Apple App Store and Google Play Store.
In addition to working toward making Threads compatible with the ActivityPub protocol, soon we’ll be adding a number of new features to help you continue to discover threads and creators you’re interested in, including improved recommendations in feed and a more robust search function that makes it easier to follow topics and trends in real time.
Should Science Migrate over to Threads Instead of Twitter?
I have written multiple time of the impact of social media, Science and Web 2.0 and the new Science and Web 3.0 including
It, as of this writing, appears it is not crucial that scientific institutions need to migrate over to Threads yet, although the impetus is certainly there. Many of the signups have of course been through Instagram (which is the only way to signup for now) and a search of @Threads does not show that large scientific organizations have signed up for now.
A search for NIH, NCBI, AACR, and Personalized Medicine Coalition or PMC which is the big MGH orgaization on personalized medicine appears to return nothing yet. Pfizer and most big pharma is on @Threads now but that is because they maintain a marketing thread on Instagram. How necessary is @Threads for communicating science over Science 3.0 platform remains to be seen. In addition, how will @Threads be used for real time scientific conference coverage? Will Meta be able to integrate with virtual reality?
Other articles of Note on this Open Access Scientific Journal Include:
OpenAI and ChatGPT face unique legal challenges over CopyRight Laws
Reporter: Stephen J. Williams, PhD
In previous weeks on this page and on the sister page ChatGPT applied to Cancer & Oncology, a comparison between ChatGPT, OpenAI, and Google large language model based search reveals a major difference between the algorithms with repect to citation and author credit. In essence while Google returns a hyperlink to the information used to form an answer, ChatGPT and OpenAI are agnostic in crediting or citing the sources of information used to generate answers to queries. With ChatGPT the source data, or more specifically the training set used for the AI algorithm is never properly cited in the query results.
This, as outlined below, is making a big problem when it comes to copyright law and intelectual property. Last week a major lawsuit has been filed because of incorrect and citing, referencing, and attribution of ownership of intellectual property.
As Miles Klee reports in The Rolling Stone
“OpenAI faces allegations of privacy invasion and violating authors’ copyright — but this may be just the tip of the iceberg”
The burgeoning AI industry has just crossed another major milestone, with two new class-action lawsuits calling into question whether this technology violates privacy rights, scrapes intellectual property without consent and negatively affects the public at large. Experts believe they’re likely to be the first in a wave of legal challenges to companies working on such products. Both suits were filed on Wednesday and target OpenAI, a research lab consisting of both a nonprofit arm and a corporation, over ChatGPT software, a “large language model” capable of generating human-like responses to text input. One, filed by Clarkson, a public interest law firm, is wide-ranging and invokes the potentially “existential” threat of AI itself. The other, filed by the Joseph Saveri Law Firm and attorney Matthew Butterick, is focused on two established authors, Paul Tremblay and Mona Awad, who claim that their books were among those ChatGPT was trained on — a violation of copyright, according to the complaint. (Saveri and Butterick are separately pursuing legal action against OpenAI, GitHub and Microsoft over GitHub Copilot, an AI-based coding product that they argue “appears to profit from the work of open-source programmers by violating the conditions of their open-source licenses.”)
Saveri and Butterick’s latest suit goes after OpenAI for direct copyright infringement as well as violations of the Digital Millennium Copyright Act (DMCA). Tremblay (who wrote the novel The Cabin at the End of the World) and Awad (author of 13 Ways of Looking at a Fat Girl and Bunny) are the representatives of a proposed class of plaintiffs who would seek damages as well as injunctive relief in the form of changes to ChatGPT. The filing includes ChatGPT’s detailed responses to user questions about the plots of Tremblay’s and Awad’s books — evidence, the attorneys argue, that OpenAI is unduly profiting off of infringed materials, which were scraped by the chat bot. While the suits venture into uncharted legal territory, they were more or less inevitable, according to those who research AI tech and privacy or practice law around those issues.
“[AI companies] should have and likely did expect these types of challenges,” says Ben Winters, senior counsel at the Electronic Privacy Information Center and head of the organization’s AI and Human Rights Project. He points out that OpenAI CEO Sam Altman mentioned a few prior “frivolous” suits against the company during his congressional testimony on artificial intelligence in May. “Whenever you create a tool that implicates so much personal data and can be used so widely for such harmful and otherwise personal purposes, I would be shocked there is not anticipated legal fire,” Winters says. “Particularly since they allow this sort of unfettered access for third parties to integrate their systems, they end up getting more personal information and more live information that is less publicly available, like keystrokes and browser activity, in ways the consumer could not at all anticipate.”
They say that OpenAI defendants “profit richly” from the use of their copyrighted materials and yet the authors never consented to the use of their copyrighted materials without credit or compensation.
ChatGPT lawsuit says OpenAI has previously utilized illegal ‘shadow libraries’ for AI training datasets
Although many types of material are used to train large language models, “books offer the best examples of high-quality longform writing,” according to the ChatGPT lawsuit.
OpenAI has previously utilized books for its AI training datasets, including unpublished novels (the majority of which were under copyright) available on a website that provides the materials for free. The plaintiffs suggest that OpenAI may have utilized copyrighted materials from “flagrantly illegal shadow libraries.”
Tremblay and Awad note that OpenAI’s March 2023 paper introducing GPT-4 failed to include any information about the training dataset. However, they say that ChatGPT was able to generate highly accurate summaries of their books when prompted, suggesting that their copyrighted material was used in the training dataset without their consent.
They filed the ChatGPT class action lawsuit on behalf of themselves and a proposed class of U.S. residents and entities that own a U.S. copyright for any work used as training data for the OpenAI language models during the class period.
Earlier this year, a tech policy group urged federal regulators to block OpenAI’s GPT-4 AI product because it does not meet federal standards.
What is the general consensus among legal experts on generative AI and copyright?
Given the hype around ChatGPT and the speculation that it could be widely used, it is important to understand the legal implications of the technology. First, do copyright owners of the text used to train ChatGPT have a copyright infringement claim against OpenAI? Second, can the output of ChatGPT be protected by copyright and, if so, who owns that copyright?
To answer these questions, we need to understand the application of US copyright law.
Copyright Law Basics
Based on rights in Article I, Section 8 of the Constitution, Congress passed the first copyright law in 1790. It has been amended several times. Today, US copyright law is governed by the Copyright Act of 1976. This law grants authors of original works exclusive rights to reproduce, distribute, and display their work. Copyright protection applies from the moment of creation, and, for most works, the copyright term is the life of the author plus 70 years after the author’s death. Under copyright law, the copyright holder has the exclusive right to make copies of the work, distribute it, display it publicly, and create derivative works based on it. Others who want to use the work must obtain permission from the copyright holder or use one of the exceptions to copyright law, such as fair use.
The purpose of copyright law is to incentivize authors to create novel and creative works. It does this by granting authors exclusive rights to control the use of their work, thus allowing them to financially benefit from their works. Copyright law also encourages the dissemination of knowledge by allowing others to use copyrighted works under certain conditions, such as through the fair use doctrine, which allows for limited use of copyrighted material for the purposes of criticism, commentary, news reporting, teaching, scholarship, or research. By protecting the rights of authors and creators while also allowing for the use of copyrighted works for the public benefit, copyright law aims to strike a balance between the interests of authors and the public.
Inputs – Training ChatGPT with Copyrighted Material
ChatGPT was trained on a large training dataset sourced from the internet, including a vast amount of text from websites, articles, books, social media posts, and academic papers. Importantly, ChatGPT was not aware of the source of the data, it only saw the text and learned the patterns and relationships between the words, phrases and sentences. The vast majority of the text used to train ChatGPT was certainly subject to copyright protection—except for text that is in the public domain like facts or discoveries or works whose term of copyright protection has ended.
Did the ChatGPT training process violate the copyright of the original authors? To answer that question we must determine: if during the training process OpenAI copied the underlying works—because copyright infringement requires an act of copying works that are protected by copyright; is the output of ChatGPT a “derivative work” under copyright law; and would such copying or production of a derivate work fall under the “fair use” exception of copyright law.
Copying During Training
We are not aware of publicly available information regarding whether, during the training process, the training text for ChatGPT was copied or simply referenced. Therefore, we asked ChatGPT and received this answer:
Prompt: During the ChatGPT training process, was the underlying training text copied into a OpenAI database?
Answer: During the training process, text from various sources is used to train the ChatGPT model. It is likely that the text was copied into an internal database at OpenAI for the purpose of training the model. However, the training text is typically preprocessed to remove any sensitive information such as personal identifiers, copyrighted text, etc. In addition, the text is also used to train the model and not stored in a database. The model uses the text to learn patterns and structure of the language and once the training is done, it doesn’t require the text anymore.
So, it seems that during the training process, text was copied. It is also interesting that ChatGPT stated that the training text was “preprocessed” to remove any copyrighted text. That seems highly unlikely since otherwise nearly all text would have been removed.
Is ChatGPT Output a Derivative Work?
Under US copyright law, the owner of a copyright has the exclusive right “to prepare derivative works based upon the copyrighted work.” A “derivative work” is “a work based upon one or more preexisting works.” ChatGPT is trained on preexisting works and generates output based on that training.
As Daniel Gervais, a professor at Vanderbilt Law School who specializes in intellectual property law, says, the definition of a derivative work under copyright law “could loosely be used as a definition of machine learning when applied to the creation of literary and artistic productions because AI machines can produce literary and artistic content (output) that is almost necessarily ‘based upon’ a dataset consisting of preexisting works.” Under this view, it seems that all ChatGPT output is a derivative work under copyright law.
On a related point, it is worth noting that in producing its output, ChatGPT is not “copying” anything. ChatGPT generates text based on the context of the input and the words and phrase patterns it was trained on. ChatGPT is not “copying” and then changing text.
What About Fair Use?
Let’s assume that the underlying text was copied in some way during the ChatGPT training process. Let’s further assume that outputs from Chatto are, at least sometimes, derivative works under copyright law. If that is the case, do copyright owners of the original works have a copyright infringement claim against OpenAI? Not if the copying and the output generation are covered by the doctrine of “fair use.” If a use qualifies as fair use, then actions that would otherwise be prohibited would not be deemed an infringement of copyright.
In determining whether the use made of a work in any particular case is a fair use, the factors include:
The purpose and character of the use, including whether such use is of a commercial nature or is for nonprofit educational purposes.
The nature of the copyrighted work.
The amount and substantiality of the portion used in relation to the copyrighted work as a whole.
The effect of the use upon the potential market for or value of the copyrighted work.
In this case, assuming OpenAI copied copyrighted text as part of the ChatGPT training process, such copying was not for a commercial purpose and had no economic impact on the copyright owner. Daniel Gervais says “it is much more likely than not” that training systems on copyrighted data will be covered by fair use.
In determining if a commercial use will be considered “fair use,” the courts will primarily look at the scope and purpose of the use and the economic impact of such use. Does the use in question change the nature of the underlying copyright material in some material way (described as a “transformative” use) and does it economically impact the original copyright holder?
Without a specific example, it is difficult to determine exactly if a resulting output from ChatGPT would be fair use. The fact that ChatGPT does not copy and has been trained on millions of underlying works, it seems likely most output would be fair use—without using significant portions of any one protected work. In addition, because of the vast corpus of text used to train ChatGPT, it seems unlikely that ChatGPT output will have a negative economic impact on any one copyright holder. But, given the capabilities of ChatGPT, that might not always be the case.
Imagine if you asked ChatGPT to “Write a long-form, coming of age, story in the style of J.K. Rowling, using the characters from Harry Potter and the Chamber of Secrets.” In that case, it would seem that the argument for fair use would be weak. This story could be sold to the public and could conceivably have a negative economic impact on J.K. Rowling. A person that wants to read a story about Harry Potter might buy this story instead of buying a book by J. K. Rowling.
Finally, it is worth noting that OpenAI is a non-profit entity that is a “AI research and deployment company.” It seems that OpenAI is the type of research company, and ChatGPT is the type of research project, that would have a strong argument for fair use. This practice has been criticized as “AI Data Laundering,” shielding commercial entities from liability by using a non-profit research institution to create the data set and train AI engines that might later be used in commercial applications.
Outputs – Can the Output of ChatGPT be Protected by Copyright
Is the output of ChatGPT protected by copyright law and, if so, who is the owner? As an initial matter, does the ChatGPT textual output fit within the definition of what is covered under copyright law: “original works of authorship fixed in any tangible medium of expression.”
The text generated by ChatGPT is the type of subject matter that, if created by a human, would be covered by copyright. However, most scholars have opined, and the US Copyright Office has ruled that the output of generative AI systems, like ChatGPT, are not protectable under US copyright law because the work must be an original, creative work of a human author.
In 2022, the US Copyright Office, ruling on whether a picture generated completely autonomously by AI could be registered as a valid copyright, stated “[b]because copyright law as codified in the 1976 Act requires human authorship, the [AI Generated] Work cannot be registered.” The U.S. Copyright Office has issued several similar statements, informing creators that it will not register copyright for works produced by a machine or computer program. The human authorship requirement of the US Copyright Office is set forth as follows:
The Human Authorship Requirement – The U.S. Copyright Office will register an original work of authorship, provided that the work was created by a human being. The copyright law only protects “the fruits of intellectual labor” that “are founded in the creative powers of the mind.” Trade-Mark Cases, 100 U.S. 82, 94 (1879).
While such policies are not binding on the courts, the stance by the US Copyright Office seems to be in line with the purpose of copyright law flowing from the Constitution: to incentivize humans to produce creative works by giving them a monopoly over their creations for a limited period of time. Machines, of course, need and have no such motivation. In fact, copyright law expressly allows a corporation or other legal entity to be the owner of a copyright under the “work made for hire” doctrine. However, to qualify as a work made for hire, the work must be either work prepared by an employee within the scope of his or her employment, or be prepared by a party who “expressly agrees in a written instrument signed by them that the work shall be considered a work made for hire.” Only humans can be employees and only humans or corporations can enter a legally binding contract—machines cannot.
Other articles of note in this Open Access Scientific Journal on ChatGPT and Open AI Include:
Frank Wilkens Jr and Family Endowed Scholar in AD Research, MGH; Assistant Professor of Neurology, HMS
TYK2 as a novel therapeutic target in a subset of Alzheimer’s Disease with neuroinflammation
Predictive Biomarkers for ALS & AD
Genetic validation: TYK2 – NADALS Basket Trial
Yakeel Quiroz, PhD
Director, Familial Dementia Neuroimaging Lab and Director, Multicultural Alzheimer’s Prevention Program, MGH; Paul B. and Sandra M. Edgerley MGH Research Scholar; Associate Professor, HMS
Untangling the role of rare genetic variant in protection against Alzheimer’s disease: From biomarkers to novel therapeutic targets
· Unmet needs of AD
· Familial AD research: sporadic late onset +65
· COLBOS Extreme – Protection against Dementia
· Regulation of amyloid formation: Amyloid Beta aggregation & uptake
· Neuronal Tau – mutation on Reelin gene
· Bind to heparin
· Reduce Tau phosphorylation
Tanya Mayadas, PhD
Senior Staff Scientist, BWH; Professor of Pathology, HMS Targeting neutrophils for T cell-mediated anti-tumor immunotherapy
Targeting neutrophils for T cell-mediated anti-tumor immunotherapy
Dendritic cells lack robust anti-tumor
Neutrophil CD16B with Antigen to generate APCs
AAC increases T cells and neutral killer (NK) cell infiltration
AAC enhances anti PD-1 increases activation and accumulation of memory TSCM and TRM cells
Translation – AAC combination therapy
Synho Do, PhD
Director, Lab of Medical Imaging and Computation, Mass General Brigham; Assistant Professor, HMS
SafeAI: Live Error-free or Die
AI Classifier
AI algorithms effective errors – accountability for AI mistakes
Error-free in normal cases vs in all cases
Scalability and large-scale data throughput
Continuous Learning AI: Auto-label open DBs
Repurposing AI: from traditional AI to SafeAI
Tatjana Jakobs, MD
Associate Scientist, Schepens Eye Research Institute of Mass Eye and Ear; Associate Professor of Ophthalmology, HMS
Astrocyte-derived SPP1 prevents age and glaucoma-related loss of vision
Age and glaucoma
Mining astrocytes for neuroprotective factors
Spp1 is expressed in response to optic nerve damage – is neuroprotective
Overexpression of Spp1 via AAV2
Visual acuity in glaucoma
Retinal ganglion cells- Spp1 as a noval target
Russell Jenkins, MD, PhD
Investigator, Center for Cancer Research, MGH; Assistant Professor of Medicine, HMS
Evaluating Novel Cancer Therapeutic Strategies Using Living Tumor Biopsies
Matastatic cancer (melanoma) cured with immunotherapy
PD-1 and PDL-1 pathways – Solid tumors
Clinical Trial landscape is very complex
Combination therapy Trials – Human tumor immunity: Check inhibitors -pus antiPD-1 – functional precision cancer medicine
Testing across cancer types & stages
Deprioritized ineffective strategies
ROCHE leads the way
PDOTS tumor-immune interactions
Clotilde Lagier-Tourenne, MD, PhD
Araminta Broch-Healey Endowed Chair in ALS, MGH; Associate Professor of Neurology, HMS
Targeting disruption of stathmin-2 in neurodegenerative diseases
ALS and FTD (Frontaltemporal Dementia): Overlapping neurodegenerative diseases
TDP-43: an RNA binding protein in abnormal slpicing of stathmin-2 (STMN2)
STMN2 – neuromuscular junctions and axonal regeneration
Statin-mediated increase in STMN2 RNA with neurite extension– compound that restore STMN2 in neurodegenerative disease
Kerry Ressler, MD, PhD
Chief Scientific Officer, McLean Hospital; Professor of Psychiatry, HMS
Preventing post-traumatic stress disorder: Novel pharmacological approaches based on the neuroscience of fear
Two drugs for PTSD – no biomarkers known
Neuroscience – fear: amygdala biology of trauma
Memory of fear – Trauma consolidation: car crush
AURORA study
Amygdala reactivity 3 month and 12 month later – efficacy of NKB-expressing cells – antagonismachieve fear expression reduced
Predictive analytics to prevent sequela of PTSD
Atomwise – new compounds
Fabrisia Ambrosio, PhD
Atlantic Charter Director of the Discovery Center for Musculoskeletal Recovery, Schoen Adams Research Institute, Spaulding Rehabilitation Hospital; Faculty, HMS
Extracellular vesicle engineering to counteract age-related cognitive declines
Age and exercise have circulating rejuvenating effects
Lifespan: decline physical and cognitive
Extracellular Vesicles (EV): information exchange reprogram distal cells
EV cross the BBB: functional memory, circulatory contribution
CNS application to benefit from research on EV – evaluate cognitive outcomes
Molecules: Klotin effect in the aging brain
Molecular cargo: optimize cargo engineering, dosing study and Kinetics
Li Chai, MD
Pathologist and Principal Investigator, BWH; Associate Professor of Pathology, HMS
Novel mechanism and compound targeting oncogenic transcription factor SALL4 in cancer
Transcription factors SALL4 – a “fetal-oncoprotein” in the liver – is present in wild variety of tumors
SALL4 knockout mice are resistant to tumor formation
Mechanism: MYC and PTEN known to drive cancer formation
Liver cancer HCC: high incidence globally, high mortality, no effective therapy
SALL4 target viability: CP1, a non-IMiD (IP protected) small molecule SALL4 degrader reduceing tumor growth in vivo — >> apoptosis
Angela Shen, MD / Marcela Maus, MD, PhD
Original Presenter: Marcela Maus, MD, PhD Director, Cellular Immunotherapy, MGH; Associate Professor, HMS Video Presenter: Angela Shen, MD Vice President, Strategic Innovation Leaders, MGB Innovation
Novel CAR-T cells engineered to overcome obstacles observed in the clinic
CAR-T next generation genetically-modified (CAR) T in patients with cancer and other diseases
New targets – CD37 and CD70 – B & T cell lymphoma, AML
TACI/BCMA – multiple myeloma
Target multiple targets – CD79b/CD19 – B cell lymphoma
CRISPR – solid tumors, novel proof of concept POC
Allo and auto rejection – Cloaking
CAR-TEAM [T cell Engaging Antibody Molecule]
Ralph Mazitschek, PhD
Ralph Mazitschek, PhD Principal Investigator, MGH; Assistant Professor, HMS
Unlocking aminoacyl-tRNA-synthetases as novel drug targets for first-in-class therapeutics
Aminoacyl tRNA-Syntherases (aaRSs) as grug target after the biology is known
Human aaRSspoised for small moledule inhibitors
No drug no progress no interest
Current aaRS inhibitor discovery & development: high throughput screening & medicinal chemistry campaign
Human prolyl-tRNA synthease: NCP26 targets cancer cells by Inhibiting multiple myeloma growth in vitro and in vivo
In today’s fast-paced business world, effective visual communication is more important than ever. This is where Apple Vision Pro comes in, serving as the ultimate tool for enhancing visual communication in the workplace. With its innovative software solution, it revolutionizes the way businesses communicate by providing new and improved methods for creating, editing, and sharing visual content. Apple Vision Pro boasts a user-friendly interface and advanced features that have made it an indispensable asset for businesses seeking to streamline their visual communication processes and boost productivity. The software empowers businesses to generate professional-looking visuals that are easily shareable and foster collaboration, making it an invaluable tool for staying ahead in today’s competitive landscape.
Apple Vision Pro sets itself apart with cutting-edge features such as augmented reality and machine learning, enabling users to create immersive and informative content. Through this tool, businesses can effortlessly produce and distribute videos, presentations, and other visual materials, making it a must-have for business owners, marketers, and creative professionals alike.
The impact of Apple Vision Pro is transformative, revolutionizing how businesses communicate visually. With its advanced capabilities and intuitive interface, it empowers users to craft visually stunning content that not only captivates but also educates. The tool offers a diverse range of visual elements like charts, graphs, images, and videos, enabling the effective conveyance of complex information to audiences. Furthermore, Apple Vision Pro facilitates real-time collaboration, making it easier for teams to work together, generate content collectively, and share ideas seamlessly. These capabilities enable businesses to enhance their visual communication efforts and create more impactful content, ultimately driving them towards achieving their goals with greater efficiency and effectiveness.
Some of the potential applications of Apple Vision Pro:
Gaming: Vision Pro could be used for gaming by providing a more immersive experience.
Productivity: Vision Pro could be used for productivity applications by providing a more natural way to interact with computers.
Creative applications: Vision Pro could be used for creative applications by providing a more immersive way to create and edit content.
Education: Vision Pro could be used for education by providing a more immersive way to learn.
Training: Vision Pro could be used for training by providing a more immersive way to learn new skills.
Remote collaboration: Vision Pro could be used for remote collaboration by providing a more immersive way to work with others.
Optimism for Future Equality of Access to Healthcare in the Inaugural address as AMA President, Jesse M. Ehrenfeld, MD, MPH | AMA 2023 Annual Meeting of House of Delegates
In his inaugural address as AMA President, Jesse M. Ehrenfeld, MD, MPH, highlights the need for a more inclusive and equitable future in medicine. He shares personal experiences of discrimination and emphasizes the importance of advocacy, addressing health disparities, and fighting against disinformation to ensure equitable care for all patients.
The Use of ChatGPT in the World of BioInformatics and Cancer Research and Development of BioGPT by MIT
Curator: Stephen J. Williams, Ph.D.
Chatbots are being used in multiple interdisciplanary areas in research and medicine and so it was a natural progression to incorporate artificial intelligence (AI), natural language processing (NLP), and chatbot technology like ChatGPT into bioinformatic analysis.
“In domains like informatics, management and marketing, media and communication science, languages and philosophy, psychology and sociology, engineering, design, and human-computer interaction, the fast expanding body of chatbot study is clearly interdisciplinary.
The field of bioinformatics is a natural fit for incorporting this technology. The curated information below shows some use examples of this technology in bioinformatics related to cancer research.
How ChatGPT can be used in bioinformatics research?
ChatGPT is a variant of the GPT (Generative Pre-trained Transformer) language model that was designed to generate human-like text in a conversational setting. It is not directly related to bioinformatics, which is the field of study that deals with the storage, retrieval, and analysis of biological data, particularly in the context of genetics and genomics. However, ChatGPT could potentially be used in a bioinformatics context as a tool for generating natural language descriptions of genetic or genomic data, or for generating responses to queries about such data.
For example, a researcher could use ChatGPT to generate descriptions of genetic variants or gene expression patterns based on input data. This could be useful for generating summaries of results for reports or papers, or for generating explanations of complex concepts for non-expert audiences. ChatGPT could also be used to generate responses to queries about genetic or genomic data, such as “What is the function of gene X?” or “What are the potential consequences of variant Y?”
It’s worth noting that ChatGPT is just one of many tools and techniques that can be used in bioinformatics, and it is unlikely to be the most suitable or effective option in every situation. There are many specialized tools and resources available for working with biological data, and it is often necessary to use a combination of these tools to fully analyze and understand the data.
Generating descriptions of genetic or genomic data: ChatGPT could be used to generate natural language descriptions of genetic or genomic data based on input data. For example, suppose a researcher has a dataset containing information about gene expression levels in different tissues. The researcher could use ChatGPT to generate a description of the data, such as:
“Gene X is highly expressed in the liver and kidney, with moderate expression in the brain and heart. Gene Y, on the other hand, shows low expression in all tissues except for the lung, where it is highly expressed.”
Thereby ChatGPT, at its simplest level, could be used to ask general questions like “What is the function of gene product X?” and a ChatGPT could give a reasonable response without the scientist having to browse through even highly curated databases lie GeneCards or UniProt or GenBank. Or even “What are potential interactors of Gene X, validated by yeast two hybrid?” without even going to the curated InterActome databases or using expensive software like Genie.
Summarizing results: ChatGPT could be used to generate summaries of results from genetic or genomic studies. For example, a researcher might use ChatGPT to generate a summary of a study that found a association between a particular genetic variant and a particular disease. The summary might look something like this:
“Our study found that individuals with the variant form of gene X are more likely to develop disease Y. Further analysis revealed that this variant is associated with changes in gene expression that may contribute to the development of the disease.”
It’s worth noting that ChatGPT is just one tool that could potentially be used in these types of applications, and it is likely to be most effective when used in combination with other bioinformatics tools and resources. For example, a researcher might use ChatGPT to generate a summary of results, but would also need to use other tools to analyze the data and confirm the findings.
ChatGPT is a variant of the GPT (Generative Pre-training Transformer) language model that is designed for open-domain conversation. It is not specifically designed for generating descriptions of genetic variants or gene expression patterns, but it can potentially be used for this purpose if you provide it with a sufficient amount of relevant training data and fine-tune it appropriately.
To use ChatGPT to generate descriptions of genetic variants or gene expression patterns, you would first need to obtain a large dataset of examples of descriptions of genetic variants or gene expression patterns. You could use this dataset to fine-tune the ChatGPT model on the task of generating descriptions of genetic variants or gene expression patterns.
Here’s an example of how you might use ChatGPT to generate a description of a genetic variant:
First, you would need to pre-process your dataset of descriptions of genetic variants to prepare it for use with ChatGPT. This might involve splitting the descriptions into individual sentences or phrases, and encoding them using a suitable natural language processing (NLP) library or tool.
Next, you would need to fine-tune the ChatGPT model on the task of generating descriptions of genetic variants. This could involve using a tool like Hugging Face’s Transformers library to load the ChatGPT model and your pre-processed dataset, and then training the model on the task of generating descriptions of genetic variants using an appropriate optimization algorithm.
Once the model has been fine-tuned, you can use it to generate descriptions of genetic variants by providing it with a prompt or seed text and asking it to generate a response. For example, you might provide the model with the prompt “Generate a description of a genetic variant associated with increased risk of breast cancer,” and ask it to generate a response. The model should then generate a description of a genetic variant that is associated with increased risk of breast cancer.
It’s worth noting that generating high-quality descriptions of genetic variants or gene expression patterns is a challenging task, and it may be difficult to achieve good results using a language model like ChatGPT without a large amount of relevant training data and careful fine-tuning.
To train a language model like chatGPT to extract information about specific genes or diseases from research papers, you would need to follow these steps:
Gather a large dataset of research papers that contain information about the specific genes or diseases you are interested in. This dataset should be diverse and representative of the types of papers you want the model to be able to extract information from.
Preprocess the text data in the research papers by tokenizing the text and creating a vocabulary. You may also want to consider lemmatizing or stemming the text to reduce the dimensionality of the dataset.
Train the language model on the preprocessed text data. You may want to fine-tune a pre-trained model such as chatGPT on your specific dataset, or you can train a new model from scratch.
ChatGPT could also be useful for sequence analysis
A few examples of sequence analysis a ChatGPT could be useful include:
Protein structure
Identifying functional regions of a protein
Predicting protein-protein interactions
Identifying protein homologs
Generating Protein alignments
All this could be done without having access to UNIX servers or proprietary software or knowing GCG coding
ChatGPT in biomedical research
There are several potential ways that ChatGPT or other natural language processing (NLP) models could be applied in biomedical research:
Text summarization: ChatGPT or other NLP models could be used to summarize large amounts of text, such as research papers or clinical notes, in order to extract key information and insights more quickly.
Data extraction: ChatGPT or other NLP models could be used to extract structured data from unstructured text sources, such as research papers or clinical notes. For example, the model could be trained to extract information about specific genes or diseases from research papers, and then used to create a database of this information for further analysis.
Literature review: ChatGPT or other NLP models could be used to assist with literature review tasks, such as identifying relevant papers, extracting key information from papers, or summarizing the main findings of a group of papers.
Predictive modeling: ChatGPT or other NLP models could be used to build predictive models based on large amounts of text data, such as electronic health records or research papers. For example, the model could be trained to predict the likelihood of a patient developing a particular disease based on their medical history and other factors.
It’s worth noting that while NLP models like ChatGPT have the potential to be useful tools in biomedical research, they are only as good as the data they are trained on, and it is important to carefully evaluate the quality and reliability of any results generated by these models.
ChatGPT in text mining of biomedical data
ChatGPT could potentially be used for text mining in the biomedical field in a number of ways. Here are a few examples:
Extracting information from scientific papers: ChatGPT could be trained on a large dataset of scientific papers in the biomedical field, and then used to extract specific pieces of information from these papers, such as the names of compounds, their structures, and their potential uses.
Generating summaries of scientific papers: ChatGPT could be used to generate concise summaries of scientific papers in the biomedical field, highlighting the main findings and implications of the research.
Identifying trends and patterns in scientific literature: ChatGPT could be used to analyze large datasets of scientific papers in the biomedical field and identify trends and patterns in the data, such as emerging areas of research or common themes among different papers.
Generating questions for further research: ChatGPT could be used to suggest questions for further research in the biomedical field based on existing scientific literature, by identifying gaps in current knowledge or areas where further investigation is needed.
Generating hypotheses for scientific experiments: ChatGPT could be used to generate hypotheses for scientific experiments in the biomedical field based on existing scientific literature and data, by identifying potential relationships or associations that could be tested in future research.
PLEASE WATCH VIDEO
In this video, a bioinformatician describes the ways he uses ChatGPT to increase his productivity in writing bioinformatic code and conducting bioinformatic analyses.
He describes a series of uses of ChatGPT in his day to day work as a bioinformatian:
Using ChatGPT as a search engine: He finds more useful and relevant search results than a standard Google or Yahoo search. This saves time as one does not have to pour through multiple pages to find information. However, a caveat is ChatGPT does NOT return sources, as highlighted in previous postings on this page. This feature of ChatGPT is probably why Microsoft bought OpenAI in order to incorporate ChatGPT in their Bing search engine, as well as Office Suite programs
ChatGPT to help with coding projects: Bioinformaticians will spend multiple hours searching for and altering open access available code in order to run certain function like determining the G/C content of DNA (although there are many UNIX based code that has already been established for these purposes). One can use ChatGPT to find such a code and then assist in debugging that code for any flaws
ChatGPT to document and add coding comments: When writing code it is useful to add comments periodically to assist other users to determine how the code works and also how the program flow works as well, including returned variables.
One of the comments was interesting and directed one to use BIOGPT instead of ChatGPT
0:54 oh dear. You cannot use chatgpt like that in Bioinformatics as it is rn without double checking the info from it. You should be using biogpt instead for paper summarisation. ChatGPT goes for human-like responses over precise information recal. It is quite good for debugging though and automating boring awkward scripts
The BioGPT model was proposed in BioGPT: generative pre-trained transformer for biomedical text generation and mining by Renqian Luo, Liai Sun, Yingce Xia, Tao Qin, Sheng Zhang, Hoifung Poon and Tie-Yan Liu. BioGPT is a domain-specific generative pre-trained Transformer language model for biomedical text generation and mining. BioGPT follows the Transformer language model backbone, and is pre-trained on 15M PubMed abstracts from scratch.
The abstract from the paper is the following:
Pre-trained language models have attracted increasing attention in the biomedical domain, inspired by their great success in the general natural language domain. Among the two main branches of pre-trained language models in the general language domain, i.e. BERT (and its variants) and GPT (and its variants), the first one has been extensively studied in the biomedical domain, such as BioBERT and PubMedBERT. While they have achieved great success on a variety of discriminative downstream biomedical tasks, the lack of generation ability constrains their application scope. In this paper, we propose BioGPT, a domain-specific generative Transformer language model pre-trained on large-scale biomedical literature. We evaluate BioGPT on six biomedical natural language processing tasks and demonstrate that our model outperforms previous models on most tasks. Especially, we get 44.98%, 38.42% and 40.76% F1 score on BC5CDR, KD-DTI and DDI end-to-end relation extraction tasks, respectively, and 78.2% accuracy on PubMedQA, creating a new record. Our case study on text generation further demonstrates the advantage of BioGPT on biomedical literature to generate fluent descriptions for biomedical terms.
Tips:
BioGPT is a model with absolute position embeddings so it’s usually advised to pad the inputs on the right rather than the left.
BioGPT was trained with a causal language modeling (CLM) objective and is therefore powerful at predicting the next token in a sequence. Leveraging this feature allows BioGPT to generate syntactically coherent text as it can be observed in the run_generation.py example script.
The model can take the past_key_values (for PyTorch) as input, which is the previously computed key/value attention pairs. Using this (past_key_values or past) value prevents the model from re-computing pre-computed values in the context of text generation. For PyTorch, see past_key_values argument of the BioGptForCausalLM.forward() method for more information on its usage.
This model was contributed by kamalkraj. The original code can be found here.
BioGPT is MIT-licensed. The license applies to the pre-trained models as well.
Contributing
This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.opensource.microsoft.com.
When you submit a pull request, a CLA bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., status check, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.
As of right now this does not seem Open Access, however a sign up is required!
We provide our pre-trained BioGPT model checkpoints along with fine-tuned checkpoints for downstream tasks, available both through URL download as well as through the Hugging Face 🤗 Hub.
Luo R, Sun L, Xia Y, Qin T, Zhang S, Poon H, Liu TY.Brief Bioinform. 2022 Nov 19;23(6):bbac409. doi: 10.1093/bib/bbac409.PMID: 36156661
We evaluate BioGPT on six biomedical natural language processing tasks and demonstrate that our model outperforms previous models on most tasks. …Our case study on text generation further demonstrates the advantage of BioGPT on biomedical literature to generate fl …
Here they show the advantages of BioGPT over BioBERT and ChatGPT in an example of text extraction and question answer
Table 7. Example of generated text
Input Model Text
Bicalutamide GPT-2 Bicalutamide, a synthetic bicalutamide derivative, was found to increase the cellular proliferation
of C. elegans cells. This effect was not observed with the other synthetic bicalutamide derivatives. This is in line with our previous work which showed that bicalutamide increases the proliferation of C. elegans cells but not in the presence of synthetic bicalutamide.
BioGPT Bicalutamide (Casodex) is an androgen receptor (AR) antagonist approved for the treatment of metastatic castration-resistant prostate cancer (mCRPC) in patients who have progressed on or are ineligible for docetaxel chemotherapy, as well as for the treatment of early-stage prostate cancer in men who have not progressed on or are ineligible for docetaxel chemotherapy, as well as for the treatment of metastatic castration-sensitive prostate cancer (mCSPC) in men who have not progressed on or are ineligible for docetaxel chemotherapy.
Janus kinase 3 (JAK-3) GPT-2 Janus kinase 3 (JAK-3) mediates the conversion of glucose to glycogen in skeletal muscle. The
increase in glucose uptake by skeletal muscle is believed to be associated with a reduction in muscle protein breakdown and with the release of ketone bodies, which contribute to the metabolism of glucose.
BioGPT Janus kinase 3 (JAK-3) is a member of the Janus kinase (JAK) family of non-receptor tyrosine kinases and plays an important role in the regulation of cell proliferation, differentiation, survival, migration and angiogenesis.
Apricitabine GPT-2 Apricitabine, duloxetine and citalopram) were investigated in patients with a history of
treatment-resistant depression (n = 10). We found that treatment with the three drugs significantly decreased depressive symptoms, but not depressive symptoms over the next 12 weeks. We conclude that antidepressant drugs that reduce depressive symptoms and reduce depressive symptoms over time may be beneficial in patients with recurrent depression.
BioGPT Apricitabine is an oral prodrug of 5-aza-2 ’-deoxycytidine (5-aza-CdR), a DNA methyltransferase (DNMT) inhibitor, which has been approved by the US Food and Drug Administration (FDA) for the treatment of myelodysplastic syndrome (MDS) and acute myeloid leukemia (AML) in combination with low-dose cytarabine (Ara-C) and granulocyte colony-stimulating factor (G-CSF) for patients with intermediate-2 or high-risk MDS or AML.
Xylazine GPT-2 Xylazine, the ‘active ingredient’ in ‘bath salts’ (see above) has been linked to numerous deaths,
including those of former University of California, Berkeley, professor Andrew Anglin, who posted
a video of himself having a bath filled with it.
BioGPT Xylazine is an alpha 2-adrenoceptor agonist which has been used as a sedative and analgesic in veterinary medicine for many years, but its effects on the cardiovascular system have not been extensively studied in the dog, and its effects on the central nervous system (CNS) have not been well characterized in the dog, despite the fact that xylazine has been widely used as a sedative and analgesic in veterinary medicine for more than 30 years.
Psoralen GPT-2 Psoralen, the city of the spiritualist, and had been given to him by God, who wished to show him
the way of salvation, and to draw him back to the true life of Christ, and to bring him into communion with his fellow-man.
BioGPT Psoralen photochemotherapy (PUVA) is a well-established treatment for psoriasis, but its use is limited by the risk of skin cancer, particularly squamous cell carcinoma (SCC) of the head and neck (H & N), which is the most common site of skin cancer in the United States (US)
CP-673451 GPT-2 CP-673451) and 4-5-6-3-1-2-3-4-6-7-8-9-10-11-12-13-14-15-16-17-18-19-20-21-22-23-24-25-26-27-
BioGPT CP-673451 is a potent, selective, and orally active inhibitor of human neutrophil elastase (HNE) and human cathepsin G (CatG) with in vitro and in vivo anti-inflammatory activity in a variety of animal models of inflammation and in a model of acute lung injury (ALI) in the rat induced by intratracheal instillation of lipopolysaccharide (LPS) and tumor necrosis factor-alpha (TNF-alpha), a model of acute lung injury (ALI) in which neutrophils play an important role.
BIIB-021 GPT-2 BIIB-021A-2-1.pdf. Wright, C. (2002). ‘The War on Terror: A Legal Theory of Terrorist Attacks,’ in
L.E.R. Wright, S.R. Warrick and J.H. Rothman (Eds.), The War on Terror: Essays in Honor of Michael T. Klare (New York: Oxford University Press), 143-57.
BioGPT BIIB-021 is a novel, orally active, non-peptide bradykinin B2 receptor antagonist with potent and long-lasting anti-inflammatory activity in animal models of acute and chronic inflammation and in a rat model of adjuvant-induced arthritis (AIA), an animal model of rheumatoid arthritis (RA) and in a rat model of collagen-induced arthritis (CIA), an animal model of collagen-induced arthritis (CIA), in which arthritis is induced by immunization with bovine type II collagen (CII).
Huang L, Lin J, Li X, Song L, Zheng Z, Wong KC.Brief Bioinform. 2022 Jan 17;23(1):bbab451. doi: 10.1093/bib/bbab451.PMID: 34791012
The rapid growth in literature accumulates diverse and yet comprehensive biomedical knowledge hidden to be mined such as drug interactions. However, it is difficult to extract the heterogeneous knowledge to retrieve or even discover the latest and novel knowledge in an efficient manner. To address such a problem, we propose EGFI for extracting and consolidating drug interactions from large-scale medical literature text data. Specifically, EGFI consists of two parts: classification and generation. In the classification part, EGFI encompasses the language model BioBERT which has been comprehensively pretrained on biomedical corpus. In particular, we propose the multihead self-attention mechanism and packed BiGRU to fuse multiple semantic information for rigorous context modeling. In the generation part, EGFI utilizes another pretrained language model BioGPT-2 where the generation sentences are selected based on filtering rules.
Results: We evaluated the classification part on ‘DDIs 2013’ dataset and ‘DTIs’ dataset, achieving the F1 scores of 0.842 and 0.720 respectively. Moreover, we applied the classification part to distinguish high-quality generated sentences and verified with the existing growth truth to confirm the filtered sentences. The generated sentences that are not recorded in DrugBank and DDIs 2013 dataset demonstrated the potential of EGFI to identify novel drug relationships.
Jin Q, Yang Y, Chen Q, Lu Z.ArXiv. 2023 May 16:arXiv:2304.09667v3. Preprint.PMID: 37131884 Free PMC article.
While large language models (LLMs) have been successfully applied to various tasks, they still face challenges with hallucinations. Augmenting LLMs with domain-specific tools such as database utilities can facilitate easier and more precise access to specialized knowledge. In this paper, we present GeneGPT, a novel method for teaching LLMs to use the Web APIs of the National Center for Biotechnology Information (NCBI) for answering genomics questions. Specifically, we prompt Codex to solve the GeneTuring tests with NCBI Web APIs by in-context learning and an augmented decoding algorithm that can detect and execute API calls. Experimental results show that GeneGPT achieves state-of-the-art performance on eight tasks in the GeneTuring benchmark with an average score of 0.83, largely surpassing retrieval-augmented LLMs such as the new Bing (0.44), biomedical LLMs such as BioMedLM (0.08) and BioGPT (0.04), as well as GPT-3 (0.16) and ChatGPT (0.12). Our further analyses suggest that: (1) API demonstrations have good cross-task generalizability and are more useful than documentations for in-context learning; (2) GeneGPT can generalize to longer chains of API calls and answer multi-hop questions in GeneHop, a novel dataset introduced in this work; (3) Different types of errors are enriched in different tasks, providing valuable insights for future improvements.
PLEASE WATCH THE FOLLOWING VIDEOS ON BIOGPT
This one entitled
Microsoft’s BioGPT Shows Promise as the Best Biomedical NLP
gives a good general description of this new MIT/Microsoft project and its usefullness in scanning 15 million articles on PubMed while returning ChatGPT like answers.
Please note one of the comments which is VERY IMPORTANT
bioGPT is difficult for non-developers to use, and Microsoft researchers seem to default that all users are proficient in Python and ML.
Much like Microsoft Azure it seems this BioGPT is meant for developers who have advanced programming skill. Seems odd then to be paying programmers multiK salaries when one or two Key Opinion Leaders from the medical field might suffice but I would be sure Microsoft will figure this out.
ALSO VIEW VIDEO
This is a talk from Microsoft on BioGPT
Other Relevant Articles on Natural Language Processing in BioInformatics, Healthcare and ChatGPT for Medicine on this Open Access Scientific Journal Include
Health Care Policy Analysis derived from the Farewell remarks from AMA President Jack Resneck Jr., MD | AMA 2023 Annual Meeting
Curators: Aviva Lev-Ari, PhD, RN, Stephen J. Williams, PhD and Prof. Marcus W. Feldman
Article ID #301: Health Care Policy Analysis derived from the Farewell remarks from AMA President Jack Resneck Jr., MD | AMA 2023 Annual Meeting. Published on 6/10/23
WordCloud Image Produced by Adam Tubman
Bot Name: ChatGPT, GPT-4
Date of Update: 07/03/2023 Programmer’s Name: Frason K. Human Verifier: Aviva Lev-Ari & Dr. Stephen J. Williams
On June 10, 2023, I watched the video, below which represents the delivery of the Farewell remarks from AMA by the AMA President, Jack Resneck Jr., MD at the AMA 2023 Annual Meeting on 6/10/2023.
Upon completion of watching this video, I concluded that I should include it as an embedded video in this article as a new Audio Podcast in our Library of 300 “Interviews with Scientific Leaders” same title of a research category in the ontology of LPBI Group’s PharmaceuticalIntelligence.com Journal.
The context for the decision made in favor of embedding the video of AMA President, Jack Resneck Jr., MD, Farewell remarks from AMA at the AMA 2023 Annual Meeting on 6/10/2023 is one of Policy Analysis of the Health Care system in the US in 2023.
Aligned with this decision was to qualify Dr. Resneck Jr, MD speech to be an equivalent to an “Interview with a Scientific Leader in the domain of Health Policy” to be included in LPBI Group’s Library of 300 audio podcast Interviews planned to be published in July 2023.
Key points made by Dr. Resneck Jr, MD in the video
growing number of states and courts forcing themselves into the most intimate and difficult conversations patients and physicians
The challenges facing the medical profession and delivery of care by Providers:
A dysfunctional health care environment, and
The climate of anti-science aggression
In his own words: Dr. Resneck Jr, MD
We need to fix what’s broken in health care, and it’s NOT the doctor.
The Wisconsin Supreme Court agreed with us that patients and judges can’t force physicians to administer substandard care.
Courts have invalidated parts of No Surprises Act rules that plainly ignored Congressional intent and put a thumb on the scale to favor insurance companies… thank you Texas Medical Association and AMA!
The 5th Circuit Court is staying- for now – an egregious ruling that would have stripped patients of the right to access preventive care service with no out-of-pocket costs, a key piece of the Affordable Care Act.
The U.S. Supreme Court is delaying attempts by a single district judge with no scientific or medical training to take mifepristone off the market nationally and upend our entire FDA drug regulatory process.
We’ve helped shift the national conversation about protecting patient data and making sure digital health and AI tools are proven BEFORE being deployed.
We’ve broadened and intensified our work to embed equity and racial justice, and to push upstream to affect structural and social drivers of health inequities.
The AMA doesn’t win every battle. But we are more resolute in our work because of the threats to our profession and our patients.
I’m still appalled by the Medicare cuts. What on earth was Congress thinking? Practices are on the brink. Our workforce is at risk. Access to care stands in the balance
Physician burnout
One in five physicians plans to leave their practice within two years, while one in three is reducing hours.
Only 57 percent of doctors today would choose medicine again if they were just starting their careers.
two in five physicians go beyond mere daydreams of another career to wishing they had never chosen this path in the first place
And shame on political leaders, fueling fear and sowing division by making enemies of public health officials, of transgender adolescents, of physicians doing anti-racism work, and of women making personal decisions about their pregnancies.
The burnout and the moral injury are real … I’ve felt it myself. I hear this concern in the voices of medical students, residents, and even young physicians when they ask me … “Am I going to be okay?” “Have I made the right career choice?”
Medicare payment reform for “a dilapidated Medicare payment system”
fighting for long overdue fixes to a broken Medicare payment system, and obnoxious prior auth abuses, even when policymakers have neglected the problems for decades.
We absolutely must tie future Medicare payments to inflation, and we’re readying a major national campaign to finally achieve Congressional action.
Linking physician payment to inflation is an absolute top priority, an existential must to keep practices afloat, and pillar #1 of our plan. An important step on that path was the recent introduction of a bipartisan bill to finally align the Medicare fee schedule with MEI.
key role in legislation to extend Medicare Telehealth coverage.
State after state is making progress to constrain prior authorization, and CMS issued rules to do the same in Medicare Advantage plans.
Medicaid work requirements that conflict with AMA policy were kept out of the debt ceiling bill.
Scope of practice expansions
In partnership with states and specialties, our advocacy has helped protect patients from outrageous and broad scope expansions more than 50 times so far this year.
defending against broad scope expansions that put patients at risk, even when it requires gearing up again and again, in state after state.
When politicians force their way into our exam rooms Interfering with the sacred patient-doctor relationship is about CONTROL. : battling in state legislatures and courthouses for the very soul of our nation and our profession – to protect patients from those outside influences wanting to dictate the terms of their care … …telling them what medical treatments their physicians can provide … …what FDA-approved medicines we can prescribe…. …even what words we can use …
I loved traveling to Mississippi and witnessing their progress from startling COVID inequities to achieving one of the nation’s top vaccination rates among Black residents.
And we have been instrumental in helping create confidential wellness programs for physicians and removing outdated questions from past impairment from licensing and credentialing forms.
Gun Violence Victims – Preventable and needless homicides and suicides continue, and the political inaction is atrocious.
But solid majorities of Americans believe in commonsense gun reforms in line with our AMA recommendations.
You wouldn’t know it from 20 state legislatures racing to criminalize abortion and rob women of access to reproductive health care… But most people in this country support our policies and the fundamental rights of patients to make their own decisions about their health.
>> Insurance impact on delivery of care by providers
m health insurers still bullying us with prior auth delays and denying care …
We’ve joined others in suing Cigna for shortchanging doctors and patients.
The Voice of Dr. Stephen J. Williams
The outgoing president of the AMA, Dr. Jack Resneck, gives an impassioned speech about his concerns for the present and future of medicine, his profession, and the issues which will face future physicians, and all involved in healthcare. These issues have been building up for decades now in the U.S. and his remarks hopefully will be taken more to heart by those who can enact change, instead of wafting in the ongoing partisan debates in Washington. He eventually outlines the actions which could be taken but ultimately laments the inaction of many parties involved, including business, the political class, and his own physician profession. Dr. Resneck rightly states that the AMA must carry the burden of equitable and sustainable healthcare into the future and must continue the fight in this regard. He likens this fight for equitable and sustainable medicine like a marathon, where there is no defined end, no finish tape for medical professionals except to persevere in their task.
However, there are more extraneous issues to the profession where the physician has to
get back up, shake the dust off, and keep running
He notes some of the problems occurring not in direct control of the profession are
the constant onslaught and tiresome battle against disinformation
large insurers
a political class that has jeapardized the physician/patient relationship with either their action and inaction
the financial burdens placed on the small physician practice of rising third party “inflators” like higher rents, increased drug prices, higher operating costs
These laments have been felt by many parallel professions where the standards and practice to the profession have been subjugated and hijacked by other outside interests (middle men). And when the ultimate decisions of conduct are not governed by the constituents or stakeholders of the profession but by a cadre of business people, profiteers or social engineers problems like this result. As such, Dr. Resneck sees the draconian Medicare cuts as such an onslaught. This has been voiced in an earlier posting describing how these problems have crept in the biomedicine and biotech field as well as in medical care in Can the Public Benefit Company Structure Save US Healthcare?
One must consider then, as Dr. Resneck had, is it time to reinvent the healthcare structure in this country to allow more equitable, sustainable delivery of healthcare and to stave off a potential crisis in the number of physicians staying in the profession? As such he had suggested the AMA move forward with their “revival plan” in order to force legislation to reform Medicare as well as individual regulatory reform. To date there has been some success by the AMA to this effect, but as he eluded to, these efforts have been rather piecemeal instead of an overall reform.
The Voice of Aviva Lev-Ari, PhD, RN
Gun Violence, all should not have to happen and burden the care delivery system designed to deal with chronic and acute diagnoses.
As Supervisor of a Long Term Acute Hospital in Waltham, MA in 2010:
I became familiar with care plans of patients victims of gun violence and the life long disabilities cause by ONE gun shot to the brain or to the spine. Accidents that are preventable and needless.
I found Dr. Resneck’s address to be a call for continuation of a long term fight the AMA is involved in, with all the constituents of the Medical profession. They are very many and very powerful:
Big Pharma,
FDA,
State and Federal legislators,
HMOs,
Health Insurers,
For-profit, and
not-for-profit institutions
all having interests that are private and public and often conflicting ones, chiefly are the following:
Gun reforms made impossible by The National Rifle Association (NRA)’s supporters linking the defense to bear arms with the Constitution
20 state legislatures racing to criminalize abortion and rob women of access to reproductive health care…
Drug pricing and Insurance denying coverage
Need for redesign of the Curriculum of in Medical School to include the rapid change in technology, medical devices, knowledge base in life sciences and more
Dr Resneck’s talk has three components: two are rather pessimistic and concern Medicine as a profession and Health-care as a goal of medicine. The positive part, which was quite brief, concerned the continuing work of the AMA in its advocacy for better conditions for physicians and for a more equitable distribution of health care.
Medicine as a part of science continues to be assailed by anti-science political groups. 57% of doctors surveyed said they would not choose Medicine as a profession if given the chance to relive their lives. Part of this is the failure of Medicare and other insurance mechanisms to properly compensate physicians. Part is due to attacks on the profession by anti-science anti education social media and state legislatures. Whereas Medicine was once the profession of choice for the best students, universities are seeing the premed majors overtaken by computer-related fields. Dr. Resneck also referred to the importance of maintaining high standards of medical ethics, which is increasingly difficult in today’s political and economic climate.
With respect to the specifics of health care, Dr. Resneck stressed the attack on the medical professions by laws and regulations that outlaw people rights to their own bodies, manifest in anti-abortion and anti-gender affirming procedures, anti-education book banning, political opposition to measures, supported by the majority of Americans, that would reduce gun violence, and the difficulty of achieving improvements in government procedures for reimbursement of health care services. The AMA is involved in trying to elicit medically sound decisions on these.
Dr Resneck was positive, if not very optimistic about the AMA’s important role in advocacy for reform of Medicare and the Health-Care system, reform that is essential for the sustainability of Medicine as a profession.
We recommend AMA to add to their Library resources from LPBI Group:
Chapter 13: Valve Replacement, Valve Implantation and Valve Repair
13.2 Aortic Valve
13.2.1 New method for performing Aortic Valve Replacement: Transmural catheter procedure developed at NIH, Minimally-invasive tissue-crossing – Transcaval access, abdominal aorta and the inferior vena cava
13.2.4 Surgical Aortic Valve Replacement (SAVR) vs Transcatheter Aortic Valve Implantation (TAVI): Results Comparison for Prosthesis-Patient Mismatch (PPM) – adjusted outcomes, including mortality, heart failure (HF) rehospitalization, stroke, and quality of life, at 1 year
13.2.6 Off-Label TAVR Procedures: 1 in 10 associated with higher in-hospital 30-day mortality, 1-year mortality was similar in the Off-Label and the On-Label groups
13.2.11 One year Post-Intervention Mortality Rate: TAVR and AVR – Aortic Valve Procedures 6.7% in AVR, 11.0% in AVR with CABG, 20.7 in Transvascular (TV-TAVR) and 28.0% in Transapical (TA-TAVR) Patients
13.2.16 The Centers for Medicare & Medicaid Services (CMS) covers transcatheter aortic valve replacement (TAVR) under Coverage with Evidence Development (CED)
Reporter: Frason Francis Kalapurakal, Research Assistant II
Researchers from MIT and Technion have made a significant contribution to the field of machine learning by developing an adaptive algorithm that addresses the challenge of determining when a machine should follow a teacher’s instructions or explore on its own. The algorithm autonomously decides whether to use imitation learning, which involves mimicking the behavior of a skilled teacher, or reinforcement learning, which relies on trial and error to learn from the environment.
The researchers’ key innovation lies in the algorithm’s adaptability and ability to determine the most effective learning method throughout the training process. To achieve this, they trained two “students” with different learning approaches: one using a combination of reinforcement and imitation learning, and the other relying solely on reinforcement learning. The algorithm continuously compared the performance of these two students, adjusting the emphasis on imitation or reinforcement learning based on which student achieved better results.
The algorithm’s efficacy was tested through simulated training scenarios, such as navigating mazes or reorienting objects with touch sensors. In all cases, the algorithm demonstrated superior performance compared to non-adaptive methods, achieving nearly perfect success rates and significantly outperforming other methods in terms of both accuracy and speed. This adaptability could enhance the training of machines in real-world situations where uncertainty is prevalent, such as robots navigating unfamiliar buildings or performing complex tasks involving object manipulation and locomotion.
Furthermore, the algorithm’s potential applications extend beyond robotics to various domains where imitation or reinforcement learning is employed. For example, large language models like GPT-4 could be used as teachers to train smaller models to excel in specific tasks. The researchers also suggest that analyzing the similarities and differences between machines and humans learning from their respective teachers could provide valuable insights for improving the learning experience.The MIT and Technion researchers’ algorithm stands out due to its principled approach, efficiency, and versatility across different domains. Unlike existing methods that require brute-force trial-and-error or manual tuning of parameters, their algorithm dynamically adjusts the balance between imitation and trial-and-error learning based on performance comparisons. This robustness, adaptability, and promising results make it a noteworthy advancement in the field of machine learning.
References:
“TGRL: TEACHER GUIDED REINFORCEMENT LEARNING ALGORITHM FOR POMDPS” Reincarnating Reinforcement Learning Workshop at ICLR 2023 https://openreview.net/pdf?id=kTqjkIvjj7
Concrete Problems in AI Safety by Dario Amodei, Chris Olah, Jacob Steinhardt, Paul Christiano, John Schulman, Dan Mané https://arxiv.org/abs/1606.06565
Other related articles published in this Open Access Online Scientific Journal include the following:
92 articles in the Category:
‘Artificial Intelligence – Breakthroughs in Theories and Technologies’