Funding, Deals & Partnerships: BIOLOGICS & MEDICAL DEVICES; BioMed e-Series; Medicine and Life Sciences Scientific Journal – http://PharmaceuticalIntelligence.com
In this article, I will list 9 free Harvard courses that you can take to learn data science from scratch. Feel free to skip any of these courses if you already possess knowledge of that subject.
Step 1: Programming
The first step you should take when learning data science is to learn to code. You can choose to do this with your choice of programming language?—?ideally Python or R.
If you’d like to learn R, Harvard offers an introductory R course created specifically for data science learners, called Data Science: R Basics.
This program will take you through R concepts like variables, data types, vector arithmetic, and indexing. You will also learn to wrangle data with libraries like dplyr and create plots to visualize data.
If you prefer Python, you can choose to take CS50’s Introduction to Programming with Python offered for free by Harvard. In this course, you will learn concepts like functions, arguments, variables, data types, conditional statements, loops, objects, methods, and more.
Both programs above are self-paced. However, the Python course is more detailed than the R program, and requires a longer time commitment to complete. Also, the rest of the courses in this roadmap are taught in R, so it might be worth learning R to be able to follow along easily.
Step 2: Data Visualization
Visualization is one of the most powerful techniques with which you can translate your findings in data to another person.
With Harvard’s Data Visualization program, you will learn to build visualizations using the ggplot2 library in R, along with the principles of communicating data-driven insights.
Step 3: Probability
In this course, you will learn essential probability concepts that are fundamental to conducting statistical tests on data. The topics taught include random variables, independence, Monte Carlo simulations, expected values, standard errors, and the Central Limit Theorem.
The concepts above will be introduced with the help of a case study, which means that you will be able to apply everything you learned to an actual real-world dataset.
Step 4: Statistics
After learning probability, you can take this course to learn the fundamentals of statistical inference and modelling.
This program will teach you to define population estimates and margin of errors, introduce you to Bayesian statistics, and provide you with the fundamentals of predictive modeling.
Step 5: Productivity Tools (Optional)
I’ve included this project management course as optional since it isn’t directly related to learning data science. Rather, you will be taught to use Unix/Linux for file management, Github, version control, and creating reports in R.
The ability to do the above will save you a lot of time and help you better manage end-to-end data science projects.
Step 6: Data Pre-Processing
The next course in this list is called Data Wrangling, and will teach you to prepare data and convert it into a format that is easily digestible by machine learning models.
You will learn to import data into R, tidy data, process string data, parse HTML, work with date-time objects, and mine text.
As a data scientist, you often need to extract data that is publicly available on the Internet in the form of a PDF document, HTML webpage, or a Tweet. You will not always be presented with clean, formatted data in a CSV file or Excel sheet.
By the end of this course, you will learn to wrangle and clean data to come up with critical insights from it.
Step 7: Linear Regression
Linear regression is a machine learning technique that is used to model a linear relationship between two or more variables. It can also be used to identify and adjust the effect of confounding variables.
This course will teach you the theory behind linear regression models, how to examine the relationship between two variables, and how confounding variables can be detected and removed before building a machine learning algorithm.
Step 8: Machine Learning
Finally, the course you’ve probably been waiting for! Harvard’s machine learning program will teach you the basics of machine learning, techniques to mitigate overfitting, supervised and unsupervised modelling approaches, and recommendation systems.
Step 9: Capstone Project
After completing all the above courses, you can take Harvard’s data science capstone project, where your skills in data visualization, probability, statistics, data wrangling, data organization, regression, and machine learning will be assessed.
With this final project, you will get the opportunity to put together all the knowledge learnt from the above courses and gain the ability to complete a hands-on data science project from scratch.
Note: All the courses above are available on an online learning platform from edX and can be audited for free. If you want a course certificate, however, you will have to pay for one.
Data powers AI. Good data can mean the difference between an impactful solution or one that never gets off the ground. Re-assess the foundational AI questions to ensure your data is working for, not against, you.
Innovation to Reality
The challenges of implementing AI are many. Avoid the common pitfalls with real-world case studies from leaders who have successfully turned their AI solutions into reality.
Harness What’s Possible at the Edge
With its potential for near instantaneous decision making, pioneers are moving AI to the edge. We examine the pros and cons of moving AI decisions to the edge, with the experts getting it right.
Generative AI Solutions
The use of generative AI to boost human creativity is breaking boundaries in creative areas previously untouched by AI. We explore the intersection of data and algorithms enabling collaborative AI processes to design and create.
Data powers AI. Good data can mean the difference between an impactful solution or one that never gets off the ground. Re-assess the foundational AI questions to ensure your data is working for, not against, you.
Data is the most under-valued and de-glamorized aspect of AI. Learn why shifting the focus from model/algorithm development to quality of the data is the next and most efficient, way to improve the decision-making abilities of AI.
Data labeling is key to determining the success or failure of AI applications. Learn how to implement a data-first approach that can transform AI inference, resulting in better models that make better decisions.
Question the status quo. Build stakeholder trust. These are foundational elements of thought leadership in AI. Explore how organizations can use their data and algorithms in ethical and responsible ways while building bigger and more effective systems.
Haniyeh Mahmoudian
Global AI Ethicist, DataRobot
Mainstage Break (10:35 a.m. – 11:05 a.m.)
Networking and refreshments for our live audience and a selection of curated content for those tuning in virtually.
With its next-generation machine learning models fueling precision medicine, French biotech company, Owkin, captured the attention of the pharma industry. Learn how they did it and get tips to navigate the complex task of scaling your innovation.
Networking and refreshments for our live audience.
Innovation to Reality (11:05 a.m. – 12:30 p.m.)
The challenges of implementing AI are many. Avoid the common pitfalls with real-world case studies from leaders who have successfully turned their AI solutions into reality.
Deploying AI in real-world environments benefits from human input before and during implementation. Get an inside look at how organizations can ensure reliable results with the key questions and competing needs that should be considered when implementing AI solutions.
AI is evolving from the research lab into practical real world applications. Learn what issues should be top of mind for businesses, consumers, and researchers as we take a deep dive into AI solutions that increase modern productivity and accelerate intelligence transformation.
Getting AI to work 80% of the time is relatively straightforward, but trustworthy AI requires deployments that work 100% of the time. Unpack some of the biggest challenges that come up when eliminating the 20% gap.
Bali Raghavan
Head of Engineering, Forward
Lunch and Networking Break (12:30 p.m. – 1:30 p.m.)
Lunch served at the MIT Media Lab and a selection of curated content for those tuning in virtually.
Harness What’s Possible at the Edge (1:30 p.m. – 3:15 p.m.)
With its potential for near instantaneous decision making, pioneers are moving AI to the edge. We examine the pros and cons of moving AI decisions to the edge, with the experts getting it right.
To create sustainable business impact, AI capabilities need to be tailored and optimized to an industry or organization’s specific requirements and infrastructure model. Hear how customers’ challenges across industries can be addressed in any compute environment from the cloud to the edge with end-to-end hardware and software optimization.
Kavitha Prasad
VP & GM, Datacenter, AI and Cloud Execution and Strategy, Intel Corporation
Decision making has moved from the edge to the cloud before settling into a hybrid setup for many AI systems. Through the examination of key use-cases, take a deep dive into understanding the benefits and detractors of operating a machine-learning system at the point of inference.
Enable your organization to transform customer experiences through AI at the edge. Learn about the required technologies, including teachable and self-learning AI, that are needed for a successful shift to the edge, and hear how deploying these technologies at scale can unlock richer, more responsive experiences.
Reimagine AI solutions as a unified system, instead of individual components. Through the lens of autonomous vehicles, discover the pros and cons of using an all-inclusive AI-first approach that includes AI decision-making at the edge and see how this thinking can be applied across industry.
Raquel Urtasun
Founder & CEO, Waabi
Mainstage Break (3:15 p.m. – 3:45 p.m.)
Networking and refreshments for our live audience and a selection of curated content for those tuning in virtually.
Advances in machine learning are enabling artists and creative technologists to think about and use AI in new ways. Discuss the concept of creative AI and look at project examples from London’s art scene that illustrate the various ways creative AI is bridging the gap between the traditional art world and the latest technological innovations.
Luba Elliott
Curator, Producer, and Researcher, Creative AI
Generative AI Solutions (3:45 p.m. – 5:10 p.m.)
The use of generative AI to boost human creativity is breaking boundaries in creative areas previously untouched by AI. We explore the intersection of data and algorithms enabling collaborative AI processes to design and create.
Change the design problem with AI. The creative nature of generative AI enhances design capabilities, finding efficiencies and opportunities that humans alone might not conceive. Explore business applications including project planning, construction, and physical design.
Deep learning is data hungry technology. Manually labelled training data has become cost prohibitive and time-consuming. Get a glimpse at how interactive large-scale synthetic data generation can accelerate the AI revolution, unlocking the potential of data-driven artificial intelligence.
Danny Lange
SVP of Artificial Intelligence, Unity Technologies
Push beyond the typical uses of AI. Explore the nexus of art, technology, and human creativity through the unique innovation of kinetic data sculptures that use machines to give physical context and shape to data to rethink how we engage with the physical world.
Refik Anadol
CEO, RAS Lab; Lecturer, UCLA
Last Call with the Editors (5:10 p.m. – 5:20 p.m.)
Before we wrap day 1, join our last call with all of our editors to get their analysis on the day’s topics, themes, and guests.
Networking Reception (5:20 p.m. – 6:20 p.m.)
WEDNESDAY, MARCH 30
Evolving the Algorithms
What’s Next for Deep Learning
Deep learning algorithms have powered most major AI advances of the last decade. We bring you into the top innovation labs to see how they are advancing their deep learning models to find out just how much more we can get out of these algorithms.
AI in Day-To-Day Business
Many organizations are already using AI internally in their day-to-day operations, in areas like cybersecurity, customer service, finance, and manufacturing. We examine the tools that organizations are using when putting AI to work.
Making AI Work for All
As AI increasingly underpins our lives, businesses, and society, we must ensure that AI must work for everyone – not just those represented in datasets, and not just 80% of the time. Examine the challenges and solutions needed to ensure AI works fairly, for all.
Envisioning the Next AI
Some business problems can’t be solved with current deep learning methods. We look at what’s around the corner at the new approaches and most revolutionary ideas propelling us toward the next stage in AI evolution.
Day 2: Evolving the Algorithms (9:00 a.m. – 5:25 p.m.)
What’s Next for Deep Learning (9:10 a.m. – 10:25 a.m.)
Deep learning algorithms have powered most major AI advances of the last decade. We bring you into the top innovation labs to see how they are advancing their deep learning models to find out just how much more we can get out of these algorithms.
Transformer-based language models are revolutionizing the way neural networks process natural language. This deep dive looks at how organizations can put their data to work using transformer models. We consider the problems that business may face as these massive models mature, including training needs, managing parallel processing at scale, and countering offensive data.
Critical thinking may be one step closer for AI by combining large-scale transformers with smart sampling and filtering. Get an early look at how AlphaCode’s entry into competitive programming may lead to a human-like capacity for AI to write original code that solves unforeseen problems.
As advanced AI systems gain greater capabilities in our search for artificial general intelligence, it’s critical to teach them how to understand human intentions. Look at the latest advancements in AI systems and how to ensure they can be truthful, helpful, and safe.
Mira Murati
SVP, Research, Product, & Partnerships, OpenAI
Mainstage Break (10:25 a.m. – 10:55 a.m.)
Networking and refreshments for our live audience and a selection of curated content for those tuning in virtually.
Good data is the bedrock of a self-service data consumption model, which in turn unlocks insights, analytics, personalization at scale through AI. Yet many organizations face immense challenges setting up a robust data foundation. Dive into a pragmatic perspective on abstracting the complexity and untangling the conflicts in data management for better AI.
Naveen Kamat
Executive Director, Data and AI Services, Kyndryl
AI in Day-To-Day Business (10:55 a.m. – 12:20 p.m.)
Many organizations are already using AI internally in their day-to-day operations, in areas like cybersecurity, customer service, finance, and manufacturing. We examine the tools that organizations are using when putting AI to work.
Effectively operationalized AI/ML can unlock untapped potential in your organization. From enhancing internal processes to managing the customer experience, get the pragmatic advice and takeaways leaders need to better understand their internal data to achieve impactful results.
Use AI to maximize reliability of supply chains. Learn the dos and don’ts to managing key processes within your supply chain, including workforce management, streamlining and simplification, and reaping the full value of your supply chain solutions.
Darcy MacClaren
Senior Vice President, Digital Supply Chain, SAP North America
Machine and reinforcement learning enable Spotify to deliver the right content to the right listener at the right time, allowing for personalized listening experiences that facilitate discovery at a global scale. Through user interactions, algorithms suggest new content and creators that keep customers both happy and engaged with the platform. Dive into the details of making better user recommendations.
Tony Jebara
VP of Engineering and Head of Machine Learning, Spotify
Lunch and Networking Break (12:20 p.m. – 1:15 p.m.)
Lunch served at the MIT Media Lab and a selection of curated content for those tuning in virtually.
Making AI Work for All (1:15 p.m. – 2:35 p.m.)
As AI increasingly underpins our lives, businesses, and society, we must ensure that AI must work for everyone – not just those represented in datasets, and not just 80% of the time. Examine the challenges and solutions needed to ensure AI works fairly, for all.
Walk through the practical steps to map and understand the nuances, outliers, and special cases in datasets. Get tips to ensure ethical and trustworthy approaches to training AI systems that grow in scope and scale within a business.
Lauren Bennett
Group Software Engineering Lead, Spatial Analysis and Data Science, Esri
Get an inside look at the long- and short-term benefits of addressing inequities in AI opportunities, ranging from educating the tech youth of the future to a 10,000-foot view on what it will take to ensure that equity top is of mind within society and business alike.
Public policies can help to make AI more equitable and ethical for all. Examine how policies could impact corporations and what it means for building internal policies, regardless of what government adopts. Identify actionable ideas to best move policies forward for the widest benefit to all.
Nicol Turner Lee
Director, Center for Technology Innovation, Brookings Institution
Mainstage Break (2:35 p.m. – 3:05 p.m.)
Networking and refreshments for our live audience and a selection of curated content for those tuning in virtually.
From the U.S. to China, the global robo-taxi race is gaining traction with consumers and regulators alike. Go behind the scenes with AutoX – a Level 4 driving technology company – and hear how it overcame obstacles while launching the world’s second and China’s first public, fully driverless robo-taxi service.
Jianxiong Xiao
Founder and CEO, AutoX
Envisioning the Next AI (3:05 p.m. – 4:50 p.m.)
Some business problems can’t be solved with current deep learning methods. We look at what’s around the corner at the new approaches and most revolutionary ideas propelling us toward the next stage in AI evolution.
The use of AI in finance is gaining traction as organizations realize the advantages of using algorithms to streamline and improve the accuracy of financial tasks. Step through use cases that examine how AI can be used to minimize financial risk, maximize financial returns, optimize venture capital funding by connecting entrepreneurs to the right investors; and more.
Sameena Shah
Managing Director, J.P. Morgan AI Research, JP Morgan Chase
In a study of simulated robotic evolution, it was observed that more complex environments and evolutionary changes to the robot’s physical form accelerated the growth of robot intelligence. Examine this cutting-edge research and decipher what this early discovery means for the next generation of AI and robotics.
Agrim Gupta
PhD Student, Stanford Vision and Learning Lab, Stanford University
Understanding human thinking and reasoning processes could lead to more general, flexible and human-like artificial intelligence. Take a close look at the research building AI inspired by human common-sense that could create a new generation of tools for complex decision-making.
Zenna Tavares
Research Scientist, Columbia University; Co-Founder, Basis
Look under the hood at this innovative approach to AI learning with multi-agent and human-AI interactions. Discover how bots work together and learn together through personal interactions. Recognize the future implications for AI, plus the benefits and obstacles that may come from this new process.
David Ferrucci was the principal investigator for the team that led IBM Watson to its landmark Jeopardy success, awakening the world to the possibilities of AI. We pull back the curtain on AI for a wide-ranging discussion on explicable models, and the next generation of human and machine collaboration creating AI thought partners with limitless applications.
Medical Startups – Artificial Intelligence (AI) Startups in Healthcare
Reporters: Stephen J. Williams, PhD and Aviva Lev-Ari, PhD, RN and Shraga Rottem, MD, DSc,
The motivation for this post is two fold:
First, we are presenting an application of AI, NLP, DL to our own medical text in the Genomics space. Here we present the first section of Part 1 in the following book. Part 1 has six subsections that yielded 12 plots. The entire Book is represented by 38 x 2 = 76 plots.
Second, we bring to the attention of the e-Reader the list of 276 Medical Startups – Artificial Intelligence (AI) Startups in Healthcare as a hot universe of R&D activity in Human Health.
Third, to highlight one academic center with an AI focus
Dear friends of the ETH AI Center,
We would like to provide you with some exciting updates from the ETH AI Center and its growing community.
As the Covid-19 restrictions in Switzerland have recently been lifted, we would like to hear from you what kind of events you would like to see in 2022! Participate in the survey to suggest event formats and topics that you would enjoy being a part of. We are already excited to learn what we can achieve together this year.
We already have many interesting events coming up, we look forward to seeing you at our main and community events!
LPBI Group is applying AI for Medical Text Analysis with Machine Learning and Natural Language Processing: Statistical and Deep Learning
Our Book
Latest in Genomics Methodologies for Therapeutics: Gene Editing, NGS & BioInformatics, Simulations and the Genome Ontology
Medical Text Analysis of this Books shows the following results obtained by Madison Davis by applying Wolfram NLP for Biological Languages on our own Text. See below an Example:
From High-Throughput Assay to Systems Biology: New Tools for Drug Discovery
Curator: Stephen J. Williams, PhD
Marc W. Kirschner*
Department of Systems Biology Harvard Medical School
Boston, Massachusetts 02115
With the new excitement about systems biology, there is understandable interest in a definition. This has proven somewhat difficult. Scientific fields, like species, arise by descent with modification, so in their earliest forms even the founders of great dynasties are only marginally different than their sister fields and species. It is only in retrospect that we can recognize the significant founding events. Before embarking on a definition of systems biology, it may be worth remembering that confusion and controversy surrounded the introduction of the term “molecular biology,” with claims that it hardly differed from biochemistry. Yet in retrospect molecular biology was new and different. It introduced both new subject matter and new technological approaches, in addition to a new style.
As a point of departure for systems biology, consider the quintessential experiment in the founding of molecular biology, the one gene one enzyme hypothesis of Beadle and Tatum. This experiment first connected the genotype directly to the phenotype on a molecular level, although efforts in that direction can certainly be found in the work of Archibald Garrod, Sewell Wright, and others. Here a protein (in this case an enzyme) is seen to be a product of a single gene, and a single function; the completion of a specific step in amino acid biosynthesis is the direct result. It took the next 30 years to fill in the gaps in this process. Yet the one gene one enzyme hypothesis looks very different to us today. What is the function of tubulin, of PI-3 kinase or of rac? Could we accurately predict the phenotype of a nonlethal mutation in these genes in a multicellular organism? Although we can connect structure to the gene, we can no longer infer its larger purpose in the cell or in the organism. There are too many purposes; what the protein does is defined by context. The context also includes a history, either developmental or physiological. Thus the behavior of the Wnt signaling pathway depends on the previous lineage, the “where and when” questions of embryonic development. Similarly the behavior of the immune system depends on previous experience in a variable environment. All of these features stress how inadequate an explanation for function we can achieve solely by trying to identify genes (by annotating them!) and characterizing their transcriptional control circuits.
That we are at a crossroads in how to explore biology is not at all clear to many. Biology is hardly in its dotage; the process of discovery seems to have been perfected, accelerated, and made universally applicable to all fields of biology. With the completion of the human genome and the genomes of other species, we have a glimpse of many more genes than we ever had before to study. We are like naturalists discovering a new continent, enthralled with the diversity itself. But we have also at the same time glimpsed the finiteness of this list of genes, a disturbingly small list. We have seen that the diversity of genes cannot approximate the diversity of functions within an organism. In response, we have argued that combinatorial use of small numbers of components can generate all the diversity that is needed. This has had its recent incarnation in the simplistic view that the rules of cis-regulatory control on DNA can directly lead to an understanding of organisms and their evolution. Yet this assumes that the gene products can be linked together in arbitrary combinations, something that is not assured in chemistry. It also downplays the significant regulatory features that involve interactions between gene products, their localization, binding, posttranslational modification, degradation, etc. The big question to understand in biology is not regulatory linkage but the nature of biological systems that allows them to be linked together in many nonlethal and even useful combinations. More and more we come to realize that understanding the conserved genes and their conserved circuits will require an understanding of their special properties that allow them to function together to generate different phenotypes in different tissues of metazoan organisms. These circuits may have certain robustness, but more important they have adaptability and versatility. The ease of putting conserved processes under regulatory control is an inherent design feature of the processes themselves. Among other things it loads the deck in evolutionary variation and makes it more feasible to generate useful phenotypes upon which selection can act.
Systems biology offers an opportunity to study how the phenotype is generated from the genotype and with it a glimpse of how evolution has crafted the phenotype. One aspect of systems biology is the development of techniques to examine broadly the level of protein, RNA, and DNA on a gene by gene basis and even the posttranslational modification and localization of proteins. In a very short time we have witnessed the development of high-throughput biology, forcing us to consider cellular processes in toto. Even though much of the data is noisy and today partially inconsistent and incomplete, this has been a radical shift in the way we tear apart problems one interaction at a time. When coupled with gene deletions by RNAi and classical methods, and with the use of chemical tools tailored to proteins and protein domains, these high-throughput techniques become still more powerful.
High-throughput biology has opened up another important area of systems biology: it has brought us out into the field again or at least made us aware that there is a world outside our laboratories. Our model systems have been chosen intentionally to be of limited genetic diversity and examined in a highly controlled and reproducible environment. The real world of ecology, evolution, and human disease is a very different place. When genetics separated from the rest of biology in the early part of the 20th century, most geneticists sought to understand heredity and chose to study traits in the organism that could be easily scored and could be used to reveal genetic mechanisms. This was later extended to powerful effect to use genetics to study cell biological and developmental mechanisms. Some geneticists, including a large school in Russia in the early 20th century, continued to study the genetics of natural populations, focusing on traits important for survival. That branch of genetics is coming back strongly with the power of phenotypic assays on the RNA and protein level. As human beings we are most concerned not with using our genetic misfortunes to unravel biology’s complexity (important as that is) but with the role of our genetics in our individual survival. The context for understanding this is still not available, even though the data are now coming in torrents, for many of the genes that will contribute to our survival will have small quantitative effects, partially masked or accentuated by other genetic and environmental conditions. To understand the genetic basis of disease will require not just mapping these genes but an understanding of how the phenotype is created in the first place and the messy interactions between genetic variation and environmental variation.
Extracts and explants are relatively accessible to synthetic manipulation. Next there is the explicit reconstruction of circuits within cells or the deliberate modification of those circuits. This has occurred for a while in biology, but the difference is that now we wish to construct or intervene with the explicit purpose of describing the dynamical features of these synthetic or partially synthetic systems. There are more and more tools to intervene and more and more tools to measure. Although these fall short of total descriptions of cells and organisms, the detailed information will give us a sense of the special life-like processes of circuits, proteins, cells in tissues, and whole organisms in their environment. This meso-scale systems biology will help establish the correspondence between molecules and large-scale physiology.
You are probably running out of patience for some definition of systems biology. In any case, I do not think the explicit definition of systems biology should come from me but should await the words of the first great modern systems biologist. She or he is probably among us now. However, if forced to provide some kind of label for systems biology, I would simply say that systems biology is the study of the behavior of complex biological organization and processes in terms of the molecular constituents. It is built on molecular biology in its special concern for information transfer, on physiology for its special concern with adaptive states of the cell and organism, on developmental biology for the importance of defining a succession of physiological states in that process, and on evolutionary biology and ecology for the appreciation that all aspects of the organism are products of selection, a selection we rarely understand on a molecular level. Systems biology attempts all of this through quantitative measurement, modeling, reconstruction, and theory. Systems biology is not a branch of physics but differs from physics in that the primary task is to understand how biology generates variation. No such imperative to create variation exists in the physical world. It is a new principle that Darwin understood and upon which all of life hinges. That sounds different enough for me to justify a new field and a new name. Furthermore, the success of systems biology is essential if we are to understand life; its success is far from assured—a good field for those seeking risk and adventure.
Biologically active small molecules have a central role in drug development, and as chemical probes and tool compounds to perturb and elucidate biological processes. Small molecules can be rationally designed for a given target, or a library of molecules can be screened against a target or phenotype of interest. Especially in the case of phenotypic screening approaches, a major challenge is to translate the compound-induced phenotype into a well-defined cellular target and mode of action of the hit compound. There is no “one size fits all” approach, and recent years have seen an increase in available target deconvolution strategies, rooted in organic chemistry, proteomics, and genetics. This review provides an overview of advances in target identification and mechanism of action studies, describes the strengths and weaknesses of the different approaches, and illustrates the need for chemical biologists to integrate and expand the existing tools to increase the probability of evolving screen hits to robust chemical probes.
5.1.5. Large-Scale Proteomics
While FITExP is based on protein expression regulation during apoptosis, a study of Ruprecht et al. showed that proteomic changes are induced both by cytotoxic and non-cytotoxic compounds, which can be detected by mass spectrometry to give information on a compound’s mechanism of action. They developed a large-scale proteome-wide mass spectrometry analysis platform for MOA studies, profiling five lung cancer cell lines with over 50 drugs. Aggregation analysis over the different cell lines and the different compounds showed that one-quarter of the drugs changed the abundance of their protein target. This approach allowed target confirmation of molecular degraders such as PROTACs or molecular glues. Finally, this method yielded unexpected off-target mechanisms for the MAP2K1/2 inhibitor PD184352 and the ALK inhibitor ceritinib [97]. While such a mapping approach clearly provides a wealth of information, it might not be easily attainable for groups that are not equipped for high-throughput endeavors.
All-in-all, mass spectrometry methods have gained a lot of traction in recent years and have been successfully applied for target deconvolution and MOA studies of small molecules. As with all high-throughput methods, challenges lie in the accessibility of the instruments (both from a time and cost perspective) and data analysis of complex and extensive data sets.
5.2. Genetic Approaches
Both label-based and mass spectrometry proteomic approaches are based on the physical interaction between a small molecule and a protein target, and focus on the proteome for target deconvolution. It has been long realized that genetics provides an alternative avenue to understand a compound’s action, either through precise modification of protein levels, or by inducing protein mutations. First realized in yeast as a genetically tractable organism over 20 years ago, recent advances in genetic manipulation of mammalian cells have opened up important opportunities for target identification and MOA studies through genetic screening in relevant cell types [98]. Genetic approaches can be roughly divided into two main areas, with the first centering on the identification of mutations that confer compound resistance (Figure 3a), and the second on genome-wide perturbation of gene function and the concomitant changes in sensitivity to the compound (Figure 3b). While both methods can be used to identify or confirm drug targets, the latter category often provides many additional insights in the compound’s mode of action.
Figure 3. Genetic methods for target identification and mode of action studies. Schematic representations of (a) resistance cloning, and (b) chemogenetic interaction screens.
5.2.1. Resistance Cloning
The “gold standard” in drug target confirmation is to identify mutations in the presumed target protein that render it insensitive to drug treatment. Conversely, different groups have sought to use this principle as a target identification method based on the concept that cells grown in the presence of a cytotoxic drug will either die or develop mutations that will make them resistant to the compound. With recent advances in deep sequencing it is now possible to then scan the transcriptome [99] or genome [100] of the cells for resistance-inducing mutations. Genes that are mutated are then hypothesized to encode the protein target. For this approach to be successful, there are two initial requirements: (1) the compound needs to be cytotoxic for resistant clones to arise, and (2) the cell line needs to be genetically unstable for mutations to occur in a reasonable timeframe.
In 2012, the Kapoor group demonstrated in a proof-of-concept study that resistance cloning in mammalian cells, coupled to transcriptome sequencing (RNA-seq), yields the known polo-like kinase 1 (PLK1) target of the small molecule BI 2536. For this, they used the cancer cell line HCT-116, which is deficient in mismatch repair and consequently prone to mutations. They generated and sequenced multiple resistant clones, and clustered the clones based on similarity. PLK1 was the only gene that was mutated in multiple groups. Of note, one of the groups did not contain PLK1 mutations, but rather developed resistance through upregulation of ABCBA1, a drug efflux transporter, which is a general and non-specific resistance mechanism [101]. In a following study, they optimized their pipeline “DrugTargetSeqR”, by counter-screening for these types of multidrug resistance mechanisms so that these clones were excluded from further analysis (Figure 3a). Furthermore, they used CRISPR/Cas9-mediated gene editing to determine which mutations were sufficient to confer drug resistance, and as independent validation of the biochemical relevance of the obtained hits [102].
While HCT-116 cells are a useful model cell line for resistance cloning because of their genomic instability, they may not always be the cell line of choice, depending on the compound and process that is studied. Povedana et al. used CRISPR/Cas9 to engineer mismatch repair deficiencies in Ewing sarcoma cells and small cell lung cancer cells. They found that deletion of MSH2 results in hypermutations in these normally mutationally silent cells, resulting in the formation of resistant clones in the presence of bortezomib, MLN4924, and CD437, which are all cytotoxic compounds [103]. Recently, Neggers et al. reasoned that CRISPR/Cas9-induced non-homologous end-joining repair could be a viable strategy to create a wide variety of functional mutants of essential genes through in-frame mutations. Using a tiled sgRNA library targeting 75 target genes of investigational neoplastic drugs in HAP1 and K562 cells, they generated several KPT-9274 (an anticancer agent with unknown target)-resistant clones, and subsequent deep sequencing showed that the resistant clones were enriched in NAMPT sgRNAs. Direct target engagement was confirmed by co-crystallizing the compound with NAMPT [104]. In addition to these genetic mutation strategies, an alternative method is to grow the cells in the presence of a mutagenic chemical to induce higher mutagenesis rates [105,106].
When there is already a hypothesis on the pathway involved in compound action, the resistance cloning methodology can be extended to non-cytotoxic compounds. Sekine et al. developed a fluorescent reporter model for the integrated stress response, and used this cell line for target deconvolution of a small molecule inhibitor towards this pathway (ISRIB). Reporter cells were chemically mutagenized, and ISRIB-resistant clones were isolated by flow cytometry, yielding clones with various mutations in the delta subunit of guanine nucleotide exchange factor eIF2B [107].
While there are certainly successful examples of resistance cloning yielding a compound’s direct target as discussed above, resistance could also be caused by mutations or copy number alterations in downstream components of a signaling pathway. This is illustrated by clinical examples of acquired resistance to small molecules, nature’s way of “resistance cloning”. For example, resistance mechanisms in Hedgehog pathway-driven cancers towards the Smoothened inhibitor vismodegib include compound-resistant mutations in Smoothened, but also copy number changes in downstream activators SUFU and GLI2 [108]. It is, therefore, essential to conduct follow-up studies to confirm a direct interaction between a compound and the hit protein, as well as a lack of interaction with the mutated protein.
5.2.3. “Chemogenomics”: Examples of Gene-Drug Interaction Screens
When genetic perturbations are combined with small molecule drugs in a chemogenetic interaction screen, the effect of a gene’s perturbation on compound action is studied. Gene perturbation can render the cells resistant to the compound (suppressor interaction), or conversely, result in hypersensitivity and enhanced compound potency (synergistic interaction) [5,117,121]. Typically, cells are treated with the compound at a sublethal dose, to ascertain that both types of interactions can be found in the final dataset, and often it is necessary to use a variety of compound doses (i.e., LD20, LD30, LD50) and timepoints to obtain reliable insights (Figure 3b).
An early example of successful coupling of a phenotypic screen and downstream genetic screening for target identification is the study of Matheny et al. They identified STF-118804 as a compound with antileukemic properties. Treatment of MV411 cells, stably transduced with a high complexity, genome-wide shRNA library, with STF-118804 (4 rounds of increasing concentration) or DMSO control resulted in a marked depletion of cells containing shRNAs against nicotinamide phosphoribosyl transferase (NAMPT) [122].
The Bassik lab subsequently directly compared the performance of shRNA-mediated knockdown versus CRISPR/Cas9-knockout screens for the target elucidation of the antiviral drug GSK983. The data coming out of both screens were complementary, with the shRNA screen resulting in hits leading to the direct compound target and the CRISPR screen giving information on cellular mechanisms of action of the compound. A reason for this is likely the level of protein depletion that is reached by these methods: shRNAs lead to decreased protein levels, which is advantageous when studying essential genes. However, knockdown may not result in a phenotype for non-essential genes, in which case a full CRISPR-mediated knockout is necessary to observe effects [123].
Another NAMPT inhibitor was identified in a CRISPR/Cas9 “haplo-insufficiency (HIP)”-like approach [124]. Haploinsuffiency profiling is a well-established system in yeast which is performed in a ~50% protein background by heterozygous deletions [125]. As there is no control over CRISPR-mediated loss of alleles, compound treatment was performed at several timepoints after addition of the sgRNA library to HCT116 cells stably expressing Cas9, in the hope that editing would be incomplete at early timepoints, resulting in residual protein levels. Indeed, NAMPT was found to be the target of phenotypic hit LB-60-OF61, especially at earlier timepoints, confirming the hypothesis that some level of protein needs to be present to identify a compound’s direct target [124]. This approach was confirmed in another study, thereby showing that direct target identification through CRISPR-knockout screens is indeed possible [126].
An alternative strategy was employed by the Weissman lab, where they combined genome-wide CRISPR-interference and -activation screens to identify the target of the phase 3 drug rigosertib. They focused on hits that had opposite action in both screens, as in sensitizing in one but protective in the other, which were related to microtubule stability. In a next step, they created chemical-genetic profiles of a variety of microtubule destabilizing agents, rationalizing that compounds with the same target will have similar drug-gene interactions. For this, they made a focused library of sgRNAs, based on the most high-ranking hits in the rigosertib genome-wide CRISPRi screen, and compared the focused screen results of the different compounds. The profile for rigosertib clustered well with that of ABT-571, and rigorous target validation studies confirmed rigosertib binding to the colchicine binding site of tubulin—the same site as occupied by ABT-571 [127].
From the above examples, it is clear that genetic screens hold a lot of promise for target identification and MOA studies for small molecules. The CRISPR screening field is rapidly evolving, sgRNA libraries are continuously improving and increasingly commercially available, and new tools for data analysis are being developed [128]. The challenge lies in applying these screens to study compounds that are not cytotoxic, where finding the right dosage regimen will not be trivial.
SYSTEMS BIOLOGY AND CANCER RESEARCH & DRUG DISCOVERY
Integrative Analysis of Next-Generation Sequencing for Next-Generation Cancer Research toward Artificial Intelligence
The rapid improvement of next-generation sequencing (NGS) technologies and their application in large-scale cohorts in cancer research led to common challenges of big data. It opened a new research area incorporating systems biology and machine learning. As large-scale NGS data accumulated, sophisticated data analysis methods became indispensable. In addition, NGS data have been integrated with systems biology to build better predictive models to determine the characteristics of tumors and tumor subtypes. Therefore, various machine learning algorithms were introduced to identify underlying biological mechanisms. In this work, we review novel technologies developed for NGS data analysis, and we describe how these computational methodologies integrate systems biology and omics data. Subsequently, we discuss how deep neural networks outperform other approaches, the potential of graph neural networks (GNN) in systems biology, and the limitations in NGS biomedical research. To reflect on the various challenges and corresponding computational solutions, we will discuss the following three topics: (i) molecular characteristics, (ii) tumor heterogeneity, and (iii) drug discovery. We conclude that machine learning and network-based approaches can add valuable insights and build highly accurate models. However, a well-informed choice of learning algorithm and biological network information is crucial for the success of each specific research question
1. Introduction
The development and widespread use of high-throughput technologies founded the era of big data in biology and medicine. In particular, it led to an accumulation of large-scale data sets that opened a vast amount of possible applications for data-driven methodologies. In cancer, these applications range from fundamental research to clinical applications: molecular characteristics of tumors, tumor heterogeneity, drug discovery and potential treatments strategy. Therefore, data-driven bioinformatics research areas have tailored data mining technologies such as systems biology, machine learning, and deep learning, elaborated in this review paper (see Figure 1 and Figure 2). For example, in systems biology, data-driven approaches are applied to identify vital signaling pathways [1]. This pathway-centric analysis is particularly crucial in cancer research to understand the characteristics and heterogeneity of the tumor and tumor subtypes. Consequently, this high-throughput data-based analysis enables us to explore characteristics of cancers with a systems biology and a systems medicine point of view [2].Combining high-throughput techniques, especially next-generation sequencing (NGS), with appropriate analytical tools has allowed researchers to gain a deeper systematic understanding of cancer at various biological levels, most importantly genomics, transcriptomics, and epigenetics [3,4]. Furthermore, more sophisticated analysis tools based on computational modeling are introduced to decipher underlying molecular mechanisms in various cancer types. The increasing size and complexity of the data required the adaptation of bioinformatics processing pipelines for higher efficiency and sophisticated data mining methodologies, particularly for large-scale, NGS datasets [5]. Nowadays, more and more NGS studies integrate a systems biology approach and combine sequencing data with other types of information, for instance, protein family information, pathway, or protein–protein interaction (PPI) networks, in an integrative analysis. Experimentally validated knowledge in systems biology may enhance analysis models and guides them to uncover novel findings. Such integrated analyses have been useful to extract essential information from high-dimensional NGS data [6,7]. In order to deal with the increasing size and complexity, the application of machine learning, and specifically deep learning methodologies, have become state-of-the-art in NGS data analysis.
Figure 1. Next-generation sequencing data can originate from various experimental and technological conditions. Depending on the purpose of the experiment, one or more of the depicted omics types (Genomics, Transcriptomics, Epigenomics, or Single-Cell Omics) are analyzed. These approaches led to an accumulation of large-scale NGS datasets to solve various challenges of cancer research, molecular characterization, tumor heterogeneity, and drug target discovery. For instance, The Cancer Genome Atlas (TCGA) dataset contains multi-omics data from ten-thousands of patients. This dataset facilitates a variety of cancer researches for decades. Additionally, there are also independent tumor datasets, and, frequently, they are analyzed and compared with the TCGA dataset. As the large scale of omics data accumulated, various machine learning techniques are applied, e.g., graph algorithms and deep neural networks, for dimensionality reduction, clustering, or classification. (Created with BioRender.com.)
Figure 2. (a) A multitude of different types of data is produced by next-generation sequencing, for instance, in the fields of genomics, transcriptomics, and epigenomics. (b) Biological networks for biomarker validation: The in vivo or in vitro experiment results are considered ground truth. Statistical analysis on next-generation sequencing data produces candidate genes. Biological networks can validate these candidate genes and highlight the underlying biological mechanisms (Section 2.1). (c) De novo construction of Biological Networks: Machine learning models that aim to reconstruct biological networks can incorporate prior knowledge from different omics data. Subsequently, the model will predict new unknown interactions based on new omics information (Section 2.2). (d) Network-based machine learning: Machine learning models integrating biological networks as prior knowledge to improve predictive performance when applied to different NGS data (Section 2.3). (Created with BioRender.com).
Therefore, a large number of studies integrate NGS data with machine learning and propose a novel data-driven methodology in systems biology [8]. In particular, many network-based machine learning models have been developed to analyze cancer data and help to understand novel mechanisms in cancer development [9,10]. Moreover, deep neural networks (DNN) applied for large-scale data analysis improved the accuracy of computational models for mutation prediction [11,12], molecular subtyping [13,14], and drug repurposing [15,16].
2. Systems Biology in Cancer Research
Genes and their functions have been classified into gene sets based on experimental data. Our understandings of cancer concentrated into cancer hallmarks that define the characteristics of a tumor. This collective knowledge is used for the functional analysis of unseen data.. Furthermore, the regulatory relationships among genes were investigated, and, based on that, a pathway can be composed. In this manner, the accumulation of public high-throughput sequencing data raised many big-data challenges and opened new opportunities and areas of application for computer science. Two of the most vibrantly evolving areas are systems biology and machine learning which tackle different tasks such as understanding the cancer pathways [9], finding crucial genes in pathways [22,53], or predicting functions of unidentified or understudied genes [54]. Essentially, those models include prior knowledge to develop an analysis and enhance interpretability for high-dimensional data [2]. In addition to understanding cancer pathways with in silico analysis, pathway activity analysis incorporating two different types of data, pathways and omics data, is developed to understand heterogeneous characteristics of the tumor and cancer molecular subtyping. Due to its advantage in interpretability, various pathway-oriented methods are introduced and become a useful tool to understand a complex diseases such as cancer [55,56,57].
In this section, we will discuss how two related research fields, namely, systems biology and machine learning, can be integrated with three different approaches (see Figure 2), namely, biological network analysis for biomarker validation, the use of machine learning with systems biology, and network-based models.
2.1. Biological Network Analysis for Biomarker Validation
The detection of potential biomarkers indicative of specific cancer types or subtypes is a frequent goal of NGS data analysis in cancer research. For instance, a variety of bioinformatics tools and machine learning models aim at identify lists of genes that are significantly altered on a genomic, transcriptomic, or epigenomic level in cancer cells. Typically, statistical and machine learning methods are employed to find an optimal set of biomarkers, such as single nucleotide polymorphisms (SNPs), mutations, or differentially expressed genes crucial in cancer progression. Traditionally, resource-intensive in vitro analysis was required to discover or validate those markers. Therefore, systems biology offers in silico solutions to validate such findings using biological pathways or gene ontology information (Figure 2b) [58]. Subsequently, gene set enrichment analysis (GSEA) [50] or gene set analysis (GSA) [59] can be used to evaluate whether these lists of genes are significantly associated with cancer types and their specific characteristics. GSA, for instance, is available via web services like DAVID [60] and g:Profiler [61]. Moreover, other applications use gene ontology directly [62,63]. In addition to gene-set-based analysis, there are other methods that focuse on the topology of biological networks. These approaches evaluate various network structure parameters and analyze the connectivity of two genes or the size and interconnection of their neighbors [64,65]. According to the underlying idea, the mutated gene will show dysfunction and can affect its neighboring genes. Thus, the goal is to find abnormalities in a specific set of genes linked with an edge in a biological network. For instance, KeyPathwayMiner can extract informative network modules in various omics data [66]. In summary, these approaches aim at predicting the effect of dysfunctional genes among neighbors according to their connectivity or distances from specific genes such as hubs [67,68]. During the past few decades, the focus of cancer systems biology extended towards the analysis of cancer-related pathways since those pathways tend to carry more information than a gene set. Such analysis is called Pathway Enrichment Analysis (PEA) [69,70]. The use of PEA incorporates the topology of biological networks. However, simultaneously, the lack of coverage issue in pathway data needs to be considered. Because pathway data does not cover all known genes yet, an integration analysis on omics data can significantly drop in genes when incorporated with pathways. Genes that can not be mapped to any pathway are called ‘pathway orphan.’ In this manner, Rahmati et al. introduced a possible solution to overcome the ‘pathway orphan’ issue [71]. At the bottom line, regardless of whether researchers consider gene-set or pathway-based enrichment analysis, the performance and accuracy of both methods are highly dependent on the quality of the external gene-set and pathway data [72].
2.2. De Novo Construction of Biological Networks
While the known fraction of existing biological networks barely scratches the surface of the whole system of mechanisms occurring in each organism, machine learning models can improve on known network structures and can guide potential new findings [73,74]. This area of research is called de novo network construction (Figure 2c), and its predictive models can accelerate experimental validation by lowering time costs [75,76]. This interplay between in silico biological networks building and mining contributes to expanding our knowledge in a biological system. For instance, a gene co-expression network helps discover gene modules having similar functions [77]. Because gene co-expression networks are based on expressional changes under specific conditions, commonly, inferring a co-expression network requires many samples. The WGCNA package implements a representative model using weighted correlation for network construction that leads the development of the network biology field [78]. Due to NGS developments, the analysis of gene co-expression networks subsequently moved from microarray-based to RNA-seq based experimental data [79]. However, integration of these two types of data remains tricky. Ballouz et al. compared microarray and NGS-based co-expression networks and found the existence of a bias originating from batch effects between the two technologies [80]. Nevertheless, such approaches are suited to find disease-specific co-expressional gene modules. Thus, various studies based on the TCGA cancer co-expression network discovered characteristics of prognostic genes in the network [81]. Accordingly, a gene co-expression network is a condition-specific network rather than a general network for an organism. Gene regulatory networks can be inferred from the gene co-expression network when various data from different conditions in the same organism are available. Additionally, with various NGS applications, we can obtain multi-modal datasets about regulatory elements and their effects, such as epigenomic mechanisms on transcription and chromatin structure. Consequently, a gene regulatory network can consist of solely protein-coding genes or different regulatory node types such as transcription factors, inhibitors, promoter interactions, DNA methylations, and histone modifications affecting the gene expression system [82,83]. More recently, researchers were able to build networks based on a particular experimental setup. For instance, functional genomics or CRISPR technology enables the high-resolution regulatory networks in an organism [84]. Other than gene co-expression or regulatory networks, drug target, and drug repurposing studies are active research areas focusing on the de novo construction of drug-to-target networks to allow the potential repurposing of drugs [76,85].
2.3. Network Based Machine Learning
A network-based machine learning model directly integrates the insights of biological networks within the algorithm (Figure 2d) to ultimately improve predictive performance concerning cancer subtyping or susceptibility to therapy. Following the establishment of high-quality biological networks based on NGS technologies, these biological networks were suited to be integrated into advanced predictive models. In this manner, Zhang et al., categorized network-based machine learning approaches upon their usage into three groups: (i) model-based integration, (ii) pre-processing integration, and (iii) post-analysis integration [7]. Network-based models map the omics data onto a biological network, and proper algorithms travel the network while considering both values of nodes and edges and network topology. In the pre-processing integration, pathway or other network information is commonly processed based on its topological importance. Meanwhile, in the post-analysis integration, omics data is processed solely before integration with a network. Subsequently, omics data and networks are merged and interpreted. The network-based model has advantages in multi-omics integrative analysis. Due to the different sensitivity and coverage of various omics data types, a multi-omics integrative analysis is challenging. However, focusing on gene-level or protein-level information enables a straightforward integration [86,87]. Consequently, when different machine learning approaches tried to integrate two or more different data types to find novel biological insights, one of the solutions is reducing the search space to gene or protein level and integrated heterogeneous datatypes [25,88].
In summary, using network information opens new possibilities for interpretation. However, as mentioned earlier, several challenges remain, such as the coverage issue. Current databases for biological networks do not cover the entire set of genes, transcripts, and interactions. Therefore, the use of networks can lead to loss of information for gene or transcript orphans. The following section will focus on network-based machine learning models and their application in cancer genomics. We will put network-based machine learning into the perspective of the three main areas of application, namely, molecular characterization, tumor heterogeneity analysis, and cancer drug discovery.
3. Network-Based Learning in Cancer Research
As introduced previously, the integration of machine learning with the insights of biological networks (Figure 2d) ultimately aims at improving predictive performance and interpretability concerning cancer subtyping or treatment susceptibility.
3.1. Molecular Characterization with Network Information
Various network-based algorithms are used in genomics and focus on quantifying the impact of genomic alteration. By employing prior knowledge in biological network algorithms, performance compared to non-network models can be improved. A prominent example is HotNet. The algorithm uses a thermodynamics model on a biological network and identifies driver genes, or prognostic genes, in pan-cancer data [89]. Another study introduced a network-based stratification method to integrate somatic alterations and expression signatures with network information [90]. These approaches use network topology and network-propagation-like algorithms. Network propagation presumes that genomic alterations can affect the function of neighboring genes. Two genes will show an exclusive pattern if two genes complement each other, and the function carried by those two genes is essential to an organism [91]. This unique exclusive pattern among genomic alteration is further investigated in cancer-related pathways. Recently, Ku et al. developed network-centric approaches and tackled robustness issues while studying synthetic lethality [92]. Although synthetic lethality was initially discovered in model organisms of genetics, it helps us to understand cancer-specific mutations and their functions in tumor characteristics [91].
Furthermore, in transcriptome research, network information is used to measure pathway activity and its application in cancer subtyping. For instance, when comparing the data of two or more conditions such as cancer types, GSEA as introduced in Section 2 is a useful approach to get an overview of systematic changes [50]. It is typically used at the beginning of a data evaluation [93]. An experimentally validated gene set can provide information about how different conditions affect molecular systems in an organism. In addition to the gene sets, different approaches integrate complex interaction information into GSEA and build network-based models [70]. In contrast to GSEA, pathway activity analysis considers transcriptome data and other omics data and structural information of a biological network. For example, PARADIGM uses pathway topology and integrates various omics in the analysis to infer a patient-specific status of pathways [94]. A benchmark study with pan-cancer data recently reveals that using network structure can show better performance [57]. In conclusion, while the loss of data is due to the incompleteness of biological networks, their integration improved performance and increased interpretability in many cases.
3.2. Tumor Heterogeneity Study with Network Information
The tumor heterogeneity can originate from two directions, clonal heterogeneity and tumor impurity. Clonal heterogeneity covers genomic alterations within the tumor [95]. While de novo mutations accumulate, the tumor obtains genomic alterations with an exclusive pattern. When these genomic alterations are projected on the pathway, it is possible to observe exclusive relationships among disease-related genes. For instance, the CoMEt and MEMo algorithms examine mutual exclusivity on protein–protein interaction networks [96,97]. Moreover, the relationship between genes can be essential for an organism. Therefore, models analyzing such alterations integrate network-based analysis [98].
In contrast, tumor purity is dependent on the tumor microenvironment, including immune-cell infiltration and stromal cells [99]. In tumor microenvironment studies, network-based models are applied, for instance, to find immune-related gene modules. Although the importance of the interaction between tumors and immune cells is well known, detailed mechanisms are still unclear. Thus, many recent NGS studies employ network-based models to investigate the underlying mechanism in tumor and immune reactions. For example, McGrail et al. identified a relationship between the DNA damage response protein and immune cell infiltration in cancer. The analysis is based on curated interaction pairs in a protein–protein interaction network [100]. Most recently, Darzi et al. discovered a prognostic gene module related to immune cell infiltration by using network-centric approaches [101]. Tu et al. presented a network-centric model for mining subnetworks of genes other than immune cell infiltration by considering tumor purity [102].
3.3. Drug Target Identification with Network Information
In drug target studies, network biology is integrated into pharmacology [103]. For instance, Yamanishi et al. developed novel computational methods to investigate the pharmacological space by integrating a drug-target protein network with genomics and chemical information. The proposed approaches investigated such drug-target network information to identify potential novel drug targets [104]. Since then, the field has continued to develop methods to study drug target and drug response integrating networks with chemical and multi-omic datasets. In a recent survey study by Chen et al., the authors compared 13 computational methods for drug response prediction. It turned out that gene expression profiles are crucial information for drug response prediction [105].
Moreover, drug-target studies are often extended to drug-repurposing studies. In cancer research, drug-repurposing studies aim to find novel interactions between non-cancer drugs and molecular features in cancer. Drug-repurposing (or repositioning) studies apply computational approaches and pathway-based models and aim at discovering potential new cancer drugs with a higher probability than de novo drug design [16,106]. Specifically, drug-repurposing studies can consider various areas of cancer research, such as tumor heterogeneity and synthetic lethality. As an example, Lee et al. found clinically relevant synthetic lethality interactions by integrating multiple screening NGS datasets [107]. This synthetic lethality and related-drug datasets can be integrated for an effective combination of anticancer therapeutic strategy with non-cancer drug repurposing.
4. Deep Learning in Cancer Research
DNN models develop rapidly and become more sophisticated. They have been frequently used in all areas of biomedical research. Initially, its development was facilitated by large-scale imaging and video data. While most data sets in the biomedical field would not typically be considered big data, the rapid data accumulation enabled by NGS made it suitable for the application of DNN models requiring a large amount of training data [108]. For instance, in 2019, Samiei et al. used TCGA-based large-scale cancer data as benchmark datasets for bioinformatics machine learning research such as Image-Net in the computer vision field [109]. Subsequently, large-scale public cancer data sets such as TCGA encouraged the wide usage of DNNs in the cancer domain [110]. Over the last decade, these state-of-the-art machine learning methods have been incorporated in many different biological questions [111].
In addition to public cancer databases such as TCGA, the genetic information of normal tissues is stored in well-curated databases such as GTEx [112] and 1000Genomes [113]. These databases are frequently used as control or baseline training data for deep learning [114]. Moreover, other non-curated large-scale data sources such as GEO (https://www.ncbi.nlm.nih.gov/geo/, accessed on 20 May 2021) can be leveraged to tackle critical aspects in cancer research. They store a large-scale of biological data produced under various experimental setups (Figure 1). Therefore, an integration of GEO data and other data requires careful preprocessing. Overall, an increasing amount of datasets facilitate the development of current deep learning in bioinformatics research [115].
4.1. Challenges for Deep Learning in Cancer Research
Many studies in biology and medicine used NGS and produced large amounts of data during the past few decades, moving the field to the big data era. Nevertheless, researchers still face a lack of data in particular when investigating rare diseases or disease states. Researchers have developed a manifold of potential solutions to overcome this lack of data challenges, such as imputation, augmentation, and transfer learning (Figure 3b). Data imputation aims at handling data sets with missing values [116]. It has been studied on various NGS omics data types to recover missing information [117]. It is known that gene expression levels can be altered by different regulatory elements, such as DNA-binding proteins, epigenomic modifications, and post-transcriptional modifications. Therefore, various models integrating such regulatory schemes have been introduced to impute missing omics data [118,119]. Some DNN-based models aim to predict gene expression changes based on genomics or epigenomics alteration. For instance, TDimpute aims at generating missing RNA-seq data by training a DNN on methylation data. They used TCGA and TARGET (https://ocg.cancer.gov/programs/target/data-matrix, accessed on 20 May 2021) data as proof of concept of the applicability of DNN for data imputation in a multi-omics integration study [120]. Because this integrative model can exploit information in different levels of regulatory mechanisms, it can build a more detailed model and achieve better performance than a model build on a single-omics dataset [117,121]. The generative adversarial network (GAN) is a DNN structure for generating simulated data that is different from the original data but shows the same characteristics [122]. GANs can impute missing omics data from other multi-omics sources. Recently, the GAN algorithm is getting more attention in single-cell transcriptomics because it has been recognized as a complementary technique to overcome the limitation of scRNA-seq [123]. In contrast to data imputation and generation, other machine learning approaches aim to cope with a limited dataset in different ways. Transfer learning or few-shot learning, for instance, aims to reduce the search space with similar but unrelated datasets and guide the model to solve a specific set of problems [124]. These approaches train models with data of similar characteristics and types but different data to the problem set. After pre-training the model, it can be fine-tuned with the dataset of interest [125,126]. Thus, researchers are trying to introduce few-shot learning models and meta-learning approaches to omics and translational medicine. For example, Select-ProtoNet applied the ProtoTypical Network [127] model to TCGA transcriptome data and classified patients into two groups according to their clinical status [128]. AffinityNet predicts kidney and uterus cancer subtypes with gene expression profiles [129].
Figure 3. (a) In various studies, NGS data transformed into different forms. The 2-D transformed form is for the convolution layer. Omics data is transformed into pathway level, GO enrichment score, or Functional spectra. (b) DNN application on different ways to handle lack of data. Imputation for missing data in multi-omics datasets. GAN for data imputation and in silico data simulation. Transfer learning pre-trained the model with other datasets and fine-tune. (c) Various types of information in biology. (d) Graph neural network examples. GCN is applied to aggregate neighbor information. (Created with BioRender.com).
4.2. Molecular Charactization with Network and DNN Model
DNNs have been applied in multiple areas of cancer research. For instance, a DNN model trained on TCGA cancer data can aid molecular characterization by identifying cancer driver genes. At the very early stage, Yuan et al. build DeepGene, a cancer-type classifier. They implemented data sparsity reduction methods and trained the DNN model with somatic point mutations [130]. Lyu et al. [131] and DeepGx [132] embedded a 1-D gene expression profile to a 2-D array by chromosome order to implement the convolution layer (Figure 3a). Other algorithms, such as the deepDriver, use k-nearest neighbors for the convolution layer. A predefined number of neighboring gene mutation profiles was the input for the convolution layer. It employed this convolution layer in a DNN by aggregating mutation information of the k-nearest neighboring genes [11]. Instead of embedding to a 2-D image, DeepCC transformed gene expression data into functional spectra. The resulting model was able to capture molecular characteristics by training cancer subtypes [14].
Another DNN model was trained to infer the origin of tissue from single-nucleotide variant (SNV) information of metastatic tumor. The authors built a model by using the TCGA/ICGC data and analyzed SNV patterns and corresponding pathways to predict the origin of cancer. They discovered that metastatic tumors retained their original cancer’s signature mutation pattern. In this context, their DNN model obtained even better accuracy than a random forest model [133] and, even more important, better accuracy than human pathologists [12].
4.3. Tumor Heterogeneity with Network and DNN Model
As described in Section 4.1, there are several issues because of cancer heterogeneity, e.g., tumor microenvironment. Thus, there are only a few applications of DNN in intratumoral heterogeneity research. For instance, Menden et al. developed ’Scaden’ to deconvolve cell types in bulk-cell sequencing data. ’Scaden’ is a DNN model for the investigation of intratumor heterogeneity. To overcome the lack of training datasets, researchers need to generate in silico simulated bulk-cell sequencing data based on single-cell sequencing data [134]. It is presumed that deconvolving cell types can be achieved by knowing all possible expressional profiles of the cell [36]. However, this information is typically not available. Recently, to tackle this problem, single-cell sequencing-based studies were conducted. Because of technical limitations, we need to handle lots of missing data, noises, and batch effects in single-cell sequencing data [135]. Thus, various machine learning methods were developed to process single-cell sequencing data. They aim at mapping single-cell data onto the latent space. For example, scDeepCluster implemented an autoencoder and trained it on gene-expression levels from single-cell sequencing. During the training phase, the encoder and decoder work as denoiser. At the same time, they can embed high-dimensional gene-expression profiles to lower-dimensional vectors [136]. This autoencoder-based method can produce biologically meaningful feature vectors in various contexts, from tissue cell types [137] to different cancer types [138,139].
4.4. Drug Target Identification with Networks and DNN Models
In addition to NGS datasets, large-scale anticancer drug assays enabled the training train of DNNs. Moreover, non-cancer drug response assay datasets can also be incorporated with cancer genomic data. In cancer research, a multidisciplinary approach was widely applied for repurposing non-oncology drugs to cancer treatment. This drug repurposing is faster than de novo drug discovery. Furthermore, combination therapy with a non-oncology drug can be beneficial to overcome the heterogeneous properties of tumors [85]. The deepDR algorithm integrated ten drug-related networks and trained deep autoencoders. It used a random-walk-based algorithm to represent graph information into feature vectors. This approach integrated network analysis with a DNN model validated with an independent drug-disease dataset [15].
The authors of CDRscan did an integrative analysis of cell-line-based assay datasets and other drug and genomics datasets. It shows that DNN models can enhance the computational model for improved drug sensitivity predictions [140]. Additionally, similar to previous network-based models, the multi-omics application of drug-targeted DNN studies can show higher prediction accuracy than the single-omics method. MOLI integrated genomic data and transcriptomic data to predict the drug responses of TCGA patients [141].
4.5. Graph Neural Network Model
In general, the advantage of using a biological network is that it can produce more comprehensive and interpretable results from high-dimensional omics data. Furthermore, in an integrative multi-omics data analysis, network-based integration can improve interpretability over traditional approaches. Instead of pre-/post-integration of a network, recently developed graph neural networks use biological networks as the base structure for the learning network itself. For instance, various pathways or interactome information can be integrated as a learning structure of a DNN and can be aggregated as heterogeneous information. In a GNN study, a convolution process can be done on the provided network structure of data. Therefore, the convolution on a biological network made it possible for the GNN to focus on the relationship among neighbor genes. In the graph convolution layer, the convolution process integrates information of neighbor genes and learns topological information (Figure 3d). Consequently, this model can aggregate information from far-distant neighbors, and thus can outperform other machine learning models [142].
In the context of the inference problem of gene expression, the main question is whether the gene expression level can be explained by aggregating the neighboring genes. A single gene inference study by Dutil et al. showed that the GNN model outperformed other DNN models [143]. Moreover, in cancer research, such GNN models can identify cancer-related genes with better performance than other network-based models, such as HotNet2 and MutSigCV [144]. A recent GNN study with a multi-omics integrative analysis identified 165 new cancer genes as an interactive partner for known cancer genes [145]. Additionally, in the synthetic lethality area, dual-dropout GNN outperformed previous bioinformatics tools for predicting synthetic lethality in tumors [146]. GNNs were also able to classify cancer subtypes based on pathway activity measures with RNA-seq data. Lee et al. implemented a GNN for cancer subtyping and tested five cancer types. Thus, the informative pathway was selected and used for subtype classification [147]. Furthermore, GNNs are also getting more attention in drug repositioning studies. As described in Section 3.3, drug discovery requires integrating various networks in both chemical and genomic spaces (Figure 3d). Chemical structures, protein structures, pathways, and other multi-omics data were used in drug-target identification and repurposing studies (Figure 3c). Each of the proposed applications has a specialty in the different purposes of drug-related tasks. Sun et al. summarized GNN-based drug discovery studies and categorized them into four classes: molecular property and activity prediction, interaction prediction, synthesis prediction, and de novo drug design. The authors also point out four challenges in the GNN-mediated drug discovery. At first, as we described before, there is a lack of drug-related datasets. Secondly, the current GNN models can not fully represent 3-D structures of chemical molecules and protein structures. The third challenge is integrating heterogeneous network information. Drug discovery usually requires a multi-modal integrative analysis with various networks, and GNNs can improve this integrative analysis. Lastly, although GNNs use graphs, stacked layers still make it hard to interpret the model [148].
4.6. Shortcomings in AI and Revisiting Validity of Biological Networks as Prior Knowledge
The previous sections reviewed a variety of DNN-based approaches that present a good performance on numerous applications. However, it is hardly a panacea for all research questions. In the following, we will discuss potential limitations of the DNN models. In general, DNN models with NGS data have two significant issues: (i) data requirements and (ii) interpretability. Usually, deep learning needs a large proportion of training data for reasonable performance which is more difficult to achieve in biomedical omics data compared to, for instance, image data. Today, there are not many NGS datasets that are well-curated and -annotated for deep learning. This can be an answer to the question of why most DNN studies are in cancer research [110,149]. Moreover, the deep learning models are hard to interpret and are typically considered as black-boxes. Highly stacked layers in the deep learning model make it hard to interpret its decision-making rationale. Although the methodology to understand and interpret deep learning models has been improved, the ambiguity in the DNN models’ decision-making hindered the transition between the deep learning model and translational medicine [149,150].
As described before, biological networks are employed in various computational analyses for cancer research. The studies applying DNNs demonstrated many different approaches to use prior knowledge for systematic analyses. Before discussing GNN application, the validity of biological networks in a DNN model needs to be shown. The LINCS program analyzed data of ’The Connectivity Map (CMap) project’ to understand the regulatory mechanism in gene expression by inferring the whole gene expression profiles from a small set of genes (https://lincsproject.org/, accessed on 20 May 2021) [151,152]. This LINCS program found that the gene expression level is inferrable with only nearly 1000 genes. They called this gene list ’landmark genes’. Subsequently, Chen et al. started with these 978 landmark genes and tried to predict other gene expression levels with DNN models. Integrating public large-scale NGS data showed better performance than the linear regression model. The authors conclude that the performance advantage originates from the DNN’s ability to model non-linear relationships between genes [153].
Following this study, Beltin et al. extensively investigated various biological networks in the same context of the inference of gene expression level. They set up a simplified representation of gene expression status and tried to solve a binary classification task. To show the relevance of a biological network, they compared various gene expression levels inferred from a different set of genes, neighboring genes in PPI, random genes, and all genes. However, in the study incorporating TCGA and GTEx datasets, the random network model outperformed the model build on a known biological network, such as StringDB [154]. While network-based approaches can add valuable insights to analysis, this study shows that it cannot be seen as the panacea, and a careful evaluation is required for each data set and task. In particular, this result may not represent biological complexity because of the oversimplified problem setup, which did not consider the relative gene-expressional changes. Additionally, the incorporated biological networks may not be suitable for inferring gene expression profiles because they consist of expression-regulating interactions, non-expression-regulating interactions, and various in vivo and in vitro interactions.
“ However, although recently sophisticated applications of deep learning showed improved accuracy, it does not reflect a general advancement. Depending on the type of NGS data, the experimental design, and the question to be answered, a proper approach and specific deep learning algorithms need to be considered. Deep learning is not a panacea. In general, to employ machine learning and systems biology methodology for a specific type of NGS data, a certain experimental design, a particular research question, the technology, and network data have to be chosen carefully.”
Hoadley, K.A.; Yau, C.; Wolf, D.M.; Cherniack, A.D.; Tamborero, D.; Ng, S.; Leiserson, M.D.; Niu, B.; McLellan, M.D.; Uzunangelov, V.; et al. Multiplatform analysis of 12 cancer types reveals molecular classification within and across tissues of origin. Cell2014, 158, 929–944. [Google Scholar] [CrossRef] [PubMed]
Hutter, C.; Zenklusen, J.C. The cancer genome atlas: Creating lasting value beyond its data. Cell2018, 173, 283–285. [Google Scholar] [CrossRef]
Chuang, H.Y.; Lee, E.; Liu, Y.T.; Lee, D.; Ideker, T. Network-based classification of breast cancer metastasis. Mol. Syst. Biol.2007, 3, 140. [Google Scholar] [CrossRef]
Zhang, W.; Chien, J.; Yong, J.; Kuang, R. Network-based machine learning and graph theory algorithms for precision oncology. NPJ Precis. Oncol.2017, 1, 25. [Google Scholar] [CrossRef] [PubMed]
Ngiam, K.Y.; Khor, W. Big data and machine learning algorithms for health-care delivery. Lancet Oncol.2019, 20, e262–e273. [Google Scholar] [CrossRef]
Creixell, P.; Reimand, J.; Haider, S.; Wu, G.; Shibata, T.; Vazquez, M.; Mustonen, V.; Gonzalez-Perez, A.; Pearson, J.; Sander, C.; et al. Pathway and network analysis of cancer genomes. Nat. Methods2015, 12, 615. [Google Scholar]
Reyna, M.A.; Haan, D.; Paczkowska, M.; Verbeke, L.P.; Vazquez, M.; Kahraman, A.; Pulido-Tamayo, S.; Barenboim, J.; Wadi, L.; Dhingra, P.; et al. Pathway and network analysis of more than 2500 whole cancer genomes. Nat. Commun.2020, 11, 729. [Google Scholar] [CrossRef]
Luo, P.; Ding, Y.; Lei, X.; Wu, F.X. deepDriver: Predicting cancer driver genes based on somatic mutations using deep convolutional neural networks. Front. Genet.2019, 10, 13. [Google Scholar] [CrossRef]
Jiao, W.; Atwal, G.; Polak, P.; Karlic, R.; Cuppen, E.; Danyi, A.; De Ridder, J.; van Herpen, C.; Lolkema, M.P.; Steeghs, N.; et al. A deep learning system accurately classifies primary and metastatic cancers using passenger mutation patterns. Nat. Commun.2020, 11, 728. [Google Scholar] [CrossRef]
Chaudhary, K.; Poirion, O.B.; Lu, L.; Garmire, L.X. Deep learning–based multi-omics integration robustly predicts survival in liver cancer. Clin. Cancer Res.2018, 24, 1248–1259. [Google Scholar] [CrossRef]
Gao, F.; Wang, W.; Tan, M.; Zhu, L.; Zhang, Y.; Fessler, E.; Vermeulen, L.; Wang, X. DeepCC: A novel deep learning-based framework for cancer molecular subtype classification. Oncogenesis2019, 8, 44. [Google Scholar] [CrossRef]
Zeng, X.; Zhu, S.; Liu, X.; Zhou, Y.; Nussinov, R.; Cheng, F. deepDR: A network-based deep learning approach to in silico drug repositioning. Bioinformatics2019, 35, 5191–5198. [Google Scholar] [CrossRef]
Issa, N.T.; Stathias, V.; Schürer, S.; Dakshanamurthy, S. Machine and deep learning approaches for cancer drug repurposing. In Seminars in Cancer Biology; Elsevier: Amsterdam, The Netherlands, 2020. [Google Scholar]
The ICGC/TCGA Pan-Cancer Analysis of Whole Genomes Consortium. Pan-cancer analysis of whole genomes. Nature2020, 578, 82. [Google Scholar] [CrossRef] [PubMed]
King, M.C.; Marks, J.H.; Mandell, J.B. Breast and ovarian cancer risks due to inherited mutations in BRCA1 and BRCA2. Science2003, 302, 643–646. [Google Scholar] [CrossRef] [PubMed]
Courtney, K.D.; Corcoran, R.B.; Engelman, J.A. The PI3K pathway as drug target in human cancer. J. Clin. Oncol.2010, 28, 1075. [Google Scholar] [CrossRef] [PubMed]
Parker, J.S.; Mullins, M.; Cheang, M.C.; Leung, S.; Voduc, D.; Vickery, T.; Davies, S.; Fauron, C.; He, X.; Hu, Z.; et al. Supervised risk predictor of breast cancer based on intrinsic subtypes. J. Clin. Oncol.2009, 27, 1160. [Google Scholar] [CrossRef]
Yersal, O.; Barutca, S. Biological subtypes of breast cancer: Prognostic and therapeutic implications. World J. Clin. Oncol.2014, 5, 412. [Google Scholar] [CrossRef] [PubMed]
Zhao, L.; Lee, V.H.; Ng, M.K.; Yan, H.; Bijlsma, M.F. Molecular subtyping of cancer: Current status and moving toward clinical applications. Brief. Bioinform.2019, 20, 572–584. [Google Scholar] [CrossRef] [PubMed]
Jones, P.A.; Issa, J.P.J.; Baylin, S. Targeting the cancer epigenome for therapy. Nat. Rev. Genet.2016, 17, 630. [Google Scholar] [CrossRef] [PubMed]
Huang, S.; Chaudhary, K.; Garmire, L.X. More is better: Recent progress in multi-omics data integration methods. Front. Genet.2017, 8, 84. [Google Scholar] [CrossRef]
Chin, L.; Andersen, J.N.; Futreal, P.A. Cancer genomics: From discovery science to personalized medicine. Nat. Med.2011, 17, 297. [Google Scholar] [CrossRef] [PubMed]
Use of Systems Biology in Anti-Microbial Drug Development
Genomics, Computational Biology and Drug Discovery for Mycobacterial Infections: Fighting the Emergence of Resistance. Asma Munir, Sundeep Chaitanya Vedithi, Amanda K. Chaplin and Tom L. Blundell. Front. Genet., 04 September 2020 | https://doi.org/10.3389/fgene.2020.00965
In an earlier review article (Waman et al., 2019), we discussed various computational approaches and experimental strategies for drug target identification and structure-guided drug discovery. In this review we discuss the impact of the era of precision medicine, where the genome sequences of pathogens can give clues about the choice of existing drugs, and repurposing of others. Our focus is directed toward combatting antimicrobial drug resistance with emphasis on tuberculosis and leprosy. We describe structure-guided approaches to understanding the impacts of mutations that give rise to antimycobacterial resistance and the use of this information in the design of new medicines.
Genome Sequences and Proteomic Structural Databases
In recent years, there have been many focused efforts to define the amino-acid sequences of the M. tuberculosis pan-genome and then to define the three-dimensional structures and functional interactions of these gene products. This work has led to essential genes of the bacteria being revealed and to a better understanding of the genetic diversity in different strains that might lead to a selective advantage (Coll et al., 2018). This will help with our understanding of the mode of antibiotic resistance within these strains and aid structure-guided drug discovery. However, only ∼10% of the ∼4128 proteins have structures determined experimentally.
Several databases have been developed to integrate the genomic and/or structural information linked to drug resistance in Mycobacteria (Table 1). These invaluable resources can contribute to better understanding of molecular mechanisms involved in drug resistance and improvement in the selection of potential drug targets.
There is a dearth of information related to structural aspects of proteins from M. leprae and their oligomeric and hetero-oligomeric organization, which has limited the understanding of physiological processes of the bacillus. The structures of only 12 proteins have been solved and deposited in the protein data bank (PDB). However, the high sequence similarity in protein coding genes between M. leprae and M. tuberculosis allows computational methods to be used for comparative modeling of the proteins of M. leprae. Mainly monomeric models using single template modeling have been defined and deposited in the Swiss Model repository (Bienert et al., 2017), in Modbase (Pieper et al., 2014), and in a collection with other infectious disease agents (Sosa et al., 2018). There is a need for multi-template modeling and building homo- and hetero-oligomeric complexes to better understand the interfaces, druggability and impacts of mutations.
We are now exploiting Vivace, a multi-template modeling pipeline developed in our lab for modeling the proteomes of M. tuberculosis (CHOPIN, see above) and M. abscessus [Mabellini Database (Skwark et al., 2019)], to model the proteome of M. leprae. We emphasize the need for understanding the protein interfaces that are critical to function. An example of this is that of the RNA-polymerase holoenzyme complex from M. leprae. We first modeled the structure of this hetero-hexamer complex and later deciphered the binding patterns of rifampin (Vedithi et al., 2018; Figures 1A,B). Rifampin is a known drug to treat tuberculosis and leprosy. Owing to high rifampin resistance in tuberculosis and emerging resistance in leprosy, we used an approach known as “Computational Saturation Mutagenesis”, to identify sites on the protein that are less impacted by mutations. In this study, we were able to understand the association between predicted impacts of mutations on the structure and phenotypic rifampin-resistance outcomes in leprosy.
FIGURE 2
Figure 2.(A) Stability changes predicted by mCSM for systematic mutations in the ß-subunit of RNA polymerase in M. leprae. The maximum destabilizing effect from among all 19 possible mutations at each residue position is considered as a weighting factor for the color map that gradients from red (high destabilizing effects) to white (neutral to stabilizing effects) (Vedithi et al., 2020). (B) One of the known mutations in the ß-subunit of RNA polymerase, the S437H substitution which resulted in a maximum destabilizing effect [-1.701 kcal/mol (mCSM)] among all 19 possibilities this position. In the mutant, histidine (residue in green) forms hydrogen bonds with S434 and Q438, aromatic interactions with F431, and other ring-ring and π interactions with the surrounding residues which can impact the shape of the rifampin binding pocket and rifampin affinity to the ß-subunit [-0.826 log(affinity fold change) (mCSM-lig)]. Orange dotted lines represent weak hydrogen bond interactions. Ring-ring and intergroup interactions are depicted in cyan. Aromatic interactions are represented in sky-blue and carbonyl interactions in pink dotted lines. Green dotted lines represent hydrophobic interactions (Vedithi et al., 2020).
Examples of Understanding and Combatting Resistance
The availability of whole genome sequences in the present era has greatly enhanced the understanding of emergence of drug resistance in infectious diseases like tuberculosis. The data generated by the whole genome sequencing of clinical isolates can be screened for the presence of drug-resistant mutations. A preliminary in silico analysis of mutations can then be used to prioritize experimental work to identify the nature of these mutations.
FIGURE 3
Figure 3.(A) Mechanism of isoniazid activation and INH-NAD adduct formation. (B) Mutations mapped (Munir et al., 2019) on the structure of KatG (PDB ID:1SJ2; Bertrand et al., 2004).
Other articles related to Computational Biology, Systems Biology, and Bioinformatics on this online journal include:
The Future of Speech-Based Human-Computer Interaction
Reporter: Ethan Coomber, Research Assistant III
2021 LPBI Summer Internship in Data Science and Podcast Library Development This article reports on a research conducted by the Tokyo Institute of Technology, published on 9 June 2021.
As technology continues to advance, the human-computer relationship develops alongside with it. As researchers and developers find new ways to improve a computer’s ability to recognize the distinct pitches that compose a human’s voice, the potential of technology begins to push back what people previously thought was possible. This constant improvement in technology has allowed us to identify new potential challenges in voice-based technological interaction.
When humans interact with one another, we do not convey our message with only our voices. There are a multitude of complexities to our emotional states and personality that cannot be obtained simply through the sound coming out of our mouths. Aspects of our communication such as rhythm, tone, and pitch are essential in our understanding of one another. This presents a challenge to artificial intelligence as technology is not able to pick up on these cues.
In the modern day, our interactions with voice-based devices and services continue to increase. In this light, researchers at Tokyo Institute of Technology and RIKEN, Japan, have performed a meta-synthesis to understand how we perceive and interact with the voice (and the body) of various machines. Their findings have generated insights into human preferences, and can be used by engineers and designers to develop future vocal technologies.
– Kate Seaborn
While it will always be difficult for technology to perfectly replicate a human interaction, the inclusion of filler terms such as “I mean…”, “um” and “like…” have been shown to improve human’s interaction and comfort when communicating with technology. Humans prefer communicating with agents that match their personality and overall communication style. The illusion of making the artificial intelligence appear human has a dramatic affect on the overall comfort of the person interacting with the technology. Several factors that have been proven to improve communication are when the artificial intelligence comes across as happy or empathetic with a higher pitched voice.
Using machine learning, computers are able to recognize patterns within human speech rather than requiring programming for specific patterns. This allows for the technology to adapt to human tendencies as they continue to see them. Over time, humans develop nuances in the way they speak and communicate which frequently results in a tendency to shorten certain words. One of the more common examples is the expression “I don’t know”. This expression is frequently reduced to the phrase “dunno”. Using machine learning, computers would be able to recognize this pattern and realize what the human’s intention is.
With advances in technology and the development of voice assistance in our lives, we are expanding our interactions to include computer interfaces and environments. While there are still many advances that need to be made in order to achieve the desirable level of communication, developers have identified the necessary steps to achieve the desirable human-computer interaction.
Sources:
Tokyo Institute of Technology. “The role of computer voice in the future of speech-based human-computer interaction.” ScienceDaily. ScienceDaily, 9 June 2021.
Application of Natural Language Processing (NLP) on ~1MM cases of semi-structured echocardiogram reports: Identification of aortic stenosis (AS) cases – Accuracy comparison to administrative diagnosis codes (IDC 9/10 codes)
Reporter: Aviva Lev-Ari, PhD, RN
Large-Scale Identification of Aortic Stenosis and its Severity Using Natural Language Processing on Electronic Health Records
Background Systematic case identification is critical to improving population health, but widely used diagnosis code-based approaches for conditions like valvular heart disease are inaccurate and lack specificity. Objective To develop and validate natural language processing (NLP) algorithms to identify aortic stenosis (AS) cases and associated parameters from semi-structured echocardiogram reports and compare its accuracy to administrative diagnosis codes. Methods Using 1,003 physician-adjudicated echocardiogram reports from Kaiser Permanente Northern California, a large, integrated healthcare system (>4.5 million members), NLP algorithms were developed and validated to achieve positive and negative predictive values >95% for identifying AS and associated echocardiographic parameters. Final NLP algorithms were applied to all adult echocardiography reports performed between 2008-2018, and compared to ICD-9/10 diagnosis code-based definitions for AS found from 14 days before to six months after the procedure date. Results A total of 927,884 eligible echocardiograms were identified during the study period among 519,967 patients. Application of the final NLP algorithm classified 104,090 (11.2%) echocardiograms with any AS (mean age 75.2 years, 52% women), with only 67,297 (64.6%) having a diagnosis code for AS between 14 days before and up to six months after the associated echocardiogram. Among those without associated diagnosis codes, 19% of patients had hemodynamically significant AS (i.e., greater than mild disease). Conclusion A validated NLP algorithm applied to a systemwide echocardiography database was substantially more accurate than diagnosis codes for identifying AS. Leveraging machine learning-based approaches on unstructured EHR data can facilitate more effective individual and population management than using administrative data alone.
Large-scale identification of aortic stenosis and its severity using natural language processing on electronic health records
Systematic case identification is critical to improving population health, but widely used diagnosis code–based approaches for conditions like valvular heart disease are inaccurate and lack specificity.
Objective
To develop and validate natural language processing (NLP) algorithms to identify aortic stenosis (AS) cases and associated parameters from semi-structured echocardiogram reports and compare their accuracy to administrative diagnosis codes.
Methods
Using 1003 physician-adjudicated echocardiogram reports from Kaiser Permanente Northern California, a large, integrated healthcare system (>4.5 million members), NLP algorithms were developed and validated to achieve positive and negative predictive values > 95% for identifying AS and associated echocardiographic parameters. Final NLP algorithms were applied to all adult echocardiography reports performed between 2008 and 2018 and compared to ICD-9/10 diagnosis code–based definitions for AS found from 14 days before to 6 months after the procedure date.
Results
A total of 927,884 eligible echocardiograms were identified during the study period among 519,967 patients. Application of the final NLP algorithm classified 104,090 (11.2%) echocardiograms with any AS (mean age 75.2 years, 52% women), with only 67,297 (64.6%) having a diagnosis code for AS between 14 days before and up to 6 months after the associated echocardiogram. Among those without associated diagnosis codes, 19% of patients had hemodynamically significant AS (ie, greater than mild disease).
Conclusion
A validated NLP algorithm applied to a systemwide echocardiography database was substantially more accurate than diagnosis codes for identifying AS. Leveraging machine learning–based approaches on unstructured electronic health record data can facilitate more effective individual and population management than using administrative data alone.
Keywords
Aortic stenosis Echocardiography Machine learning Population health Quality and outcomes Valvular heart disease
In this blog post, I want to highlight some of the most important stories related to machine learning and NLP that I came across in 2019.
SAS AI/ML Training
By Elvis Saravia, Affective Computing & NLP Researcher
Other Related Topics
Activation Atlases is a technique developed by researchers at Google and Open AI to better understand and visualize the interactions happening between neurons of a neural network.
“An activation atlas of the InceptionV1 vision classification network reveals many fully realized features, such as electronics, buildings, food, animal ears, plants, and watery backgrounds.” — source
This Colab notebook provides a great introduction on how to use Nucleus and TensorFlow for “DNA Sequencing Error Correction”. And here is a great detailed post on the use of deep learning architectures for exploring DNA.
Alexander Rush is a Harvard NLP researcher who wrote an important article about the issues with tensors and how some current libraries expose them. He also went on to talk about a proposal for tensors with named indices.
ML/NLP Tools and Datasets ⚙️
StanfordNLP released StanfordNLP 0.2.0 which is a Python library for natural language analysis. You can perform different types of linguistic analysis such as lemmatization and part of speech recognition on over 70 different languages.
GQA is a visual question answering dataset for enabling research related to visual reasoning.
exBERT is a visual interactive tool to explore the embeddings and attention of Transformer language models. You can find the paper here and the demo here.
Natural language processing is perhaps the most talked-about subfield of data science. It’s interesting, it’s promising, and it can transform the way we see technology today. Not just technology, but it can also transform the way we perceive human languages.
Natural language processing has been gaining too much attention and traction from both research and industry because it is a combination between human languages and technology. Ever since computers were first created, people have dreamt about creating computer programs that can comprehend human languages.
The advances in machine learning and artificial intelligence fields have driven the appearance and continuous interest in natural language processing. This interest will only grow bigger, especially now that we can see how natural language processing could make our lives easier. This is prominent by technologies such as Alexa, Siri, and automatic translators.
The truth is, natural language processing is the reason I got into data science. I was always fascinated by languages and how they evolve based on human experience and time. I wanted to know how we can teach computers to comprehend our languages, not just that, but how can we make them capable of using them to communicate and understand us.
In this article, I will go through the 6 fundamental techniques of natural language processing that you should know if you are serious about getting into the field.
NLP 101: What is Natural Language Processing?
How did NLP start?
towardsdatascience.com
Lemmatization and stemming
Stemming and lemmatization are probably the first two steps to build an NLP project — you often use one of the two. They represent the field’s core concepts and are often the first techniques you will implement on your journey to be an NLP master.
Often, beginners tend to confuse the two techniques. Although they have their similarities, they are quite different.
Stemming: Stemming is a collection of algorithms that work by clipping off the end of the beginning of the word to reach its infinitive form.These algorithms do that by considering the common prefixes and suffixes of the language being analyzed. Clipping off the words can lead to the correct infinitive form, but that’s not always the case. There are many algorithms to perform stemming; the most common one used in English is the Porter stemmer. This algorithm contains 5 phases that work sequentially to obtain the word’s root.
Lemmatization: To overcome the flaws of stemming, lemmatization algorithms were designed. In these types of algorithms, some linguistic and grammar knowledge needs to be fed to the algorithm to make better decisions when extracting a word’s infinitive form. For lemmatization algorithms to perform accurately, they need to extract the correct lemma of each word. So, they often require a dictionary of the language to be able to categorize each word correctly.
Based on these definitions, you can imagine that building a lemmatizer is more complex and more time consuming than building a stemmer. However, it is more accurate and will cause less noise in the final analysis results.
Keywords extraction
Keyword extraction — sometimes called keyword detection or keyword analysis — is an NLP technique used for text analysis. This technique’s main purpose is to automatically extract the most frequent words and expressions from the body of a text. It is often used as a first step to summarize the main ideas of a text and to deliver the key ideas presented in the text.
In the backend of keyword extraction algorithms lays the power of machine learning and artificial intelligence. They are used to extract and simplify a given text for it to be understandable by the computer. The algorithm can be adapted and applied to any type of context, from academic text to colloquial text used in social media posts.
Keywords extraction has many applications in today’s world, including social media monitoring, customer service/ feedback, product analysis, and search engine optimization.
Named Entity Recognition (NER)
Like stemming and lemmatization, named entity recognition, or NER, NLP’s basic and core techniques are. NER is a technique used to extract entities from a body of a text used to identify basic concepts within the text, such as people’s names, places, dates, etc.
NER algorithm has mainly two steps. First, it needs to detect an entity in the text and then categorize it into one set category. The performance of NER depends heavily on the training data used to develop the model. The more relevant the training data to the actual data, the more accurate the results will be.
another factor contributing to the accuracy of a NER model is the linguistic knowledge used when building the model. That being said, there are open NER platforms that are pre-trained and ready to use.
NER can be used in a varsity of fields, such as building recommendation systems, in health care to provide better service for patients, and in academia to help students get relevant materials to their study scopes.
Topic Modelling
You can use keyword extractions techniques to narrow down a large body of text to a handful of main keywords and ideas. From which, you can probably extract the main topic of the text.
Another, more advanced technique to identify a text’s topic is topic modeling—top modeling built upon unsupervised machine learning that doesn’t require a labeled data for training.
Multiple algorithms can be used to model a topic of text, such as Correlated Topic Model, Latent Dirichlet Allocation, and Latent Sentiment Analysis. The most commonly used approach is the Latent Dirichlet. This approach analyzes the text, breaks it down into words and statements, and then extracts different topics from these words and statements. All you need to do is feed the algorithm a body of text, and it will take it from there.
One of the useful and promising applications of NLP is text summarization. That is reducing a large body of text into a smaller chuck containing the text’s main message. This technique is often used in long news articles and to summarize research papers.
Text summarization is an advanced technique that used other techniques that we just mentioned to establish its goals, such as topic modeling and keyword extraction. The way this is established is via two steps, extract and then abstract.
In the extract phase, the algorithms create a summary by extracting the text’s important parts based on their frequency. After that, the algorithm generates another summary, this time by creating a whole new text that conveys the same message as the original text. There are many text summarization algorithms, e.g., LexRank and TextRank.
In LexRank, the algorithm categorizes the sentences in the text using a ranking model. The ranks are based on the similarity between the sentences; the more similar a sentence is to the rest of the text, the higher it will be ranked.
Sentiment Analysis
The most famous, well-known, and used NLP technique is, without a doubt, sentiment analysis. This technique’s core function is to extract the sentiment behind a body of text by analyzing the containing words.
The technique’s most simple results lay on a scale with 3 areas, negative, positive, and neutral. The algorithm can be more complex and advanced; however, the results will be numeric in this case. If the result is a negative number, then the sentiment behind the text has a negative tone to it, and if it is positive, then some positivity in the text.
Sentiment analysis is one of the broad applications of machine learning techniques. It can be implemented using either supervised or unsupervised techniques. Perhaps the most common supervised technique to perform sentiment analysis is using the Naive Bayes algorithm. Other supervised ML algorithms that can be used are gradient boosting and random forest.
Humans’ desire for computers to understand and communicate with them using spoken languages is an idea that is as old as computers themselves. Thanks to the rapid advances in technology and machine learning algorithms, this idea is no more just an idea. It is a reality that we can see and experience in our daily lives. This idea is the core diving power of natural language processing.
Natural language processing is one of today’s hot-topics and talent-attracting field. Companies and research institutes are in a race to create computer programs that fully understand and use human languages. Virtual agents and translators did improve rapidly since they first appeared in the 1960s.
Despite the different tasks that natural language processing can execute, to get in the field and start building your own projects, you need to be completely comfortable with the core 6 fundamental natural language processing techniques.
These techniques are the basic building blocks of most — if not all — natural language processing algorithms. So, if you understand these techniques and when to use them, nothing can stop you.
A Learning Path To Becoming a Data Scientist
The 10 steps roadmap to kickstarting your data science future
Recent advances in biomedical informatics, such as the application of machine learning and natural language processing (NLP) to Electronic Health Record (EHR) data, have resulted in breakthroughs in the ability to identify, classify, and predict aspects of patient care, symptoms, and communication in the clinical record. These new tools that allow researchers and clinicians to generate and examine new research questions examining patient care quality and health-related quality of life.
This webinar presents four research studies highlighting different NLP applications in EHR free text. Topics include (1) phenotyping for treatment-related side effects and system severity, (2) cancer treatment-related side-effects, (3) non-adherence to cancer therapy and recurrence, and (4) documentation of patient care goals.
Presenters discuss how these methodologies support the capture and use of real-world data for precision oncology care, population health management, and how to scale-up applications within and across health care systems.
Presenters
Julian Hong, MD, MS
Assistant Professor
Healthcare Delivery Research Program
Department of Radiation Oncology
UCSF Medical Center
Charlotta Lindvall, MD, PhD
Instructor, Medicine, Harvard Medical School
Physician, Department of Psychosocial Oncology and Palliative Care
Dana-Farber Cancer Institute
Tina Hernandez-Boussard, PhD
Associate Professor
Stanford University School of Medicine
Imon Banerjee, PhD
Assistant Professor
Department of Biomedical Informatics
Emory University School of Medicine
Intended Audience
Extramural investigators at junior, mid, and senior levels. Basic familiarity with data science methods may be helpful, but not required.
re:Invent 2020 – Virtual 3 weeks Conference, Nov. 30 – Dec. 18, 2020: How Healthcare & Life Sciences leaders are using AWS to transform their businesses and innovate on behalf of their customers.
Preview the tracks that will be available, along with the general agenda, on the website.
AWS re:Invent routinely fills several Las Vegas venues with standing-room only crowds, but we are bringing it to you with an all-virtual and free event this year. This year’s conference is gearing up to be our biggest yet and we have an exciting program planned with five keynotes, 18 leadership sessions, and over 500 breakout sessions beginning November 30. Hear how AWS experts and inspiring members of the Life Sciences & Genomics industry are using cloud technology to transform their businesses and innovate on the behalf of their customers.For Life Sciences attendees looking to get the most out of their experience, follow these steps:
Take a look at all of the Life Sciences sessions available, as well as lots of other information and additional activities, in our curated Life Sciences Attendee Guide coming soon!
Check back on this post regularly, as we’ll continually update it to reflect the newest information.
Life Sciences at re:Invent 2020
AWS enables pharma and biotech companies to transform every stage of the pharma value chain, with services that enhance data liquidity, operational excellence, and customer engagement. AWS is the trusted technology provider with the cost-effective compute and storage, machine learning capabilities, and customer-centric know how to help companies embrace innovation and bring differentiated therapeutics to market faster.
Dates and Presentation Title
BlockChain Architecture
DEC 1, 2020 | 12:00 AM – 12:20 AM EST
Nestlé brings supply chain transparency with Amazon Managed Blockchain
Chain of origin is the Nestlé answer to complete supply chain transparency, from crop to coffee cup, with technology at its heart. Today, consumers want to know about the quality of their product and know where it is sourced from. Using AWS and Amazon Man
This session demonstrates how to build interactive, trusted, and transparent live virtual experiences using the Amazon Interactive Video Service, Amazon Chime, Amazon QLDB, and Amazon Managed Blockchain to capture cryptographic, immutable, and verifiable records of real-time audience interactions.
Add To Calendar
Architecture Blockchain
DEC 10, 2020 | 11:15 PM – 11:45 PM EST
Trust and transparency in live virtual events
This session demonstrates how to build interactive, trusted, and transparent live virtual experiences using the Amazon Interactive Video Service, Amazon Chime, Amazon QLDB, and Amazon Managed Blockchain to capture cryptographic, immutable, and verifiable records of real-time audience interactions.
Add To Calendar
Architecture Blockchain
Friday, December 11
DEC 11, 2020 | 7:15 AM – 7:45 AM EST
Trust and transparency in live virtual events
This session demonstrates how to build interactive, trusted, and transparent live virtual experiences using the Amazon Interactive Video Service, Amazon Chime, Amazon QLDB, and Amazon Managed Blockchain to capture cryptographic, immutable, and verifiable records of real-time audience interactions.
Add To Calendar
Architecture Blockchain
Tuesday, December 15
DEC 15, 2020 | 4:00 PM – 4:30 PM EST
What’s new in Amazon Managed Blockchain
Amazon Managed Blockchain is a fully managed service that makes it easy for you to create and manage scalable blockchain networks using popular open-source technologies. Blockchain technologies enable groups of organizations to securely transact and
Amazon Managed Blockchain is a fully managed service that makes it easy for you to create and manage scalable blockchain networks using popular open-source technologies. Blockchain technologies enable groups of organizations to securely transact and
Amazon Managed Blockchain is a fully managed service that makes it easy for you to create and manage scalable blockchain networks using popular open-source technologies. Blockchain technologies enable groups of organizations to securely transact and
Building robots to help hospitals become safer and smarter
In hospitals and other healthcare venues, robots increasingly perform contactless delivery and autonomous maintenance services to reduce the risk of exposing patients and medical staff to harmful viruses and bacteria. In this session, see how Solaris JetBrain and M
Transform research environments with Service Workbench on AWS
Reenvison how research environments are spun up by reducing wait times from days to minutes. Service Workbench on AWS promotes repeatability, multi-institutional collaboration, and transparency in the research process. In this session, learn how Harvard Medical School is procuring and deploying domain-specific data, tools, and secure IT environments to accelerate research.
Add To Calendar
Public Sector Healthcare
Wednesday, December 2
DEC 2, 2020 | 1:15 AM – 1:45 AM EST
Transform research environments with Service Workbench on AWS
Reenvison how research environments are spun up by reducing wait times from days to minutes. Service Workbench on AWS promotes repeatability, multi-institutional collaboration, and transparency in the research process. In this session, learn how Harvard Medical School is procuring and deploying domain-specific data, tools, and secure IT environments to accelerate research.
Add To Calendar
Public Sector Healthcare
DEC 2, 2020 | 9:15 AM – 9:45 AM EST
Transform research environments with Service Workbench on AWS
Reenvison how research environments are spun up by reducing wait times from days to minutes. Service Workbench on AWS promotes repeatability, multi-institutional collaboration, and transparency in the research process. In this session, learn how Harvard Medical School is procuring and deploying domain-specific data, tools, and secure IT environments to accelerate research.
Add To Calendar
Public Sector Healthcare
DEC 2, 2020 | 11:00 AM – 11:30 AM EST
Reinventing medical imaging with machine learning on AWS
It is hard to imagine the future of medical imaging without machine learning (ML) as its central innovation engine. Countless researchers, developers, startups, and larger enterprises are engaged in building, training, and deploying ML solutions for medical i
Making healthcare more personal with MetroPlus Health
COVID has made a huge impact across the world, and organizations have had to adapt quickly to changing requirements as a result. Learn how MetroPlus Health, a New York City health plan covering over half a million people, leveraged AWS technology to quickly
Securing protected health information and high-risk datasets
Join this session featuring Jonathan Cook, Chief Technology Officer at Arcadia, for a discussion around securing mission-critical and high-risk datasets such as personal health information (PHI) in the cloud. Learn how Arcadia developed a HITRUST CSF-certified plat
ML and analytics addressing nationwide COVID-19 impact and recovery (sponsored …
In this session, learn how Fractal.AI delivered a platform to help analyze data and make decisions related to COVID-19 progression for the government of Telangana, India, deploying it on AWS in five days. The solution, based on Intel processors, delivered more than 100 dashboards using anonymized government and public datasets with hundreds of thousands of COVID-19 d… Learn More
Add To Calendar
Public Sector Partner Solutions for Business
DEC 2, 2020 | 6:30 PM – 7:00 PM EST
How Vyaire uses AWS analytics to scale ventilator production & save lives
When COVID-19 hit the US, Vyaire Medical, one of the country’s only ventilator manufacturers, knew it would have to scale rapidly while still offering quality machinery. In order to scale to 20 times more than its usual production and gain insights from all its new
Reinventing medical imaging with machine learning on AWS
It is hard to imagine the future of medical imaging without machine learning (ML) as its central innovation engine. Countless researchers, developers, startups, and larger enterprises are engaged in building, training, and deploying ML solutions for medical i
Making healthcare more personal with MetroPlus Health
COVID has made a huge impact across the world, and organizations have had to adapt quickly to changing requirements as a result. Learn how MetroPlus Health, a New York City health plan covering over half a million people, leveraged AWS technology to quickly
Securing protected health information and high-risk datasets
Join this session featuring Jonathan Cook, Chief Technology Officer at Arcadia, for a discussion around securing mission-critical and high-risk datasets such as personal health information (PHI) in the cloud. Learn how Arcadia developed a HITRUST CSF-certified plat
ML and analytics addressing nationwide COVID-19 impact and recovery (sponsored …
In this session, learn how Fractal.AI delivered a platform to help analyze data and make decisions related to COVID-19 progression for the government of Telangana, India, deploying it on AWS in five days. The solution, based on Intel processors, delivered more than 100 dashboards using anonymized government and public datasets with hundreds of thousands of COVID-19 d… Learn More
Add To Calendar
Public Sector Partner Solutions for Business
DEC 3, 2020 | 2:30 AM – 3:00 AM EST
How Vyaire uses AWS analytics to scale ventilator production & save lives
When COVID-19 hit the US, Vyaire Medical, one of the country’s only ventilator manufacturers, knew it would have to scale rapidly while still offering quality machinery. In order to scale to 20 times more than its usual production and gain insights from all its new
Reinventing medical imaging with machine learning on AWS
It is hard to imagine the future of medical imaging without machine learning (ML) as its central innovation engine. Countless researchers, developers, startups, and larger enterprises are engaged in building, training, and deploying ML solutions for medical i
Making healthcare more personal with MetroPlus Health
COVID has made a huge impact across the world, and organizations have had to adapt quickly to changing requirements as a result. Learn how MetroPlus Health, a New York City health plan covering over half a million people, leveraged AWS technology to quickly
Securing protected health information and high-risk datasets
Join this session featuring Jonathan Cook, Chief Technology Officer at Arcadia, for a discussion around securing mission-critical and high-risk datasets such as personal health information (PHI) in the cloud. Learn how Arcadia developed a HITRUST CSF-certified plat
ML and analytics addressing nationwide COVID-19 impact and recovery (sponsored …
In this session, learn how Fractal.AI delivered a platform to help analyze data and make decisions related to COVID-19 progression for the government of Telangana, India, deploying it on AWS in five days. The solution, based on Intel processors, delivered more than 100 dashboards using anonymized government and public datasets with hundreds of thousands of COVID-19 d… Learn More
Add To Calendar
Public Sector Partner Solutions for Business
DEC 3, 2020 | 10:30 AM – 11:00 AM EST
How Vyaire uses AWS analytics to scale ventilator production & save lives
When COVID-19 hit the US, Vyaire Medical, one of the country’s only ventilator manufacturers, knew it would have to scale rapidly while still offering quality machinery. In order to scale to 20 times more than its usual production and gain insights from all its new
Productionizing R workloads using Amazon SageMaker, featuring Siemens
R language and its 16,000+ packages dedicated to statistics and ML are used by statisticians and data scientists in industries such as energy, healthcare, life science, and financial services. Using R, you can run simulations and ML securely and at scale with Amazon S
Accelerating the transition to telehealth with AWS
Learn how AWS is helping healthcare organizations develop and deploy telehealth solutions quickly and at scale. Join speakers from AWS and MedStar Health as they discuss their experience developing and deploying two call centers in less than a week using Amaz
Productionizing R workloads using Amazon SageMaker, featuring Siemens
R language and its 16,000+ packages dedicated to statistics and ML are used by statisticians and data scientists in industries such as energy, healthcare, life science, and financial services. Using R, you can run simulations and ML securely and at scale with Amazon S
Accelerating the transition to telehealth with AWS
Learn how AWS is helping healthcare organizations develop and deploy telehealth solutions quickly and at scale. Join speakers from AWS and MedStar Health as they discuss their experience developing and deploying two call centers in less than a week using Amaz
Productionizing R workloads using Amazon SageMaker, featuring Siemens
R language and its 16,000+ packages dedicated to statistics and ML are used by statisticians and data scientists in industries such as energy, healthcare, life science, and financial services. Using R, you can run simulations and ML securely and at scale with Amazon S
Accelerating the transition to telehealth with AWS
Learn how AWS is helping healthcare organizations develop and deploy telehealth solutions quickly and at scale. Join speakers from AWS and MedStar Health as they discuss their experience developing and deploying two call centers in less than a week using Amaz
How Erickson Living built a COVID-19 outbreak management solution
As innovators in independent living, assisted living, and skilled nursing care, Erickson Living responded to the COVID-19 outbreak by building an infectious disease management system with the AWS Data Lab to prevent the spread of the virus. This session focuses o
Rapidly deploying social services on Amazon Connect
Organizations that respond to disruptive, large-scale events need the ability to rapidly scale and iterate on their contact centers to provide services to their constituents. Amazon Connect can be set up in minutes and scale to handle virtually any number of contact
Improving data liquidity in Roche’s personalized healthcare platform
Roche’s personalized healthcare mission is to accelerate drug discovery and transform the patient journey by using digital technologies and advanced analytics to facilitate greater scientific collaboration and insight sharing. In this session, Roche shares ho
Life Sciences Artificial Intelligence & Machine Learning
DEC 8, 2020 | 10:30 PM – 11:00 PM EST
How Erickson Living built a COVID-19 outbreak management solution
As innovators in independent living, assisted living, and skilled nursing care, Erickson Living responded to the COVID-19 outbreak by building an infectious disease management system with the AWS Data Lab to prevent the spread of the virus. This session focuses o
Rapidly deploying social services on Amazon Connect
Organizations that respond to disruptive, large-scale events need the ability to rapidly scale and iterate on their contact centers to provide services to their constituents. Amazon Connect can be set up in minutes and scale to handle virtually any number of contact
Improving data liquidity in Roche’s personalized healthcare platform
Roche’s personalized healthcare mission is to accelerate drug discovery and transform the patient journey by using digital technologies and advanced analytics to facilitate greater scientific collaboration and insight sharing. In this session, Roche shares ho
Life Sciences Artificial Intelligence & Machine Learning
DEC 9, 2020 | 6:30 AM – 7:00 AM EST
How Erickson Living built a COVID-19 outbreak management solution
As innovators in independent living, assisted living, and skilled nursing care, Erickson Living responded to the COVID-19 outbreak by building an infectious disease management system with the AWS Data Lab to prevent the spread of the virus. This session focuses o
Rapidly deploying social services on Amazon Connect
Organizations that respond to disruptive, large-scale events need the ability to rapidly scale and iterate on their contact centers to provide services to their constituents. Amazon Connect can be set up in minutes and scale to handle virtually any number of contact
Improving data liquidity in Roche’s personalized healthcare platform
Roche’s personalized healthcare mission is to accelerate drug discovery and transform the patient journey by using digital technologies and advanced analytics to facilitate greater scientific collaboration and insight sharing. In this session, Roche shares ho
Life Sciences Artificial Intelligence & Machine Learning
DEC 9, 2020 | 10:30 AM – 11:00 AM EST
BlueJeans’ explosive growth journey with AWS during the pandemic
Global video provider BlueJeans (a Verizon company) supports employees working from home, healthcare providers shifting to telehealth, and educators moving to distance learning. With so many people now working from home, BlueJeans saw explosive gro
Learn how healthcare organizations can harness the power of AI and machine learning to automate clinical workflows, digitize medical information, extract and summarize medical information, protect patient data, and more. Using AWS document understand
As clinical trials increasingly become decentralized and virtual, engaging effectively with patients can be challenging. In this session, hear how Evidation Health architects on AWS to create patient-centric experiences, ingests data from millions of devices in real time
BlueJeans’ explosive growth journey with AWS during the pandemic
Global video provider BlueJeans (a Verizon company) supports employees working from home, healthcare providers shifting to telehealth, and educators moving to distance learning. With so many people now working from home, BlueJeans saw explosive gro
Learn how healthcare organizations can harness the power of AI and machine learning to automate clinical workflows, digitize medical information, extract and summarize medical information, protect patient data, and more. Using AWS document understand
As clinical trials increasingly become decentralized and virtual, engaging effectively with patients can be challenging. In this session, hear how Evidation Health architects on AWS to create patient-centric experiences, ingests data from millions of devices in real time
BlueJeans’ explosive growth journey with AWS during the pandemic
Global video provider BlueJeans (a Verizon company) supports employees working from home, healthcare providers shifting to telehealth, and educators moving to distance learning. With so many people now working from home, BlueJeans saw explosive gro
Learn how healthcare organizations can harness the power of AI and machine learning to automate clinical workflows, digitize medical information, extract and summarize medical information, protect patient data, and more. Using AWS document understand
As clinical trials increasingly become decentralized and virtual, engaging effectively with patients can be challenging. In this session, hear how Evidation Health architects on AWS to create patient-centric experiences, ingests data from millions of devices in real time
Edge computing innovation with AWS Snowcone and AWS Snowball Edge
In this session, learn how the AWS Snow Family can help you run operations in harsh, non-data center environments and in locations where there is a lack of consistent network connectivity. The AWS Snow Family, comprised of AWS Snowcone and AWS Snowball Edge, offers a number of physical devices and capacity points with built-in computing capabilities. This sess… Learn More
Join AWS Healthcare and Life Science Leader Shez Partovi, MD, for a look into how cloud technology can reshape the future of healthcare. In this executive overview, Dr. Partovi shares a vision of a digitally enhanced, data-driven future. Learn how AWS is working
Edge computing innovation with AWS Snowcone and AWS Snowball Edge
In this session, learn how the AWS Snow Family can help you run operations in harsh, non-data center environments and in locations where there is a lack of consistent network connectivity. The AWS Snow Family, comprised of AWS Snowcone and AWS Snowball Edge, offers a number of physical devices and capacity points with built-in computing capabilities. This sess… Learn More
Join AWS Healthcare and Life Science Leader Shez Partovi, MD, for a look into how cloud technology can reshape the future of healthcare. In this executive overview, Dr. Partovi shares a vision of a digitally enhanced, data-driven future. Learn how AWS is worki
Edge computing innovation with AWS Snowcone and AWS Snowball Edge
In this session, learn how the AWS Snow Family can help you run operations in harsh, non-data center environments and in locations where there is a lack of consistent network connectivity. The AWS Snow Family, comprised of AWS Snowcone and AWS Snowball Edge, offers a number of physical devices and capacity points with built-in computing capabilities. This sess… Learn More
Join AWS Healthcare and Life Science Leader Shez Partovi, MD, for a look into how cloud technology can reshape the future of healthcare. In this executive overview, Dr. Partovi shares a vision of a digitally enhanced, data-driven future. Learn how AWS is worki
Intelligent document processing for the insurance industry
Organizations in the insurance industry, both for healthcare and financial services, extract sensitive information such as names, dates, claims, or medical procedures from scanned images and documents to perform their business operations. These organization
This session is open to anyone, but it is intended for current and potential AWS Partners. The COVID-19 pandemic has been a formative event affecting our world physically, emotionally, and economically. Despite the challenges created, AWS Partners have responded quickly and proven their resiliency by enabling digital transformation at unprecedented rates. In this sessi… Learn More
Add To Calendar
Global Partner Summit (GPS) Session
DEC 15, 2020 | 9:00 PM – 9:30 PM EST
Intelligent document processing for the insurance industry
Organizations in the insurance industry, both for healthcare and financial services, extract sensitive information such as names, dates, claims, or medical procedures from scanned images and documents to perform their business operations. These organization
This session is open to anyone, but it is intended for current and potential AWS Partners. The COVID-19 pandemic has been a formative event affecting our world physically, emotionally, and economically. Despite the challenges created, AWS Partners have responded quickly and proven their resiliency by enabling digital transformation at unprecedented rates. In this sessi… Learn More
Add To Calendar
Global Partner Summit (GPS) Session
Wednesday, December 16
DEC 16, 2020 | 5:00 AM – 5:30 AM EST
Intelligent document processing for the insurance industry
Organizations in the insurance industry, both for healthcare and financial services, extract sensitive information such as names, dates, claims, or medical procedures from scanned images and documents to perform their business operations. These organization
This session is open to anyone, but it is intended for current and potential AWS Partners. The COVID-19 pandemic has been a formative event affecting our world physically, emotionally, and economically. Despite the challenges created, AWS Partners have responded quickly and proven their resiliency by enabling digital transformation at unprecedented rates. In this sessi… Learn More
Add To Calendar
Global Partner Summit (GPS) Session
DEC 16, 2020 | 11:45 AM – 12:15 PM EST
Simplify healthcare compliance with third-party solutions
Sensitive health data must be protected to ensure patient privacy, and healthcare organizations need to ensure that IT infrastructure is compliant with changing policies and regulations. In this session, learn how healthcare providers can address compli
An introduction to healthcare interoperability and FHIR Works on AWS
Fast Healthcare Interoperability Resources (FHIR) is gaining popularity around the world as the standard to use for exchanging healthcare data, and it is being increasingly adopted in Europe and Australasia. In the US, it is actually mandated in the 21st Century
Achieving healthcare interoperability with FHIR Works on AWS
The Fast Healthcare Interoperability Resources (FHIR) standard has become increasingly necessary for enabling interoperability between healthcare applications and organizations. Join this session for a deep dive into how the FHIR Works on AWS open-source t
AWS at the edge: Using AWS IoT to optimize Amazon wind farms
AWS IoT and edge computing solutions move data processing and analysis closer to where data is generated to enable customers to innovate and achieve more sustainable operations. In this session, learn how Amazon renewable energy projects use AWS IoT to coll
Simplify healthcare compliance with third-party solutions
Sensitive health data must be protected to ensure patient privacy, and healthcare organizations need to ensure that IT infrastructure is compliant with changing policies and regulations. In this session, learn how healthcare providers can address compli
An introduction to healthcare interoperability and FHIR Works on AWS
Fast Healthcare Interoperability Resources (FHIR) is gaining popularity around the world as the standard to use for exchanging healthcare data, and it is being increasingly adopted in Europe and Australasia. In the US, it is actually mandated in the 21st Century
Achieving healthcare interoperability with FHIR Works on AWS
The Fast Healthcare Interoperability Resources (FHIR) standard has become increasingly necessary for enabling interoperability between healthcare applications and organizations. Join this session for a deep dive into how the FHIR Works on AWS open-source t
AWS at the edge: Using AWS IoT to optimize Amazon wind farms
AWS IoT and edge computing solutions move data processing and analysis closer to where data is generated to enable customers to innovate and achieve more sustainable operations. In this session, learn how Amazon renewable energy projects use AWS IoT to coll
Simplify healthcare compliance with third-party solutions
Sensitive health data must be protected to ensure patient privacy, and healthcare organizations need to ensure that IT infrastructure is compliant with changing policies and regulations. In this session, learn how healthcare providers can address compliance
An introduction to healthcare interoperability and FHIR Works on AWS
Fast Healthcare Interoperability Resources (FHIR) is gaining popularity around the world as the standard to use for exchanging healthcare data, and it is being increasingly adopted in Europe and Australasia. In the US, it is actually mandated in the 21st Century
Achieving healthcare interoperability with FHIR Works on AWS
The Fast Healthcare Interoperability Resources (FHIR) standard has become increasingly necessary for enabling interoperability between healthcare applications and organizations. Join this session for a deep dive into how the FHIR Works on AWS open-source t
AWS at the edge: Using AWS IoT to optimize Amazon wind farms
AWS IoT and edge computing solutions move data processing and analysis closer to where data is generated to enable customers to innovate and achieve more sustainable operations. In this session, learn how Amazon renewable energy projects use AWS IoT to coll
Share information by removing language barriers with Amazon Translate
In this session, see how to use Amazon Translate and Amazon Transcribe to create subtitles for educational videos and translate them to the language of the consumer’s choice. The session includes a demonstration of how this process reduced the time it took for information about COVID-19 to be translated to many languages, thus spreading accurate information quickly.
Share information by removing language barriers with Amazon Translate
In this session, see how to use Amazon Translate and Amazon Transcribe to create subtitles for educational videos and translate them to the language of the consumer’s choice. The session includes a demonstration of how this process reduced the time it took for information about COVID-19 to be translated to many languages, thus spreading accurate information quickly.
Share information by removing language barriers with Amazon Translate
In this session, see how to use Amazon Translate and Amazon Transcribe to create subtitles for educational videos and translate them to the language of the consumer’s choice. The session includes a demonstration of how this process reduced the time it took for information about COVID-19 to be translated to many languages, thus spreading accurate information quickly.
Share information by removing language barriers with Amazon Translate
In this session, see how to use Amazon Translate and Amazon Transcribe to create subtitles for educational videos and translate them to the language of the consumer’s choice. The session includes a demonstration of how this process reduced the time it took for information about COVID-19 to be translated to many languages, thus spreading accurate information quickly.
Bookmark this blog and check back for direct links to each session and add to your re:Invent schedule as soon as the session catalog is released:
LFS201: Life Sciences Industry: Executive Outlook
Learn how AWS technology is helping organizations improve their data liquidity, achieve operational excellence, and enhance customer engagement.
LFS202: Improving data liquidity in Roche’s personalized healthcare platform
Learn how Roche’s personalized healthcare platform is accelerating drug discovery and transforming the patient journey with digital technology.
LFS302: AstraZeneca genomics on AWS: from petabytes to new medicines
Learn how AstraZeneca built an industry leading genomics pipeline on AWS to analyze 2 million genomes in support of precision medicine.
LFS303: Building patient-centric virtualized trials
Learn how Evidation Health architects on AWS to create patient-centric experiences in decentralized and virtual clinical trials.
LFS304: Streamlining manufacturing and supply chain at Novartis
Learn how Novartis is creating real-time analytics and transparency in the pharma manufacturing process and supply chain to bring innovative medicines to market.
LFS305: Accelerating regulatory assessments in life sciences manufacturing
Learn how Merck leveraged Amazon Machine Learning to build an evaluation and recommendation engine for streamlining pharma manufacturing change requests.
Other related sessions of interest:
ENT203: How BMS automates GxP compliance for SAP systems on AWS
HLC203: Securing Personal Health Information and High Risk Data Sets
WPS202: Transform research environments with Service Workbench on AWS
AIM310: Intelligent document processing for healthcare organizations
Healthcare Attendee Guide
AWS re:Invent routinely fills several Las Vegas venues with standing-room only crowds, but we are bringing it to you with an all-virtual and free event this year. This year’s conference is gearing up to be our biggest yet and we have an exciting program planned for the Healthcare industry with five keynotes, 18 leadership sessions, and over 500 breakout sessions beginning November 30. See how AWS experts and talented members of the Healthcare industry are using cloud technology to transform their businesses and innovate on the behalf of their customers.For Healthcare attendees looking to get the most out of their experience, follow these steps:
Take a look at all of the Healthcare sessions available, as well as lots of other information and additional activities, in our curated Healthcare Attendee Guide coming soon!
Check back on this post regularly, as we’ll continually update it to reflect the newest information.
Healthcare at re:Invent 2020
AWS is the trusted technology partner to the global healthcare industry. For over 12 years, AWS has established itself as the most mature, comprehensive, and broadly adopted cloud platform and is trusted by thousands of healthcare customers around the world—including the fastest-growing startups, the largest enterprises, and leading government agencies. The secure and compliant AWS technology enables the highly regulated healthcare industry to improve outcomes and lower costs by providing the tools to unlock the potential of healthcare data, predict healthcare events, and build closer relationships with patients and consumers. The healthcare track at re:Invent 2020 will feature customer-led sessions focused on these each of these critical components, accelerating the transformation of healthcare.
Healthcare sessions
Learn more and bookmark each Healthcare session:
HCL201: Healthcare Executive Outlook: Accelerating Transformation
Learn how AWS is working with industry leaders to increase their pace of innovation, unlock the potential of their healthcare data, help predict patient health events, and personalize the healthcare journey for their patients, consumers, and members.
HLC202: Making Healthcare More Personal with MetroPlus Health
Learn how MetroPlus Health leveraged AWS technology to quickly build and deploy an application that personally and proactively reached out to its members during a time of critical need.
HLC203: Securing Personal Health Information and High Risk Data Sets
Learn how Arcadia developed a HITRUST CSF Certified platform by leveraging AWS technology to enable the secure management of data from over 100 million patients.
HLC204: Accelerating the Transition to Virtual Care with AWS
Learn how MedStar Health developed and deployed two call centers in less than week that are supporting more than 3,500 outpatient telehealth sessions a day.
WPS202: Transform research environments with Service Workbench on AWS
Learn how Harvard Medical School is using AWS to procure and deploy domain-specific data, tools, and secure IT environments to accelerate research.
WPS209: Reinventing medical imaging with machine learning on AWS
Learn how Radboud University Medical Center uses AWS to power its machine learning imaging platform with 45,000+ registered researchers and clinicians from all over the world.
WPS211: An introduction to healthcare interoperability and FHIR Works on AWS
Learn about AWS FHIR Works, an open-source project, designed to accelerate the industries use of the interoperability standard, Fast Healthcare Interoperability Resources (FHIR).
WPS304: Achieving healthcare interoperability with FHIR Works on AWS
Learn how Black Pear Software leveraged AWS to build an integration toolkit to help their customers share healthcare data more effectively.
Extras you won’t want to miss out on!
LFS201: Life Sciences Industry: Executive outlook
LFS202: AstraZeneca genomics on AWS: From petabytes to new medicines
LFS303: Building patient-centric virtualized trials
AIM303: Using AI to automate clinical workflows
AIM310: Intelligent document processing for the insurance industry
INO204: Solving societal challenges with digital innovation on AWS
ZWL208: Using cloud-based genomic research to reduce health care disparities
Ahmet K. Karagozoglu, Ph.D. | C.V. Starr Distinguished Professor of Finance | Visiting Scholar, Volatility and Risk Institute | Hofstra University | New York University Stern School of Business
Type: Track Keynote, Level: All Levels, Focus Area: NLP
Intelligibility Throughout the Machine Learning Life Cycle
Sveta Kostinsky | Director of Sales Engineering | Samasource
Marcelo Benedetti | Senior Account Executive | Samasource
Type: Talk, Level: Intermediate, Focus Area: Machine Learning, Deep Learning
quality rubric
Internal QA Sampling
Client QA Sampling
Auto QA
Transfer Learning in NLP
Thu, October 29, 3:40 PM (PDT)
00:
03:
30
Joan Xiao, PhD | Principal Data Scientist | Linc Global
Type: Talk, Level: Intermediate, Focus Area: NLP, Deep Learning
Transfer learning enables leveraging knowledge acquired from related data to improve performance on a target task. The advancement of deep learning and large amount of labelled data such as ImageNet has made high performing pre-trained computer vision models possible. Transfer learning, in particular, fine-tuning a pre-trained model on a target task, has been a far more common practice than training from scratch in computer vision.
In NLP, starting from 2018, thanks to the various large language models (ULMFiT, OpenAI GPT, BERT family, etc) pre-trained on large corpus, transfer learning has become a new paradigm and new state of the art results on many NLP tasks have been achieved.
In this session we’ll learn the different types of transfer learning, the architecture of these pre-trained language models, and how different transfer learning techniques can be used to solve various NLP tasks. In addition, we’ll also show a variety of problems that can be solved using these language models and transfer learning.
Transfer learning: Computer Vision – ImageNet Classification
OpenAI built a text generator – too dangerous to release
OpenAI GPT-3 – Trained on 300B tokens – THREE models:
Zero-shot – English to French – no training
one-shots
Few-shot – the GOAL – GPT-3
GRT-3 is large scale NLP
Examples – Feature extraction
English to SQL
English to CSS
English to LaTex
Semantic textual similarity
NL inference
ULMFiT – Fine tuning – the larger the # of Training examples – the better the performance
LM pre-training – start from scratch: BART, Big Bird, ELECTRA, Longformer
LM fine-tuning
Classifier fine-tuning
Data augmentation
Contextual Augmentation
Original sentence
masked
augmented
Test generation
boolean questions
from structured data, i.e., RDF – Resource Description Framework
OCTOBER 30TH
Generalized Deep Reinforcement Learning for Solving Combinatorial Optimization Problems
Fri, October 30, 9:00 AM (PDT)
Azalia Mirhoseini, PhD | Senior Research Scientist | Google Brain
Type: Keynote
Abstract:
Many problems in systems and chip design are in the form of combinatorial optimization on graph structured data. In this talk, I will motivate taking a learning based approach to combinatorial optimization problems with a focus on deep reinforcement learning (RL) agents that generalize. I will discuss our work on a new domain-transferable reinforcement learning methodology for optimizing chip placement, a long pole in hardware design. Our approach is capable of learning from past experience and improving over time, resulting in more optimized placements on unseen chip blocks as the RL agent is exposed to a larger volume of data. Our objective is to minimize PPA (power, performance, and area), and we show that, in under 6 hours, our method can generate placements that are superhuman or comparable on modern accelerator chips, whereas existing baselines require human experts in the loop and can take several weeks.
Bio:
Azalia Mirhoseini is a Senior Research Scientist at Google Brain. She is the co-founder/tech-lead of the Machine Learning for Systems Team in Google Brain where they focus on deep reinforcement learning based approaches to solve problems in computer systems and metal earning. She has a Ph.D. in Electrical and Computer Engineering from Rice University. She has received a number of awards, including the MIT Technology Review 35 under 35 award, the Best Ph.D. Thesis Award at Rice and a Gold Medal in the National Math Olympiad in Iran. Her work has been covered in various media outlets including MIT Technology Review, IEEE Spectrum, and Wired.
Placement Optimmization using AGENTS to place the nodes
Train Policy to be using for placement of ALL chips
Compiling a Dataset of Chip Placements
Policy/Value Model Architecture to save wire length used
RISC-V: Placement Visualization: Training from Scratch (Human) 6-8 weeks vs Pre-Trained 24 hours
Keynote Session – Zoubin Ghahramani
Fri, October 30, 9:30 AM (PDT)
Zoubin Ghahramani, PhD | Distinguished Scientist and Sr Research Director | Professor of Information Engineering | ex-Chief Scientist and VP of AI | Google | University of Cambridge | Uber
Automating Augmenting Data with knowledge: feature-concept mapping
Modeling
Time Series Forecasting
AI to decision Optimization
Demand forecasting from Standard AutoAI by ADDING Historical Decisions and Historical Business Impact__>> reinforced learning – Automatically created model from past and Auto AI
Validation
Meta-learning for performance prediction
Train the META data
Score production data with AI
Deployment
staged deployment with contextual bandits
Monitoring
Performance prediction meta model applied over windows of production traffic
INNOVATIONS;
End-to-end AI life cycle
expanding scope of automation; Domain knowledge and decision optimization
The State of Serverless and Applications to AI
Fri, October 30, 11:20 AM (PDT)
Joe Hellerstein, PhD | Chief Strategy Officer, Professor of Computer Science | Trifacta, Berkeley
The Cloud and practical AI have evolved hand-in-hand over the last decade. Looking forward to the next decade, both of these technologies are moving toward increased democratization, enabling the broad majority of developers to gain access to the technology.
Serverless computing is a relatively new abstraction for democratizing the task of programming the cloud at scale. In this talk I will discuss the limitations of first-generation serverless computing from the major cloud vendors, and ongoing research at Berkeley’s RISELab to push forward toward “”””stateful”””” serverless computing. In addition to system infrastructure, I will discuss and demonstrate applications including data science, model serving for machine learning, and cloud-bursted computing for robotics.
Bio:
Joseph M. Hellerstein is the Jim Gray Professor of Computer Science at the University of California, Berkeley, whose work focuses on data-centric systems and the way they drive computing. He is an ACM Fellow, an Alfred P. Sloan Research Fellow and the recipient of three ACM-SIGMOD “Test of Time” awards for his research. Fortune Magazine has included him in their list of 50 smartest people in technology , and MIT’s Technology Review magazine included his work on their TR10 list of the 10 technologies “most likely to change our world”. Hellerstein is the co-founder and Chief Strategy Officer of Trifacta, a software vendor providing intelligent interactive solutions to the messy problem of wrangling data. He has served on the technical advisory boards of a number of computing and Internet companies including Dell EMC, SurveyMonkey, Captricity, and Datometry, and previously served as the Director of Intel Research, Berkeley.
Type: Talk, Level: Intermediate, Focus Area: AI for Good, Machine Learning
Tina Eliassi-Rad, PhD | Professor | Core Faculty | Northeastern University | Network Science Institute
Type: Talk, Level: All Levels, Focus Area: Machine Learning
In 1997, Tom Mitchell defined the well-posed learning problem as follows: “A computer program is said to learn from experience E with respect to some task T and some performance measure P, if its performance on T, as measured by P, improves with experience E.” In this talk, I will discuss current tasks, experiences, and performance measures as they pertain to fairness in machine learning. The most popular task thus far has been risk assessment. We know this task comes with impossibility results (e.g., see Kleinberg et al. 2016, Chouldechova 2016). I will highlight new findings in terms of these impossibility results. In addition, most human decision-makers seem to use risk estimates for efficiency purposes and not to make fairer decisions. I will present an alternative task definition whose goal is to provide more context to the human decision-maker. The problems surrounding experience have received the most attention. Joy Buolamwini (MIT Media Lab) refers to these as the “under-sampled majority” problem. The majority of the population is non-white, non-male; however, white males are overrepresented in the training data. Not being properly represented in the training data comes at a cost to the under-sampled majority when machine learning algorithms are used to aid human decision-makers. In terms of performance measures, a variety of definitions exist from group- to individual- to procedural-fairness. I will discuss our null model for fairness and demonstrate how to use deviations from this null model to measure favoritism and prejudice in the data.
Tasks:
Assessing risk
Ranking
Statistical parity: among classifier
PARITY vs imperfect classifier – can’t satisfy all the three conditions
Precision
Tru positive
False parity
All classifier do not consider context or allow for uncertainty
Learning to Place within existing cases
Incentives/values of Human decision maker which incorporate in the decision external factors
Game-theoretical framework
How human exemplars make decision
Are algorithms value free?
Computational Ethics
Logically consistent principle
Camouflage – machine did not learn on the task but on the cloudiness of the sky
Model Cards for Model Reporting
The “undersampled majority”
Experience: Demonstration: Should we learn from demonstrations or from simulations?
Complex networks: guilt by association vs privilege and prejudice, individual fairness
Datasheets for Datasets
Algorithms are like prescription drug: Adverse events
Human vs Machine judgement
Performance measure – FAIRNESS: Group, individual
Normativity throughout the entire well-posed learning problem
Incentive/values
Human or machines to make decisions?
Laws are needed if algorithms are used as expert witness
Machine Learning for Biology and Medicine
Fri, October 30, 2:00 PM
Sriram Sankararaman, PhD | Professor, Computer Science | University of California – Los Angeles
Type: Talk, Focus Area: Machine Learning
Abstract:
Biology and medicine are deluged with data so that techniques from machine learning and statistics will increasingly play a key role in extracting insights from the vast quantities of data being generated. I will provide an overview of the modeling and inferential challenges that arise in these domains.
In the first part of my talk, I will focus on machine learning problems arising in the field of genomics. The cost of genome sequencing has decreased by over 100,000 fold over the last decade. Availability of genetic variation data from millions of individuals has opened up the possibility of using genetic information to identifying the cause of diseases, developing effective drugs, predicting disease risk and personalizing treatment. While genome-wide association studies offer a powerful paradigm to discovering disease-causing genes, the hidden genetic structure of human populations can confound these studies. I will describe statistical models that can infer this hidden structure and show how these inferences lead to novel insights into the genetic basis of diseases.
In the second part of my talk, I will discuss how the availability of large-scale electronic medical records is opening up the possibility of using machine learning in clinical settings. These electronic medical records are designed to capture a wide range of data associated with a patient including demographic information, laboratory tests, images, medications and clinical notes. Using electronic records from around 60,000 surgeries over five years in the UCLA hospital, I will describe efforts to use machine learning algorithms to predict mortality after surgery. Our results reveal that these algorithms can accurately predict mortality from information available prior to surgery indicating that automated predictive systems have great potential to augment clinical care.
Bio:
Sriram Sankararaman is an assistant professor in the Departments of Computer Science, Human Genetics, and Computational Medicine at UCLA where he leads the machine learning and genomic lab. His research interests lie at the interface of computer science, statistics and biology and is interested in developing statistical machine learning algorithms to make sense of large-scale biomedical data and in using these tools to understand the interplay between evolution, our genomes and traits. He received a B.Tech. in Computer Science from the Indian Institute of Technology, Madras, a Ph.D. in Computer Science from UC Berkeley and was a post-doctoral fellow in Harvard Medical School before joining UCLA. He is a recipient of the Alfred P. Sloan Foundation fellowship (2017), Okawa Foundation grant (2017), the UCLA Hellman fellowship (2017), the NIH Pathway to Independence Award (2014), a Simons Research fellowship (2014), and a Harvard Science of the Human Past fellowship (2012) as well as the Northrop-Grumman Excellence in Teaching Award at UCLA (2019).
ML & BioMedicine
BioMedical data: high D, heterogeneous, noisy data
Clinical Data & DL
Predict death after surgery – 1000 dealth complication, sepsis acout kidney injury
Mortality during and after surgery
collaboration: Anesthesiology, PeriOps, UCLA Health
Data warehouse – EMR 4/2013 – 12/2018
60,000 patients in data: Age, height, weight, gender,ASA Status- input from physician
Pre-operative mortality risk prediction – False positive, missing data: Lab data was collected, what were the values
With the computational advances over the past few decades, Bayesian analysis approaches are starting to be fully appreciated. Forecasting and time series also have Bayesian approaches and techniques, but most people are unfamiliar with them due to the immense popularity of Exponential Smoothing and autoregressive integrated moving average (ARIMA) classes of models. However, Bayesian modeling and time series analysis have a lot in common! Both are based on using historical information to help inform future modeling and decisions. Using past information is key to any time series analysis because the data typically evolves over time in a correlated way. Bayesian techniques rely on new data updating their models from previous instances for better estimates of posterior distributions. This talk will briefly introduce the differences between classical frequentist approaches of statistics to their Bayesian counterparts as well as the difference between time series data made for forecasting compared to traditional cross-sectional data. From there, it will compare the classical Exponential Smoothing and ARIMA class models of time series to Bayesian models with autoregressive components. Comparing the results of these models across the same data set allows the audience to see the potential benefits and disadvantages of using each of the techniques. This talk aims to allow people to update their own skill set in forecasting with these potentially Bayesian techniques. At the end, the talk explores the technique of model ensembling in a time series context. From these ensembles, the benefits of all types of models are potentially blended together. These models and their respective outputs will be displayed in R
Single Exponential Smoothing
ARIMA – long-memory models – Autoregressive AR
Moving Average (MA) model – short memory
Intergrated AR+MA = ARIMA
Learning Intended Reward Functions: Extracting all the Right Information from All the Right Places
Fri, October 30, 3:45 PM
(PDT)
00:04:42
Anca Dragan, PhD | Assistant Professor, EECS | Head | UC Berkeley | InterACT lab
Learning Intended Reward Functions: Extracting all the Right Information from All the Right Places
Abstract:
Content: AI work tends to focus on how to optimize a specified reward function, but rewards that lead to the desired behavior consistently are not so easy to specify. Rather than optimizing specified reward, which is already hard, robots have the much harder job of optimizing intended reward. While the specified reward does not have as much information as we make our robots pretend, the good news is that humans constantly leak information about what the robot should optimize. In this talk, we will explore how to read the right amount of information from different types of human behavior — and even the lack thereof.
Learning outcomes: After participating, you should be able to articulate the common pitfalls we face in defining an AI reward, loos, or objective function. You should also develop a basic understanding of the main algorithmic tools we have for avoiding these pitfalls.
Target audience: Participants with some AI experience, be in supervised or reinforcement learning.
Bio:
Anca Dragan is an Assistant Professor in EECS at UC Berkeley, where she runs the InterACT lab. Her goal is to enable robots to work with, around, and in support of people. She works on algorithms that enable robots to a) coordinate with people in shared spaces, and b) learn what people want them to do. Anca did her PhD in the Robotics Institute at Carnegie Mellon University on legible motion planning. At Berkeley, she helped found the Berkeley AI Research Lab, is a co-PI for the Center for Human-Compatible AI, and has been honored by the Presidential Early Career Award for Scientists and Engineers (PECASE), the Sloan fellowship, the NSF CAREER award, the Okawa award, MIT’s TR35, and an IJCAI Early Career Spotlight.
Sequential decision making
defining what robots goal is
Autonomous car
AI = optimize intended rewards vs specified reward
parametrization of the reward function
Agent over-learn from specified rewards but under-learn from other sources
observing feedback and express the human feedback in observation (human) model
How can we model reward design/specification as a noisy and suboptiman process
Human feedback as a reward-rational implicit choice
The state of the environment as a reward-rational implicit choice
task specification –>> reward
KEYNOTE SPEAKERS
ODSC West Keynotes
Suchi Saria, PhD
Director Of The Machine Learning And Healthcare Lab, John C. Malone Endowed Chair, Founder Of Bayesian Health, MIT Technology Review’s 35 Innovators Under 35, And A World Economic Forum Young Global Leader
Johns Hopkins University
Jeannette M. Wing, PhD
Avanessians Director Of The Data Science Institute, Professor Of Computer Science Columbia University, Former Corporate Vice President Microsoft, Former Assistant Director, National Science Foundation
Columbia University
Ion Stoica, PhD
Professor Of Computer Science, Head Of RISELab. Co-Founder Of Anyscale, Databricks, And Conviva Networks, ACM Fellow, SIGOPS Hall Of Fame Award (2015), SIGCOMM Test Of Time Award (2011)
UC Berkeley
Raluca Ada Popa, PhD
Cybersecurity & Applied Cryptography Professor, MIT Technology Review’s 35 Under 35, Recipient Of Intel Early Career Faculty Honor Award, George M. Sprowls Award For Best MIT CS Doctoral Thesis, Co-Founder Of PreVeil
UC Berkeley
Zoubin Ghahramani, PhD
Chief Scientist, Founding Director Of The AlanTuring Institute, Prof. Of Information Engineering & Deputy Director Of The Leverhulme Centre For The Future Of Intelligence, Fellow Of St John’s College Cambridge And Of The Royal Society
Uber | The University of Cambridge
Azalia Mirhoseini, PhD
Senior Research Scientist At Google Brain. Advisor At Cmorq. Co-Founder Machine Learning For Systems Moonshot At Brain Focusing On Deep RL. MIT Technology Review 35 Under 35 Award
Google Brain
Marinela Profi
Global Strategist For AI, Global Ambassador For The Women Tech Network, Author Of “Mastering Model Lifecycle Orchestration: An Interactive Guide”
SAS
John Montgomery
Corporate Vice President, Visual Studio, Microsoft Azure AI Lead, Former Chief Information Office At Imagine Publishing, Author At Visual Studio
Microsoft
Ben Taylor,PhD
Chief AI Evangelist, Deep Learning & HPC Expert, Co-Founder & Chief Scientist At Zeff.Ai, Former Chief Scientist At HireVue, ProductCraft Contributor
Julian Hong, MD, MS
Charlotta Lindvall, MD, PhD
Tina Hernandez-Boussard, PhD
Imon Banerjee, PhD
2012pharmaceutical
Amandeep Kaur
Aashir Awan, Phd
Abhisar Anand
Adina Hazan
Alan F. Kaul, PharmD., MS, MBA, FCCP
alexcrystal6
anamikasarkar
apreconasia
aviralvatsa
David Orchard-Webb, PhD
danutdaagmailcom
Demet Sag, Ph.D., CRA, GCP
Dror Nir
dsmolyar
Ethan Coomber
evelinacohn
Gail S Thornton
Irina Robu
jayzmit48
jdpmd
jshertok
kellyperlman
Ed Kislauskis
larryhbern
Madison Davis
marzankhan
megbaker58
ofermar2020
Dr. Pati
pkandala
Rosalind Codrington, PhD
ritusaxena
Rick Mandahl
sjwilliamspa
Srinivas Sriram
stuartlpbi
Dr. Sudipta Saha
tildabarliya
vaishnavee24
zraviv06
zs22