Feeds:
Posts
Comments

Archive for the ‘Artificial Intelligence – General’ Category

Advanced AI: TRAINING DATA, Sequoia Capital Podcast, 31 episodes

Reporter: Aviva Lev-Ari, PhD, RN

UPDATE – May 26, 2026

Sequoia Capital remains the #1 global unicorn investor with 191 unicorns backed before unicorn status, according to Prof. Ilya Strebulaev’s 2026 ranking.

This article originally focused on Sequoia Capital’s 2025 podcast series on advanced AI training data.

SOURCE

https://www.linkedin.com/posts/ilyavcandpe_my-first-2026-ranking-of-the-top-investors-share-7464375364400611328-SKmO/?utm_source=social_share_send&utm_medium=ios_app&rcm=ACoAAAABVi0BmYKOKsh70AIfmMVAHFSJ31jS2iY&utm_campaign=share_via

 

Advanced AI: TRAINING DATA, Sequoia Capital Podcast, 31 episodes

SOURCE

https://www.youtube.com/playlist?list=PLOhHNjZItNnMm5tdW61JpnyxeYH5NDDx8

Our motivation to Post in our Journal the entire List of 31 episodes is educational in Nature.

  • See all categories of research we developed on subjects of Artificial Intelligence
  • See all our portals on Artificial Intelligence, below
  • Forthcoming Portal: AI for Healthcare Foundation Model driven by Medical Expert Training Data

Artificial Intelligence: Genomics & Cancer

2021-2025 Medical Text Analysis (NLP)

ChatGPT + Wolfram PlugIn

Medicine with GPT-4 & ChatGPT

AGI, generativeAI, Grok, DeepSeek & Expert Models in Healthcare

Our Educational motivation for calling attention to advanced topics in AI:

TRAINING DATA, Sequoia Capital Podcast, 31 episodes

32:46

Now playing

 

OpenAI’s Deep Research Team on Why Reinforcement Learning is the Future for AI Agents

Sequoia Capital

39K views • 2 days ago

2

1:00:09

Now playing

 

AI, Security and the New World Order ft. Palo Alto Networks’s Nikesh Arora

Sequoia Capital

8K views • 9 days ago

3

44:27

Now playing

 

Vector Databases and the Data Structure of AI ft. MongoDB’s Sahir Azam

Sequoia Capital

3.3K views • 2 weeks ago

4

54:47

Now playing

 

Using AI to Empower Creators fr Roblox Studio Head Stef Corazza

Sequoia Capital

702 views • 3 weeks ago

5

52:30

Now playing

 

From AlphaGo to AGI ft ReflectionAI Founder Ioannis Antonoglou

Sequoia Capital

1.7K views • 4 weeks ago

6

52:07

Now playing

 

Turning Graph AI into ROI ft Kumo’s Hema Raghavan

Sequoia Capital

1.3K views • 1 month ago

7

1:00:06

Now playing

 

Turning Academic Open Source into Startup Success ft Databricks Founder Ion Stoica

Sequoia Capital

3.9K views • 1 month ago

8

51:38

Now playing

 

Cracking the Code on Offensive Security With AI ft XBOW CEO and GitHub Copilot Creator Oege de Moor

Sequoia Capital

2.1K views • 2 months ago

9

38:49

Now playing

 

Using AI to Build “Self-Driving Money” ft Ramp CEO Eric Glyman

Sequoia Capital

4K views • 2 months ago

10

1:03:08

Now playing

 

Getting the Most From AI With Multiple Custom Agents ft Dust’s Gabriel Hubert and Stanislas Polu

Sequoia Capital

2.8K views • 3 months ago

11

51:38

Now playing

 

Building the Sales ‘System of Action’ with AI ft Clay’s Kareem Amin

Sequoia Capital

2.5K views • 3 months ago

12

46:35

Now playing

 

Decart’s Dean Leitersdorf on AI-Generated Video Games and Worlds

Sequoia Capital

3.2K views • 3 months ago

13

44:49

Now playing

 

How Glean CEO Arvind Jain Solved the Enterprise Search Problem – and What It Means for AI at Work

Sequoia Capital

5.9K views • 3 months ago

14

41:43

Now playing

 

OpenAI Researcher Dan Roberts on What Physics Can Teach Us About AI

Sequoia Capital

7.8K views • 4 months ago

15

32:08

Now playing

 

Google NotebookLM’s Raiza Martin and Jason Spielman on the Potential for Source-Grounded AI

Sequoia Capital

10K views • 4 months ago

16

59:30

Now playing

 

Snowflake CEO Sridhar Ramaswamy on Using Data to Create Simple, Reliable AI for Businesses

Sequoia Capital

10K views • 4 months ago

17

45:23

Now playing

 

OpenAI’s Noam Brown, Ilge Akkaya and Hunter Lightman on o1 and Teaching LLMs to Reason Better

Sequoia Capital

41K views • 4 months ago

18

39:46

Now playing

 

Why Vlad Tenev and Tudor Achim of Harmonic Think AI Is About to Change Math—and Why It Matters

Sequoia Capital

9.9K views • 5 months ago

19

49:14

Now playing

 

Jim Fan on Nvidia’s Embodied AI Lab and Jensen Huang’s Prediction that All Robots will be Autonomous

Sequoia Capital

30K views • 5 months ago

20

51:16

Now playing

 

Founder Eric Steinberger on Magic’s Counterintuitive Approach to Pursuing AGI

Sequoia Capital

5.6K views • 5 months ago

21

1:12:32

Now playing

 

Sierra co-founder Clay Bavor on Making Customer-Facing AI Agents Delightful

Sequoia Capital

14K views • 6 months ago

22

50:34

Now playing

 

Phaidra’s Jim Gao on Building the Fourth Industrial Revolution with Reinforcement Learning

Sequoia Capital

9.8K views • 6 months ago

23

39:19

Now playing

 

Fireworks Founder Lin Qiao on the Power of Small Models to Democratize AI Use Cases

Sequoia Capital

6.5K views • 6 months ago

24

1:07:35

Now playing

 

GitHub CEO Thomas Dohmke on Building Copilot, and the the Future of Software Development

Sequoia Capital

4K views • 6 months ago

25

42:08

Now playing

 

Meta’s Joe Spisak on Llama 3.1 405B and the Democratization of Frontier Models | Training Data

Sequoia Capital

7.1K views • 6 months ago

26

51:36

Now playing

 

Klarna CEO Sebastian Siemiatkowski on Getting AI to Do the Work of 700 Customer Service Reps

Sequoia Capital

20K views • 7 months ago

27

1:07:05

Now playing

 

Reflection AI’s Misha Laskin on the AlphaGo Moment for LLMs | Training Data

Sequoia Capital

13K views • 7 months ago

28

1:00:28

Now playing

 

Microsoft CTO Kevin Scott on How Far Scaling Laws Will Extend | Training Data

Sequoia Capital

40K views • 7 months ago

29

55:13

Now playing

 

Zapier’s Mike Knoop launches ARC Prize to Jumpstart New Ideas for AGI | Training Data

Sequoia Capital

4.1K views • 7 months ago

30

59:11

Now playing

 

Factory’s Matan Grinberg and Eno Reyes Unleash the Droids on Software Development | Training Data

Sequoia Capital

3.6K views • 8 months ago

31

49:51

Now playing

 

LangChain’s Harrison Chase on Building the Orchestration Layer for AI Agents | Training Data

Sequoia Capital

14K views • 8 months ago

Read Full Post »

Bridging the Gender Gap in Healthcare: Unlocking Biopharma’s Potential in Women’s Health

Curator: Dr. Sudipta Saha, Ph.D.

Nearly half of the global population—and 80 percent of patients in therapeutic areas such as immunology—are women. Yet, treatments are frequently developed without tailored insights for female patients, often ignoring critical biological differences such as hormonal impacts, genetic factors, and cellular sex. Historically, women’s health has been narrowly defined through the lens of reproductive organs, while for non-reproductive conditions, women were treated as “small men.” This lack of focus on sex-specific biology has contributed to significant gaps in healthcare.

A recent analysis found that women spend 25 percent more of their lives in poor health compared with men due to the absence of sex-based treatments. Addressing this disparity could not only improve women’s quality of life but also unlock over $1 trillion in annual global GDP by 2040.

Four key factors contribute to the women’s health gap: limited understanding of sex-based biological differences, healthcare systems designed around male physiology, incomplete data that underestimates women’s disease burden, and chronic underfunding of female-focused research. For instance, despite women representing 78 percent of U.S. rheumatoid arthritis patients, only 7 percent of related NIH funding in 2019 targeted female-specific studies.

However, change is happening. Companies have demonstrated how targeted R&D can drive better outcomes for women. These therapies achieved expanded FDA approvals after clinical trials revealed their unique benefits for female patients. Similarly, addressing sex-based treatment gaps in asthma, atrial fibrillation, and tuberculosis could prevent millions of disability-adjusted life years.

By closing the women’s health gap, biopharma companies can drive innovation, improve therapeutic outcomes, and build high-growth markets while addressing long-standing inequities. This untapped opportunity holds the potential to transform global health outcomes for women and create a more equitable future.

References

https://www.mckinsey.com/industries/life-sciences/our-insights/closing-the-womens-health-gap-biopharmas-untapped-opportunity?stcr=97136BA6BDD64C2396A57E9487438CC6

https://www.weforum.org

https://www.nih.gov

https://www.fda.gov

https://www.who.int

Read Full Post »

DeepSeek-V3 and Reasoning Model R1: Four Views (a) Explanations (b) The Chinese Perspective (c) DeepSeek Impact on Demand for Inference Chips & Training Chips, and (d) LPBI Group: Expert Content for ML Models in Healthcare, Pharmaceutical, Medical and Life Sciences

Curator: Aviva Lev-Ari, PhD, RN

With the announcement of DeepSeek on January 27, 2025, it became compelling to cover several aspects of this hot Artificial Intelligence Technology.

This curation has four Parts: 

Part A: Explanations 

Part B: The Chinese Perspective

Part C: DeepSeek potential Impact on Demand for Inference Chips & Training Chips, and

Part D: LPBI Group: Expert Content for ML Models in Healthcare, Pharmaceutical, Medical and Life Sciences

 

Part A: Explanations by Morgan Brown

@morganb

Jan 27   Read on X

🧵 Finally had a chance to dig into DeepSeek’s r1…

Let me break down why DeepSeek’s  AI innovations are blowing people’s minds (and possibly threatening Nvidia’s $2T market cap) in simple terms… 

0/ first off, shout out to @doodlestein who wrote the must-read on this here:

The Short Case for Nvidia StockAll the reasons why Nvidia will have a very hard time living up to the currently lofty expectations of the market.https://youtubetranscriptoptimizer.com/blog/05_the_short_case_for_nvda

1/ First, some context: Right now, training top AI models is INSANELY expensive. OpenAI, Anthropic, etc. spend $100M+ just on compute. They need massive data centers with thousands of $40K GPUs. It’s like needing a whole power plant to run a factory. 

2/ DeepSeek just showed up and said “LOL what if we did this for $5M instead?” And they didn’t just talk – they actually DID it. Their models match or beat GPT-4 and Claude on many tasks. The AI world is (as my teenagers say) shook. 

3/ How? They rethought everything from the ground up. Traditional AI is like writing every number with 32 decimal places. DeepSeek was like “what if we just used 8? It’s still accurate enough!” Boom – 75% less memory needed. 

4/ Then there’s their “multi-token” system. Normal AI reads like a first-grader: “The… cat… sat…” DeepSeek reads in whole phrases at once. 2x faster, 90% as accurate. When you’re processing billions of words, this MATTERS. 

5/ But here’s the really clever bit: They built an “expert system.” Instead of one massive AI trying to know everything (like having one person be a doctor, lawyer, AND engineer), they have specialized experts that only wake up when needed.

[color added by curator, See Part D, below]

6/ Traditional models? All 1.8 trillion parameters active ALL THE TIME. DeepSeek? 671B total but only 37B active at once. It’s like having a huge team but only calling in the experts you actually need for each task. 

7/ The results are mind-blowing:
– Training cost: $100M → $5M
– GPUs needed: 100,000 → 2,000
– API costs: 95% cheaper
– Can run on gaming GPUs instead of data center hardware 

8/ “But wait,” you might say, “there must be a catch!” That’s the wild part – it’s all open source. Anyone can check their work. The code is public. The technical papers explain everything. It’s not magic, just incredibly clever engineering. 

9/ Why does this matter? Because it breaks the model of “only huge tech companies can play in AI.” You don’t need a billion-dollar data center anymore. A few good GPUs might do it. 

10/ For Nvidia, this is scary. Their entire business model is built on selling super expensive GPUs with 90% margins. If everyone can suddenly do AI with regular gaming GPUs… well, you see the problem. 

11/ And here’s the kicker: DeepSeek did this with a team of <200 people. Meanwhile, Meta has teams where the compensation alone exceeds DeepSeek’s entire training budget… and their models aren’t as good. 

12/ This is a classic disruption story: Incumbents optimize existing processes, while disruptors rethink the fundamental approach. DeepSeek asked “what if we just did this smarter instead of throwing more hardware at it?” 

13/ The implications are huge:
– AI development becomes more accessible
– Competition increases dramatically
– The “moats” of big tech companies look more like puddles
– Hardware requirements (and costs) plummet 

14/ Of course, giants like OpenAI and Anthropic won’t stand still. They’re probably already implementing these innovations. But the efficiency genie is out of the bottle – there’s no going back to the “just throw more GPUs at it” approach. 

15/ Final thought: This feels like one of those moments we’ll look back on as an inflection point. Like when PCs made mainframes less relevant, or when cloud computing changed everything.

 AI is about to become a lot more accessible, and a lot less expensive. The question isn’t if this will disrupt the current players, but how fast.

/end 

P.S. And yes, all this is available open source. You can literally try their models right now. We’re living in wild times! 🚀 

Momma, I’m going viral! No substack or gofundme to share but a few things to add/clarify:

1/ The DeepSeek app is not the same thing as the model. Apps are owned and operated by a Chinese corporation, the model itself is open source.

2/ Jevon’s paradox is the counter argument. Thanks papa @satyanadella. Could be a mix shift in chip type, compute type, etc. but we’re constrained by power and compute right now, not demand constrained.

3/ The techniques used are not ground breaking. It’s the combination of them w/the relative model performance that is so exciting. These are common eng techniques that combined really fly in the face of more compute is the only answer for model performance. Compute is no longer a moat.

4/ Thanks to all for pointing out my NVIDIA market cap numbers miss and other nuances – will do better next time, coach. 🫡 

SOURCE

https://threadreaderapp.com/thread/1883686162709295541.html#google_vignette

 

Part B: The Chinese Perspective

© 2025 Jordan Schneider

DeepSeek: The View from China

China’s takes are better than yours

 

SOURCE

From: ChinaTalk <chinatalk@substack.com> on behalf of ChinaTalk <chinatalk@substack.com>
Reply-To: ChinaTalk <reply+2ktto4&8t4ds&&6fa8442469b96573268378f7538ff49c28c45589f5811b2a55b30e89ee8ff94d@mg1.substack.com>
Date: Tuesday, January 28, 2025 at 9:54 AM
To: Aviva Lev-Ari <avivalev-ari@alum.berkeley.edu>
Subject: DeepSeek: The View from China

And

https://www.chinatalk.media/p/deepseek-the-view-from-china

https://open.substack.com/pub/chinatalk/p/deepseek-the-view-from-china?r=8t4ds&utm_campaign=post&utm_medium=email

The Mystical DeepSeek. ‘The most important thing about DeepSeek is pushing intelligence’

  1. Founder and CEO Liang Wenfeng is the core person of DeepSeek. He is not the same type of person as Sam Altman. He is very knowledgeable about technology.
  2. DeepSeek has a good reputation because it was the first to release the reproducible MoE, o1, etc. It succeeded in acting early, but whether or not it did the absolute best remains to be seen. Moving forward, the biggest challenges are that resources are limited and can only be invested in the most high-potential areas. DeepSeek’s research and culture are still strong, and if given 100,000 or 200,000 chips, they might be able to do better.
  3. From its preview to its official release, DeepSeek’s model’s long-context capabilities have improved rapidly. DeepSeek’s long-context 20K can be achieved with very conventional methods.
  4. The CEO of Scale.ai said that DeepSeek has 50,000 chips, but that is definitely not reality. According to public information, DeepSeek had 10,000 old A100 chips and possibly 3,000 H800 cards before the ban. DeepSeek pays great attention to compliance and has not purchased any non-compliant GPUs, so it should have few chips. The way the United States uses GPUs is too extravagant.
  5. DeepSeek focused all its efforts on a single goal and subsequently gave up many things, such as multimodality. DeepSeek is not just serving people, but seeking intelligence itself, which may have been a key factor in its success.
  6. In some ways, quant trading can be said to be the business model of DeepSeek. Huanfang (another quantitative investment company founded by Liang Wenfeng) is the product of the last round of machine learning. DeepSeek’s highest priority is to push intelligence. Money and commercialization are not high priorities. China needs several leading AI labs to explore things that can beat OpenAI. Intelligence takes a long time to develop, and has begun to differentiate again this year, so new innovations are bound to result.
  7. From a technical perspective, DeepSeek has been instrumental as a training ground for talent.
  8. The business model of AI labs in the United States is not good either. AI does not have a good business model today and will require viable solutions in the future. Liang Wenfeng is ambitious; DeepSeek does not care about the model and is just heading towards AGI.
  9. Many of the insights from DeepSeek’s paper involve saving hardware costs. On a couple of big dimensions of scaling, DeepSeek’s techniques are able to reduce costs.
  10. In the short-term, everyone will be driven to think about how to make AI more efficient. In the long-run, questions about computing power will remain. Demand for compute remains strong and no company has enough.
  11. Discussing DeepSeek’s organization:
    1. When investing, we always choose the most advanced talent. But we see from DeepSeek’s model (the team is mostly smart young people who graduated from domestic universities) that a group that coheres well may also gradually advance their skills together. It has yet to be seen whether poaching one person might break DeepSeek’s advantage, but for now this seems unlikely.
    2. While there’s a lot of money in the market, DeepSeek’s core advantage is its culture. The research culture of DeepSeek and ByteDance are similar, and both are critical for determining the availability of funding and long-term viability. Only with an important business model can there be a sustainable culture. Both DeepSeek and ByteDance have very good business models.
  12. Why did DeepSeek catch up so fast?
    1. Reasoning models require high-quality data and training. For LLMs or multimodal AI, it’s difficult to catch up with a closed source model from scratch. The architecture of pure reasoning models hasn’t changed much, so it’s easier to catch up in reasoning.
    2. One reason R1 caught up quickly was that the task was not particularly difficult. Reinforcement learning only made the model choices more accurate. R1 did not break through the efficiency of Consensus 32, spending 32 times the efficiency, which is equivalent to moving from deep processing to parallelization, which is not pushing the boundaries of intelligence, just making it easier.

Pioneers vs. Chasers: ‘AI Progress Resembles a Step Function – Chasers Require 1/10th the Compute’

Points 13 – 17

[Points 18-48 was a long technical discussion we’ve machine-translated below]

Why didn’t the other companies take the DeepSeek approach: ‘Models from the big labs need to maintain a low profile’

Points 49, 50

The Divergence and Bets of 2025 Technology: ‘Can We Find Architectures Beyond Transformer?’

Points 51 – 56

Have developers moved from closed-source models to DeepSeek? ‘Not yet’

Points 57 – 62

OpenAI Stargate’s $500B Narrative and Changes in Computing Power Demand

  1. The emergence of DeepSeek has led people to question the latest $500B narrative from Nvidia and OpenAI. There’s no verdict yet on compute — and OpenAI’s $500B narrative is their attempt to throw themselves a lifeline.
  2. Regarding the doubts about OpenAI’s $500B infrastructure investment: because OpenAI is a commercial company, it could be risky if debt is involved.
  3. $500B is an extreme number — likely to be executed over 4 or 5 years. SoftBank and OpenAI are the leading players (the former providing capital, the latter technology) — but SoftBank’s current funds can’t support $500B; rather SoftBank is using its assets as collateral. OpenAI, meanwhile, isn’t very cash-rich either, and other AI companies are more technical participants than they are funding providers. So it will be a struggle to fully realize the $500B vision.
  4. OpenAI’s $500B computing power makes sense: during the exploration phase, the cost of trial and error is high, with both human and investment costs being substantial. But although the path isn’t clear and getting from o1 to R1 won’t be easy, at least we can see what the finish line looks like: we can track the intermediate markers, and from day one, aim for others’ proven end states; this gives us a better bearing on our progress. Being at the frontier exploring the next generation is most resource-intensive. The followers don’t bear exploration costs — they’re always just following. If Google/Anthropic succeed in their exploration areas, they might become the frontier company.
  5. In the future, Anthropic might replace all their inference with TPU or AWS chips.
  6. Domestic Chinese companies were previously constrained by computing power, but now it’s proven that the potential technical space is vast. For more efficient models, we might not need especially large cards — we can provide relatively customized chips that can be adapted for compatibility with AMD and ASIC. From an investment perspective, Nvidia’s moat is very high, but ASIC will have yet greater opportunities.
  7. The DeepSeek situation isn’t really about compute — it’s about America realizing China’s capabilities and efficiency.DeepSeek isn’t Nvidia’s vulnerability; Nvidia will grow as long as AI grows. Nvidia’s strength is its ecosystem, which has been built up over a long time. Indeed, when technology develops rapidly, the ecosystem is crucial. The real crisis comes, though, when technology matures like electricity: it becomes commoditized; then, everyone will focus on products, and many ASIC chips will emerge for specific scenario optimization.

 

Impact on the Secondary Market: ‘Short-term sentiment is under pressure, but the long-term narrative continues’

Points 70 – 74

Open-Source vs Closed Source: ‘If capabilities are similar, closed source will struggle.’

Points 75 – 78

The Impact of DeepSeek’s Breakthrough: ‘Vision Trumps Technology’

  1. DeepSeek’s breakthrough made the outside world realize China’s AI strength. Previously, outsiders thought China’s AI progress lagged America by two years, but DeepSeek shows the gap is actually 3 to 9 months, and in some areas, even shorter.
  2. When it comes to technologies and sectors that America has historically blocked China from accessing, if China can break through nonetheless, those sectors ultimately become highly competitive. AI might follow this pattern — and DeepSeek’s success may well prove this.
  3. DeepSeek didn’t suddenly explode. R1’s impressive results reverberated throughout America’s entire AI establishment.
  4. DeepSeek stands on the shoulders of giants — but exploring the frontier still requires much more time and human capital cost. R1 doesn’t mean that future training costs will decrease.
  5. AI explorers definitely need more computing power; China, as a follower, can leverage its engineering advantages. How Chinese large-model teams use less computing power to produce results, thereby having some definite resilience — or even doing better — might end up being how the US-China AI landscape plays out in the future.
  6. China is still replicating technical solutions; reasoning was proposed by OpenAI in o1, so the next gap between various AI labs will be about who can propose the next reasoning. Infinite-length reasoning might be one vision.
  7. The core difference between different AI labs’ models lies not in technology, but in what each lab’s next vision is.
  8. After all, vision matters more than technology.

Technical Discussion

There was a deep technical discussion in the article that we’ve machine-translated below.

Technical Detail 1: Supervised Fine-Tuning (SFT). ‘No need for SFT on the reasoning level’

Points 18 – 27

Technical Detail 2: Data. ‘DeepSeek values data annotation’

Points 28 – 30

Technical Detail 3: Distillation. ‘The limit of distillation is that model diversity drops

Points 31 – 43

Technical Detail 4: Process Reward. ‘The upper limit of process reward is human, but the upper limit of outcome supervision is the model itself.’

Points 44 – 48

 

SOURCE of the Chinese Perspective

https://www.chinatalk.media/p/deepseek-the-view-from-china?utm_source=substack&publication_id=4220&post_id=155916148&utm_medium=email&utm_content=share&utm_campaign=email-share&triggerShare=true&isFreemail=true&r=8t4ds&triedRedirect=true

 

Part C: DeepSeek Impact on Demand for “Inference Chips” and “Training Chips”

 

Watch Full Interviews with Ark’s Cathie Wood

 

  • Ark’s Wood on DeepSeek, AI, Crypto, Trump | Cathie Wood Full Interview

https://youtu.be/EKELCEW8lNo?si=Zri9QqcMHsESgO8N

 

  • Cathie Wood Talks DeepSeek Lessons, Musk, Driverless Cars & UK

https://youtu.be/aThejSuMX-I?si=e9uM7TpoQ1Neb-cT

 

“Inference Chips” and “Training Chips”: Technology explained

 

AI Chips Explained: Training vs. Inference Processors Unveiled

https://www.friendsofthemetaverse.com/blog/ai-chips-explained-training-vs-inference-processors-unveiled

 

Inference chips and training chips are both types of AI chips that serve different purposes. Training chips are used to develop AI models, while inference chips are used to deploy those models in real-world applications. 

An “inference chip” is designed to efficiently execute a trained AI model on new data to make predictions in real-time, prioritizing low latency and power consumption, while a “training chip” is optimized for the computationally intensive process of initially training a machine learning model, requiring high processing power and memory bandwidth, often at the cost of power efficiency; essentially, inference chips are for “applying” the learned model, while training chips are for “learning” the model itself. 

 

SOURCE

https://www.google.com/search?q=training+chips+vs+inference+chips&oq=Training+Chips+vs+Inference+chips&gs_lcrp=EgZjaHJvbWUqBggAEEUYOzIGCAAQRRg7Mg0IARAAGIYDGIAEGIoFMg0IAhAAGIYDGIAEGIoFMg0IAxAAGIYDGIAEGIoFMgoIBBAAGIAEGKIEMgoIBRAAGIAEGKIEMgoIBhAAGIAEGKIEMgoIBxAAGIAEGKIE0gEKMTc2OTVqMGoxNagCCLACAQ&sourceid=chrome&ie=UTF-8

 

Training vs. Inference (But, Really: Training Then Inference)

To recap: the AI training stage is when you feed data into your learning algorithm to produce a model, and the AI inference stage is when your  algorithm uses that training to make inferences from data. Here’s a chart for quick reference: 

Table

Inference

Feed training data into a learning algorithm

Apply the model to the inference data

Produces a model comprising code and data

Produces output data

One time-ish (Requirement to retain training data in case of re-training.)

Often continuous

Inference

Apply the model to the inference data

Produces output data

Often continuous

The difference may seem inconsequential at first glance, but defining these two stages helps to show implications for AI adoption particularly with businesses. That is, given that it’s much less resource intensive (and therefore, less expensive), it’s likely to be much easier for businesses to integrate already-trained AI algorithms with their existing systems. 

And, as always, we’re big believers in demystifying terminology for discussion purposes. Let us know what you think in the comments, and feel free to let us know what you’re interested in learning about next.

SOURCE

AI 101: Training vs. Inference

November 9, 2023 by Stephanie Doyle

https://www.backblaze.com/blog/ai-101-training-vs-inference/

 

r/AMD_Stock

“AI is really two markets, training and inference. Inference is going to be 100 times bigger than training. Nvidia is really good at training but very miscast at inference.” – Chamath Palihapitiya

Let’s discuss.

Below I layout AMD investor relevant time stamps:

7:35 – Meta AI business strategy

10:00 – Open source impact on LLM marketplace

12:10 – Telecom analogy (capex discussion)

16:35 – Closed source model economic viability

19:50 – Meta overspend on training (Nvidia)

SOURCE

https://www.reddit.com/r/AMD_Stock/comments/1cf765y/ai_is_really_two_markets_training_and_inference/

 

Part D: LPBI Group: Expert Content for ML Models in Healthcare, Pharmaceutical, Medical and Life Sciences

 

LPBI Group’s Journal http://pharmaceuticalintelligence.com had a fully developed ontology for the Healthcare, Pharmaceutical, Medical and Life Sciences domains of knowledge.

The ontology comprises of +750 categories of research. Each category consists of multiple scientific articles that were curated by domain knowledge experts in the fields of Healthcare, Pharmaceutical, Medical and Life Sciences.

  • Each article is a token, a Non Fungible Token (NFT) = a mutually exclusive scientifically written piece that makes a Prior Art artifact from the intellectual property law perspective and copyright law.
  • Each category of research is “An expert system knowledge base”
  • Examples: The last column in this table represents the number of articles in this category of research
  • Each curation is written by an expert in this domain, and
  • Each one of the 469 articles in Example #1, in this category of research had been assigned THIS category by an EXPERT in this domain. 
  • The universe of 469 articles represents an “Expert System Knowledge Base” in the domain of biological networks, gene regulation and evolution
  • Example #1 comprises of 469 NFTs
  • Example #2 comprises of 1,022 NFTs
  • Example #3 comprises of 681 NFTs
  • An ML model can be trained on the content of a Master file that included the content of all the 469 article files mentioned in Example #1 – that process is performed on Training Chips
  • The outcomes of the model involve the phase of Inference. That process is performed on Inference Chips.

 

Example #1: 469 articles in Biological Networks, Gene Regulation and Evolution

Expert, Author, Writer (EAW): Dr. Larry Bernstein
Degree: BS, MS, MD
Specialty: Clinical Pathology
e-Mail: larry.bernstein@gmail

N = 469

Biological Networks, Gene Regulation and Evolution

 

Points (a) to (f) are applicable as well to Example #2, and #3, below. Or for any other category of research from the universe of +750 categories that consists of +50 articles

 

Example #2: 1,022 articles in CANCER BIOLOGY & Innovations in Cancer Therapy

Contributor EAW: Prabodh kumar Kandala, PhD Specialty: Preclinical Oncology, Prabodh.kandala@gmail.com

Contributor EAW: Ritu Saxena, PhD
ritu.uab@gmail.com

Contributor EAW: Dr. Larry Bernstein
Degree: BS, MS, MD
Specialty: Clinical Pathology
e-Mail: larry.bernstein@gmail.com

Contributor EAW: Stephen J. Williams
Degree: Ph.D. Pharmacology
Specialty: cancer pharmacology, ovarian specialty
e-Mail: sjwilliamspa@comcast.net
Phone: 215-487-0259

Contributor EAW: Tilda Barliya
Degree: PhD
Specialty: Cancer biology, cell biology, nanotechnology and drug delivery
e-Mail: tildabarliya@gmail.com
Phone: +972-50-8622289

N = 1,022

CANCER BIOLOGY & Innovations in Cancer Therapy

 

Example #3: 681 articles in Frontiers in Cardiology and Cardiovascular Disorders

EAW: Aviva Lev-Ari, PhD, RN

EAW: Justin D. Pearlman
Degree: MD ME PhD MA FACC
Specialty: Internal Medicine, Cardiology, Cardiovascular Radiology, Image Processing, Computer Science, Electronic Records
jdpmdphd@gmail.com
Phone:617-894-6888

N = 681

Frontiers in Cardiology and Cardiovascular Disorders

 

Respectively, the categories of research are

  • “Expert systems domain knowledge bases”
  • They are ready for ML model development in each of the domains that a category comprises more than 50 articles.
  • Total number of categories of research in the Journal’s Ontology N = 757 on 1/28/2025

Read Full Post »

Chicoric Acid: A Natural Boost for Glucose Metabolism via AMPK Activation

Reporter: Dr. Sudipta Saha, Ph.D.

The study published in Journal of Functional Foods explores the molecular mechanisms underlying chicoric acid’s (CA) role in glucose metabolism. Chicoric acid, a natural polyphenolic compound found in plants like chicory and basil, has garnered attention for its anti-inflammatory and antidiabetic properties. The researchers investigated its potential to regulate glucose uptake and insulin sensitivity, focusing on the AMP-activated protein kinase (AMPK) pathway.

The experiments demonstrated that chicoric acid significantly enhances glucose uptake in insulin-sensitive and insulin-resistant cells. This effect was primarily mediated through the activation of AMPKα, a key metabolic regulator that responds to energy stress. The phosphorylation of AMPKα triggered downstream signaling cascades, including the activation of Akt, a protein crucial for glucose transporter type 4 (GLUT4) translocation to the cell membrane, thereby facilitating glucose uptake.

Interestingly, the study also noted that inhibiting AMPK activity reduced CA-induced Akt phosphorylation, confirming that AMPK activation is essential for chicoric acid’s metabolic effects. Furthermore, CA showed potential in improving insulin sensitivity, which is impaired in type 2 diabetes, by mitigating cellular oxidative stress and inflammation.

The findings suggest that chicoric acid could serve as a promising therapeutic candidate for managing diabetes and metabolic disorders. By targeting the AMPKα-Akt signaling axis, CA offers a dual benefit of improving glucose metabolism and reducing insulin resistance, highlighting its potential as a natural alternative for metabolic health interventions.

References

https://www.sciencedirect.com/science/article/abs/pii/S1756464619302774

https://pubmed.ncbi.nlm.nih.gov/22436748

https://pubmed.ncbi.nlm.nih.gov/11742412

https://pubmed.ncbi.nlm.nih.gov/12145153

Read Full Post »

SNU-BioTalk 2025: Symphony of Cellular Signals in Metabolism and Immune Response – International Conference at Sister Nivedita University, Kolkata, India on 16 & 17 January 2025

SNU-BioTalk 2025: Symphony of Cellular Signals in Metabolism and Immune Response – International Conference at Sister Nivedita University, Kolkata, India on 16 & 17 January 2025

Joint Convenor: Dr. Sudipta Saha (Member of LPBI since 2012)

About the Conference:

The International Conference on ‘Symphony of Cellular Signals in Metabolism and Immune Response’ focuses on the complex signalling pathways governing cellular functions in health and disease. It will explore the cellular mechanisms that regulate metabolism, immune responses, and survival, highlighting advances in medical science and biotechnology. Bringing together leading experts and emerging researchers, the conference will feature keynote lectures, panel discussions, research presentations, and interactive sessions, all designed to foster collaboration and innovation. By promoting an exchange of ideas, the event aims to drive transformative insights and solutions that impact human health and sustainable healthcare practices.

The conference will also be livestreamed on YouTube and Facebook

This programme will also host I-STEM: Indian Science, Technology and Engineering facilities Map (I-STEM) is a dynamic and interactive national portal for research cooperation.

Thrust areas:

  • Intracellular signalling processes of cellular metabolism
  • Signalling pathways in physiological and pathological processes
  • Signalling in innate and adaptive immunity

Conference Webpage: https://www.snuniv.ac.in/snu-biotalk-2025/

NU-BioTalk 2025 Abstract Submission Form: https://forms.gle/ygdGqtuBGa7DEhDFA

SNU-BioTalk 2025 Registration Form: https://forms.gle/unasPpByLmYwrRBM6

Programme Schedule:

YouTube Links of Live Telecast:

Day 1:

Day 2:

Media:

Newspaper:

The Telegraph – Click to View

 

Abstract Book

Scan to Download:

Click: 

Abstract Book

Read Full Post »

Real Time Coverage Morning Session on Precision Oncology: Advancing Precision Medicine Annual Conference, Philadelphia PA November 2 2024

Reporter: Stephen J. Williams, Ph.D.

9:20-9:50

How Can We Close the Clinical Practice Gaps in Precision Medicine?

Susanne Munksted, Diaceutics

Studies are showing that genetic tests are being ordered at a sufficient rate however it appears there are problems in interpretation and developing treatment plans based on omics testing results

 

  • 30 % of patients in past and now currently half of all patients are not being given the proper treatment based on genomic testing results (ASCO)
  • E.g. only 1.5% with NTRK fusions received a NTRK based therapy (this was > 4000 patients receiving wrong therapy)
  • A lung oncologist may only see one patient with NTRK fusion in three years

 

Precision Medicine Practice Gaps

48% of oncologist surveyed  agreed pathologist needs to be more informed and relevant in the decision making process with regard to tests needing to be ordered

95% said need to flip cost issues ; what does it cost not to get a test … i.e. what is the cost of the wrong therapy

We need a new commercialization model for therapeutic development for this new era of “n of one” patient

9:50-10:15

Implementation of a CLIA-based Reverse Phase Protein Array Assay for Precision Oncology Applications: Proteomics and Phosphoproteomics at the Bedside (CME Eligible)

Emanuel Petricoin, George Mason University

There are some tumor markers approved by FDA that cant just be measured by NGS and are correlated with a pathologic complete response

 

  • Many point mutations will have no actionable drug
  • Many alterations are post-genomic meaning there is a post translational component to many prognostic biomarkers
  • Prevalence of point mutation with no actionable mutation is a limit of NGS
  • It is important to look at phospho protein spectrum as a potential biomarker

 

Reverse phase protein proteomic analysis

  • Made into CLIA based array
  • They trained centers around the US on the technology and analysis
  • Basing proteomics or protein markers by traditional IHC requires much antibody validation so if the mass spectrometry field can catch up it would be very powerful
  • With multiple MRM.MS there is too low abundance of phosphoproteins to allow for good detection

 

They  conducted the I-SPY2 trial for breast cancer and determining if phosphoproteins could be a good biomarker panel

  • They found they could predict a HER2 response better than NGS
  • There were patients who were predicted HER2 negative that actually had an activated HER2 signaling pathway by proteomics so NGS must have had a series of false negatives
  • HER2 co phosphorylation predicts pathologic complete response and predicts therapy by herceptin
  • They found patients classified as HER2 negative by FISH were HER2 positive by proteomics and had HER2 activation

10:15-11:10

Liquid Biopsy MRD to Escalate or De-escalate Therapy (CME Eligible)

Adrian Lee

Adrian Lee, UPMC

Marija Balic, UPMC

Howard McLeod

Howard McLeod, Utah Tech University

Muhammed, Murtaza, University of Wisconsin-Madison

 

11:15-11:25  PRODUCT PRESENTATION  204A

SpaceIQ™ – Powering Next Generation Precision Therapeutics with AI-Driven Spatial Biomarkers

Dusty Majumdar, PredxBio 

Single Cell and Spatial Omics

 

  • Single cell transcriptomics technology have been scaled up very nicely over the past ten years
  • Spatial informatics field is lacking in innovations
  • Can get a terabyte worth of data from analysis of one slide

11:25-11:35  PRODUCT PRESENTATION  204C

10x Genomics

11:40-12:35

Transcriptomics and AI in Transforming Precision Diagnosis

Maher Albitar, Genomic Testing Cooperative

Transciptomica and AI:Transforming Precision diagnosis

-The Genomics Testing Coopererative at www.genomictestingcooperative.com

 

Advantages of transcriptomics

– mutation frequency and allele variant detection now at 80% (higher sensitivity in mutation detection)

 

– transcriptomics has good detection of chromosomal translocations

– great surrogate for IHC and detect splicing alterations

– can use AI to predict % of PDL1 in tumor cells versus immune cells

– they have developed a software UMAP (uniform manifold approximation and projection) to supervise cluster analysis

– the group has used AI to predict prognosis and survival using transcriptomics data

Marija Balic, UPMC

Andrew Pecora, Hackensack University Medical Center 

12:35-1:00

The Impact of Multi-Omics in the Context of the APOLLO-2 Moonshot Program (CME Eligible)

 

 

Read Full Post »

Coverage Afternoon Session on Precision Oncology: Advancing Precision Medicine Annual Conference, Philadelphia PA November 1 2024

Reporter: Stephen J. Williams, Ph.D.

Unlocking the Next Quantum Leap in Precision Medicine – A Town Hall Discussion (CME Eligible)

Co-Chairs

Amanda Paulovich, Professor, Aven Foundation Endowed Chair
Fred Hutchinson Cancer Center

Susan Monarezm Deputy Director ARPA-H

Henry Rodriguez, NCI/NIH

Eric Schadt, Pathos

Ezra Cohen, Tempus

Jennifer Leib, Innovation Policy Solutions

Nick Seddon, Optum Genomics

Giselle Sholler, Penn State Hershey Children’s Hospital

Janet Woodcock, formerly FDA

Amanda Paulovich: Frustrated by the variability in cancer therapy results.  Decided to help improve cancer diagnostics

  •  We have plateaued on relying on single gene single protein companion diagnostics
  • She considers that regulatory, economic, and cultural factors are hindering the innovation and resulting in the science way ahead of the clinical aspect of diagnostics
  • Diagnostic research is not as well funded as drug discovery
  • Biomarkers, the foundation for the new personalized medicine, should be at forefront Read the Tipping Point by Malcolm Gladwell
  • FDA is constrained by statutory mandates 

 

Eric Schadt

Pathos

 

  • Multiple companies trying to chase different components of precision medicine strategy including all the one involved in AI
  • He is helping companies creating those mindmaps, knowledge graphs, and create more predictive systems
  • Population screening into population groups will be using high dimensional genomic data to determine risk in various population groups however 60% of genomic data has no reported ancestry
  • He founded Sema4 but many of these companies are losing $$ on these genomic diagnostics
  • So the market is not monetizing properly
  • Barriers to progress: arbitrary evidence thresholds for payers, big variation across health care system, regulatory framework

 

Beat Childhood Cancer Consortium Giselle

 

  • Consortium of university doctors in pediatrics
  • They had a molecular tumor board to look at the omics data
  • Showed example of choroid plexus tumor success with multi precision meds vs std chemo
  • Challenges: understanding differences in genomics test (WES, NGS, transcriptome etc.
  • Precision medicine needs to be incorporated in med education.. Fellowships.. Residency
  • She spends hours with the insurance companies providing more and more evidence to justify reimbursements
  • She says getting that evidence is a challenged;  biomedical information needs to be better CURATED

 

Dr. Ezra Cohen, Tempest

 

  • HPV head and neck cancer, good prognosis, can use cituximab and radiation
  • $2 billion investment at Templest of AI driven algorithm to integrate all omics; used LLM models too

Dr. Janet Woodcock

 

  • Our theoretical problem with precision and personalized medicine is that we are trained to think of the average patient
  • ISPAT II trial a baysian trial; COVID was a platform trial
  • She said there should there be NIH sponsored trials on adaptive biomarker platform trials

This event will be covered by the LPBI Group on Twitter.  Follow on

@Pharma_BI

@StephenJWillia2

@Aviva1950

@AdvancingPM

using the following meeting hashtags

#AdvancingPM #precisionmedicine

Read Full Post »

Powerful Cancer-Fighting Foods and Their Role in Body Repair

Curator: Dr. Sudipta Saha, Ph.D.

In the search for dietary approaches to prevent and fight cancer, certain foods have been found to possess potent anti-cancer properties. These foods not only help reduce the risk of cancer but also assist in repairing the body. Five such foods are green tea, broccoli like vetables, papaya, purple potatoes, and pomegranate—and the bioactive compounds responsible for their benefits.

1. Green Tea

Green tea, particularly rich in the catechin epigallocatechin gallate (EGCG), has gained considerable attention for its cancer-fighting properties. EGCG functions as a potent antioxidant, neutralizing free radicals and reducing oxidative stress, which is a key factor in the development of cancer. Studies suggest that EGCG can inhibit cancer cell proliferation by disrupting the signaling pathways essential for cell growth and survival, especially in breast, prostate, and colorectal cancers. Additionally, green tea has been shown to enhance the body’s immune function, making it more effective at targeting abnormal cells. EGCG induces apoptosis (programmed cell death) in cancer cells, halts angiogenesis (the formation of new blood vessels that nourish tumors), and inhibits metastasis (the spread of cancer cells to other parts of the body).

2. Broccoli and Cauliflower

Cruciferous vegetables like broccoli and cauliflower are rich in sulforaphane, a compound known for its detoxifying and anti-carcinogenic properties. Sulforaphane activates the body’s natural detoxification enzymes, which help eliminate carcinogens before they can damage cells. Moreover, it has been shown to inhibit the growth of various cancer cells, including those of the colon, breast, and prostate. Sulforaphane enhances the activity of phase II detoxification enzymes and induces apoptosis in cancer cells. It also inhibits histone deacetylase, an enzyme associated with cancer cell growth, thus preventing cancerous cells from replicating.

3. Papaya

Papaya is rich in carotenoids such as beta-carotene, lycopene, and beta-cryptoxanthin, which are powerful antioxidants. These compounds neutralize free radicals, reducing oxidative stress that can lead to cancer. Lycopene, in particular, has been linked to a lower risk of cancers, including those of the prostate, breast, and lung. Papaya also contains other bioactive compounds that help modulate immune responses, supporting the body’s ability to identify and destroy cancer cells. Carotenoids act by scavenging free radicals and reducing oxidative stress. Lycopene has also been shown to regulate cell cycle progression and inhibit growth factor signaling in cancer cells.

4. Purple Potatoes

Purple potatoes are unique due to their high levels of anthocyanins, which not only provide them with their distinctive color but also contribute to cancer prevention. Studies suggest that anthocyanins in purple potatoes help repair damaged tissues by promoting stem cell regeneration. They also have anti-inflammatory and anti-proliferative effects, which are crucial for halting cancer growth. Anthocyanins inhibit the growth of cancer cells by inducing cell cycle arrest and promoting the repair of damaged tissues through stem cell activation.

5. Pomegranate

Pomegranates are rich in ellagitannins, compounds that break down into ellagic acid in the body. Ellagic acid has been shown to possess anti-cancer properties by inhibiting tumor growth and promoting apoptosis in cancer cells. Pomegranate juice has demonstrated potential in reducing the progression of cancers such as breast and prostate cancer, due to its ability to suppress inflammation and oxidative stress. Ellagitannins and their metabolites inhibit cell proliferation and induce apoptosis. They also act by reducing inflammation and inhibiting the pathways involved in cancer cell survival and growth.

Conclusion

Incorporating foods like green tea, broccoli, papaya, purple potatoes, and pomegranates into your diet may help fight cancer and promote the repair of damaged tissues. The bioactive compounds found in these foods—EGCG, sulforaphane, carotenoids, anthocyanins, and ellagitannins—work through various mechanisms to inhibit cancer cell growth, induce apoptosis, and support the body’s natural repair processes. Including these nutrient-dense foods in your diet may contribute to overall health and resilience against cancer.

References:

https://pubmed.ncbi.nlm.nih.gov/9327595

https://pubmed.ncbi.nlm.nih.gov/1549603

https://pubmed.ncbi.nlm.nih.gov/15068816

https://pubmed.ncbi.nlm.nih.gov/17867677

https://pubmed.ncbi.nlm.nih.gov/17532103

https://pubmed.ncbi.nlm.nih.gov/19472429

https://pubmed.ncbi.nlm.nih.gov/18800808

https://pubmed.ncbi.nlm.nih.gov/16309738

https://www.taylorfrancis.com/chapters/edit/10.1201/9781420009866-5/pomegranate-phytochemicals-navindra-seeram-yanjun-zhang-jess-reed-christian-krueger-jakob-vaya

https://pubmed.ncbi.nlm.nih.gov/25403817

https://pubmed.ncbi.nlm.nih.gov/25027102

https://pubmed.ncbi.nlm.nih.gov/16563357

Read Full Post »

Nobel Prize in Physics 2024 to J.J. Hopfield and to G.E. Hinton

Reporter: Aviva Lev- Ari, PhD, RN 

 

UPDATED on 10/19/2024

Why the Nobel Prize in Physics Went to AI Research 

Nobel committee recognizes scientists for foundation research in neural networks

 

The Nobel Prize Committee for Physics caught the academic community off-guard by handing the 2024 award to John J. Hopfield and Geoffrey E. Hinton for their foundational work in neural networks.

The pair won the prize for their seminal papers, both published in the 1980s, that described rudimentary neural networks. Though much simpler than the networks used for modern generative AI like ChatGPT or Stable Diffusion, their ideas laid the foundations on which later research built.

Even Hopfield and Hinton didn’t believe they’d win, with the latter telling The Associated Press he was “flabbergasted.” After all, AI isn’t what comes to mind when most people think of physics. However, the committee took a broader view, in part because the researchers based their neural networks on “fundamental concepts and methods from physics.”

“Initially, I was surprised, given it’s the Nobel Prize in Physics, and their work was in AI and machine learning,” says Padhraic Smyth, a distinguished professor at the University of California, Irvine. “But thinking about it a bit more, it was clearer to me why [the Nobel Prize Committee] did this.” He added that physicists in statistical mechanics have “long thought” about systems that display emergent behavior.

Hopfield first explored these ideas in a 1982 paper on neural networks. He described a type of neural network, later called a Hopfield network, formed by a single layer of interconnected neurons. The paper, which was originally categorized under biophysics, said a neural network could retain “memories” from “any reasonably sized subpart.”

Hinton expanded on that work to conceptualize the Boltzmann machine, a more complex neural network described in a 1985 paper Hinton co-authored with David H. Ackley and Terrence J. Sejnowski. They introduced the concept of “hidden units,” additional layers of neurons which exist between the input and output layers of a neural network but don’t directly interact with either. This makes it possible to handle tasks that require a more generalized understanding, like classifying images.

So, what’s the connection to physics?

Hopfield’s paper references the concept of a “spin glass,” a material in which disordered magnetic particles lead to complex interactions. Hinton and his co-authors drew on statistical mechanics, a field of physics that uses statistics to describe the behavior of particles in a system. They even named their network in honor of Ludwig Boltzmann, the physicist whose work formed the foundation of statistical mechanics.

And the connection between neural networks and physics isn’t a one-way street. Machine learning was crucial to the discovery of the Higgs boson, where it sorted the data generated by billions of proton collisions. This year’s Nobel Prize for Chemistry further underscored machine learning’s importance in research, as the award went to a trio of scientists who built an AI model to predict the structures of proteins.

While Hopfield and Hinton authored influential papers, their contributions to machine learning were cemented by their continued work, and both won multiple awards before the Nobel Prize. Among others, Hopfield won the Boltzmann Medal in 2022; Hinton received the IEEE Frank Rosenblatt Award in 2014, the IEEE James Clerk Maxwell Medal in 2016, and the Turing Award in 2018 (that last one alongside Yann LeCun and Yoshua Bengio).

Smyth saw Hopfield’s efforts first-hand as a student at the California Institute of Technology. “Hopfield was able to bring together mathematicians, engineers, computer scientists, and physicists. He got them in the same room, got them excited about modeling the brain, doing pattern recognition and machine learning, unified by mathematical theories he brought in from physics.”

In 2012, Hinton co-founded a company called DNNResearch with two of his students; Ilya Sutskever, who later co-founded OpenAI, and Alex Krizhevsky. Together, the trio collaborated on AlexNet, a hugely influential neural network for computer vision. Hinton also taught at the University of Toronto, where he continued to champion machine learning.

Navdeep Jaitly, now a deep learning researcher at Apple, said Hinton inspired new generations of engineers and researchers. In Jaitly’s case, the influence was direct; Jaitly studied under Hinton at the University of Toronto.

“I came in with experience in statistical modeling,” says Jaitly, “but Hinton still managed to entirely change how I think about problem solving. In terms of his contributions to machine learning, his methods are central to almost everything we do.”

SOURCE

https://spectrum.ieee.org/nobel-prize-in-physics

 

UPDATED on 10/13/2024

Website: https://www.bbc.co.uk/newsnight

https://youtu.be/MGJpR591oaM?si=6DhusxGt_B8dUpT_

 

10/8/2024

John J. Hopfield
Princeton University, NJ, USA

Born 1933 in Chicago, IL, USA. PhD 1958 from Cornell University, Ithaca, NY, USA. Professor at Princeton University, NJ, USA.

Geoffrey E. Hinton
University of Toronto, Canada

Born 1947 in London, UK. PhD 1978 from The University of Edinburgh, UK. Professor at University of Toronto, Canada.

was announced on 10/8/2024 in Stockholm, Sweden.

“for foundational discoveries and inventions that enable machine learning with artificial neural networks”

They trained artificial neural networks using physics

This year’s two Nobel Laureates in Physics have used tools from physics to develop methods that are the foundation of today’s powerful machine learning. John Hopfield created an associative memory that can store and reconstruct images and other types of patterns in data. Geoffrey Hinton invented a method that can autonomously find properties in data, and so perform tasks such as identifying specific elements in pictures.

John Hopfield invented a network that uses a method for saving and recreating patterns. We can imagine the nodes as pixels. The Hopfield network utilises physics that describes a material’s characteristics due to its atomic spin – a property that makes each atom a tiny magnet. The network as a whole is described in a manner equivalent to the energy in the spin system found in physics, and is trained by finding values for the connections between the nodes so that the saved images have low energy. When the Hopfield network is fed a distorted or incomplete image, it methodically works through the nodes and updates their values so the network’s energy falls. The network thus works stepwise to find the saved image that is most like the imperfect one it was fed with.

Geoffrey Hinton used the Hopfield network as the foundation for a new network that uses a different method: the Boltzmann machine. This can learn to recognise characteristic elements in a given type of data. Hinton used tools from statistical physics, the science of systems built from many similar components. The machine is trained by feeding it examples that are very likely to arise when the machine is run. The Boltzmann machine can be used to classify images or create new examples of the type of pattern on which it was trained. Hinton has built upon this work, helping initiate the current explosive development of machine learning.

Reference

Popular science background: They used physics to find patterns in information (pdf)


Scientific background: “For foundational discoveries and inventions that enable machine learning with artificial neural networks” (pdf)

 

SOURCE

https://www.nobelprize.org/prizes/physics/2024/press-release/

Read Full Post »

Israeli vendor AISAP gained FDA clearance for its new AI-enabled, point-of-care ultrasound (POCUS) software platform, AISAP Cardio

Reporter: Aviva Lev-Ari, PhD, RN

FDA clears AI-powered POCUS platform for structural heart disease, heart failure

Read Full Post »

« Newer Posts - Older Posts »