{"id":88,"date":"2023-02-08T10:39:47","date_gmt":"2023-02-08T09:39:47","guid":{"rendered":"http:\/\/localhost:8080\/?page_id=88"},"modified":"2023-08-29T12:27:18","modified_gmt":"2023-08-29T10:27:18","slug":"home","status":"publish","type":"page","link":"https:\/\/amldgenai.epfl.ch\/","title":{"rendered":"Home-EXS"},"content":{"rendered":"\n
\"\"<\/figure>\n\n\n\n
\n

AMLD Generative AI Workshops for the EPFL community<\/h1>\n\n\n\n

EPFL Campus, Lausanne, Switzerland<\/h4>\n\n\n\n

Tuesday, August 29th, 2023<\/strong><\/p>\n<\/header>\n\n\n\n

<\/div>\n\n\n\n
\n
<\/div>\n\n\n\n

To further the discussions from the main AMLD GenAI Conference<\/span><\/a>, we’re bringing together another group of experts for a special session on themes in generative AI, including theory, science, and policy. Generative AI and foundation models promise to change the world as personal computers, the web and mobile computing did before them. Join us for an exciting day of presentations and discussions at this pivotal moment in the next technological revolution.<\/p>\n<\/div>\n\n\n\n

<\/div>\n\n\n\n
\n
REGISTRATION<\/strong><\/a><\/div>\n<\/div>\n\n\n\n
\n
<\/div>\n\n\n\n

TRACK 1 – Technology of Foundation Models<\/strong><\/h4>\n\n\n\n

Organized by Prof. Volkan Cevher (STI), Prof. Nicolas Flammarion (IC), Prof. Caglar Gulcehre (IC)<\/em><\/strong>, Prof. Martin Jaggi (IC), Prof. Amir Zamir (IC), and Prof. Lenka Zdeborova (IC, SB)<\/em><\/strong><\/p>\n\n\n\n

This 3-fold workshop with world-leading experts will focus on the technology of recent foundation models such as large language models: How to build them – a systems and engineering perspective; How to understand them – towards a theory of foundation models; and how to integrate models across different data modalities.<\/p>\n<\/div>\n\n\n\n

\n
<\/div>\n\n\n\n

TRACK 2 – AI Policy Track<\/strong><\/strong><\/h4>\n\n\n\n

Organized by <\/i><\/b>Dr. Jan Kerschgens (CIS) and Prof. Tanja K\u00e4ser (IC)<\/strong><\/em><\/p>\n\n\n\n

The realm of AI has emerged as a pivotal technology in the 21st century. Recent breakthroughs in training Large Language Models such as ChatGPT, built upon foundational models applicable to a diverse range of human activities, are already reshaping numerous facets of our society, promising substantial boosts to economic productivity (McKinsey<\/a>). Our AI policy workshop on this day aims to delve into these transformative dynamics. Through illuminating presentations from experts in science, economy, and policy-making, we will explore how the forthcoming EU AI Act and its subsequent implementation via industrial standards will need to balance risk mitigation with the enablement of positive AI-driven contributions to our societies.<\/p>\n<\/div>\n\n\n\n

\n
<\/div>\n\n\n\n

TRACK 3 – Foundation Models for Science<\/strong><\/strong><\/strong><\/h4>\n\n\n\n

Organized by Prof. Maria Brbic (IC), Prof. Pascal Frossard (STI)<\/em><\/strong><\/em><\/strong><\/em><\/strong><\/em><\/strong><\/em><\/strong><\/em><\/strong>, Prof. Philippe Schwaller (SB), and Dr. Dorina Thanou (STI, SB, IC)<\/em><\/strong><\/em><\/strong><\/em><\/strong><\/p>\n\n\n\n

Foundation models \u2013 powerful AI models that have been trained on massive datasets and can be used to solve many different downstream tasks \u2013 have been revolutionizing AI recently. In this workshop, we will discuss recent advances, opportunities and risks of these models in scientific applications. The workshop will feature renowned speakers from the fields of biology, medicine, and chemistry, bringing diverse perspectives and expertise to explore the potential of foundation models for scientific breakthroughs in these fields.<\/p>\n<\/div>\n\n\n\n

\n

Program – Day two workshops<\/h2>\n\n\n\n
\n
\n

Technology of Foundation Models<\/strong><\/strong> <\/h4>\n\n\n\n

CM3 auditorium<\/strong> (live feed in CM1 when CM3 is at full capacity)<\/em><\/p>\n\n\n\n

08:30 – 09:00    Welcome & registration<\/strong><\/p>\n\n\n\n

09:00 – 09:10      Introduction<\/p>\n\n\n\n

09:10 – 09:45      Armand Joulin, \u00ab\u00a0Democratizing Large Language Models\u00a0\u00bb <\/p>\n\n\n\n

09:45 – 10:20      Julien Launay, \u00ab\u00a0Challenges in Training Frontier Language Models\u00a0\u00bb      <\/p>\n\n\n\n

10:20 – 10:50     Coffee break<\/strong><\/p>\n\n\n\n

10:50 – 11:15         Ce Zhang, \u00ab\u00a0Building RedPajama\u00a0\u00bb <\/p>\n\n\n\n

11:15 – 11:50          Tim Dettmers, \u00ab\u00a0QLoRA: Efficient Finetuning of Quantized LLMs\u00a0\u00bb <\/p>\n\n\n\n

11:50 – 12:30        Panel discussion #1 with Tim Dettmers, Johnathan Frankle, Julien Launay and Ce Zhang.<\/p>\n\n\n\n

12:30 – 14:00<\/strong>       Lunch break<\/strong> (on your own)<\/p>\n\n\n\n

14:00 – 14:35        Ani Kembhavi, \u00ab\u00a0Is this the beginning or is this the end for end-to-end vision models ?\u00a0\u00bb<\/p>\n\n\n\n

14:35 – 15:10        Neil Houlsby, \u00ab\u00a0Advances in Visual Pretraining for LLMS\u00a0\u00bb<\/p>\n\n\n\n

15:10 – 15:40      Coffee break<\/strong><\/p>\n\n\n\n

15:40 – 16:15        Emily Webber, \u00ab\u00a0Pretrain Foundation Models on Public Clouds\u00a0\u00bb(joining remotely)<\/p>\n\n\n\n

16:15 – 16:50        Fei Xia (joining remotely), \u00ab\u00a0Low-level Embodied Intelligence with Foundation Models\u00a0\u00bb<\/p>\n\n\n\n

16:50 – 17:30       Panel discussion #2 with Armand Joulin, Neil Houlsby, Ani Kembhavi and Fei Xia.<\/p>\n\n\n\n

17:30                     Closing<\/strong><\/p>\n<\/div>\n\n\n\n

\n

AI Policy Track<\/strong><\/strong><\/h4>\n\n\n\n

CM2<\/strong> auditorium<\/strong><\/p>\n\n\n\n

08:30 – 09:00    Welcome & registration<\/strong><\/p>\n\n\n\n

09:00 – 09:10      Introduction<\/p>\n\n\n\n

09:10 – 09:30\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0Pierre Vandergheynst, \u00ab\u00a0A Super Simple Introduction to AI and Generative AI\u00a0\u00bb<\/p>\n\n\n\n

09:30 – 09:50     Roger Dubach, \u00ab\u00a0Set the course: Crafting a legal and regulatory landscape for AI\u00a0\u00bb<\/p>\n\n\n\n

09:50 – 10:10      Adina Dorthe, \u00ab\u00a0AI in the machine tool industry: opportunities & challenges\u00a0\u00bb<\/p>\n\n\n\n

10:10 – 10:30       Ayisha Piotti, \u00ab\u00a0AI Policy – a strategic opportunity\u00a0\u00bb<\/p>\n\n\n\n

10:30 – 11:00     Coffee break <\/strong><\/p>\n\n\n\n

11:00 – 12:00       Round table with Daniel Dobos, Adina Dorthe, Roger Dubach, Adam M. Gontarz (remote), Marcel Knecht, Ayisha Piotti, Sabine S\u00fcsstrunk and Pierre Vandergheynst.<\/p>\n\n\n\n

Moderated by Jan Kerschgens<\/p>\n\n\n\n

12:00                     Closing<\/strong><\/p>\n<\/div>\n\n\n\n

\n

Foundation Models for Science<\/strong><\/strong><\/strong><\/h4>\n\n\n\n

CM2<\/strong> auditorium<\/strong><\/p>\n\n\n\n

13:30 – 14:00    Welcome & registration<\/strong><\/p>\n\n\n\n

14:00 – 14:05      Introduction<\/p>\n\n\n\n

14:05 – 14:40      Pranav Rajpurkar, \u00ab\u00a0The Generalist Medical AI Will See You Now\u00a0\u00bb<\/p>\n\n\n\n

14:40 – 15:15       Payel Das, \u00ab\u00a0Promises (and Pitfalls) of Foundation Models for Science\u00a0\u00bb<\/p>\n\n\n\n

15:15 – 15:45      Coffee break <\/strong><\/p>\n\n\n\n

15:45 – 16:20      Andrew White, \u00ab\u00a0Language is the Future of Chemistry\u00a0\u00bb<\/p>\n\n\n\n

16:20 – 16:55      Shekoofeh Azizi, \u00ab\u00a0Exploring Foundation Models for Generalist Biomedical AI\u00a0\u00bb<\/p>\n\n\n\n

16:55 – 17:30      Round table with Shekoofeh Azizi, Payel Das, Pranav Rajpurkar, Nigam Shah and Andrew White.<\/p>\n\n\n\n

17:30                     Closing<\/strong><\/p>\n<\/div>\n<\/div>\n<\/div>\n\n\n\n

\n

Speakers<\/h2>\n\n\n\n
\n
\"\"
Shekoofeh Azizi
Google DeepMind<\/figcaption><\/figure>\n\n\n\n
\"\"
Payel Das
AI Science Department, IBM<\/figcaption><\/figure>\n\n\n\n
\"\"
Daniel Dobos
Research Director, Swisscom<\/figcaption><\/figure>\n\n\n\n
\"\"
Adina Dorthe
Head of Innovation & R&D Digital Business Unit, Georg Fischer<\/figcaption><\/figure>\n\n\n\n
\"\"
Roger Dubach
Ambassador, Deputy Director, Directorate of International Law at EDA – DFAE – FDFA<\/figcaption><\/figure>\n\n\n\n
\"\"
Jonathan Frankle
Chief Scientist, MosaicML<\/figcaption><\/figure>\n\n\n\n
\"\"
Adam M. Gontarz
Swissmem, Mitglied der Gesch\u00e4ftsleitung, Bereichsleitung Digitalisierung, Innovation und Technik<\/figcaption><\/figure>\n\n\n\n
\"\"
Neil Houlsby<\/a>
Research Scientist, Google Brain<\/a><\/figcaption><\/figure>\n\n\n\n
\"\"
Armand Joulin
Research Scientist, Apple MLR<\/figcaption><\/figure>\n\n\n\n
\"\"
Aniruddha Kembhavi
Senior Director of Computer Vision at the Allen Institute for AI (AI2)<\/a><\/figcaption><\/figure>\n\n\n\n
\"\"
Marcel Knecht
SNV, Leiter Kerngesch\u00e4ft \/ Mitglied der Gesch\u00e4ftsleitun<\/figcaption><\/figure>\n\n\n\n
\"\"
Ayisha Piotti
ETHZ Center for Law & Economics and Reghorizon<\/figcaption><\/figure>\n\n\n\n
\"\"
Julien Launay
Extreme-scale lead, Hugging Face<\/figcaption><\/figure>\n\n\n\n
\"\"
Pranav Rajpurkar
Assistant Professor of Biomedical Informatics, Harvard Medical School<\/figcaption><\/figure>\n\n\n\n
\"\"
Sabine S\u00fcsstrunk
EPFL Professor, President of the Swiss Science Council<\/figcaption><\/figure>\n\n\n\n
\"\"
Tim Dettmers
PhD Student, University of Washington<\/figcaption><\/figure>\n\n\n\n
\"\"
Emily Webber
Generative AI WW Foundations Lead at AWS<\/figcaption><\/figure>\n\n\n\n
\"\"
Andrew White
Member of Technical Staff, Future House<\/figcaption><\/figure>\n\n\n\n
\"\"
Fei Xia
Research Scientist, Google DeepMind<\/a> <\/figcaption><\/figure>\n\n\n\n
\"\"
Ce Zhang
CTO of T<\/a>ogether, Associate Professor Department of Computer Science, University of Chicago<\/figcaption><\/figure>\n<\/figure>\n\n\n\n
<\/div>\n\n\n\n

Program Organization<\/h2>\n\n\n\n
\n
\"\"
Prof. Antoine Bosselut
School of Computer and Communication Sciences <\/strong><\/figcaption><\/figure>\n\n\n\n
\"\"
Prof. Maria Brbic
School of Computer and Communication Sciences <\/strong><\/figcaption><\/figure>\n\n\n\n
\"\"
Prof. Volkan Cevher
School of Engineering<\/figcaption><\/figure>\n\n\n\n
\"\"
Prof. Nicolas Flammarion
School of Computer and Communication Sciences <\/strong><\/figcaption><\/figure>\n\n\n\n
\"\"
 Prof. Pascal Frossard
School of Engineering
<\/figcaption><\/figure>\n\n\n\n
\"\"
Prof. Caglar Gulcehre
School of Computer and Communication Sciences <\/strong><\/figcaption><\/figure>\n\n\n\n
\"\"
Prof. Martin Jaggi
School of Computer and Communication Sciences <\/strong><\/figcaption><\/figure>\n\n\n\n
\"\"
Prof. Tanja K\u00e4ser
School of Computer and Communication Sciences <\/strong><\/figcaption><\/figure>\n\n\n\n
\"\"
Dr. Jan Kerschgens
Center for Intelligent Systems<\/figcaption><\/figure>\n\n\n\n
\"\"
Prof. Marcel Salath\u00e9
School of Computer and Communication Sciences
School of Life Sciences<\/figcaption><\/figure>\n\n\n\n
\"\"
Prof. Martin Schrimpf
School of Life Sciences
School of Computer and Communication Sciences <\/figcaption><\/figure>\n\n\n\n
\"\"
Prof. Philippe Schwaller
School of Basic Sciences<\/figcaption><\/figure>\n\n\n\n
\"\"
Dr. Dorina Thanou (STI, SB, IC)
School of Engineering
School of Basic Sciences
School of Computer and Communication Sciences <\/figcaption><\/figure>\n\n\n\n
\"\"
Prof. Amir Zamir
School of Computer and Communication Sciences<\/figcaption><\/figure>\n\n\n\n
\"\"
Prof. Lenka Zdeborova
School of Computer and Communication Sciences School of Basic Sciences<\/figcaption><\/figure>\n<\/figure>\n\n\n\n

Event Organization<\/h2>\n\n\n\n
\n
\"\"
Deirdre Rochat<\/figcaption><\/figure>\n\n\n\n
\"\"
Nicolas Machado<\/figcaption><\/figure>\n<\/figure>\n<\/div>\n\n\n\n
\n

Directions<\/h2>\n\n\n\n

If you’re flying in, Gen\u00e8ve-Cointrin<\/a> is the nearest international airport. By train, it takes ~45 minutes to reach Lausanne. Z\u00fcrich Airport is about ~2.5 hours away by train. To get information on train schedules, please see the Swiss Rail website<\/a>.<\/p>\n\n\n\n

To reach the CM1 and CM2 venue from the EPFL M1 metro station, please check the map below.<\/p>\n\n\n\n