Discussion of machine learning, its applications, and related ideas
A brown-bag (bring your own lunch) reading club at TReNDs Center held mainly for cross pollination of ideas and “out of the comfort zone” fun. We read and discuss papers, tutorials, or packs of papers and ideas at once. The topics span all areas of machine learning, with a focus on Deep Learning, but also venture into brain imaging and theories of how the brain works. The goal is to both learn and refine the knowledge of important foundational concepts and stay current with the literature.
Please sign up for the mailing list or, if you’re a part of the TReNDS Center, join the #reading_group channel on our Slack workspace.
A list of topics with associated materials can be found on our GitHub page.
Upcoming Meetings
??/??/???? – “What you wanted to know about ICA, but were afraid to ask”
??/??/???? – Normalizing Flows
??/??/???? – Time-Varying Neural Networks
??/??/???? – Information Theory for Deep Learning
??/??/???? – Word Embeddings
Past Meetings
Fall 2021
09/17/2021 – Causation and Discovery: Concepts, methods, and applications (video) (slides)– David Danks presents
(external speaker)
09/10/2021 – Symbolic Methods using Gradients for Neural Model Explanation (video) (slides) – Mahfuz presents
09/03/2021 – Causal Representation Learning (video) – Sergey presents
Summer 2021
08/20/2021 – Learning Function Structure in Neuromorphic Networks (video) (slides) – Amrit presents
08/13/2021 – Meshed-Memory Transformer (video) (slides) – William presents
08/06/2021 – Generative Vision model for Breaking Captcha (video) (slides) – Harsha presents
07/23/2021 – VAEs and Non-Linear ICA (video) (slides) – Rogers presents
07/16/2021 – Reinforcement Learning (pt 2) (video) (slides)– TJ presents
07/09/2021 – Reinforcement Learning (pt 1) (video) (slides) – TJ presents
06/25/2021 – PixelCNN (video) – Will presents
06/18/2021 – How Neural Networks Extrapolate (video) – Kevin presents
06/04/2021 – Normalizing Flows (NICE) (NVP) (MADE) (video) (slides)– Eloy presents
05/28/2021 – Directed Functional Connectivity (video) (slides)– Thomas presents
05/21/2021 – Neural Turing Machines (video) (slides)– Eloy and Will present
05/14/2021 – Mythos of Model Interpretability– Sergey presents
05/07/2021 – Multi-Dimensional LSTMs (video) (slides) – Yaorong presents
Spring 2021
04/30/2021 – Energy Based Out of Distribution Detection (video) (slides) – Kevin presents
04/23/2021 – Every Model is a Kernel Machine (video) – Sergey presents
04/16/2021 – Neural Relational Inference for Interacting Systems (slides) (video) – Usman presents
04/09/2021 – Transformers with Feedback Memory (slides) (video) – Alex presents
04/02/2021 – Debugging Tests for Model Explanations (slides) (video) – Mahfuz presents
03/26/2021 – Hopfield Networks ARE all you need (slides) (video) – Noah Presents
03/19/2021 – Single-shot Network Pruning (slides) (video) – Riyasat and Noah present
03/12/2021 – “Brain, Language & Deep Learning” – Harsh presents
03/05/2021 – GIN-LiNGAM (slides) (video) – Sajad presents
2/26/2021 – Geometric Deep Learning (video) – Will presents
2/19/2021 – Intro to Causal Discovery (slides) (video) – Sergey presents
2/12/2021 – PowerSGD (slides) (video) – Brad presents
2/5/2021 – Dall-E (slides) (video) – Eloy presents
1/22/2021 – Multiplicative Interactions and Where to Find Them (slides) (video) – Alex presents
1/15/2021 – Siamese Networks and Self-Supervised Learning (slides) (video) – Eloy and Alex present
Fall 2020
12/11/2020 – Notable Work at NeurIPS 202 (slides) (video) – All present
12/04/2020 – Intelligence w/o Representation (slides) (video) – Eloy presents
11/20/2020 – Stacked Capsule Autoencoders (slides) (video) – Will presents
11/13/2020 – Learning Bifurcations (slides) (video) – Jack presents
11/06/2020 – Curriculum by Smoothing (slides) (video) – Alex presents
10/09/2020 – Transformers for Image Recognition (slides) (video)
– Eloy presents
10/02/2020 – Overfitting in Classification (slides) – Thomas presents
09/25/2020 – Neural State Machines – Jack presents
09/18/2020 – Hierarchial LSTMs/ Adversarial LSTMs – William presents
09/11/2020 – MRI Segmentation (second paper) (slides) – Zafar Presents
09/04/2020 – World Models (slides) (video) – Eloy presents
8/28/2020 – Deep Learning for Right Reasons (video) (slides) – Noah presents
08/21/2020 – Sparsity Inducing Regularization (video) – Riyasat presents
Summer 2020
08/14/2020 – Inference of Causal Relations in Dynamical Systems
(Taken Theorem video) – Jack presents
08/07/2020 – Analytic Marching (slides) (video) – William presents
07/31/2020 – Learning Graph Representations
07/24/2020 – CNNs on Graphs (video) – Alex presents
07/10/2020 – Hierarchical LSTMs (video)– William presents
06/26/2020 – ANIL (slides) (video) – Alex presents
06/19/2020 – “Multitask Learning over graphs” (slides) (video) – Riyasat and Brad Present
06/12/2020 – MAML and iMAML – Alex presents
06/05/2020 – Contrastive Predictive Coding – Mahfuz presents
Spring 2020
05/29/2020 – Cutting out the Middle-Man:L Training and Evaluating Energy-Based Models without Sampling – Alex presents
05/22/2020 – Energy-Based Models – Video – Jack and Alex present
05/15/2020 – Noise Contrastive Estimation – Sergey presents
05/08/2020 – “Representation Learning” – Alex presents
05/01/2020 – ” Shortcut Learning in Deep Neural Networks” – Alex presents
04/24/2020 – Fixed Point Layers (pt 2) – presented by Sergey
04/17/2020 – Fixed Point Layers – presented by Sergey
04/10/2020 – Multitask Learning – presented by Alex
03/13/2020 – A tutorial on Automatic Differentiation – presented by Sergey
03/06/2020 – Sanity Checks for Saliency Maps
02/28/2020 – Complexity control by gradient descent in deep networks
02/21/2020 – A mathematical theory of semantic development in deep neural networks
02/14/2020 – N/A
02/07/2020 – Exact solutions to the nonlinear dynamics of learning in deep linear neural networks
01/31/2020 – Data-driven discovery of coordinates andgoverning equations
01/24/2020 – Neural Networks in System Identification
01/17/2020 – A tutorial on hidden Markov models and selected applications in speech recognition
Fall 2019
12/06/2019 – Meta-learning for neuroimaging
11/22/2019 – Nonlinear Dimensionality Reduction methods and a generalization
11/08/2019 – Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead
11/01/2019 – Synthesizing Programs for Images using Reinforced Adversarial Learning
10/25/2019 – Introduction to Deep Q-Network
10/18/2019 – Hidden stratification
10/11/2019 – Neural Ordinary Differential Equations
10/04/2019 – Model Utility
09/27/2019 – Wasserstein GANs and other easier to train models
09/20/2019 – Generative Adversarial Networks (Intro)
09/13/2019 – Predictive coding theory of the mind: part II
09/06/2019 – Predictive coding theory of the mind: Intro
08/30/2019 – Confidence and accuracy: On Calibration of Modern Neural Networks
08/23/2019 – Deep learning model introspection
Summer 2019
08/16/2019 – Deep learning trends from the deep learning summer school
08/09/2019 – Variational Autoencoders: part II
08/02/2019 – Variational Autoencoders: part I
07/26/2019 – Attention in deep learning models: part II
07/19/2019 – Attention in deep learning models: part I
07/12/2019 – NLP successes of 2018: transfer learning
Brad Baker
Sergey Plis