Reading Club

Discussion of machine learning, its applications, and related ideas

A brown-bag (bring your own lunch) reading club at TReNDs Center held mainly for cross pollination of ideas and “out of the comfort zone” fun. We read and discuss papers, tutorials, or packs of papers and ideas at once. The topics span all areas of machine learning, with a focus on Deep Learning, but also venture into brain imaging and theories of how the brain works. The goal is to both learn and refine the knowledge of important foundational concepts and stay current with the literature.

Email Sergey Plis at splis@gsu.edu if you want to be added to the club’s Slack. If you’re already a part of the TReNDS Center, join the #reading_group channel on our Slack workspace.

A list of topics with associated materials can be found on our GitHub page.


Upcoming Meetings

Fall 2022

09/30/2022 – GNNs/GCNs

09/23/2022 – Causal Mapping of Human Brain Function


Past Meetings

Summer 2022

09/16/2022 – GATO (video) (slides) – TJ presents

09/09/2022 – Conformal Predictions (video) (slides) – Sergey presents

09/02/2022 – Monks and EEG – Kseniya presents

08/26/2022 – Introspection with Influence Functions (video) – Noah presents

08/19/2022 – Label Propagation (paper 1) (paper 2) (video) (slides) – Minoo presents

08/05/2022 – ICML (& IJCNN) Highlights (video) (slides) – Alex, Mahfuz, and Sergey present

07/29/2022 – Deep Reinforcement Learning (video) (slides) – Eloy presents

07/22/2022 – Symmetry-Based Representations (video) – Eloy presents

07/15/2022 – Planning Meeting

07/08/2022 – Cortical Surface Generation (part 2) (video) (cortical++) (pialnn) (cortexode) – William presents

06/30/2022 – OHBM Recap (slides) – Group presents

06/17/2022 – Text-to-Image Generation (video) (slides) – TJ presents

06/10/2022 – Conformal PredictionSergey presents

06/03/2022 – Cortical Surface Generation Models (part 1) (video) (topofit) (deepcsr) (vox2cortex) – William presents

05/27/2022 – Dynamics in Shallow AutoEncoders (video) (slides)Brad presents

05/20/2022 – Theories of Consciousness (video) (slides)TJ presents

Spring 2022

04/29/2022 –Learning in High Dimensions Amounts to Extrapolation (video)Sergey presents

04/23/2022 – GSU Demo Day

04/15/2022 – 1000 Brains Theory (slides) (video)Eloy presents

04/08/2022 – Backprop and Neuroscience (slides) (video)Brad presents

04/01/2022 – Recurrent Independent MechanismsSergey presents

03/25/2022 – Topology Layer for Machine Learning (video) Noah presents

03/18/2022 – Multimodal Few-Shot Learning (slides) (video)Mrinal presents

03/11/2022 – Supervised Contrastive Learning (slides) (video)Mahfuz presents

03/04/2022 – Time Series Forecasting (slides) (video)Usman presents

02/25/2022 – Deep Learning in the Browser (slides) (video) Mohamed presents

02/18/2022 – Alpha Fold (slides) (video)TJ presents

02/11/2022 – Recurrent Models for Neuroimaging (video) (slides)Yaorong presents

02/04/2022 – If deep learning is the answer what is the question? (video) (slides)Brad presents

01/28/2022 – Cortical Flow (video) (slides)William presents

01/21/2022 – Best Ideas of 2021 (video) (slides)Group presentation

01/14/2022 – Multi Modal Deep Learning for Brain Development and Cognition(video) (slides)Yu-Ping presents

Fall 2021

12/17/2021 – Underspecification Challenges in Modern Machine LearningAlex presents

12/10/2021 – The physics of higher-order interactions in complex systems (video) (slides)Ashkan presents

12/03/2021 – Answer Set Programming (video) (slides)Sajad presents

11/19/2021 – Upside-Down Reinforcement Learning (video) (slides)TJ presents

11/12/2021 – Perspective on General AI (video)Sergey presents

11/05/2021 – Mixed Integer Programming (video)William presents

10/29/2021 – Multi-Task Self-Training (video) (slides)Eloy and Noah present

10/22/2021 – Fit Without Fear (video)Sergey presents

10/15/2021 – GPT-Codex (video) (slides)Mrinal presents

10/08/2021 – MLP Mixers (video) (slides)Alex presents

10/01/2021 – Dynamic Causal Models (video) (slides)Jack presents

09/24/2021 – Denoising Diffusion Probabilistic Models (video) (slides)Eloy presents

09/17/2021 – Causation and Discovery: Concepts, methods, and applications (video) (slides)David Danks presents
(external speaker)

09/10/2021 – Symbolic Methods using Gradients for Neural Model Explanation (video) (slides)Mahfuz presents

09/03/2021 – Causal Representation Learning (video)Sergey presents

Summer 2021

08/20/2021 – Learning Function Structure in Neuromorphic Networks (video) (slides) – Amrit presents

08/13/2021 – Meshed-Memory Transformer (video) (slides)William presents

08/06/2021 – Generative Vision model for Breaking Captcha (video) (slides)Harsha presents

07/23/2021 – VAEs and Non-Linear ICA (video – part 1) (video – part 2) (slides)Rogers presents

07/16/2021 – Reinforcement Learning (pt 2) (video) (slides)TJ presents

07/09/2021 – Reinforcement Learning (pt 1) (video) (slides)TJ presents

06/25/2021 – PixelCNN (video)Will presents

06/18/2021 – How Neural Networks Extrapolate (video)Kevin presents

06/04/2021 – Normalizing Flows (NICE) (NVP) (MADE) (video) (slides)Eloy presents

05/28/2021 – Directed Functional Connectivity (video) (slides)Thomas presents

05/21/2021 – Neural Turing Machines (video) (slides)Eloy and Will present

05/14/2021 – Mythos of Model InterpretabilitySergey presents

05/07/2021 – Multi-Dimensional LSTMs (video) (slides) Yaorong presents

Spring 2021

04/30/2021 – Energy Based Out of Distribution Detection (video) (slides) – Kevin presents

04/23/2021 – Every Model is a Kernel Machine (video)Sergey presents

04/16/2021 – Neural Relational Inference for Interacting Systems (slides) (video)Usman presents

04/09/2021 – Transformers with Feedback Memory (slides) (video)Alex presents

04/02/2021 – Debugging Tests for Model Explanations (slides) (video) – Mahfuz presents

03/26/2021 – Hopfield Networks ARE all you need (slides) (video)Noah Presents

03/19/2021 – Single-shot Network Pruning (slides) (video)Riyasat and Noah present

03/12/2021 – “Brain, Language & Deep Learning” – Harsh presents

03/05/2021 – GIN-LiNGAM (slides) (video)Sajad presents

2/26/2021 – Geometric Deep Learning (video)Will presents

2/19/2021 – Intro to Causal Discovery (slides) (video)Sergey presents

2/12/2021 – PowerSGD (slides) (video)Brad presents

2/5/2021 – Dall-E (slides) (video) Eloy presents

1/22/2021 – Multiplicative Interactions and Where to Find Them (slides) (video)Alex presents

1/15/2021 – Siamese Networks and Self-Supervised Learning (slides) (video)Eloy and Alex present

Fall 2020

12/11/2020 – Notable Work at NeurIPS 202 (slides) (video)All present

12/04/2020 – Intelligence w/o Representation (slides) (video)Eloy presents

11/20/2020 – Stacked Capsule Autoencoders (slides) (video) Will presents

11/13/2020 – Learning Bifurcations (slides) (video)Jack presents

11/06/2020 – Curriculum by Smoothing (slides) (video)Alex presents

10/09/2020 – Transformers for Image Recognition (slides) (video)
Eloy presents

10/02/2020 – Overfitting in Classification (slides)Thomas presents

09/25/2020 – Neural State MachinesJack presents

09/18/2020 – Hierarchial LSTMs/ Adversarial LSTMsWilliam presents

09/11/2020 – MRI Segmentation (second paper) (slides) Zafar Presents

09/04/2020 – World Models (slides) (video)Eloy presents

8/28/2020 – Deep Learning for Right Reasons (video) (slides)Noah presents

08/21/2020 – Sparsity Inducing Regularization (video)Riyasat presents

Summer 2020

08/14/2020 – Inference of Causal Relations in Dynamical Systems
(Taken Theorem video) Jack presents

08/07/2020 – Analytic Marching (slides) (video)William presents

07/31/2020 – Learning Graph Representations

07/24/2020 – CNNs on Graphs (video) Alex presents

07/10/2020 – Hierarchical LSTMs (video)William presents

06/26/2020 – ANIL (slides) (video)Alex presents

06/19/2020 – “Multitask Learning over graphs” (slides) (video) – Riyasat and Brad Present

06/12/2020 – MAML and iMAMLAlex presents

06/05/2020 – Contrastive Predictive CodingMahfuz presents

Spring 2020

05/29/2020 – Cutting out the Middle-Man:L Training and Evaluating Energy-Based Models without SamplingAlex presents

05/22/2020 – Energy-Based Models VideoJack and Alex present

05/15/2020 – Noise Contrastive EstimationSergey presents

05/08/2020 – “Representation Learning”Alex presents

05/01/2020 – ” Shortcut Learning in Deep Neural Networks”Alex presents

04/24/2020 – Fixed Point Layers (pt 2) – presented by Sergey

04/17/2020 – Fixed Point Layers – presented by Sergey

04/10/2020 – Multitask Learning – presented by Alex

03/13/2020 – A tutorial on Automatic Differentiation – presented by Sergey

03/06/2020 – Sanity Checks for Saliency Maps

02/28/2020 – Complexity control by gradient descent in deep networks

02/21/2020 – A mathematical theory of semantic development in deep neural networks

02/14/2020 – N/A

02/07/2020 – Exact solutions to the nonlinear dynamics of learning in deep linear neural networks

01/31/2020 – Data-driven discovery of coordinates andgoverning equations

01/24/2020 – Neural Networks in System Identification

01/17/2020 – A tutorial on hidden Markov models and selected applications in speech recognition

Fall 2019

12/06/2019 – Meta-learning for neuroimaging

11/22/2019 – Nonlinear Dimensionality Reduction methods and a generalization

11/08/2019 – Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead

11/01/2019 – Synthesizing Programs for Images using Reinforced Adversarial Learning

10/25/2019 – Introduction to Deep Q-Network

10/18/2019 – Hidden stratification

10/11/2019 – Neural Ordinary Differential Equations

10/04/2019 – Model Utility

09/27/2019 – Wasserstein GANs and other easier to train models

09/20/2019 – Generative Adversarial Networks (Intro)

09/13/2019 – Predictive coding theory of the mind: part II

09/06/2019 – Predictive coding theory of the mind: Intro

08/30/2019 – Confidence and accuracy: On Calibration of Modern Neural Networks

08/23/2019 – Deep learning model introspection

Summer 2019

08/16/2019 – Deep learning trends from the deep learning summer school

08/09/2019 – Variational Autoencoders: part II

08/02/2019 – Variational Autoencoders: part I

07/26/2019 – Attention in deep learning models: part II

07/19/2019 – Attention in deep learning models: part I

07/12/2019 – NLP successes of 2018: transfer learning


MLBBQ
maintained by
Brad Baker
organized by
Sergey Plis
Designed & Developed by ThemeXpert