7MetaDomain


Recent Readings for Meta, Multitask, Transfer topics in Deep Neural Networks (since 2017) (Index of Posts):

No. Read Date Title and Information We Read @
1 2020, Apr, 5 Meta Deep Learning 2020-W4
2 2019, Dec, 7 deep2reproduce 2019 Fall - 7MetaDomain papers 2019-fall Students deep2reproduce
3 2018, Oct, 25 Structure18- DNNs Varying Structures 2018-team
4 2017, Jan, 18 Basic16- Basic Deep NN with Memory 2017-team


Here is a detailed list of posts!



[1]: Meta Deep Learning


Multi-Task transfer-learning Generalization
Index Papers Our Slides
1 Invariant Risk Minimization Zhe Survey
2 Causal Machine Learning Zhe Survey
3 A Meta-Transfer Objective for Learning to Disentangle Causal Mechanisms Zhe Survey
3 Review on Optimization-Based Meta Learning Zhe Survey
4 Domain adaptation and counterfactual prediction Zhe Survey
5 Gaussian Processes Zhe Survey
6 A Framework for Learning Predictive Structures from Multiple Tasks and Unlabeled Data Zhe Survey
7 Few-shot domain adaptation by causal mechanism transfer Zhe Survey

[2]: deep2reproduce 2019 Fall - 7MetaDomain papers


BERT Transfer Multi-task regularization
Team INDEX Title & Link Tags Our Slide
T11 Parameter-Efficient Transfer Learning for NLP meta, BERT, text, Transfer OurSlide
T22 Deep Asymmetric Multi-task Feature Learning meta, regularization, Multi-task OurSlide

[3]: Structure18- DNNs Varying Structures


Architecture-Search Hyperparameter dynamic
Presenter Papers Paper URL Our Slides
Arshdeep Learning Transferable Architectures for Scalable Image Recognition PDF PDF
Arshdeep FractalNet: Ultra-Deep Neural Networks without Residuals PDF PDF

[4]: Basic16- Basic Deep NN with Memory


memory NTM seq2seq pointer set attention meta-learning Few-Shot matching net metric-learning
Presenter Papers Paper URL Our Slides
seq2seq Sequence to Sequence Learning with Neural Networks PDF  
Set Pointer Networks PDF  
Set Order Matters: Sequence to Sequence for Sets PDF  
Point Attention Multiple Object Recognition with Visual Attention PDF  
Memory End-To-End Memory Networks PDF Jack Survey
Memory Neural Turing Machines PDF  
Memory Hybrid computing using a neural network with dynamic external memory PDF  
Muthu Matching Networks for One Shot Learning (NIPS16) 1 PDF PDF
Jack Meta-Learning with Memory-Augmented Neural Networks (ICML16) 2 PDF PDF
Metric ICML07 Best Paper - Information-Theoretic Metric Learning PDF  



Here is a name list of posts!


Meta Deep Learning

less than 1 minute read

Index Papers Our Slides 1 Invariant Risk Minimization Zhe Survey 2 Causal ...