Multitask Learning in Science
Description
This book offers a comprehensive exploration of multi-task learning (MTL), a pivotal paradigm in modern machine learning that emphasizes learning related tasks together rather than in isolation. By sharing representations and inductive biases, MTL can enhance data efficiency and generalization, yet it also presents challenges such as task interference and scalability. This volume provides a coherent introduction to these issues, presenting diverse perspectives and applications across science and engineering.
Key concepts include shared representations, parameter sharing in neural networks, and task-relatedness measures. The chapters delve into both classical and contemporary MTL ideas, covering topics like regularized formulations, gradient conflicts, and structured data. Readers will encounter discussions on federated systems, healthcare applications, and geoscience, illustrating MTL's versatility and impact.
This book is an essential resource for researchers, practitioners, and students in machine learning and related fields. It serves as both an introduction for newcomers and a reference for those already engaged in MTL research. By highlighting conceptual foundations and practical applications, the book encourages the thoughtful adoption of MTL and inspires further investigation into its potential to transform learning paradigms.
More details
Content
Preface.- Notation.- 1. Multi-Task Deep Learning.- 2. Multi-Task Learning and Multi-Objective Optimization3. Supervised Multi-Task Learning4. Unsupervised Multi-Task Learning5. Semi-supervised Multi-Task Learning6. Reinforcement Learning and Multi-Task Learning7. Meta-Learning 8. Black-Box Meta-Learning 9. Optimization-based Meta-Learning 10. Bayesian Meta-Learning11. Transfer Learning12. Few-Shot Learning13. Online Multi-Task Learning14. Generative Adversarial Networks and Multi-Task Learning15. Lifelong Learning / Continual Learning16. Domain adaptation and Out-of-distribution generalization17. Applications in Science18. Applications in Engineering19. Multi-Task Learning in Large Language Models20. Multi-Task Learning in Multimodal Foundation Models 21. Mathematics for Multi-task Deep Learning 22. Tools for Multi-Task Deep Learning 23. Future Directions Bibliography.- Index.