Skip to content

This is the repository which can be used to reproduce the Multitask or Transfer Learning? paper

Notifications You must be signed in to change notification settings

steveowk/MTL-TL

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Summary of MTL-TL Paper

Abstract

Multitask Learning (MTL) and Transfer Learning (TL) are two key Machine Learning (ML) approaches which have been widely adopted to improve model’s performance. In Deep Learning (DL) context, these two learning methods have contributed to competitive results in various areas of application even if the size of dataset is relatively small. While MTL involves learning from a key task and other auxiliary tasks simultaneously and sharing signals among them, TL focuses on the transfer of knowledge from already existing solution within the same domain. In this paper, we present MTL and TL based models and their application to Invasive Ductal Carcinoma (IDC) detection. During training, the key learning task in MTL was detection of IDC whereas skin and brain tumor were auxiliary tasks. On the other hand, the TL-based model was trained on skin cancer dataset and the learned representations transferred in order to detect IDC. The accuracy difference between MTL-based model and TL-based model on I DC detection was 8.6% on validation set and 9.37% on training set. On comparing the loss metric of the same models, a cross entropy of 0.18 and 0.08 was recorded on validation set and training set respectively.

Paper:

Obonyo, S. and Ruiru, D. (2019). Multitask Learning or Transfer Learning? Application to Cancer Detection.In Proceedings of the 11th International Joint Conference on Computational Intelligence - Volume 1: NCTA, (IJCCI 2019) ISBN 978-989-758-384-1, ISSN 2184-2825, pages 548-555. DOI: 10.5220/0008495805480555

About

This is the repository which can be used to reproduce the Multitask or Transfer Learning? paper

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published