Learn how to learn and distil during learning - Using meta-learning and second order optimisation to prune the model
Invited Talk, Alan Turing Institute, Hybrid
The LLM era has make the model become extremely large and cumbersome for mobile devices. Hence, pruning such models is demanding. In this talk, I will give a brief introduction about my internship work at MediaTek about model pruning by using second-order optimisation