Knowledge Distillation vs. Pretraining from Scratch under a Fixed (Computation) Budget Conference Proceeding

Overview

CU Boulder Authors

von der Wense, Katharina Lisa Maria

publication date

June 1, 2024

Date in CU Experts

February 11, 2025 12:34 PM

Full Author List

Bui MD; Schmidt F; Glavaš G; Von Der Wense K

author count

4

presented at event

Proceedings of the Fifth Workshop on Insights from Negative Results in NLP Conference

Other Profiles

Digital Object Identifier (DOI)

https://doi.org/10.18653/v1/2024.insights-1.6

Additional Document Info

start page

41

end page

47