Enhancing Fine-Tuning in Low Data Regime by Increasing Representation Entropy During Pre-Training Phase

Jaeill Kim, Jungwook Shin, Wonjong Rhee. Enhancing Fine-Tuning in Low Data Regime by Increasing Representation Entropy During Pre-Training Phase. In 14th International Conference on Information and Communication Technology Convergence, ICTC 2023, Jeju Island, Korea, Republic of, October 11-13, 2023. pages 1319-1321, IEEE, 2023. [doi]

@inproceedings{KimSR23,
  title = {Enhancing Fine-Tuning in Low Data Regime by Increasing Representation Entropy During Pre-Training Phase},
  author = {Jaeill Kim and Jungwook Shin and Wonjong Rhee},
  year = {2023},
  doi = {10.1109/ICTC58733.2023.10391861},
  url = {https://doi.org/10.1109/ICTC58733.2023.10391861},
  researchr = {https://researchr.org/publication/KimSR23},
  cites = {0},
  citedby = {0},
  pages = {1319-1321},
  booktitle = {14th International Conference on Information and Communication Technology Convergence, ICTC 2023, Jeju Island, Korea, Republic of, October 11-13, 2023},
  publisher = {IEEE},
  isbn = {979-8-3503-1327-7},
}