Exploring the limits of transfer learning with a unified text-to-text transformer C Raffel, N Shazeer, A Roberts, K Lee, S Narang, M Matena, Y Zhou, W Li, ... The Journal of Machine Learning Research 21 (1), 5485-5551, 2020 | 6696 | 2020 |
Palm: Scaling language modeling with pathways A Chowdhery, S Narang, J Devlin, M Bosma, G Mishra, A Roberts, ... arXiv preprint arXiv:2204.02311, 2022 | 510 | 2022 |
Extracting Training Data from Large Language Models. N Carlini, F Tramer, E Wallace, M Jagielski, A Herbert-Voss, K Lee, ... USENIX Security Symposium 6, 2021 | 484 | 2021 |
Deduplicating training data makes language models better K Lee, D Ippolito, A Nystrom, C Zhang, D Eck, C Callison-Burch, N Carlini arXiv preprint arXiv:2107.06499, 2021 | 99 | 2021 |
WT5?! Training Text-to-Text Models to Explain their Predictions S Narang, C Raffel, K Lee, A Roberts, N Fiedel, K Malkan arXiv preprint arXiv:2004.14546, 2020 | 83 | 2020 |
Hallucinations in neural machine translation K Lee, O Firat, A Agarwal, C Fannjiang, D Sussillo | 68 | 2018 |
Quantifying Memorization Across Neural Language Models N Carlini, D Ippolito, M Jagielski, K Lee, F Tramer, C Zhang arXiv preprint arXiv:2202.07646, 2022 | 59 | 2022 |
Propagation of information along the cortical hierarchy as a function of attention while reading and listening to stories M Regev, E Simony, K Lee, KM Tan, J Chen, U Hasson Cerebral Cortex 29 (10), 4017-4034, 2019 | 58 | 2019 |
What Does it Mean for a Language Model to Preserve Privacy? H Brown, K Lee, F Mireshghallah, R Shokri, F Tramèr 2022 ACM Conference on Fairness, Accountability, and Transparency, 2280-2292, 2022 | 20 | 2022 |
Counterfactual Memorization in Neural Language Models C Zhang, D Ippolito, K Lee, M Jagielski, F Tramèr, N Carlini arXiv preprint arXiv:2112.12938, 2021 | 18 | 2021 |
Measuring Forgetting of Memorized Training Examples M Jagielski, O Thakkar, F Tramèr, D Ippolito, K Lee, N Carlini, E Wallace, ... arXiv preprint arXiv:2207.00099, 2022 | 9 | 2022 |
Preventing Verbatim Memorization in Language Models Gives a False Sense of Privacy D Ippolito, F Tramèr, M Nasr, C Zhang, M Jagielski, K Lee, ... arXiv preprint arXiv:2210.17546, 2022 | 4 | 2022 |
Memorization in Language Models K Lee mosaic, 2022 | | 2022 |