?url_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&rft.title=SPARSEFIT%3A+Few-shot+Prompting+with+Sparse+Fine-tuning+for+Jointly+Generating+Predictions+and+Natural+Language+Explanations&rft.creator=Solano%2C+J&rft.creator=Sanni%2C+M&rft.creator=Camburu%2C+OM&rft.creator=Minervini%2C+P&rft.description=Models+that+generate+natural+language+explanations+(NLEs)+for+their+predictions+have+recently+gained+increasing+interest.+However%2C+this+approach+usually+demands+large+datasets+of+human-written+NLEs+for+the+ground-truth+answers+at+training+time%2C+which+can+be+expensive+and+potentially+infeasible+for+some+applications.+When+only+a+few+NLEs+are+available+(a+few-shot+setup)%2C+fine-tuning+pre-trained+language+models+(PLMs)+in+conjunction+with+prompt-based+learning+has+recently+shown+promising+results.+However%2C+PLMs+typically+have+billions+of+parameters%2C+making+full+fine-tuning+expensive.+We+propose+SPARSEFIT%2C+a+sparse+few-shot+fine-tuning+strategy+that+leverages+discrete+prompts+to+jointly+generate+predictions+and+NLEs.+We+experiment+with+SPARSEFIT+on+three+sizes+of+the+T5+language+model+and+four+datasets+and+compare+it+against+existing+state-of-the-art+Parameter-Efficient+Fine-Tuning+(PEFT)+techniques.+We+find+that+fine-tuning+only+6.8%25+of+the+model+parameters+leads+to+competitive+results+for+both+the+task+performance+and+the+quality+of+the+generated+NLEs+compared+to+full+fine-tuning+of+the+model+and+produces+better+results+on+average+than+other+PEFT+methods+in+terms+of+predictive+accuracy+and+NLE+quality.&rft.publisher=Association+for+Computational+Linguistics&rft.date=2024&rft.type=Proceedings+paper&rft.language=eng&rft.source=+++++In%3A++Proceedings+of+the+Annual+Meeting+of+the+Association+for+Computational+Linguistics.++(pp.+pp.+2053-2077).++Association+for+Computational+Linguistics+(2024)+++++&rft.format=text&rft.identifier=https%3A%2F%2Fdiscovery.ucl.ac.uk%2Fid%2Feprint%2F10198210%2F1%2F2024.acl-long.113.pdf&rft.identifier=https%3A%2F%2Fdiscovery.ucl.ac.uk%2Fid%2Feprint%2F10198210%2F&rft.rights=open