?url_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&rft.title=Enhancing+Testing+at+Meta+with+Rich-State+Simulated+Populations&rft.creator=Alshahwan%2C+Nadia&rft.creator=Blasi%2C+Arianna&rft.creator=Bojarczuk%2C+Kinga&rft.creator=Ciancone%2C+Andrea&rft.creator=Gucevska%2C+Natalija&rft.creator=Harman%2C+Mark&rft.creator=Krolikowski%2C+Michal&rft.creator=Rojas%2C+Rubmary&rft.creator=Martac%2C+Dragos&rft.creator=Schellaert%2C+Simon&rft.creator=Ustiuzhanina%2C+Kate&rft.creator=Harper%2C+Inna&rft.creator=Jia%2C+Yue&rft.creator=Lewis%2C+Will&rft.description=This+paper+reports+the+results+of+the+deployment+of+Rich-State+Simulated+Populations+at+Meta+for+both+automated+and+manual+testing.+We+use+simulated+users+(aka+test+users)+to+mimic+user+interactions+and+acquire+state+in+much+the+same+way+that+real+user+accounts+acquire+state.+For+automated+testing%2C+we+present+empirical+results+from+deployment+on+the+Facebook%2C+Messenger%2C+and+Instagram+apps+for+iOS+and+Android+Platforms.+These+apps+consist+of+tens+of+millions+of+lines+of+code%2C+communicating+with+hundreds+of+millions+of+lines+of+backend+code%2C+and+are+used+by+over+2+billion+people+every+day.+Our+results+reveal+that+rich+state+increases+average+code+coverage+by+38%25%2C+and+endpoint+coverage+by+61%25.+More+importantly%2C+it+also+yields+an+average+increase+of+115%25+in+the+faults+found+by+automated+testing.+The+rich-state+test+user+populations+are+also+deployed+in+a+(continually+evolving)+Test+Universe%3B+a+web-enabled+simulation+platform+for+privacy-safe+manual+testing%2C+which+has+been+used+by+over+21%2C000+Meta+engineers+since+its+deployment+in+November+2022.&rft.subject=Software+Testing%2C+Cyber+Cyber+Digital+Twins%2C+Simulation-Based%0D%0ATesting%2C+Machine+Learning&rft.publisher=ACM&rft.date=2024-05-31&rft.type=Proceedings+paper&rft.language=eng&rft.source=+++++In%3A++Proceedings+of+the+46th+International+Conference+on+Software+Engineering%3A+Software+Engineering+in+Practice.++(pp.+pp.+1-12).++ACM+(2024)+++++&rft.format=text&rft.identifier=https%3A%2F%2Fdiscovery.ucl.ac.uk%2Fid%2Feprint%2F10199776%2F8%2FHarman_RPS4.pdf&rft.identifier=https%3A%2F%2Fdiscovery.ucl.ac.uk%2Fid%2Feprint%2F10199776%2F&rft.rights=open