Raghu Sankaran, CIO, Scholastic Inc., an IBIT partner, is working with DIF to investigate the results produced by generative AI solutions to increase transparency and predictability. The DIF team includes Konstantin Bauman, Assistant Professor of MIS, Yan Wang, Associate Professor of CIS, Manoj Chacko, and Munir Mandviwalla.
Sankaran notes that: “There are so many unknowns and facets around Gen AI that that we need to evaluate, so partnering with Temple was a no brainer to help us make progress on multiple fronts simultaneously.”
The goals include evaluating (a) how generative AI responds to different types of requests (b) evaluate the accuracy and appropriateness of the responses, and (c) estimate the factors that contribute to the responses and how that can be used to improve the tool. The DIF team has configured a virtual lab that includes the major Gen AI platforms and generated preliminary results.
