This paper presents a case study of our experience conducting HCI experiments to inform multimedia cue generation. We analyze the interrelated HCI and NLG issues that a complete multimedia cue generator should address, and the limitations of current empirical approaches. We describe the two experiments we performed. Given their limited success, the cost-benefit of adopting this approach remains an open issue