In 2003, we presented an architecture for a streaming video quality assessment system [1]. Six years later, many of the challenges outlined in that paper remain. This paper revisits the 2003 architecture, updates it given what we have learned in our experience thus far with developing the architecture, and discusses in detail the remaining challenges to the realization of this architecture. We conclude with suggestions for moving beyond the biggest challenges, namely cooperation among the interested parties and system scale. Key words: Quality of Experience (QoE), Quality of Service (QoS), Streaming Media, Measurement, Performance, Reliability