...a while back, we came to some difficult realizations about the validity of our methods for testing PC gaming performance. In my article "Inside The Second: A New Look At Game Benchmarking", we explained why the widely used frames-per-second averages tend to obscure some of the most important information about how smoothly a game plays on a given system. In a nutshell, the problem is that FPS averages summarize performance over a relatively long span of time. It's quite possible to have lots of slowdowns and performance hiccups during the period in question and still end up with an average frame rate that seems quite good. In other words, the FPS averages we (and everyone else) had been dishing out to readers for years weren't very helpful—and were potentially misleading.
Forgot the link.
Last edited by GONNAFISTYA on Sat Aug 25, 2012 8:27 pm, edited 1 time in total.
Tech Report has been using some interesting measurements in their GPU reviews for awhile. The "time spent beyond 50ms" charts I think are really an improvement over the usual average/max framerate measurements. It's been my favorite hardware review site for a long time.
HardOCP has been posting FPS charts for a long time now, this is their main benchmarking philosophy. They also subjectively describe how smooth the gaming experience is.
