In the article Scoring Serving and Passing Effectiveness I talk about the common usage of a 0-3 type of scale for rating serve reception. In this post, fellow volleyball blogger Hai-Binh Ly discusses how he progressed defining these ratings. Basically, he’s reached the point of using very defined zones to judging a pass’s rating. These are the zones defined within the commonly used DataVolley statistical program. Ly outlines them in his post.
I have my concerns with rigid definitions. Ly mentions some of them with respect to grey areas, but I would focus more on the fact that they fail to account for setter athleticism. Simply stated, a pass that might only be a 1 for a given setter might be a 2 for a quicker one. It could even be a 3. Think about a tight pass that a short setter cannot handle, but a taller one has no problem with.
The thing we have to keep in mind is the underlying idea behind these pass ratings.
The intention was to speak to the probability of earning the sideout. This is what Dr. Jim Coleman had in mind when he developed the rating system. The premise is that a 3-pass results in a sideout some percentage of the time. A 2-pass, on average, sees a team sideout at some other frequency – most likely lower. And so on down the line. From this perspective, a team’s average pass rating indicates its approximate sideout rate.
If pass ratings are going to approximate sideout success rates, then it makes sense to use a more discretionary rating approach. By that I mean rating passes based on the circumstances of the team in question. In other words, what can your setter do with the ball? Rigid definitions for each pass rating do not make sense in that context.
If, however, we want to compare serve reception across teams, or between players, then a more fixed system is more appropriate. In that case, we need a common system of measurement. That removes setter variability from the equation.
So which is best?
As a coach, it depends on your setters. Are they of similar quality? If so, you can use the more discretionary approach. If they are noticeably different, though, you probably have to go with a more rigid system. This is especially true if your passers do not work with each setter basically the same amount of time. It’s the only fair way to compare them.