Sunday, October 28, 2012

Delphi versus NGT

Compare and Contrast of Delphi and the Nominal Group Technique (NGT):

Both methods offer an evaluation methodology that differs in the fact that the Delphi method relies on expert assessment while NGT uses the learner's evaluation perspective. Within the NGT approach, all participants have an equal say in creating both the rank and ordering evaluation items. This allows the NGT course evaluations to identify both the positive and negative factors as identified by learners as well as the entire group’s rank-ordered assessments of the course's good and bad aspects. The NGT approach is more socialistic in nature by combining administration of an assessment tool (questionnaire) with an open discussion forum among the learners to assess and rank the results of the assessment findings. A benefit to this approach is that it permits the possibility of equal involvement by all group members minimizing the potential of disproportionate influence by overt or passionate individuals. However in open forums, it tends to be easier to provide positive feedback then negative feedback. This is especially true when disconcerted opinions are offered against the what may appear to be the general consensus of the group. Additionally, learners tend to be less critical and more positive when it comes to offering overall opinions. Moreover, when learners are critical, they may fail to account for cost or logistical issues that may be significant constraints. The Delphi research technique provides addresses areas where there are holes or section of incomplete knowledge about a phenomena. Delphi also implements a quantitative methodology. While Delphi it implements a quantitative method like NGT, it refines the questionnaires implementing several iterations to target specifics of the area of research.  
The two forces that would influence that use of one technique over the other is the knowledge level of the research area prior to investigation and the expertise of the evaluation target audience for sampling purposes.
If I were looking to explore a new innovation or idea I would tend to gravitate toward Delphi because of the numerous unknowns that typically accompany new innovations. I might explore a modified Delphi with more open collaboration I were looking for both market level insight as well as technical subject matter expertise.
References
Skulmoski G, Hartman F, Krahn J (2007). The Delphi method for graduate research. Journal of Information Technology Education; 6: 1– 21.

Dobbie A, Rhodes M, Tysinger J, Freeman J (2004). Using a modified nominal group technique as a curriculum evaluation tool. Family Medicine 36: 402–406

No comments:

Post a Comment