In this article, Structural communication grid (SCG), an alternative measurement and evaluation technique, has been firstly summarised and the design, development and implementation of a computer based SCG system have been introduced. The system is then tested on a sample of 154 participants consisting of candidate students, science teachers and faculty staff members. A comparative study between paper-and-pencil and computerized versions of SCG has been conducted. 154 subjects, consisting of candidate students, science teachers and faculty staff members, have participated in this study. Participants' views are probed by using Software Evaluation Questionnaire and Open-Ended Interview Form. Findings of the study show that i) participants find SCG technique easier to use in computer medium, ii) they have positive attitudes towards this computer software, and iii) they prefer computerized version of SCG technique to the paper-based SCG technique. The findings have been discussed in terms of its contribution to computer aided measurement and evaluation methods by taking similar studies in the literature into account.