This article presents a conceptual framework for evaluating the teaching effectiveness of distance education courses and demonstrates how student evaluations can be analysed by rigorous statistical techniques. The conceptual framework consists of four dimensions which relate to student development, assessment, learning materials, and a face-to-face component. Each dimension subsumes a number of attributes. Justification for inclusion of the dimensions and attributes is presented. Based on the conceptual framework, a student questionnaire was developed. The interrater reliability and construct validity of student evaluations collected by the questionnaire were demonstrated through analysis of variance and hierarchical confirmatory factor analysis, respectively.[Copyright of Distance Education is the property of Routledge. Full article may be available at the publisher's website: http://dx.doi.org/10.1080/0158791980190104]