Teaching Research Method Using a
|
Subject Topic |
2003 Class Design |
2004 Class Design |
---|---|---|
Introduction |
Ice-breaker, subject overview and preliminary presentation |
Ice-breaker, subject overview and preliminary class discussion |
Philosophy of Social Research |
Lecturer presentation followed by scenario exercises |
Scenario exercises followed by lecturer presentation |
Ethics |
General discussion and lecturer presentation |
4 way case study followed by lecturer presentation |
Principles of Effective Research Design |
Lecturer presentation and small group discussion |
Individual exercise, large group discussion, small group exercise, and lecturer presentation |
Sampling methods |
Lecturer presentation and general discussion |
Small group scenario exercise, large group discussion, lecturer presentation |
Designing Research Instruments |
Group analysis of existing instruments (examples of good practice and bad practice), lecturer presentation |
Group participation in formative evaluation of the subject, group reflection on the survey instrument, lecturer presentation |
Data Analysis |
Computer workshop and lecturer presentation |
Guest lecturer, small group scenario exercise, small group critical reading exercise and class discussion |
Evaluation |
Lecturer presentation and general discussion |
Small group scenario exercise and lecturer presentation |
Politics in Research |
Not covered |
Role plays drawing on two scenarios drawn from current public affairs |
Table 1: Changes in Class Design, 2003-2004
The specific objectives of this topic were to ensure students' understanding of the range of legal, moral, and practical issues that inform the conduct of effective social research in a public policy context, and the complex of needs of different policy actors in relation to research ethics. Further, the learning objective was to encourage students to move beyond viewing ethics as simple a matter of compliance, towards a critical understanding that ethical practice is also constitutive of effective practice in policy research.
In 2003, this class was based on a general class discussion about research ethics in context, followed by formal lecture presentation. In 2004, however, a four-way case study method was utilised. The case-study scenario was based on an actual research project being commissioned by the state Government at the time, and four different 'stakeholder positions' (ie the government, the subjects of the research, the commercial team contracted to do the work, and the workers whose work might be affected by the findings) were allocated to the students, who were divided into four small groups.
This was followed by a class discussion, focusing on the different needs and expectations of stakeholder groups regarding ethical considerations in the research. The session was concluded with a formal presentation to augment students' understanding of epistemological approaches to research ethics, and the practical considerations involved.
Reflections: While the format employed in 2003 did not appear to have adverse affects on student understandings of research ethics, the extent to which the 2004 format enhanced student learning and subsequent knowledge was notable in the more advanced level of large class discussion that occurred immediately following the case study activity. Students in the 2004 class demonstrated an understanding and engagement with the diversity of perspectives that inform ethical choices in research, and moved significantly beyond a discussion of compliance into a broader critical engagement with the philosophical frameworks that underpin research ethics. Just as importantly, the case study provided students with a common 'experience' which proved valuable when they were introduced to the more formal aspect of the class, as we could draw on this commonality to provide examples to support some of the broader conceptual issues being discussed. In this sense, the interactive small group activity became an important 'technology' (see Cooper, 1979) in the educational design for this topic. In terms of enhancing the social context of learning (see Bruffee, 1993; Jarvis), 1995, the exercise also provided students with opportunities to further get to know each other, and the small group and class discussions were characterised by broad participation, a higher level of peer to peer engagement than in previous classes, and much laughter and hilarity!
The objectives for this topic were to get students thinking about the principles of designing effective instruments, such as surveys, interview schedules and focus group questions. This included thinking about the micro-features of the instruments themselves, the quality of overall design, and the potential impacts of the external environment on that design.
In 2003, this topic was based on students critically analysing existing research instruments that had been brought to class as practical examples. In 2004, however, this exercise was extended through a process of modeling practice.
That is, the session was based on an anonymous formative evaluation questionnaire of the subject, which was administered at the beginning of class. Following students' completion of the questionnaire (and after these had been collected and put away), class discussion about the design and administration of the questionnaire was facilitated.
Students were encouraged to reflect on their own experience of completing the questionnaire and any problems of interpretation they experienced, while I reflected on the ethical and practical challenges of designing the questionnaire. This interaction continued through the more formal presentation phase of the class, which aimed to draw in information about a broader range of research instruments drawing on set readings on the topic.
Reflections: The class exercise used in 2003 was effective in encouraging students' critical analysis of existing research instruments from an external perspective. The exercise used in 2004 also encouraged critical analysis, but this time students related to the activity as actual participants in the research itself, which appeared to enhance their experiential understanding of the power of good (and not so good) research design. In addition, the process of administering the questionnaire gave me the opportunity to reinforce points from this and earlier classes by modeling how to administer a questionnaire appropriately. Finally, the results from the formative evaluation provided an opportunity to assess students' experience of the subject, and to adapt subsequent classes to meet stated needs.
Impacts of the Approach on Students' Learning Experiences
The outcomes of taking a more student-centred approach within the context of teaching PRM appear to have been consistently positive. With regard to student performance in assessment as a measure of learning outcomes, the mean result for 2004 was somewhat higher than it was in 2003. This information needs to be interpreted very cautiously, however, as the two classes are not directly comparable in terms of size or cohort.
Perhaps more convincingly is the quantitative and qualitative evidence derived from student evaluations. In 2003, students rated the quality of teaching in the subject as 4.2 on a five point scale (N = 9), while in 2004, the mean quality of teaching score was 4.8 (N = 18). Mean satisfaction with the overall quality of learning increased considerably, from 3.1 in 2003 to 4.6 in 2004. Further, in response to the statement "This subject was intellectually stimulating", the mean response in 2004 was 4.4, compared with 3.7 in 2003. Interestingly, despite the significantly increased levels of group-based activity in 2004, there were no notable differences in student responses to the statement "I felt part of the group", with each cohort responding favourably to this questionnaire item. This may in part be an effect of the fact that the class size was considerably smaller (N=10) in the earlier year.
Given the limitations of comparatively analysing statistical responses where class sizes are different and extraneous factors have not been controlled for, the qualitative evidence is of particular significance. There was considerably stronger qualitative feedback from students in 2004, with comments such as:
Practical elements were very good and helped everything sink in and use our skills
Group work helped me understand other people's perspectives and approaches
Lecture arrangements such as group work were great...considering I had no idea of policy research to begin with, I've learnt quite a fair bit
Five stars to case studies and class exercises! They're really enabling me to relate class content and readings in public policy (which is exactly the point, yey!)
With regard to the teaching methods used, the themes that emerged strongly from qualitative feedback in 2004 included:
Anecdotally, several students also indicated during the course of the subject that they had found that the group work processes developed had directly assisted them in the workplace and/or in their study techniques in other subjects. Two of the international students involved in the subject also indicated that they particularly valued the high level of social interaction in the subject, as it had helped them to make friends with domestic students, which they had found difficult in other classes. This illuminates the conclusions of broader studies (see, for example McInnis & James, 1995; Pascarella & Terenzini, 1998) that student learning outcomes and broader social engagement with University life are interdependent features in positive higher education experiences.
Overall, increasing the frequency, type and order of student-centred learning methods in the classroom appeared to have a positive effect on student performance, satisfaction and learning experience in this case. This supports Benson and Blackman's (2003) observations that activity-based approaches to teaching research methods better facilitate student learning than the more didactic model that is traditionally applied to this subject matter.
As suggested by the teaching and learning experience discussed above, utilising teaching approaches that encourage students' active and experiential engagement with the subject matter (and with each other) has the potential to be extremely effective, in terms of student satisfaction and class performance. This is particularly notable in the context of a research methods subject, given that research methods is traditionally considered to lend itself to more didactic approaches where vast amounts of technical information are transmitted from teacher to student.
From the teaching perspective, the reorientation of teaching methods toward a student-centred approach proved particularly rewarding in this case. Nevertheless, there are some conceptual issues associated with this approach that require further critical reflection.
The student-centred teaching model interpolates students as active learners without really unpacking what constitutes an active learner. In my experience, students participate in their own learning in a diversity of ways, and these are not always clearly observable as 'active' learning in the classroom. With regard to the PRM experience in 2004, the potential problems of defining active learning as a set of specific behaviours and activities was reinforced by one student's formative evaluation comment on in-class exercises that:
I am really enjoying this subject and am learning a lot...[however] I got extremely stressed when required to verbally present our [small group] findings. This anxiety became such a problem I often considered missing class to avoid the situation.
As Brookfield (1990) has pointed out, the nature of participation in education is culturally contingent, and leads us to measure participation via the presence and frequency of particular student behaviours. While the notion of the active learner is a valuable one, then, it is important that as educators, we are reflective about our own personal, experiential and cultural preconceptions of 'activeness' when designing and facilitating learning.
A related limitation of the student-centred model illuminated in this case study is the subjugation of expert (educator) knowledge in favour of student engagement through problem-based learning. Weimer (2002) discusses this in terms of shifting classroom power from teacher to students. However, I would argue that this notion is based on very fixed, and limited, understandings of the nature of power and who holds it in any given context. The case study experience discussed here suggests that, while there is much to be said for facilitating students' active learning, sometimes one of the most empowering ways to do that is to share some learning of one's own. Geelan (1996) talks about this when reflecting on his own attempts at student-centred teaching as an issue of recognising that there is a difference between constructing a new set of expectations and responsibilities for ourselves as educators, and simply transferring teaching responsibilities onto the class. Student feedback on both the formative and summative evaluations of the subject discussed here consistently indicated that formal presentation of technical material and disciplinary insights by the lecturer was a very important part of their comprehension and learning in this subject. What appeared to make the transmission of this information more effective, however, was the use of group exercises and primary source material that allowed students to build a common experience from which to draw concrete examples and to which they could relate specific dilemmas. This common experiential ground was generally created through small group activities prior to the more formal presentation. Consequently, the formal presentation sessions were, themselves, much more interactive, with students drawing on the small group activities and discussions to ask questions and make observations throughout the formal part of each topic. While an emphasis on student-centredness provided the orienting focus for the subject, some of its greatest learning value appeared to lie in the way in which that was effectively integrated with more didactic teaching practice. In this sense, class content was both a knowledge resource and a mechanism by which students developed their own knowledge further.
The shift toward student-centredness through the use of interactive small group activities based on primary resources appears to have significantly enhanced students' learning in this case. The classroom experience was characterised by a high level of dialogue and interaction, the assessment results suggest overall strong engagement with the subject matter, and student feedback was very positive. One of the key strengths of this approach was that it allowed students to build common experiential ground, which provided a shared base for engaging with more technical aspects of the subject matter. This is increasingly important in higher education contexts where flexible learning pathways are producing diverse student cohorts with no, or highly limited, common learning experiences.
At the same time, student feedback on the more didactic features of the curriculum was equally positive. What was important, it seemed, was that the common experiential ground and supportive social context was developed first, in order to support students' access to, and engagement with, this more didactically delivered material. This suggests that a holistic teaching approach at the individual subject level is as important as particular teaching techniques that emphasise student-centredness.
The use of a more student-centred approach using small group activities has improved my response to the practical and pedagogical challenges of teaching social research methods at the postgraduate coursework level. My own conclusions are that, in the context of teaching research methods to diverse cohorts of students, integration between student-centred and more traditional approaches to teaching are a recipe for success. In the spirit of student-centredness, however, it is more appropriate to conclude with a student's observation:
"Research Methods interesting? Who would have thought!!!!!!"
Benson, A. & Blackman, D. (2003) 'Can research methods ever be interesting?', Active Learning in Higher Education 4 (1): 39-55.
Brookfield, S.D. (1990) The Skillful Teacher: On Technique, Trust and Responsiveness in the Classroom, San Francisco: Jossey-Bass Publishers.
Bruffee, K. (1993) Collaborative Learning: Higher Education, Interdependence, and the Authority of Knowledge. Baltimore: The Johns Hopkins University Press.
Cooper, C. L. (1979) Learning from others in groups: experiential learning approaches, Westport: Greenwood Press.
Geelan, D. R. (1996) "The Empty center: Does student-centred learning imply abdication or role redefinition for educators?" in
Different Approaches: Theory and Practice in Higher Education. Proceedings HERDSA Conference 1996. Perth, Western Australia, 8-12 July.
Gibbs (1992) Assessing More Students, Oxford: Oxford Brookes University.
Glanz, J. (1998) Action research: an educational leader's guide to school improvement, Norwood, Mass: Christopher-Gordon Publishers.
Hativa, N. (2000) Teaching for Effective Learning in Higher Education, Dordrecht: Kluwer Academic Publishers.
Hein, G. E. (1991) 'Constructivist Learning Theory' paper presented at CECA (International Committee of Museum Educators) Conference, Jerusalem Israel, 15-22 October 1991.
Jadallah, E. (2000) 'Constructivist Learning Experiences for Social Studies Education', The Social Studies 91 (5): 221 - 225.
Jarvis, P. (1995) Adult and Continuing Education. Theory and practice 2e, London: Routledge.
Krause, K., Bochner, S. & Duchesne, S. (2003) Educational Psychology for Learning and Teaching, South Melbourne: Thomson.
Maypole, J. & Davies, T. G. (2001) 'Students' Perceptions of Constructivist Learning in a Community College American History II Survey Course', Community College Review 29 (2): 54 - 79.
McInnis, C. & Jame, R. (1995) First year on campus; Diversity in the initial experiences of Australian undergraduates, Canberra: Australian Government Publishing Service.
Nanney, B. (no date) 'Student-Centred Learning'
www.gsu.edu/~mstswh/courses/it7000/papers/student-.htm
[accessed 25 May 2004]
Pascarella, E. & Terenzini, P. (1998) How college affects students: Findings and insights from twenty years of research, San Francisco: Jossey-Bass.
Sparrow, L., Sparrow, H., & Swan, P. (2000) 'Student-centred learning: Is it possible?' in A. Hermann and M. M. Kulski (Eds),
Flexible Futures in Tertiary Teaching Proceedings of the 9th Annual Teaching Learning Forum, 2-4 February 2000. Perth: Curtin University of Technology.
Weimer, M. (2002) Learner-Centred Teaching: Five Key Changes to Practice, San Francisco: Jossey-Bass.
West, R. (1998) Learning for Life: Review of Higher Education Financing and Policy, Canberra: Australian Government Publishing Service.