technology tip of the month Pointer and Clicker Article

individual image

January/February 2004 - Discussion Board-Based Group Work in a Large Enrollment First Semester Organic Chemistry Lecture Course
By: Tyson A. Miller, Visiting Teaching Associate, Department of Chemistry, University of Illinois at Urbana-Champaign, tmiller2@uiuc.edu
Keywords: chemistry; large enrollment; online course; online education; discussion board; group work; organic chemistry

Note: This version contains a synopsis of the work discussed. There is a detailed version for those who would like a review of the details and the data from the work.

Abstract:

This work examines the practicality of a single facilitator implementing online discussion board-based group work in classes with large enrollments (> 200 students). Simultaneously, student perception of online group work value and utility via this methodology was also measured and provided insight on the benefits and costs with implementing discussion board training on this scale. Comparisons between opinions from students in face-to-face and distance education students are also made. Students were surveyed before and after the exercise about computer background, experience with online tools and courses, perceptions about group work, and value of the assignment. A stark increase in student confidence using discussion boards was reported. A higher percentage of distance education students (vide infra) benefited from the assignment as compared to the rest of the class. Facilitator effort in design, construction, and execution, and grading of the assignment was rather intensive. The results predictably reflect the need for the integration of online work in a sustained manner within the design of the course to be practical for the facilitator and popular with the students.


Background:

Students who enroll in the first semester non-majors organic chemistry course at the University of Illinois Urbana-Champaign are generally science or pre-professional majors who need the course to fulfill requirements. Enrollment size is typically 600-800 students in the fall semester and 300-400 students in the spring semester. Fall Semester 2003 was the first time the chemistry department at UIUC had offered a course via closed-circuit projection. It was discovered early that many students in the video section had little to no experience with this type of educational setting, and so students were treated in this study as distance education students. Predicting that some students who were forced to register for the video Section B1 might be prime candidates for dropping the course in frustration, the need existed to redesign the course in two principal ways: 1) the distance students should have functional connections with the students from face-to-face sections to avoid feelings of isolation; 2) the distance students needed a medium by which they could have an elevated amount of access to the instructor and to other students. Discussion boards offered a technological solution for offering help to students in a controlled and universally accessible fashion.

Objectives of the Work:

The proposed solution to both of these issues was to incorporate online group work into the course that a) permitted students across the three sections to interact with others, b) gave them hands on training in the use of technology, and c) increase their proficiency and confidence in using that technology. If students could gain confidence in using online discussion boards, then increased distance student access to the instructor via discussion boards might be a viable response to educational environment equality concerns. In addition, discussion board-based group work may increase student efforts to continue building online study groups with one another after the conclusion of the assignment.

Therefore, the “WebCT Assignment” (name given for this project) was designed to answer the following questions: 1) Can large classes be trained to use WebCT in online discussion board work efficiently and successfully? 2) Can student confidence in discussion board use increase as a function of online group work? 3) Can a single primary instructor effectively facilitate online discussion board group work for a large class? 4) Will distance education students believe they have benefited from online group work experience as much or more than their face-to-face student peers? 5) What will be the overall level of student satisfaction with the exercise? 6) Is discussion board-based facilitated small group work practical for instructors of courses with large enrollments?

The WebCT Assignment:

Students were given two weeks to introduce themselves and work together with 4-5 other students from other lecture sections to solve one potential test question via online discussion board. Students were also required to fill out online surveys before and after the assignment to provide insight on the following issues: student experience with classroom technology, student confidence using classroom technology, student attitudes regarding group work, and student perceptions about the assignment and its benefits. The assignment itself was worth 1% of the overall course grade.

Experimental Design:

Figure 1 shows the organization of the subgroups and the assignment. 669 students were organized into 112 subgroups that were easily combined into 8 groups of 14 subgroups. The students communicated with their own subgroup team to solve the potential exam question and would have a different exam question from each of the other subgroups in that group. However, with a group-level forum, they could begin to communicate on a social or professional level with other students in the class. This design limits their maximum student contact to others in their group and subgroup only (84 maximum) for the duration of the assignment and keeps the discussion boards from cluttering into a disarray of postings from the onset.

Results – Statistics, Scores, Participation, and Discussion Postings:

An immense amount of data was collected throughout the course of the assignment, as well as from the surveys. The conclusions will be highlighted without discussion in this version.

1) Student participation in various surveys ranged from representative of class size to very high.

2) Student participation in the assignment was very high overall. Counting all students who started the assignment, the average was 8.5/10 points possible. When considering only those students who completed the assignment and participated (discounting drops and those who didn’t help their respective subgroups at all), the average jumps to 9.3/10. The WebCT Assignment score had absolutely no correlation with dropping the course at a later date. At the onset, 109 subgroups had 6 members while 3 subgroups started with 5 members. Overall, 72 subgroups (64.3%) operated with full participation of all its original members. This is significant as it shows that a minority of subgroups will likely lose members from a large class design and that only a handful of subgroups are likely to lose significant numbers of members to the point of requiring special attention from the facilitator. 5672 posts total were made as part of the assignment. As a comparison, in the 13 weeks that followed, only 1937 posts were generated on post-WebCT Assignment Instructor’s Office and Expresso Bar forums during the remainder of the semester. As expected, the Subgroup forums, where the subgroups posted their discussions with one another, are where the bulk of discussion board activity lied in the assignment with 55.1% of all posts generated toward the effort of advancing subgroup answers over the course of 2 weeks. Despite the large and diverse population of students in this course possessing a variable range of computer skills and group work experience, perhaps the lack of any serious (or even minor) subgroup conflicts was one of the most pleasant outcomes from this project.

3) Can large classes be trained to use WebCT in online discussion board work efficiently and successfully? Can student confidence in discussion board use increase as a function of online group work? The answer to the first question is an unequivocal yes. The evidence shows that the overall student participation rate in the assignment was very high (88.9% of all students), despite the fact that the assignment was worth only 1% of the overall course grade. Survey results also showed that student confidence in discussion board use did increase. Finally, the WebCT Assignment didn’t appear to change students’ feelings about group work overall.

4) Can a single primary instructor effectively facilitate online discussion board group work for a large class? The total number of hours of instructor labor associated with this one assignment (just the hours mentioned in this article) is 214 hours for 669 students, not counting the time taken to accumulate and analyze score and survey data. This same course offered in the alternate semester usually has enrollments in the 300-350 range. The overall scores and percent completion rates at the individual and subgroup level are promising indicators of facilitator influence. When this project is repeated in a semester with a lesser enrollment, more can be said about the student/time ratio and whether this type of work on this scale is practical.

5) Will distance education students believe they have benefited from online group work experience as much or more than their face-to-face student peers? The surveys indicate that a higher percentage of distance students may have benefited from the assignment as compared to the class overall. The activity was not found to be any more beneficial to the video section students than to the class overall. The results show a significantly higher percentage of distance students reported benefit in three major categories by at least 8% or more over the class or the face-to-face sections: learning to use discussion boards, using a feature of WebCT, and opportunity to experience online group work. Student support for the assignment would wane over time. The numbers show that far fewer students with significant discussion board experience were in the distance section and needed the experience gained from the assignment. It is possible that the distance students may have had a perceived need to gain more out of the assignment (given that the assignment was designed to benefit the distance students the most) and therefore reflected this sentiment in the surveys. Actual benefit was not measured in other ways (more detailed pre-assignment surveys about the above topics might gain more insight on the matter).

6) What will be the overall level of student satisfaction with the exercise? Data clearly shows a sharp decline in perceived value of the assignment over time. Both sections of students that did not have the WebCT Assignment facilitator as their face-to-face classroom instructor gave a higher percentage of high-ratings for the assignment than those students who had the facilitator as their primary lecture instructor. The numbers may reflect that students who have an instructor different from the person running the online assignment gain at least an equivalent perception of assignment usefulness as distance education students. Furthermore, the numbers may reflect that students who have increased face-to-face contact with the person running an online group assignment tend to perceive discussion board-based interactions as less necessary to classroom success. As is, it was shown that discussion board training for the purposes of increased instructor access for distance students in large classes alone was not sufficient to maintain student support for the assignment.

7) Conclusion: Is discussion board-based facilitated small group work practical for instructors of courses with large enrollments?
Unfortunately, the answer to the underlined question above can’t yet be given, simply because there is but one data point: 214 facilitator hours yields one 2-week discussion board assignment for 669 students (not counting midterm and end of semester survey data workup). A facilitator time/student enrollment ratio can then be established that would give significant insight as to how practical single facilitator small group discussion board-based work is in large enrollment classes. That ratio would give course designers an idea of what it would take to implement, sustain, and support this type of student work throughout a course curriculum for classes of all sizes.

Improvements to the current design can be made in the following ways: 1) ask more precise survey questions detailing individual elements of the assignment, 2) further sensitivity to timing of deadlines, 3) increase the undergraduate teaching assistant support overall, 4) increased integration of discussion board-based group work over the course of the semester, 5) allowing students to utilize graphics or attachments as part of their answers.

Finally, when one begins with the fact that only 45.1% of the entering class had any discussion board experience at all and ends with 81.8% of the students having at least some confidence in using discussion boards, one underlying fact remains: if a student doesn’t leave an organic chemistry course with any confidence in organic chemistry, at least he or she can obtain some confidence in learning and using a technological and educational tool that will likely be a vital part of his/her future. Student learning of that kind is always worth the effort and time.

Acknowledgements:

The author would like to give thanks to Professor Stanley Smith for his mentorship and advice. Sincere thanks to Professor Jeff Moore for his efforts and collaboration in teaching the course. Grateful thanks to Dr. Patricia Phillips-Batoma for her expertise and help in the use of WebCT and in the maintenance of the course website as a whole. Also, thanks to Dr. Iris Stovall and the Illinois Online Network for the opportunity to share this research with the online educational world.

References:

1. a) Schamber, L. Delivery Systems for Distance Education. ERIC Digests http://www.ericfacility.net/databases/ERIC_Digests/ed304111.html; b) Oblinger, D.G. The Nature and Purpose of Distance Education. Available: http://ts.mivu.org/default.asp?show=article&id=647

2. Wang, A.Y.; Newlin, M.H. Predictors of Performance in the Virtual Classroom. T.H.E. Journal, Available: http://www.thejournal.com/magazine/vault/A4023.cfm

3. Renzi, S.; Klobas, J. (2000) Steps Toward Computer-Supported Collaborative Learning for Large Classes. Educational Technology & Society 3 (3). Available: http://ifets.ieee.org/periodical/vol_3_2000/d07.html

4. a) Funaro, G.M.; Montrell, F. (1999) Pedagogical Roles and Implementation Guidelines for Online Communication Tools. ALN Magazine, 3 (2). Available: http://www.aln.org/publications/magazine/v3n2/funaro.asp; b) Edelstein, S.; Edwards, J (2002) If You Build It, They Will Come: Building Learning Communities Through Threaded Discussions. Online Journal of Distance Learning Administration, 5 (1). Available: http://www.westga.edu/~distance/ojdla/spring51/edelstein51.html; c) Berge, Z.L. (2001) The Role of the Online Instructor/Facilitator. eModerators. Available: http://www.emoderators.com/moderators/teach_online.html; d) Palloff, R.M.; Pratt, K. Effective Strategies for the Online Classroom. Available: http://itlearningspace-scot.ac.uk/courses/keynotes/module1/main.cfm

5. Britt, K. Tool Talk. Available: http://webct.com/service/viewcontentframe?contentID=2515824

6. Bonk, C.J.; et al. Advances in Pedagogy: Finding the Instructor in Post-Secondary Online Learning. AERA 2000 http://www.indiana.edu/~bobweb/temp/online_ped.pdf

7. West, M.L.; Luetkehans, L. Ten Great Tips for Facilitating Virtual Learning Teams. PSD Corps. Available:http://www.psdcorp.com/dislearn.htm

8. a) Available: http://www.nwlink.com/~donclark/leader/leadtem2.html; b) Available: http://www-honors.ucdavis.edu/vohs/sec04.html; c) Available: http://www-honors.ucdavis.edu/vohs/sec04-1.html

9. a) Teaching Through Technology Guide: Getting Started with Learning Technology. Teaching Support Services. Available: http://www.tss.uoguelph.ca/TGuides/ltintrotips.html; b) Smith, B.D.; Jacobs, D.C. (2003) TextRev: A Window into How General and Organic Chemistry Students Use Textbook Resources. J. Chem. Ed. 80 (1), 99-102.

Back to Top


ION Home | Pointers and Clickers
University of Illinois

Online Courses | Institutes and Workshops | Instructional Resources | Initiatives | Institutional Partners | About ION
Home | Calendar | Contact | Sitemap | Ask ION

Use of this site indicates you accept the Terms of Use and the Privacy Statement

University of Illinois University of Illinois at Chicago University of Illinois at Springfield University of Illinois at Urbana-Champaign