Welcome to my distance education blog!

Here you can explore what the experts have to say about virtual team work in Business and Professional Writing environment. Some of the articles reviewed here will focus specifically on cross-cultural teams as teaching cross-cultural communication in Professional Writing is one of my favorite topics.

Have fun reading, and don't forget that there is a place for comments after each entry!

Wednesday, June 9, 2010

Blog #5

Vogel, D.R., Van Genuchten, M., Lou, D., Van Ekkout, M, Adams, A. (2001). Exploratory research on the role of national and professional cultures in a distributed learning project. IEEE Transactions on Professional Communication 44(2), 114-125.

While according to Neff and Whithaus (2008) process scripts can be used effectively in any type of distance learning activity, this article by Vogel et al. (2001) shows how it is especially important to provide a detailed process description to students working in intercultural virtual teams. The article describes a seven-week project where ten different heterogeneous teams of students from the Netherlands and from Hong Kong created a report with a topic in software engineering.

The researchers identify in the study that the two main factors associated with successful team work are team feeling and trust. Team feeling can be defined as the overall impression of team members that they truly feel like an integral part of the team. While Dutch students reported significantly lower rates of team feeling than their Hong Kong counterparts in this study, overall team feeling numbers were much higher in high-performing teams. The rates of reported trust levels were also lower with Dutch students, but a correlation was seen between high frequency of communication and increased trust levels. Vogel et al. attribute the differences in the reported rates to cultural differences; Dutch students took the initiatives, and were more concerned with their individual performance than students in Hong Kong with a collectivistic culture background who waited and left room for others to come up with ideas. The different cultural approach to the project could have been influenced towards a more positive outcome by instructors requiring a certain level of input (i.e. posts on discussion boards) by a certain date form all team members. This could have motivated Hong Kong team members to participate equally in the initial stage, which would have resulted in higher trust by their Dutch team mates.

When addressing the lessons learned from the project, the article by Vogel et.al emphasizes the importance of support instructors need to give throughout the project which includes quick response time, frequent monitoring of progress, and making sure that technology works for all participants while using a supportive rather than directive management style. In addition, a “sandwich structure” (p 122) is recommended to maximize effectiveness in the process of creating a collaborative report which means starting out the project with synchronous interaction, continuing asynchronously and finishing up with synchronous meetings.

This study contains many practical ideas that can be applied to cross cultural team work. While the article focuses on a software project, any type of writing class that requires students to collaborate on creating a document can use the suggestions that grew out of this extensive study. While the teams were made up of members from only two different cultures, the overall lessons learned could be applied to any diverse group. I especially agree with the authors in recommending the “sandwich structure” to control the group process as it has been suggested by other authors (i.e. Grosse 2002, Berry 2006) reviewed in previous blog entries that face-to-face meetings are crucial in the decision making phase of the project.


References

Berry, G. R. (2006). Can computer-mediated asynchronous communication improve team process and decision making? Learning from the management literature. Journal of Business Communication 43(4), 344-366.

Grosse, C. U. (2002). Managing communication within virtual intercultural teams. Business Communication Quarterly 65(4), 22-38.

Neff, J.M. & Whithaus, C. (2008) Writing Across Distances & Disciplines: Research and Pedagogy in Distributed Learning. New York: Lawrence Erlbaum Associates.

Sunday, June 6, 2010

Pedagogical Tool Review

Web-based writing assessment tools: Rubistar and Waypoint


Computers and Writing Assessment

While assessment methods have never been the center of attention in writing pedagogy, a considerable amount of effort has been made to align assessment methods with current writing pedagogy. Although the results of writing instruction cannot be measured with objective multiple choice tests, initiatives to develop holistic scoring that makes writing pieces comparable based on a normative scale keep appearing constantly, and can be seen in the assessment of the writing portion of standardized tests. However, as Peter Elbow (1996) points out, these are futile efforts that base the true score of an essay with the normalized reader. Applying computers as readers has also been tried with varying degrees of success (Hout 1996, Wohlpart et al. 2008).
As the trajectory of the development of writing pedagogy moves away from error correction and focuses on the collective constructive process instead of the product, most writing instructors still need to assign grades at the end of each semester. While the use of portfolios in grading is one way to adjust assessment with pedagogy, rubrics have also been widely used to establish grading criteria that bring the subjective process of grading essays as close as possible to the objective assessment expected by students and administration.


Rubistar

The web-based tool, Rubistar, provides an easy way to create rubrics, or use and customize one of the thousands of searchable rubrics already stored on the site. Rubistar, a venture of the Advanced Learning Technologies project at the University of Kansas Center for Research on Learning can be found at http://rubistar.4teachers.org/index.php and is free to use for anyone after they have registered with the site. While many rubrics on Rubistar are aimed at K-12 teachers, there are some that were created for freshman composition assignments and for professional writing courses. Furthermore, there are templates that make designing a rubric very easy. These templates are grouped thematically under such categories as oral projects, science, work skills, research and writing. Once a template is selected, a basic template becomes visible that has room for 10 rubric categories each evaluated on a four-point scale. The rubric categories can be selected from a list of evaluation criteria and can be modified if necessary. Also the text describing each of the four scales can be customized. The resulting rubric will automatically fit on a printed page and can be shared with students either in its printed form or via the Internet. Once the rubric has been saved in the database, it can be retrieved and printed any time from the web.
Rubistar also provides the option to analyze assessment results for each assignment that has been evaluated with the same rubric. In its analytical mode, instructors can enter for each scale level in a given rubric how many students have received that grade. While the website claims that this is a good way for instructors to determine which areas need improvement for many students, the analytical tool of Rubistar is rather simplistic, instructors can come up with the same statistics using paper and pencil and half the time needed to fill in the analytical rubrics on Rubistar.
Some of the thematically organized templates can be used effectively in teaching writing online. While instructors have to make sure that the learning outcomes they identified for the course and for each assignment are aligned with the criteria specified in the rubric, the fact that students can access these rubrics using the URL posted by the instructor makes it a valuable time saving tool in the assessment of papers. Especially when these rubrics are shared with students before an assignment is due or used for peer-review, instructors’ grading practices will be demystified and students will be able to revise their essays more effectively (Warnock 2009a, Wohlpart et al. 2008). Using rubrics and sharing them ahead of time helps students to set clear goals for themselves, gives them the ability to “self-assess”, and provides them with the vocabulary they need to critically analyze their writing (Arter and McTighe, 2001, p 12).
In addition to the rubrics that are on the website and those that can be created to evaluate writing pieces, the site also contains rubrics to evaluate oral presentations and collaborative work. These can often be used in Professional Writing classes where oral presentations and collaborative projects are the norm. For example, the rubric used to evaluate collaborative working skills can become an inherent part of the group project used by group members to evaluate each other’s performance.
What is the most beneficial feature of Rubistar? Long before such tools were widely available on the Internet, Hout (1996) has already praised the potential of computer based assessment that enables many users to share rubrics across local and global networks. Rubistar makes this sharing possible and especially since it has been integrated with another assessment tool, Waypoint, it can serve as a basis for providing feedback to students that not only helps students to understand the instructor’s grading criteria but also enables them to revise their work using detailed, constructive comments.


Waypoint Outcomes

While Waypoint also uses rubrics as the basis for student writing evaluation, it differs from Rubistar not only in the many additional features it contains, but also because it is not a free tool, but can be accessed only if your institution purchases the software. Once adapted for institutional use, the benefits are many, claims Subjective Metrics, Inc. the developer of the Waypoint Outcomes software (http://waypointoutcomes.com).
Waypoint outcomes has been developed to “help educators improve the quality of feedback to students on authentic tasks and build a culture of continuous improvement” (Waypoint Outcomes 2010). The basis of the web-based software is a rubric system that can be developed within the program or can be imported from other programs such as Rubistar. The rubrics than can be used to evaluate written assignments in many different fields, such as business, engineering, nursing or any other field where instructors assess students’ problem solving, writing, or critical thinking skills. Goodrich (2008) claims that the more detailed feedback students get through Waypoint helps develop their analytical and critical thinking skills.
When used for the evaluation of individual assignments, instructors check the appropriate rubric on a professionally formatted feedback sheet, and have the opportunity to add individual comments, paste an example segment from student text, or refer students to a specific page in the handbook for further instruction on how to correct a problem or improve a specific feature of their writing. This feedback sheet is easy to fill out, and has a color coded system for observation, recommendation, and reference. Because Waypoint can also be integrated with Blackboard, this feedback sheet can be sent to Blackboard grade book and can be viewed by students through Blackboard together with the grade they received for an assignment. This is a great feature that can be very beneficial in distance education. Students are able to see instant feedback when they check on their grade, and can use the evaluation report to improve their writing.
Waypoint can be used not only for individual assessment, but also to evaluate and compare courses within a major, an academic unit or even a whole university. It has been shown valuable for accreditation purposes for engineering schools, colleges of education and business schools. Warnock (2009b) for example, describes how Drexel University designed an accreditation focused evaluation program where papers written in a writing-intensive business course were evaluated by two different readers using a ten category rubric supported by Waypoint. The purpose of these evaluations was not to give feedback to students but it was aimed at establishing whether most students achieve the desired learning outcomes across the course which would prove the effectiveness of instruction for accreditation purposes.
Waypoint also has an analytical component, but it is much more sophisticated than that of Rubistar’s. Using Waypoint, faculty and administrators can easily aggregate data from different courses which will be displayed as graphs for easy comparison. This same data-analytical component can also be used to compare distance learning courses with on-site courses in their effectiveness of meeting learning outcomes. Within a class, individual instructors can easily identify areas which need to be revisited based on the analytical results. This is especially helpful for distance learning instructors who cannot read from nonverbal signs when students have difficulty with a specific concept.
Peer review is also an area where Waypoint can be used successfully in distance education. When teaching writing online, keeping track of the peer review process can be difficult, especially when teaching a large number of students. Using Waypoint, students can provide insightful feedback while instructors can monitor whether students have done their peer review on time and are able to access each review from a simple table that collects all peer-review data (McCann 2008). Here, instructors can also see the average score students receive through peer-review and thus can identify drafts with very low scores and can reach out to those students early on.
All of these features make Waypoint Outcomes an excellent tool to be used in teaching writing from a distance. While not all instructors might have access to Waypoint because it is only available through institutional subscription, sharing rubrics with students before an assignment is due and for peer review purposes in other ways, for example through Rubistar, enhances student performance in both on-site and distance writing courses.



References

Arter, J. & Mc. Tighe, J. (2001). Scoring Rubrics in the Classroom. Using Performance Criteria for Assessing and Improving Student Performance. Thousand Oaks, CA: Corwin Press.

Elbow, P. (1996). Writing assessment in the 21st century: A utopian view. In L. Bloom, D. Daiker, & E. White (Eds.), Composition in the twenty-first century: Crisis and change (pp. 83-100). Carbondale: Southern Illinois University Press.

Goodrich C (2008). Using web-based software to enhance student learning of analytical and critical skills. Journal of Educational Technology Systems 36(3), 247-253.

Hout, B. (1996). Computers and assessment: Understanding two technologies. Computers and Composition 13(2), 231-243.

McCann, A. (2008). Effective peer review: Leveraging the learning management system. Retrieved June 5, 2010 from http://docs.subjectivemetrics.com/home/aboutus/press/Effective%20Peer%20Review.pdf

Waypoint Outcomes (2010) Retrieved June 6, 2010 from http://waypointoutcomes.com

Warnock, S. (2009a). Teaching Writing Online: How and Why? Urbana, IL: National Council of Teachers of English

Warnock, S. (2009b). Methods and results of an accreditation-driven writing assessment in a business college. Journal of Business and Technical Communication 23, 83-107.

Wohlpart, A. J., Lindsey, C., Rademacher, C. (2008). The reliability of computer software to score essays: Innovations in a humanities course. Computers and Composition 25(2), 203-223.

Wednesday, June 2, 2010

Blog #4

Artiz, J. (2010). Cognitive organization and identity maintenance in multicultural teams. Journal of Business Communication 47(1) 20-41.

When teaching writing courses, we often assume that we need to focus on written communication only while we design an assignment or course. However, when planning for a collaborative writing project, speaking, specifically meeting-talk, might be important to pay attention to especially at the beginning stages of a group writing project when ideas are considered and decisions are made about what direction the group should proceed. This issue becomes even more complex, when such projects take place in an online course.

While the talk of meetings in general has been observed in culturally homogenous groups, this article by Jolanta Artiz concentrates on culturally heterogeneous groups and observes that group members alter their conversational styles and strategies depending on the cultural makeup of the team. In this study, Artiz analyzes the discourse patterns of small teams made up of US-born and East-Asian-born English speakers. Her findings indicate that the US-born English speakers dominate discussions and even increase their conversational presence in groups where they are minorities. On the other hand, East Asian English speakers take even fewer turns when they are in the minority as to signal their different cultural background. Artiz points out that educators need to be aware of these trends and need to inform their students of such tendencies, so that they become more conscious of their speech patterns that can have a direct influence on group participation and on the outcome of the project.

How does this apply to an online course? Instructors who are convinced that certain phases of the group project can be more productive when approached through synchronous communication, might arrange videoconferencing or synchronous chat sessions for each group. If videoconferencing is used, rules of spoken discourse definitely apply. However, if groups engage in synchronous chat sessions, additional factors need to be taken into account. Markman (2009) highlights the differences between conversations and chats. She explains that while we perceive online chats as very similar to face-to-face conversations, the turn-taking structure of the conversation is completely ambiguous as each speaker’s turn appears in the order that the server receives the entry. In addition, no one can see a turn until it is complete. These qualities of online chat make it more difficult and require more turns and attempts on the side of several participants to start and end meetings or to change topic. To avoid such problems, and to make meetings more productive in chat sessions, Markman suggests that groups create an agenda for each meeting, which will serve as a shared organizing principle for all members. In addition, appointing a chair who calls meetings might be a good idea, as it works very well in corporate settings. However, the effectiveness a leader in the educational group setting to keep the group focused has not been established in this study.

What all writing instructors can take away from this article is that we cannot neglect the guiding principles of synchronous interaction, be it face-to-face conversation or text chat, because it has a significant effect on how successful collaborative group projects will be in our online classes.

References

Markman, K. (2009). So what shall we talk about? Openings and closings in shat based virtual meetings. Journal of Business Communication 46(1), 150-170.

Wednesday, May 26, 2010

Blog #3

St. Amant, K. (2002). Integrating intercultural online learning experiences into the computer classroom. Technical Communication Quarterly 11(3), 289-315.


Creating a successful group project in a Professional Writing course that results in a unified document written by several different people can be quite difficult in a relatively homogeneous face-to-face classroom environment. If an instructor attempts to migrate (Warnock 2009) this project to an online classroom and faces the realities of a culturally and linguistically heterogeneous student body at the same time, many different factors have to be taken into account that require careful planning from the instructor to ensure the most optimal outcome.


In the article “Integrating intercultural online learning experiences into the computer classroom” St. Amant describes some of the challenges instructors face when they work with students from different cultures and provides some practical exercises that can help students to understand all the factors that affect their peers’ performance. According to St. Amant, one of the issues that play a major role is language. To ensure that language issues don’t become a problem in a virtual Professional Writing course, St. Amant provides several strategies for instructors in a different article (2007). First, he states that the standard language of class discussion and subsequent documents should be identified early on to avoid the mixture of different dialects or World Englishes. Furthermore, he suggests that instructors identify ahead of time which students might have a difficulty and provide them with different strategies (such as online tutoring) to remedy these issues. Another suggestion in the article stresses the importance of creating student web pages by each student, so that everyone has a clear understanding of each student’s linguistic background.


In addition, it is also important that students take into account the different cultural expectations associated with communication (St. Amant 2002). These cultural expectations can have an effect on how identities are represented and perceived, how arguments are presented, and how often and with how much formality students communicate. It is crucial, for this reason, that students understand how the different rhetorical styles represented within a group can influence their collaborative writing process and product.


While creating individual web pages may seem like a good idea to get people to know each other, St. Amant does not discuss what type of information should be presented on these pages. Clearly, students from individualistic cultures will post different types of information than those from collectivist cultures. For this reason, I think that instructors using the personal web page idea should create clear culturally sensitive guidelines on what type and how much information students place on these personal websites that would foster cultural diversity without alienating certain students right at the beginning.


This article contains suggestions that are applicable to any writing instructor who has a culturally and/or linguistically heterogeneous classroom, I would recommend it to anyone, and especially those who plan to integrate personal student web pages into their online curriculum.



References


St. Amant, K. (2002).Online education in an age of globalization: Foundational practices for technical communication instructors and trainers. Technical Communication Quarterly 16(1), 13-31.

Warnock, S. (2009). Teaching Writing Online: How and Why? Urbana, IL: National Council of Teachers of English

Tuesday, May 18, 2010

Blog #2

Grosse, C. U. (2002). Managing communication within virtual intercultural teams. Business Communication Quarterly 65(4), 22-38.

While creating effective virtual teams in online writing courses is a challenge in itself, the fact that in today’s US college classes there are many students with different cultural and linguistic backgrounds further complicates the issue. Instructors have to take into account not only the differences in personality of team members, but also different communication styles and expectations that stem from team members’ varied cultures. Grosse’s article discusses what kinds of complications arise in intercultural teams and how these can be overcome by using different strategies.

In her study, Grosse surveyed 90 graduate business students after they participated in a virtual e-commerce project in teams where at least two team members came from a different culture. To augment these results, Grosse also interviewed international business executives about their practices in intercultural communication. According to the results of her study, Grosse stresses that participants can make the most of these intercultural teams by understanding how diversity can strengthen a team and by showing intercultural sensitivity.

In addition to looking at intercultural issues, Grosse also reviews different methods of communication within the virtual groups. Her findings indicate email to be a very effective way of communication in both groups of respondents, students and executives. In addition, she highlights that initial face-to-face encounters also help in building the personal relationships that aid teamwork and promote appreciation of the rich cultural backgrounds of team members.

While the results in Grosse’s article clearly indicate that building personal relationships are essential in an academic environment for a successful group project, Larbi and Springfield (2004) suggest a different method for virtual teams of technical writers to ensure that remote project teams are effective. Larbi and Springfield propose a four step approach to successful virtual team projects: 1. learning special behaviors, 2 using media appropriately, 3. following a best practice, and 4. being prepared. The best practice they suggest that technical writers follow is being result oriented, because focusing on personalities rather than on the project will take away from the effectiveness of the team, or as Scotto (2001) puts it, team members need to stay focused on the project, not each other.

Larbi and Springfield advocate the establishment of communities of practice that are held together by common purpose and the need for shared knowledge. While this common purpose may be enough to create a community in even multicultural work teams, the question is would the same approach work in educational settings? I believe that communities of inquiry in educational settings have different motivations from work teams and thus being strictly result-oriented as a practice that works in a corporate environment cannot be seamlessly transferred into education. Thus, creating personal relationships in group projects of online classes is even more important with intercultural teams so that team members are able to bring in an appreciation of the diversity represented in their team as a cohesive force.

References
Larbi, N. and Springfield, S. (2004) When no one’s home: Being a writer on remote project teams. Technical Communication 51(1), 102-108.
Scotto, M. (2001). Basic Project Management for Information Systems Professionals. New York: The Scotto Group Inc.

Friday, May 14, 2010

Blog #1

Berry, G. R. (2006). Can computer-mediated asynchronous communication improve team process and decision making? Learning from the management literature. Journal of Business Communication 43(4), 344-366.

Many online writing courses have a group project component. This is especially the case in Professional Writing courses, as one of the major objectives of these courses regardless of the form of delivery is to teach students how to collaborate with others in data-gathering from printed and online sources, and in selecting, organizing, revising, and reporting information in written and oral form. Since it is important in Professional Writing courses to introduce students to the best communication practices used in the corporate world when designing these courses, research articles that describe lessons learned in the corporate environment cannot be neglected.

One such article, written by Berry, provides a review of business communication and management studies published in the last 25 years that address the advantages and disadvantages of computer-mediated asynchronous communication (CMAC) in improving team work and aiding the decision making process. In this article, Berry argues that CMAC has a positive effect on team decision making process, because it allows every team member to contribute equally regardless of their status in the organization and thus results in more alternatives to be considered. In addition when using CMAC, team members have more time to react to each individual’s contribution and the discussion is archived and can be retrieved any time. Furthermore, CMAC can help eliminate free riders in teams, since as the discussion progresses it becomes increasingly apparent when someone is not participating. CMAC may also allow increased participation of team members who are shy and would be reluctant to speak up in face-to-face meetings. While all these advantages can aid the decision making process, Berry points out that it is important to have an explicit communication plan and that expectations need to be made clear ahead of time. Also, other means of communication, especially face-to face, may need to be used when trying to reach a consensus towards the end of the decision making process.

I believe that the lessons learned about CMAC from management research listed in Berry’s article can effectively be applied in the design of a team project for an online Professional Writing course. This study can especially be helpful in the process of designing procedures in the prewriting phase, when important decisions have to be made about the content and main points of the group report, the end product of the group project. Berry’s findings would suggest that asynchronous communication is the right way to prepare for making a decision, however when consensus needs to be reached, it is advisable to switch to a synchronous method, such as group chat or possibly video conferencing. Because this article has some directly applicable findings that could improve group projects, I would recommend it to Professional Writing teachers and scholars.