CompAir讲师指南

Plan your student peer assessments

As with any learning activity, how these assignments are introduced, designed, and integrated in courses impacts the student experience with ComPAIR. UBC internal studies so far have surfaced a few recommendations to consider in your planning.

• Clearly explain the learning objective(s): Students who understand what underlying skills they are practicing in the application feel they learn more from the assignments. It is important to explain the end goal of using ComPAIR—how comparing will concretely help learning—not only how the process works. As a starting point, download the modifiable向学生介绍关联的模板UBC教师创建了。
• 在Compair Dispryments上建立: Assignments in ComPAIR are more beneficial to students when presented as part of a larger process. It is better to use ComPAIR for peer review in the context of a bigger course goal (e.g., prep for writing a later term paper, evaluation of an early project draft), rather than for standalone assignments or “busy work”.
• Provide a low-stakes training round: Students feel more confident when no- or low-stakes practice with comparing answer pairs happens prior to graded assignments in ComPAIR, especially when the practice includes review of how they've done the comparisons.
• Use multiple, detailed criteria for comparisons: Students given more guidance say they learn more from comparing, especially when assignments are more complex. Explaining precisely what to look for during comparisons—with multiple descriptive criteria in the application and/or detailed external rubrics that are provided and explained ahead of time—may result in stronger learning and possibly richer feedback.
• Require 3+ comparisons per assignment: Despite low reported confidence giving peer feedback, many students report they learn simply from practicing this skill with answer pairs. A minimum of three comparisons per student (i.e., each student reviews six peer works) is suggested to give students repeated practice to learn from.
• 评估对等反馈的质量: Adding weight of some kind to the peer feedback students write has helped instructors increase the quality of feedback given. Assigning marks creates additional accountability for students and increases their buy-in to the process.

Develop your student peer assessment criteria

In ComPAIR, one or more custom criteria can be used to guide students' comparison of the answer pairs. Each criterion must pose a question answered by choosing between the answers (e.g., Which is better?).

To develop criteria, start with the course learning outcomes and think about how seeing other work will help students get there—what can students learn from each other? Keep in mind how experienced students in the course will be, and use criteria at a difficulty level the majority will be able to understand. UBC instructors generally stick with between 1-6 total criteria, and some advise using an odd number to discourage students from selecting a “tie” between answers.

还考虑目标是更加总结（批判性地看最终工作）或形成（建设性地看着起草的工作）。更难，更复杂，更长的标准对于总结用途可能会更好。更柔软，更简单，更短的标准对于形成性使用可能会更好。

决定任务阶段的时间

You will need to decide how many ComPAIR assignments you will give in the course as well as the timing for each phase of the assignment: answering, comparing, and (optionally) self-evaluating. By default, comparing begins after answering ends, though these may be designed to overlap. However, keeping the phases separate allows students to complete their evaluations without delays (which can happen if answering and comparing overlap and there aren't enough answers available for students to compare).

ComPAIR assignments can be given during and after group projects as well. When you use a group assignment, one answer will be requested from each group (which any member can submit), but each group member must complete the required comparisons and self-evaluation (if enabled) individually.

选择结果如何影响成绩

If ComPAIR assignments will influence grades, you should communicate to students in the beginning how exactly the assessment marks will be counted, so students are not caught off-guard.

Often, instructors grade students with a combination of two aspects:

• Their participation in the process (i.e., answering, comparing, and/or self-evaluating). When creating your ComPAIR assignment, you will be able to assign the weight given for completing each phase of the assignment.
• The quality of the work students do through ComPAIR, which may mean any of the following: reviewing the answers students initially submit, seeing how peer feedback informs a revised or later work they submit, or looking at the thoroughness and thoughtfulness of their peer feedback (this has the added benefit of increasing students’ sense of accountability in providing quality constructive criticism).

A note on ComPAIR's rankings

ComPAIR’s main pedagogical focus is to help students effectively review peer work and write insightful feedback using the power of comparison. However, some instructors have considered usingCompair的可选评分/排名答案for grading as well, primarily by chunking the answers into rough top, middle, and bottom groups and assigning a grade to each.

如果您打算将Compair的结果转化为您分配的标记，请进行自己的验证。到目前为止，内部研究表明，Compair的评分可能无法可靠地映射到传统的专家评分，因为它最终依赖于新手（学生）的技能和培训，以提供对同行答案的准确，知情排名。

建立一个关联课程

You can most easily get started with ComPAIR in Canvas. Through Canvas, you can set up a ComPAIR course that will automatically populate with your class list. The instructions differ depending on if you want to sync the ComPAIR participation grades with the Canvas gradebook or not.

Understand the ComPAIR workflow

Using ComPAIR for peer review is a straightforward process.

1. You create an assignment: You set up five structural elements (the assignment details, timing of phases, comparison criteria, number of comparisons, and participation grade) for each assignment, a process that can be completed in under ten minutes.
2. 学生回答任务: Students can answer using a rich text editor, a file attachment, or both. For a group assignment, only one student from each group needs to answer.
3. Students compare and comment on pairs of peer answers: Students select a preferred answer from the pair for each criterion you set (e.g., "Which is better?), then write feedback to the author of each answer, following instructions that you can customize. This phase is done individually, whether or not it is a group assignment.
4. Students complete a self-evaluation (optional)：如果您启用自我评估，学生在流程结束时对自己的答案进行反映和评论，并按照您可以自定义的说明。此阶段是单独完成的，无论是否是一个组分配。
5. Everyone views results: Once the phases of a peer review assignment complete, students can access the peer feedback given to their (or their group’s) answer, as well as all answers submitted by peers. You and your teaching team can read and comment privately or publicly on student answers, access a participation table to view activity and participation grades, mark "top" answers, and view each student’s comparison choices, peer feedback, and self-evaluation.

要了解更多关于每一步的信息，请访问ComPAIR support site's workflow page。

创建基本的关联分配

1. 登录Compair，然后单击您的course name。如果您没有课程，则可以按照前面的步骤设置一个。
2. 点击添加任务, which will take you to a page for filling in information about the assignment:
   • 在“分配详细信息”下，设置分配的短名称，启用/禁用自我评估和组功能，并添加任何分配指令。
   • Under "Schedule", set the timelines for when students can answer, compare answers and, optionally, evaluate their own answer.
   • Under "Prompts", set the criteria that students will use to compare the answer pairs. One or more criteria can be used and each must pose a question answered by choosing between the answers. Instructions for peer feedback and self-evaluation can also be customized.
   • Under "Comparison Settings", set the number of comparisons required from each student and how the pairs will be selected by the application—at random or adaptively based on how students have ranked answers so far. You can also add a practice answer pair for students to start with and enable replies.
   • Under "Participation Grade", set the weight given for completing each part of the assignment, which is used in calculating a total participation grade.
3. 保存那作业。

Set up grade syncing for ComPAIR in Canvas

Once you have set up a ComPAIR course and assignment, you can sync grades directly from ComPAIR to Canvas. To sync properly, you will need to set up individual links in Canvas to each ComPAIR assignment. Each student must click the link of each Canvas assignment to establish a connection between their Canvas gradebook entries and their work in ComPAIR.

1. To create an assignment link in Canvas, first copy the necessary information from ComPAIR:
   • 登录Compair，然后单击您的course title。
   • Scroll to the ComPAIR assignment you want to sync grades from and clickEditunderneath the assignment title.
   • 点击Copy?在“编辑分配”页面的右上角。这将复制您在画布中输入所需的信息。
2. Log in to your Canvas course, and clickAssignmentsin the Course Navigation.
3. 点击+分配蓝色按钮在屏幕的右上角。
4. Enter the assignment name as you want students to see it.
5. Scroll down to submission type and selectExternal Toolfrom the drop-down menu.
6. 即使您知道URL，请单击找。(Entering the URL directly will not sync properly with Canvas.)
7. From the list, pickComPAIR和clickSelect。
8. At the end of the "External Tool URL" field, type a question mark (?), then paste the value you copied from ComPAIR.
   • “外部工具URL”将最终看起来像这样：
     compair.elearning.ubc.ca/api/lti/auth?assignment=*******
9. CheckLoad This Tool In A New Tab。This allows grades to properly sync with Canvas.
10. 保存并发布那作业。（学生只能访问已发布的作业。）