Learning Objective III

Graduates will have excellent oral as well as written communication skills.

The CS Department designed and implemented Course Direct Measures (CDMs) in Fall 2012 to be assessment points most closely associated with student outcomes required by ABET accreditation or learning objectives of a course. 

All CS 5000-level or above courses requiring a class project, exam, assignment, or quiz that involved either writing a report or making a presentation for any semester from Fall 2015 - Fall 2021 were asked to evaluate the graduate students' communication skills. Instructors generated a CDM by providing an assessment of the class performance for the associated PLO (e.g., graduate student communication skills) based on the level of attainment using the following 5-point scale:

  1. Student fails to demonstrate understanding of concepts required for communication skills
  2. Student fails to meet minimum criteria for success for communication skills
  3. Student barely meets minimum criteria for success for communication skills
  4. Student clearly demonstrates evidence of success for communication skills
  5. Student exhibits outstanding performance for communication skills

This assessment was generally based on targeted assignments, quizzes, or course project performances, although depending on the specific class, instructors took additional data into consideration. 

We tried to ensure that a sufficient number of courses were chosen in each semester to provide adequate assessment of graduate students' communication skills.  However, many classes for which we could collect CDMs were taught by professors who are no longer with the Department.  We decided that the least-invasive thing to do was to choose courses taught by instructors who are still with the Department and let these instructors provide a CDM report. 

Instructors were also required to include the sample of performance indicators that demonstrate the accuracy of the assessment. The samples of student work that demonstrate the accuracy of the assessment score can be provided upon request. 

A satisfactory level of attainment is that 80% of graduate students score 3 or higher on the 1-5 scale.  

A sample template of a CDM to evaluate graduate student communication skills is shown below.

LO(3) Tool - Graduate Student Communication Skills

USU Computer Science

Course

CS#### - Title

Course Description

####

Semester

Spring/Fall 20##

Instructor

####

No. of CS Graduate Students

##

Relevant LO

LO(3) - Graduates will have excellent oral as well as written communication skills.

Assessment Format

(Choose one or more assignment, project, paper, or presentation)

Assessment Criteria

(Adjust these category breakdowns as appropriate)

  • Poor (score < 50%) - 1
  • Beginning (50% ≤ score < 70%) - 2
  • Fair (70% ≤ score < 80%) - 3
  • Proficient (80% ≤ score < 90%) - 4
  • Exemplary (90% ≤ score ≤ 100%) - 5

Summary

  1. xx/xx students (x.x%)
  2. xx/xx students (x.x%)
  3. xx/xx students (x.x%)
  4. xx/xx students (x.x%)
  5. xx/xx students (x.x%)

Supporting Materials

(Description of the assignment, project, paper, or presentation used)

The CDM Evaluation scores table presents a summary of the numerical component of the assessment results in terms of the CDM evaluation scores for graduate student communication skills for 36 courses offered in the past six years from Fall 2015 to Fall 2021.

Each number in the table is a fraction number, where the numerator denotes the number of graduate students who scored 3 or higher on a scale of 1-5 and the denominator denotes the total number of graduate students.  These evaluation scores correspond to the average percentage of graduate students above the expected attainment (i.e., scoring 3 or higher on a scale of 1-5).

This table demonstrates that since Fall of 2015, 32 out of 36 (i.e., 88.89%) courses have over 80% of graduate students scoring 3 or higher on a scale of 1-5. The average number of courses offered per semester is 3 and data was missing for one course in Fall of 2019.

We could not collect CDMs for the following graduate courses:

  • CS 5300, CS 5460 and CS 5410: The instructors do not require students to write a document or make a presentation.  
  • CS 5800: The instructor requires students to write design and query optimization documentations. However, they are not essays.
  • CS 6800: The instructor involves students in various discussions and assigned participation points for the discussion.
  • CS 5640/CS 6640 and CS 6630: The instructor did not keep a record of grades.