Вы находитесь на странице: 1из 15

1

NBA’s Outcome Based Education: Communication Skills Assessment Model Using Rubrics

NBA’s Outcome Based Education: Communication


Skills Assessment Model Using Rubrics for the Final
Engineering Students
Ezhilan S, Professor of English, Jayam College of Engineering and Technology,
Dharmapuri 636 813, TN, India Tel: +91 9443563888, E-Mail: profezhilan@gmail.com

Abstract
Engineering students’ communication skills have a significant impact on placement and
higher education opportunities. With the paradigm shift towards competence-based
communication skills enhancement, the methods of assessment should also change.
This study examined communication skills assessment model based on Outcome
Based Education of NBA criteria, using rubrics to find the reliability for the final
engineering students. The author held a series of discussion with the facilitators and
prepared criteria for verbal, non-verbal, interpersonal strategies, graphical, visual, and
statistical and audio-visuals of communication skills. The assessment tool provided
tangible information and recommendations for the continuous improvement for personal
and programme development.

Keywords: NBA criteria, communications skills, assessment model, rubrics

Introduction
Higher education students’ communication skills have a valuable impact on placement
opportunities and entry into higher education institutions. Communication skills include
the blend of verbal, non-verbal and interpersonal strategies needed to interact
confidently and effectively with a variety of audiences. A Competent communicator
draws on a number of different means like graphical, visual, statistical, audio-visual and
technologists to get the point across. The human resource professionals select the right
candidates during ‘On and Off Campus’ events. They conduct various rounds include
group discussion, interviews, and stage speaking skills to select the right candidate.

Twenty first century has brought bountiful opportunities for the millions, with more focus
on the students’ overall capability apart from academic proficiency. Many students,
predominantly those from non-English medium schools, find that they are not favoured
due to their inadequacy of communication skills, even though they are good at their
technical knowledge in countries like India. Keeping in view their industry and business
needs and professional requirements, the technical universities introduced the courses
exclusively for communication skills development.

The guidelines released by NBA indication a paradigm shift in engineering educational


system. India is a provisional member of Washington Accord and working for permanent
membership. With this shift, the focus of programme assessment by NBA panel has
changed from input to outcomes. Up course, outcomes accomplishment measurement
methods and their review process form an important set of documentation for new NBA.

1
2
NBA’s Outcome Based Education: Communication Skills Assessment Model Using Rubrics

NBA guidelines also make a mention of rubrics designed to measure outcome


achievement by students.

The new challenges are integrated into the American ABET Accreditation Board for
Engineering and Technology) criteria and the European EUR-ACE (European
Accreditation Board for Engineering Education) criteria for accreditation of engineering
education. Both accreditation institutions have formulated requirements for skills that go
far beyond technical knowledge (UNESCO, 2010). Some of the ABET criteria are:
 An ability to function on multi-disciplinary teams.
 An ability to identify and solve applied science problems.
 An understanding of professional and ethical responsibility.
 An ability to communicate effectively.
 The broad education necessary to understand the impact of solutions in a global
and societal context.
 Recognition of the need for, and an ability to engage in life-long learning.
 Knowledge of contemporary issues.
 An ability to use the techniques, skills, and modern scientific and technical tools
necessary for professional practice.

Learning outcomes can serve as a benchmark to measure a success of a university.


Learning outcomes as ‘being something that student can do now that they could not do
previously’ are changes in people as a result of a learning experience (Watson 2002).
Learning outcomes can be used in a way that meets the needs of all stakeholders in
university (i.e. the student, the lecturer and external parties). ‘Student learning
outcomes’, on the other hand, encompass a wide range of student attributes and
abilities, both cognitive and affective, which are a measure of how their college
experiences have supported their development as individuals (Bloom 1977).

In short, while old output assessment model served as an indirect measure of a


programme’s level of effectiveness, the present outcomes assessment-based
accreditation insists on having direct measures in terms of programme outcomes, of
what the programme has done with its capacity and capability to contribute to the growth
in individual student learning.

Graduate Attributes:
The POs formulated for each programme must be consistent with the Graduate
Attributes mentioned in Washington Accord. Graduates Attributes (GAs) form a set
of individually assessable outcomes that are the components indicative of the
graduate’s potential to acquire competence to practice at the appropriate level. The
GAs is exemplars of the attributes expected of a graduate of an accredited
programme. The Graduate Attributes of the NBA are as following:

1. Engineering knowledge 4. Conduct investigations of complex


2. Problem analysis problems
3. Design/development of solutions 5. Modern tool usage

2
3
NBA’s Outcome Based Education: Communication Skills Assessment Model Using Rubrics

6. The engineer and society 10. Communication


7. Environment and sustainability 11. Project management and finance
8. Ethics 12. Life- long learning
9. Individual and team work

Outcomes Assessment:
NBA guidelines clearly state that “The development of different rubrics and the
achievement of the outcomes need to be clearly stated in the Self Assessment Report
(SAR). The results of assessment of each PO should be indicated, since they play a vital
role in implementing the Continuous Improvement process of the programme. The
institute shall provide the ways and means of how the results of assessment of the POs
help to refine processes of revising/redefining the POs”

ABET Definitions released in 2011 define assessment as one or more processes that
identify, collect and prepare data to evaluate the attainment of student outcomes.
Effective assessment uses relevant direct, indirect, quantitative and qualitative
measures as appropriate to the outcome being measured. Reliable assessment of
outcomes is important not only for recording student performance in a subject but also
for monitoring the overall teaching-learning process of a programme. Based on the
results of the assessment, stakeholders can take corrective action to ensure that
outcomes are attained to the satisfaction of all.

In this article, author discusses key features of a quality rubric; presents models of
rubrics for assessing communication skills courses of higher education institutions. The
author describes the models for developing and institutionalizing the assessment of
components of communication skills using rubrics. Consensus was built regarding
competencies for communication skills, rubrics by working with higher education English
teachers.

This study finds how rubrics enhance the learning and whether students enhanced
learning rubrics and whether the teachers can improve the performance of students as
they progress before and after introduction of rubrics. To establish and assess on
communication skill of engineering students and to find suitable level of mastery of the
skills necessary to be successful, this study will be helpful. At the Jayam College of
Engineering and Technology, Dharmapuri Tamil Nadu, India which has been accredited
by Anna University, Tamil Nadu, India, a committee was formed by the Faculty of
Engineering to investigate, develop, and implement a common set of rubrics for the
purpose of consistently assessing graduate attributes across all engineering disciplines.

Rubrics for Outcome Assessment:


A rubric is a set of criteria and standards for assessing students’ work or performance.
For each criterion and standard, a rubric defines the specific attributes that will be used
to score or judge the student’s performance and to differentiate between different levels
of performances. Scoring rubrics include one or more dimensions on which
performance is rated, definitions and examples that illustrate the attribute(s) being

3
4
NBA’s Outcome Based Education: Communication Skills Assessment Model Using Rubrics

measured and a rating scale for each dimension. Dimensions are generally referred to
as criteria, the rating scales as levels, and definitions as descriptors.

Rubrics help to make implicit assumptions and expectations more explicit. Rubrics offer
a clear insight into the elements, assess, find reason and motivate students towards
developing the competencies. Rubrics have been shown to provide high-level feedback
(Nordrum et al. 2013). Catherine Hack (2013) found that the rubrics very helpful in
clarifying performance and promoting self-assessment, whilst the tutors felt that it was a
time efficient and informative method of providing feedback. William et al (2012)
assessed the graduate attributes of problem analysis, design, individual and team work,
communication skills, and economics and project management using rubrics.

Whenever students are asked to demonstrate their ability to carry out a particular skill or
to create a certain product, faculty have expectations of quality they use to assess that
work. In some cases, these expectations are shared with the students, but at times,
students are not clear on exactly what is expected of them. Rubrics make explicit to
students and faculty the criteria on which products and performances will be judged.
Rubrics can provide a framework for faculty to evaluate the communication skills and
performances integral to the communication skills course. Rubrics are criterion-
referenced tools and they are used to evaluate student performance against a standard
of mastery, not just to compare students. When the criteria are accurately delineated, a
rubric has the capability of providing a fair, reliable, and valid method of measurement.

Rubrics help to make embedded assumptions and expectations more unambiguous


Rubrics offer a clear insight into the elements, assess, find reason and motivate
students towards developing the competencies. Students can be provided with a rubric
prior to submission of an assignment, which helps to clarify what is required for good
performance, and they can be used with or without marks for formative assessment
(Hancock and Brundage, 2010)

Mechanism of a Rubric
A rubric entails four components:

1. Task Description
o Involve a ‘performance’ by the student
o The task can take the form of a specific assignment; e.g., Oral presentation,
group discussion, seminar presentation, mock interview, etc.
o The task can take the form of overall behaviour; e.g., Articulation, innovative
ideas, language activities and behavioural outlook in the classroom

2. Scale
o Describes how well or inadequately any given task has been performed
o In positive terms which may be used: Emerging, Progressing, Excellent, Amazing
and Excellent
o Language style: Beginning level, Middle level and High level
o Commonly used labels:

4
5
NBA’s Outcome Based Education: Communication Skills Assessment Model Using Rubrics

o Not yet competent, partly competent, competent and highly competent


o Unacceptable, marginal, proficient and exemplary
o Novice, intermediate, high intermediate and advanced
o Novice, intermediate, proficient and distinguished
o Beginning, developing, average and accomplished

3-5 levels are typically used


o The more levels there are, the more difficult it becomes to differentiate
between them and to articulate accurately why one student's work falls in
the scale level it does
o But, more specific levels make the task clearer for the student and they
reduce the Faculty's time needed to furnish detailed grading notes

3. Dimensions
o Lay out the parts of the task merely and completely
o Should actually represent the type of component skills students must combine in
a successful intellectual work
o Breaking up the assignment into its distinct dimensions leads to a kind of task
analysis with the components of the task clearly identified

4. Description of the dimensions


o A rubric should contain at the least a description or the highest level of
performance in that dimension
o Scoring Guide Rubric means a rubric that contains only the description of the
highest level of performance

Criteria of communication skills


The criteria to be used in assessing the performance or product should emerge out of
the discussion of the models. It is the characteristics evident in the exemplary work that
will become the criteria. The criteria may range from concrete skills to more abstract
concepts and may include such items as knowledge, current issues, organization,
creativity and understanding of the problem.

Among other advantages, rubrics are valuable when grading student performance that
relies on higher order thinking or other complex matters. Whatever criteria the faculty
chooses, they should be ones students must combine for their training activities to be
successful. By defining the criteria carefully, the faculty will provide each student with
detailed feedback on how well or poorly he or she did on specific parts of the whole as
well as with an overview of the student’s strengths and weaknesses for the assignment.

Rubrics are an assessment tool which can be used to evaluate student performance
over a range of criteria. A rubric normally comprises main features (Reddy and
Andrade, 2011):

Assessment criteria: which are usually mapped to the learning outcomes or


competencies that are to be measured?

5
6
NBA’s Outcome Based Education: Communication Skills Assessment Model Using Rubrics

Quality criteria: qualitative descriptions of what is expected for a given grade or


mark; Scoring system: Grade ranges or degree classifications mapped to the
quality description.

Evaluating communication skills can be subjective which can lead students to feel that
they are being assessed disproportionately. To make the process more objective and
enable the academic to impartially compare communication skills, rubrics can be used.

There are four types of rubrics:


1. Holistic rubrics provide a single score based on an overall impression of a
student’s performance on a task.
2. Analytic rubrics provide specific feedback along several dimensions
3. General rubrics contain criteria that are general across tasks. Table 3
4. Task specific rubrics are unique to a specific task.

The holistic and analytical are main rubrics. A holistic rubric Table 1 provides a guide to
scoring a product or performance on the basis of the overall impression it creates and
the effectiveness of the work as a whole. An analytical rubric (Table 2) breaks down a
product or performance into its essential features and then describes levels of
performance relative to each of those features or criteria. The power of the analytical
rubric is that it provides detailed information to students, teachers and parents on
individual student strengths and areas for improvement.

Table 1 Holistic Rubric for Oral Presentation


5/5 The presentation demonstrates a depth of understanding by using relevant and
accurate detail on the topic. The presentation is thorough and goes beyond what
was presented in the group or in the assigned tasks.
4/5 The presentation is centred on the topic, which shows a highly developed
awareness of the novel and competent ideas and a high level of conceptual
ability.
3/5 The delivery is creative and effective in conveying ideas to the audience. The
presenter responds effectively to audience reactions and questions.
2/5 The presentation includes appropriate and easily understood visuals, which the
presenter refers to and explains at appropriate moments in the presentation.
1/5 The presentation includes appropriate and somewhat easy to understood visuals,
which the presenter refers to and explains.

From the perception of student assessment and evaluation, a rubric is basically a


scoring guide for evaluating student work. A rubric lists the important criteria on which a
product or a performance will be judged and specifies the levels of quality for each of
those criteria. As the teaching community has become increasingly interested in the use
of assessment to support the learning process, rubrics have become instrumental in
informing students about ‘what counts’ in completing a particular task. Rubrics clarify
learning goals and outcomes for students and support them in making choices and
decisions with respect to improving the quality of their work (Andrade, 2000)

6
7
NBA’s Outcome Based Education: Communication Skills Assessment Model Using Rubrics

Table 2 Analytic Rubric for Written Communication


Marker for Levels of Achievement
effective
writing Opening (1) Developing (2) Competent Proficient( 4)
(3)
I Meaning Inappropriate Appropriate Effective Insightful
and No feasible develops a Develop a The ideas
development: point of view; point of view, point of view are fresh,
ideas, little or no demonstrating and mature and
examples, evidence; weak some critical demonstrates extensively
reasons and critical thinking, thinking; may competent developed;
evidence, providing have critical insightfully
point of view inappropriate or inconsistent or thinking; develops a
insufficient inadequate enough point of view
examples, examples, Supporting and
reasons, or reasons, and detail to demonstrate
other other evidence accomplish s
Evidence of of support; the purpose of outstanding
support support tends the paper critical
towards thinking
general
statements or
lists
II Lacking Mostly Structured Perceptively
Organization: structure structured Generally Structured.
focus, Disorganized Limited organized and The article
coherence, and organization and focused, presented
progression unfocused; focus; may demonstrating or implied
of ideas, serious demonstrate coherence and with
article problems with some lapses in progression of noticeable
coherence and coherence or ideas; presents coherence;
developed
progression of progression of an article and provides
ideas; weak or Ideas; suggests a specific and
non-existent generally, plan of accurate
article neither development support
sufficient nor which is mostly
clear enough carried out
to be
convincing
III Language: Inadequate Adequat Proficient Refined
word choice Displays e Competent Choice of
and sentence frequent and Developing use of language and
variety fundamental facility in language and sentence

7
8
NBA’s Outcome Based Education: Communication Skills Assessment Model Using Rubrics

errors in language use, sometimes structure;


vocabulary; sometimes uses varied precise and
sentences weak sentence Purposeful,
may be vocabulary or structure; demonstrating
simplistic and inappropriate generally a command of
disjointed usage or word focused the language
choice; and a variety
sentence of sentence
structure tends structures
to be pedestrian
and often
repetitious
IV Distracting Fundamental Controlled Polish
Conventions: Errors interfere errors interfere Occasional ed
grammar, with the writer’s with the writer’s errors do not Control of
ability to ability to interfere with convention
punctuation,
consistently communicate the writer’s s
spelling, communicate purpose; ability to contributes
paragraphing purpose; contains an to the
communicate
, format pervasive Accumulation purpose; writer’s
mechanical of errors; some generally ability to
errors obscure weakness in appropriate communica
meaning; format te purpose;
format
inappropriate
free of most
format
mechanical
errors;
appropriate
format

On every occasion students are asked to demonstrate their ability to carry out a
particular skill or to create a certain product, teachers have expectations of quality they
use to assess that work. In some cases, these expectations are shared with the
students, but at times, students are not clear on exactly what is expected of them.
Rubrics make plain to students, teachers and parent the criteria on which products and
performances will be judged. Rubrics can provide a framework for teachers to evaluate
the complex skills, products, and performances integral to the core curriculum in
technical institutions.

Rubrics are criterion-referenced tools. That is, they are used to evaluate student
performance against a standard of mastery, not just to compare students. When the
criteria are accurately delineated, a rubric has the capability of providing a fair, reliable,
and valid method of measurement. Of course, the reliability and validity of the tool
depends very much on how well the rubric developer was able to identify the important
criteria and then differentiate between the levels of performance that could be expected
from a particular group of students along those criteria (Table 3).

8
9
NBA’s Outcome Based Education: Communication Skills Assessment Model Using Rubrics

Table 3 General rubrics for Oral Presentation


Criteria Levels of achievements
1. Knowledge/ 1. Exemplary (5): Explored current knowledge; presented innovative
Ideas/ ideas; relevant content; constructive thoughts; informative and
impressive.
2. Proficient (4) Explored current knowledge; presented innovative
ideas; constructive thoughts; informative and impressive.
3. Competent (3): Explored current knowledge; presented innovative
ides; informative and impressive.
4. Moderate (2): Simple ideas; just prepared and presented
5. Improve (1): Simple ideas; Incompetent.
2. 1. Exemplary (5): Application of technical knowledge- highly
Applications professional; outcome based; applied according to the environment
efficiently; responded the questions; economical and time saving.
2. Proficient (4): Application of technical knowledge- professional;
outcome based; applied according to the environment; responded the
questions.
3. Competencies (3): Application of technical knowledge- just
professional; somewhat outcome based; responded a few the
questions.
4. Moderate (2): Just attempted; inadequate applications.
5. Improve (1): Simple applications; inappropriate.
3. Style Exemplary (5): Handled the words brilliantly; impressive voice;
effective facial expressions; unique style; focused thoughts.
Proficient (4): Handled the words brilliantly; impressive voice; unique
style.
Competent (3): Handled the words properly; impressive voice;
effective facial expressions; unique style.
Moderate (2): Mechanical; ineffective.
Improve (1): Just presented.
4. Voice/ Exemplary (5): Audible; pleasant; modulation; lovely tone; clarity.
accent/volume Proficient (4): Audible; pleasant; modulation; clarity.
Competent (3): Audible; pleasant; modulation.
Moderate (2): Audible; simple.
Improve (1): Simple.
5. Attributes Exemplary (5): Positive body language; natural state; firm; flexible;
consistent and casual eye contact.
Proficient (4): Positive body language; natural state; firm; eye contact.
Competent (3): Positive body language; natural stature; firm.
Moderate (2): Natural stature; firm inadequate body language.
Improve (1): Just presented; improper body language.

Rubrics are a way of explicitly stating ‘what is the expected student performance in a

9
10
NBA’s Outcome Based Education: Communication Skills Assessment Model Using Rubrics

chosen area of learning’. They may lead to a grade or a score but they are necessarily
more specific and more detailed than a grade or a mark-sheet. Rubrics imagine a student
performance to be comprised of many levels and provide descriptors for the performance
at each level. These descriptors help students know what they need to work on in future
so as to improve their performance. They tend to increase overall reliability of the
assessment process especially when more than one evaluator is present for assessing
the communication skills. Moreover, they provide a common language of interaction
between teacher, evaluator, and the students. Table 4 describes overall reliability of the
assessment process of non verbal communication skills.
Table 4 Non Verbal Communication Skills Rubric
Proficient More Proficient Most Proficient
Eye Speaker displays Speaker holds the Speaker holds the attention
contact minimal eye attention of the entire of the entire audience with
contact with audience with the use the use of direct eye
audience. Student of direct eye contact contact. Students rely on
sometimes reads most of the time. notes for prompting only.
from notes. Student relies on notes
for prompting only.
Poise Speaker Speaker stands up Speaker stands up straight
sometimes stands straight. Makes minor and displays a relaxed,
up straight. mistakes, but quickly self-confident nature with
Displays mild recovers from them; no mistakes.
tension; have displays little or no The movements seem
trouble recovering tension. The fluid, enhance the
from mistakes. movements seem fluid audience’s understanding,
Very little and help the audience and help the audience
movement or visualize. visualize.
descriptive
gestures.
Volume Speaker’s voice is Speaker’s voice is loud Speaker’s voice is loud
low. Audience enough to be heard by enough to be heard by all
members have most audience audience members
some difficulty members throughout throughout the whole
hearing the whole presentation. presentation.
presentation.
Clarity Speaker mumbles Speaker uses a clear Speaker uses a clear voice
at times and/or voice and pronounces and practice pronunciation
incorrectly most words correctly. of words.
pronounces some
words.
Rate Speaker speaks at Speaker speaks at a Speaker speaks at a
an inconsistent steady pace for most of steady pace; changes in
rate throughout the presentation but at rates are purposeful.
most of the times is too fast or too
presentation. slow.
Tone Speaker’s delivery Speaker’s delivery Speaker’s delivery

10
11
NBA’s Outcome Based Education: Communication Skills Assessment Model Using Rubrics

rarely matches the matches the emotion of matches the emotion of the
emotion of the the topic most of the topic. The presenter
topic and /or rarely time. The presenter establishes the appropriate
establishes the establishes the atmosphere for the
appropriate appropriate atmosphere audience toward the topic.
atmosphere for the for the audience toward
audience toward the topic most of the
the topic. time.

Rubrics for stage speaking skills


Rubrics contain three components: 1. Dimensions (Indicators/ Performance criteria)
2. Scale (levels of performance), and 3.Score with discussions. For example, see the
rubric given in Fig 2 that is Communication Skills Laboratory (GE1352) of 2008 Syllabus)
offered in Anna University, Chennai under Govt. of Tamil Nadu for assessing students’
stage speaking skills. Using this rubric, the student is judged for the outcome related to
graduate attributes number 10 viz. Communication. Copy of this rubric is given to the
class when dates of speaking skills are announced. Assessment of the student
presenting is done by the peers in his group. It is interesting to see that in spite of
multiplicity of the evaluators (typically 10 to 12) hardly any deviation is reported in
the assessment of any particular student.

This also shows accuracy of the assessment tool. If deviation in peer group rating is
objectionably large, descriptors or dimensions or both, can be modified by talking to the
group and removing any element of subjectivity in the given rubric. Student is
encouraged to work on his stage presentation till he comes up to at least level 3 in his
performance. Since the rules of the competition are known and the assessment fair,
students enthusiastically participate in ‘level improvement competition’. Round number
in the assessment signifies number of the attempts that have been put in for the
improvement.

The faculties enlightened on speaking skills and how one can enrich and enhance.
‘While learning a language, being able to articulate what one wants to say can be one of
the most rewarding achievements of all language skills. Speaking is one of the essential
skills of real life in the present day job market. This skill raises the self esteem of a
student and helps in getting proper employment. Therefore, the focus has transferred to
acquiring speaking skill for qualification at under graduate level of professional
education’.
The faculties insisted that stage speaking skills are imperative because they play a vital
role in students' learning in all areas of the curriculum and industry expects candidates
to address the small gathering at certain issues at later stages. The students need to
listen keenly and speak in order to understand and explore ideas and concepts, identify
and solve problems, organize their experience and knowledge, express and clarify their
thoughts, feelings, and opinions, and convey information. Listening and speaking skills
are also essential for cooperative learning activities and for social interaction at home,
at college, and in the society (Table 5). The scores were recorded without and with
rubrics for the speaking skills and presented for the study.

11
12
NBA’s Outcome Based Education: Communication Skills Assessment Model Using Rubrics

Table 5 Speaking skills Rubric


Indicator Levels of achievements
of stage
presenter
1. Introduction Most competent (5): Gets the attention immediately; reveals the
topic; established credibility; uses stories, shocking statics and
quotations; ask questions.
More competent (3): Gets the attention; reveals the topic; uses
stories and quotations; asks questions.
Competent (1): Reveals the topic; asks questions.
2. Most competent (5): Well organized like a narration of a story; has
Development components of introduction, main body and conclusion; developed
of main body the topic with the perspective from the audience and the
of the speech evaluators; delivered within the time frame; well received by the
audience.
More competent (3): Somewhat organized; has all the components;
well received by the audience.
Competent (1): Better organization is needed; just attempted.
3. Language Most competent (5): Language is easy to comprehend; words are
intelligible to the topic and pleasing to hear; words, phrases and
sentences are impressive; well received by the audience due to
clarity.
More competent (3): Language is somewhat easy to comprehend;
words are pleasing to hear; well received by the audience due to
clarity.
Competent (1): Words are simple; sentences are just constructed
and presented.
4. Style Most competent (5): Built good rapport with the audience;
possesses a good vocal quality; able to grab the audience within a
few seconds; avoided monotony and used humour and quotes
effectively; avoided slangs and jargons.
More competent (3): Built good rapport with the audience;
possesses a good vocal quality; able to grab the audience; avoided
monotony and used humour and quotes.
Competent (1): Built somewhat rapport with the audience; able to
make audience to listen.
5.Voice Most competent (5): Voice is clear; audible and pleasant;
expressed ideas with proper pronunciation and pause; control over
the rate of delivery; modulation is quite natural.
More competent (3): Voice is clear; audible; expressed ideas with
proper pronunciation and pause; control over the rate of delivery.
Competent (1): Audible; modulation is less artificial.

12
13
NBA’s Outcome Based Education: Communication Skills Assessment Model Using Rubrics

6. Body Most competent (5): Maintained eye contact properly; the facial
Language expression is quite natural and positive; used positive gestures and
avoided fingers; used appropriate body movements; appropriate
postures.
More competent (3): Maintained eye contact; the facial expression
is natural; used appropriate body movements.
Competent (1): Maintained somewhat eye contact; used
appropriate body movements.
7. Conclusion Most competent (5): Concluded with appropriate quotations;
summarized with key points; reinforced the central idea; ended with
dramatic statements; concluded unexpectedly.
More competent (3): Concluded with quotations; summarized with
points; reinforced the central idea.
Competent (1): Concluded with some points; ended with
statements.

Implementation Issues:
Teaching faculty is at the heart of assessment process. Faculties must be involved in
rubrics development where they can offer insights based on their collective and
cumulative assessment experience. They may start with holistic rubrics first and then
refine them gradually into meaningful and workable analytic rubrics. Faculty consensus
on rubric is crucial to the fair and reliable outcome assessment.

Development and use of rubrics is a time consuming process and due regard should be
given to this fact while deciding a teacher’s load. If possible, teaching assistants should
be employed to facilitate the assessment work.

Outcome definition should be precise and clear before a rubric is developed for its
assessment.

It should be noted that rubrics are not needed for all the outcomes being assessed.
They are needed only where the assessment is likely to become more subjective.

While evaluating the data obtained from assessment process, it should be noted that
not all students are expected to attain all the outcomes. We are expected to develop our
own and realistic benchmarks for outcome attainment level.

Contribution of Rubrics for communication skills


Rubrics contributed to student learning and program improvement in a number of ways
and rubrics helped the faculties in enhancing communication skills. The faculties stated
that the advantages of rubrics for communication skills when assess using rubrics are
as follows:

 Allowed assessment to be more objective and consistent


 Helped focus to clarify his/her criteria in specific terms
 Provided useful feedback regarding the effectiveness of the instruction
13
14
NBA’s Outcome Based Education: Communication Skills Assessment Model Using Rubrics

 Provided benchmarks against which to measure and document progress

The students reported that


 Helped them define ‘quality’
 Promoted them awareness about the criteria to use in assessing peer
performance
 Helped them judge and revise their own work before handing in their
assignments
 Clearly shown them how their work will be evaluated and what is expected

Finally, there are also benefits for parents. A rubric:


• Clearly communicates teacher expectations.
• Provides a more objective assessment of student performance.
• Supports parent understanding of significant curricular objectives.
• Focuses discussions with teachers on student work rather than on the teacher’s
decisions.
(Jamison, 1999; Volk, 2002)

Conclusions
Rubrics are very constructive for teacher assessment or second language student of
self-assessment, especially in higher education institutions. They evaluate a student’s
performance based on the sum of a full range of criteria rather than a single numerical
score. The criteria are logically linked to the outcomes intended for a learning activity.
Teachers can increase the quality of their direct transaction by providing focus,
emphasis, and attention to particular details to direct student learning. Students have
open guidelines regarding teacher expectations. Students can use rubrics as a tool to
develop their communication skills and abilities. Teachers can reuse or slightly modify
an established rubric for language developmental activities.

Because communication skills are crucial to the success of professionals, teachers


need effective ways to assess business students’ communication skills. The authors
devised a multi‐faceted assessment of higher education students’ oral presentation,
speaking skills etc. These communication samples were rated by a team of trained
language teachers using rubrics developed for this purpose. With respect to
components of communication skills, the findings indicate that students were in the
'developing' but approaching the 'competent' level in all dimensions.

It is suggested that the teachers of English of higher education colleges need to use the
outcome of this study to identify students’ strengths and weaknesses to make changes
in communication skills course content and teaching methods that will enhance
students’ communication skills as they enter the 21st century.

There was feedback from students indicated that they found the rubrics very helpful in
clarifying performance and promoting self-assessment, whilst the faculties felt that it
was a time efficient and informative method of providing feedback. While implementing
rubrics, faculty’s consensus and active involvement is a must. Since rubrics

14
15
NBA’s Outcome Based Education: Communication Skills Assessment Model Using Rubrics

development and use is a time consuming process, due regard has to be given to it
when deciding a teacher’s load. Initial work inputs and entry level barriers involved in
outcome based education in general, and rubric development exercises in particular,
are understandably high. It is hoped that Indian teaching fraternity will not only adapt
itself to outcome based education system but will also see its own creativity unleashed
in the process.

Technical institutions who have been accredited, offer an excellent opportunity to


assess the attributes of engineering students in their final year of studies. For the
purposes of accreditation and outcomes assessment, outcome of this article can be
used.

References
Andrade, H. (2000). Using rubrics to promote thinking and learning. Educational
Leadership 57 (5), 13-18.
Ashley Kranov, Michael Milligan, Joe Sussman, (2010) ‘Dispelling Myths: Common
Misconception about ABET and Accreditation’, ABET Annual Conference, October
2011
Bloom, B.S. (1977). Taxonomy of Educational Objectives: The Classification of
Educational Goals. Handbook I: Cognitive Domain. New York: Longman

Catherine Hack (2013), Using rubrics to improve marking reliability and to clarify good
performance, The Higher Education Academy.
Hancock, A.B & Brundage, S.B (2010). Formative feedback, rubrics, and assessment of
professional competency through a speech-language pathology graduate program,
Journal of Allied Health 39, 110-9
Jamison, P. (1999). Student evaluation a staff development handbook. Regina, SK:
Saskatchewan Education and Saskatchewan Professional Development Unit.

Nordrum, L., Evans, K. & Gustafsson, M. (2013), Comparing student learning


experiences of in-text commentary and rubric-articulated feedback: strategies for
formative assessment, Assessment & Evaluation in Higher Education DOI:
10.1080/02602938.2012.758229
Reddy, YM & Andrade, H. (2010). A review of rubric use in higher education,
Assessment and Evaluation in Higher Education, 35, 435-448.
William Bishop, Oscar Nespoli, & Wayne Parker (2012), ‘Rubrics for Accreditation and
Outcomes Assessment in Engineering Capstone Projects, Proc. 2012 Canadian
Engineering Education Association (CEEA12) Conf.
UNESCO, 2010, Engineering: Issues Challenges and Opportunities for Development,
UNESCO Report, UNESCO Publishing
Watson, P. (2002). The Role and Integration of Learning Outcomes into the Educational
Process. Active Learning in Higher Education 3(3), 205-219.

15

Вам также может понравиться