Академический Документы
Профессиональный Документы
Культура Документы
Color-Encoded Music Scores: What Visual Communication Can Do for Music Reading
Author(s): Celso Wilmer
Source: Leonardo, Vol. 28, No. 2 (1995), pp. 129-136
Published by: The MIT Press
Stable URL: http://www.jstor.org/stable/1576134
Accessed: 03-07-2015 05:46 UTC
Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at http://www.jstor.org/page/
info/about/policies/terms.jsp
JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of content
in a trusted digital archive. We use information technology and tools to increase productivity and facilitate new forms of scholarship.
For more information about JSTOR, please contact support@jstor.org.
The MIT Press and Leonardo are collaborating with JSTOR to digitize, preserve and extend access to Leonardo.
http://www.jstor.org
This content downloaded from 148.206.159.132 on Fri, 03 Jul 2015 05:46:31 UTC
All use subject to JSTOR Terms and Conditions
GENERAL
ARTICLE
Color-Encoded
Music
What
Can
Visual
Do
for
Scores:
Communication
Music
Reading
ABSTRACT
Visualcommunication
and
Piaget'spedagogicaltheorycan
be appliedto musicreadingwith
interestingresults.Thepurpose
of the author'sprojectis to make
musicalscores easierto readand
playandthusfacilitatethe teachingof music.Thisarticlede-
CelsoWilmer
? 1995 ISAST
~---:L--
L:--
---..;.:
......
t.....'J
r 4^r~~ffLa
V:#:Io^L.I^ c^ f
?--.-l
N I
This content downloaded from 148.206.159.132 on Fri, 03 Jul 2015 05:46:31 UTC
All use subject to JSTOR Terms and Conditions
Except for intensity directions, practically all the graphic elements in a musical score relate to the pitch and the duration of notes. Let us begin with pitch.
Self-Evident Representation
of Pitch
The first question a layperson might ask
about Fig. 1 is: "Which key should I
press?"
To show clearly the correspondence
between the lines and spaces in the staff
(where the notes are placed) and the piano keys, the score need only represent
a keyboard, with the same lines as those
in the staff marked on it [2]. (This correspondence is brought home in Fig. 2,
which will be explained in due time. As
examination of Fig. 2 shows, the system
employs exactly the same staff lines as
those used in the traditional system.)
A
Fig. 2. The Raindrop score for the
passage from
Mozart's Sonata
XVI pictured in Fig.
1. (a) The notation
is written according
to the new system.
(b) The keyboard
diagram with the
same lines as the
staff shows the correspondence between notes and
keys. (c) The correspondence is the
same as that in the
traditional system,
which allows immediate conversion of
a score from the
new system to the
old, and vice versa.
IA1
.1
.v
I
IA
*^
uh
i
(a)
q |11|
__ Cl- 11
----
Ill 1. I II
--'
'
r' -_-
ii
w..::X
t
I.
I
i-------t.l.s:X
(b)
I I
do so is that it was devised with the intention of recording vocal music, long
before the piano had been invented.
But, given the pressing need for making
readers' response to the score as prompt
as possible, the representation of pitch
from bottom to top is anachronistic and
unjustifiable [3].
The staff should be vertical rather
than horizontal, so that pitch variation,
which is perpendicular to it, may be represented analogously to its arrangement
on the keyboard. This means that the
musical text can progress either from
top to bottom or from bottom to top, in
either case accompanied by the keyboard diagram.
But we will make our choice only after the criteria involved are better understood. Although at first it would
seem that just about anyone would favor a top-bottom direction, caution is
required before accepting the dictates
of common sense unfounded on pedagogical sense.
REQUIEM FOR AN
UNWRITEN OPUS
The resort to an imaginary conveyor belt
should not deceive us as to the real convenience of this form of representing duration. For if in place of the wax-covered
belt we have a paper reel and instead of
fingers we have pens activated by keys,we
get an automatic way to record music on
paper. Since the complexity of such a
mechanism surely does not exceed that
of a piano, it follows that this method has
(c)
130
This content downloaded from 148.206.159.132 on Fri, 03 Jul 2015 05:46:31 UTC
All use subject to JSTOR Terms and Conditions
Conceptual
C33
(IIi5
Graphic
musical ideas such as pitch and duration) from one level to the next, on
each of which the idea must be elaborated before progress is possible:
concrete -> graphic -, conceptual
Concrete
PIAGETAND MUSIC
TEACHING
Let us now turn to pedagogy to find a
criterion for choosing the most ador botequate direction-top-bottom
tom-top-for reading a musical text, as
well as to find corroboration for the decisions we have already made.
As a result of the in-depth research
into cognitive development in children
carried out byJean Piaget (1896-1980),
mathematical education has undergone
a major revolution in recent years. One
consequence of this revolution is the
present practice of making abundant
use of concrete materials and graphic
resources as necessary aids in the process of abstraction of mathematical concepts [5]. The same must be accomplished for teaching music. Let me sum
up Piaget's thesis in a few words: There
is a natural order in the abstraction of
any new idea by a learner (in this case,
Round
Drop
Sharp
Drop
Flat
Drop
Tone
Sharped lbne
Fig. 4. Musicalnotes in the new system.
Eachnote of the scale in use is represented
by a round drop. Accidentalalterations
(sharpsand flats) thatraise or lowerthe
note by a semitone are representedby the
sharpdrop and flat drop.Withthis redefinition of the concepts of sharpand flat, the
new score is the same for anykey.
sounds
colors
COLORlf
CODE 1Q
CONCLUSION
COLORS
ABOUT
J
EXAMPLE OF A RAINDROP
SCORE
Referring to the Raindrop score of the
passage from Mozart's Sonata XVI (see
Fig. 2) one can determine the following:
1. The positions of the symbols show
which key to play for each note, since
the same lines appear in the keyboard
diagram and in the staff.
2. The number of beats to each measure (3) and the duration (length) of
each beat are shown graphically, instead
indicated by the symbol
3. The staff is a Cartesian axis, divided
in numbered measures of equal length.
It is also subdivided into beats or other
This content downloaded from 148.206.159.132 on Fri, 03 Jul 2015 05:46:31 UTC
All use subject to JSTOR Terms and Conditions
131
Dmin FMi,
Avm
BC
c Mj
Z ma
(a)
(b)
(c)
132
Mi
nM
EASY-TO-TRANSPOSE SCORES
Key transposition is the process by which
the key of a musical piece is changed in
order to adapt it to a singer's register, to
allow more convenient fingering on a
different instrument or to otherwise
adapt the piece to musicians' needs.
Generally speaking, any given composition will tend to predominantly use the
seven notes in the scale of the key in
which it is written, other notes being understood as alterations of these seven
(accidentals). This is reflected in the design of the piano keyboard: for the key
of C major, the full scale is played on the
white keys, while the accidentals are
played on the black keys. On the piano,
fingering is easiest in C major. On the
guitar, however, A major is the most convenient key; in it the bass line is played
mostly on open strings.
Up to a certain point, the traditional
system acknowledges the frequent need
to effect key transposition. When the
piece uses only the notes in the scale of
its key, all that need be done in order to
transpose it is to raise or lower all the
notes on the staff the same number of
lines or spaces.
But when the piece employs accidentals, transposition in the traditional system requires a complete rewriting of the
text. This is so because accidentals can
be indicated differently in the two keys
involved. For example, the seventh step
in C major is B, whereas in G major it is
F#-hence the sharp sign in the key signature of G major. So this seventh step
lowered by one semitone is, in C major,
B flat (indicated on the staff by t), and,
in G major, natural F (on the staff, #).
It is this use of different symbols (in
this case, 1 and #) that prevents sight
transposition when the musician must
play in a key other than the one in the
score he or she is reading.
To overcome this problem, accidentals
must be treated as functions, in the
mathematical sense of the term. The
sharping function raises the note by one
semitone and the flatting function lowers
This content downloaded from 148.206.159.132 on Fri, 03 Jul 2015 05:46:31 UTC
All use subject to JSTOR Terms and Conditions
COLOR-ENCODED SCORES
As a teaching resource, colors make it
easier to apprehend Gestaltenin music
scores, highlighting the relative values
of the various features. Of all the different ways colors can be used-to signal
repeating passages, the sections of a
song, the parts of a choral, etc.-I believe the most interesting is in notes and
chords.
On the surface level, the use of color
in notes, together with verticalization of
the staff, reinforces the positional representation of pitch, making it easy to
identify the key corresponding to each
note. On a deeper and more original
level, color provides a visual model for
the teaching of certain relationships between sounds that are far from obvious
in the field of harmony. A schema of the
three stages in the development of this
model is shown in Fig. 5.
The first stage in the model's development establishes the correspondence
between notes and colors. Here one
must be careful, for if we are to reach
conclusions concerning relationships
between sounds, it is necessary at this
stage to choose colors that are also related to one another [6]. (The second
stage refers to the observation of the colors, for instance, in a particular chord,
followed by conclusions that can be
drawn from them-such as, blue, purple
and magenta are neighboring colors.
This leads to an initial conjecture and
later to a conclusion in terms of music
such as "this chord.")
The basic relationship between colors
is expressed by their proximity in the
rainbow or in Newton's disk (the color
spectrum in a circular shape). The following circular sequence of colors
should be visually memorized by stu-
(a)
(b)
Fig. 7. Two examples of color-encoded scores. (a) The passage from Mozart's Sonata XVI.
(b) A passage near the beginning of Satie's "Gymnopedie 1." An examination of the colors
shows us that the top example is a classical piece (with the initial chord [here, the tonic]
containing the first three colors-blue, purple and magenta-of the system I propose); the
bottom example, a modern piece (the initial chord contains four colors-yellow, green,
blue and purple; yellow replaces blue [the tonic's color] in the bass).
This content downloaded from 148.206.159.132 on Fri, 03 Jul 2015 05:46:31 UTC
All use subject to JSTOR Terms and Conditions
133
Sonata
XVI
W.A Mozart
E. Satie
A
I
Y
IA
A
(:
A A
12
$1
:1
I:
'4
|I
Al
ISA
10
1
4A0
I --
41
A
A1
9
I'tIMII.it'lMltl
Andante
Fig. 8. Example of a Raindrop Score of the first 16 bars in the andante of Mozart's Sonata XVI. Even in black and white, the notekey correspondence is made clear by the piano keyboard diagram.
hand staff.
On the basis of this particular example, I devised a color code for any
key. Notes were replaced by the steps in
the scale, and chords by harmonic functions. We might say that a harmonic
function is the place occupied by a
chord within a musical piece. Let us
consider the tonic, the subdominant
and the dominant. For instance, in the
Color
blue
purple
magenta
red
orange
yellow
green
134
Step
1 (and 8)
3
5
7
2
4
6
Wilmer, Color-Encoded
Harmonic
Function
I tonic
IIImediant
V dominant
VIIsubtonic
IIsupertonic
IVsubdominant
VIsubmediant
Music Scores
This content downloaded from 148.206.159.132 on Fri, 03 Jul 2015 05:46:31 UTC
All use subject to JSTOR Terms and Conditions
Fig. 10. A triad of notes in the G major scale (G-B-D#)is represented in every system discussed in this article, illustrating the five improvements in music reading brought about by
the new musical notation system: (1) representation of duration by a Cartesian system;
(2) representation of accidental alterations by a functional system; (3) representation of
melody and chords by a color-encoded system; (4) teaching of music reading by a Piagetian
system; (5) dynamic music reading, introduced by the possibility of a video music score
[11].
of Stevie
played in some order (without mentioning their names): F-F maj, F-G
maj, F-Amin (where A min = A + C +
E); the audience
is invited
to ar-
This content downloaded from 148.206.159.132 on Fri, 03 Jul 2015 05:46:31 UTC
All use subject to JSTOR Terms and Conditions
135
ADHESIVE DROPS
The use of color allows an additional resource for immediate identification of
the key to be played for a given note in
the score: colored notes made of adhesive paper. If a student using a score notated with this system glues color paper
notes onto the piano keys-following
the keyboard diagram-his or her eyes
can move directly from the score to the
instrument, skipping the diagram. (The
same can be done on a guitar or other
stringed instruments.)
136
(G. Schirmer,
(London:
manuscript
written in
11. A video score is a common videotape that exhibits a music score written not in the traditional
system, but in a Cartesian system (a necessary condition for it). It moves before the student's eyes at
one of a few metronome-corntrolled
speeds (very
slow, slow, regular), so that it may fit the student's
current needs. It also includes the possibility of the
student's simultaneously
listening to the music of
that score. A prototype of a Rainbow Scores video
score was presented
to the public at the 1993
Mostra Atlantic de Realidade Virtual (Atlantic Virtual Reality Exhibition).
This content downloaded from 148.206.159.132 on Fri, 03 Jul 2015 05:46:31 UTC
All use subject to JSTOR Terms and Conditions