Note: To protect the privacy of our members, e-mail addresses have been removed from the archived messages. As a result, some links may be broken.

Lesson Plans


NAEP ARTS REPORT

[ Thread ][ Subject ][ Author ][ Date ]
National Art Education Association (naea)
Mon, 23 Feb 1998 16:48:41 -0500 (EST)


NATIONAL ART EDUCATION ASSOCIATION
Office of the Executive Director
Phone 703-860-8000 Fax 703-860-2960
Home Page-http://www.naea-reston.org
E-mail: naea

FOR RELEASE
,
CONTACT: MICHAEL DAY (NAEA PRESIDENT)
PHONE 801-378-2489 FAX 801-378-5964

ADVANCE COPY-NAEA NEWS, NAEA PRESIDENT'S COLUMN, APRIL 1998

INTERPRETING THE 1997 NAEP ARTS REPORT

>From the President

National Assessment of Educational Progress (NAEP) in Visual Art
About the time school begins in Fall 1998, an important event will occur
that will make a significant impact on the field of art education. This is
the release of the 1997 NAEP Arts Report. For a brief period after release
of this report, the news media as well as local, state, and national
educational policy makers will focus on the arts in education.

Will release of this report be a positive occasion for art education? Will
this professional field gain stature and support as a result of the 1997
NAEP Arts Report? The answers to these questions will depend to a large
extent upon the members of this Association, our colleagues, and friends.
Will art educators be prepared to interpret the NAEP Arts Report? What do
we need to do to become prepared? How can we shape this event in support of
our mission to provide substantive art education for all children and young
people in America?

What is NAEP?
NAEP is a congressionally mandated program of the National Center for
Education Statistics at the U.S. Department of Education. The NAEP program
is administered by the Commissioner of Education Statistics, who is
responsible for providing continuing reviews, including validation studies,
on NAEP's conduct and usefulness.

Often called the "Nation's Report Card," the National Assessment of
Educational Progress (NAEP) is the only nationally representative,
continuing assessment of what America's students know and can do in various
subject areas. The assessment has been conducted regularly since 1969, but
only occasionally has it assessed learning in the arts.

What are the NAEP Arts Tests?
Since its inception in 1969, NAEP has assessed numerous academic subjects,
including mathematics, science, reading, writing, world geography, U.S.
history, civics, social studies, and the arts. The last arts test was
conducted in 1980.

The 1997 NAEP Arts Assessment included a small-scale operational assessment
(probe) of visual arts, music, and theatre at grade 8 and a field test of
visual arts, music, theatre, and dance at grade 12. The assessment involved
6,000 eighth grade students in public and private schools. National samples
of students were used in art and music; in theatre, NAEP assessed targeted
samples of students enrolled in theatre classes, and a dance instructional
program survey was administered to a sample of middle school dance
teachers.

The framework for the NAEP Arts Assessment is organized according to the
processes of creating, performing/interpreting, and responding. The two
major content components are:

* knowledge and understanding about the arts, including the
personal, historical, cultural, and social contexts for works; and

* perceptual, technical, expressive, and intellectual/reflective
skills.

In both the 8th grade test and the field tests for grades 4, 8, and 12, the
assessment consisted of a set of paper-and-pencil items for the entire
group, completed at the students' desks, and lasting from 60-90 minutes. A
smaller sample of students completed a set of performance exercises lasting
approximately 120 minutes.

Several innovations in NAEP testing practices are associated with the NAEP
Arts Assessment. For some items, NAEP integrated content and process,
emphasizing performance tasks that were rigorous, demanding, and authentic.
In music exercises, for example, students improvised compositions based on
a piece of music and evaluated their compositions. For some visual arts
exercises, students responded to questions about a work of art and created
pieces themselves.

The process used to gather student responses for evaluation of arts
learning also departed from previous NAEP assessments. For some items,
student performances were videotaped or audiotaped, and student art work
was photographed or collected intact. Most of the questions used in NAEP
assessment remain secure or confidential to protect the integrity of the
assessment. NAEP ordinarily releases nearly one-third of the questions used
in each assessment, making them available for public use.*

When will the NAEP Art Results be reported?
The 1997 NAEP Arts Report is scheduled for public release in September 1998.

How are NAEP test results reported?
NAEP reports information for the nation and for specific geographic regions
of the country: Northeast, Southeast, Central, and West. NAEP provides
results about subject-matter achievement, instructional experiences, and
school environment, and reports these results for populations of students
(e.g., fourth graders) and subgroups (e.g., male students or Hispanic
students). Because the achievement scales for each subject are developed
independently, it is not possible to compare achievement level results
across school subjects.

This national assessment program collects and reports information related
to academic achievement and contextual background. NAEP is not designed to
report scores for individual students and scores cannot be linked to
students, teachers, or schools. (The program guarantees that all data
related to individual students and families remain confidential). The
national NAEP samples are not designed to support the reporting of
representative state-level results, thus, it will not be possible to make
state by state comparisons of results for the NAEP Arts Assessment.

Why is NAEP important to art educators?
NAEP makes objective information about student performance available to
policy makers at national and state levels. The focused national reports
provide valuable information for evaluation of conditions and progress of
the nation's education. There is some validity, as well, in the observation
that what is important in education is evaluated. The fact that this NAEP
assessment is dedicated to the arts is a positive indication that art is
valued within the context of general education.

The assessment itself is instructive to art educators in at least two ways.
First, educational assessment is a central component for responsible arts
education. The NAEP tests will provide the field with useful information
regarding assessment of visual arts knowledge and skills, especially as
some actual test items are released for study and use in other assessments.

Second, the NAEP Arts Education Assessment Framework was developed
concurrently with the National Standards for the Visual Arts. Although they
differ in some respects, the two documents share a common vision for art
education. The 1997 NAEP Arts Report will provide the first national art
assessment of student achievement consistent with the National Standards.

What will the results of the 1997 NAEP Arts Report indicate?
To date, NAEP has not communicated exactly how the arts assessment results
will be reported. Apparently the report will not employ the three
achievement levels (Basic, Proficient, and Advanced) as with the 1996
Science Report and the planned 1998 assessments of civics, reading, and
writing.

More likely, the 1997 NAEP Arts Report will present student results in
percentile groups, with examples of assessment items correctly answered by
a predominance of the students in each percentile group. A second reporting
method will examine the performance of demographic groups of students
(income levels, gender, types of schools, etc.).

If the 1996 NAEP Science Report is an indicator, student achievement
results might be relatively low. For example, for the national sample of
students at grade 8, 39% scored below the Basic achievement level for
science. A total of 29% scored at the Proficient (26%) or Advanced (3%)
levels. Looking at the scores another way, 71% of 8th grade students scored
below the Proficient level in science.

Low scores on achievement tests are never welcome news to parents,
students, educators, and communities. When low scores are reported, causes
for the problem are often sought. Sometimes schools and teachers are blamed
for low performance by students. How will art educators respond to the NAEP
art results, if scores are low? Are low scores the reflection of
ineffective teaching?

How shall art educators interpret the results of the 1997 NAEP Arts Report?
Explaining scores is one example of how art educators can interpret NAEP
results for the public. For example, low scores might signal poor teaching,
but other factors must be considered as well, such as the likelihood that
students who were tested for achievement in art actually did not receive
regular art instruction.

The sampling method used by NAEP does not distinguish among students from
grades K-8 with various histories of art instruction. This means that, very
likely, numbers of students tested had very little formal instruction in
art, depending on where they went to school. Other students in the sample
might have had excellent regular art instruction consistent with
recommendations of the National Standards. Results of the NAEP Arts
Assessment, then, will reflect not only student achievement resulting from
formal instruction in art, but it will also reflect the degree to which art
is a regular part of the school curriculum. Hopefully, we will have the
task of interpreting high as well as low student scores.

Art educators need to be aware of what information the results of the 1997
NAEP Arts Report provide and what the information represents. The 1997 NAEP
Arts Assessment in the visual arts is based on a sample of only 2,500
students at the eighth grade level. A field test of 1,200 twelfth grade
students also was conducted in 1997.

In contrast, the 1998 NAEP Civics Assessment includes 6,000 students at 4th
grade, 8,000 students at 8th grade, and 8,000 students at 12th grade. The
1998 Reading Assessment sample includes 32,000 students in 4th, 8th, and
12th grades. The 1980 NAEP Art Assessment included a total of 33,000
students at grades 4, 8, and 12.

Results for the 1997 NAEP Arts Report, then, are based on a relatively
small sample that includes only 8th grade students. The grade 12 visual
arts field test will be reported in a "process report" that does not
provide student achievement data. Field tests for grade 4 and grade 8, were
conducted and will be reported with the grade 12 process report.

Art educators can interpret results of the 1997 NAEP Arts Report with the
understanding that a complete assessment with a larger national sample for
grades 4, 8, and 12 would have provided much more useful information.

What about the next NAEP Arts Assessment?
The National Assessment Governing Board (NAGB) determines which school
subjects are assessed and sets the schedule for assessments. According to
the pattern from 1980 to the present, the four subjects regularly assessed
are mathematics, science, reading, and writing. These are the four subjects
that make up the NAEP Long-Term Trend assessments, which constitute a
longitudinal study of student achievement with consistent test items. The
arts have not been included in Long-Term Trend assessments.

Where do the arts figure in plans for future NAEP assessments? During the
17 years between the 1980 and the 1997 NAEP Arts Assessment, assessments
have been conducted and reported for citizenship/social studies,
literature, computer competence, U.S. history (twice), civics (twice),
document literacy, and geography (twice) in addition to the regular
assessments of reading, writing, mathematics, and science. The good news is
that the arts are on the schedule for a full scale assessment in 2007,
establishing a pattern of a 10-year cycle for NAEP assessment of arts
education.

What can art educators do to prepare for the 1997 NAEP Arts Report?
Art educators can focus on positive aspects of the 1997 NAEP Arts Report
and communicate those aspects to their communities:

* The fact that the arts were assessed nationally is a significant
event. This assessment serves to confirm the place of the arts in the
regular curriculum.

* The NAEP tests are based on a solid framework for assessment of
student learning, developed by art educators, and published by the National
Assessment Governing Board (see references).

* Release of the NAEP results provides an ideal opportunity to
communicate that there are indeed National Arts Standards for student
learning. Data from the Status of the States Reports (see NAEA's home page
at www.naea-reston.org) indicate that most states have adopted or adapted
the Standards.

* The NAEP Assessment demonstrates that student learning in art can
be assessed on a large scale. All students, not just a talented few, can
learn about and through art and their progress can be assessed.

* The 1997 NAEP Arts Report will demonstrate that many children
achieve in art, but some don't, possibly because they have not had the
opportunity to learn. All children should receive regular art instruction
by qualified art teachers.

A number of actions and strategies are available for art educators to call
attention to and gain support for their art programs:

* Keep in touch with your state art education association. Your
state president regularly receives information from the NAEA organization
(Regional Vice-Presidents, Division Directors, Reston office, etc.).

* Watch for publications from NAEA on this topic, such as the
NAEAnews, Art Education, NAEA Advisories, and other mailings from your
national professional organization.

* Inform your art education colleagues about the 1997 NAEP Arts
Report and do the same for community members who might become your
advocates when the report is released.

* Know the status of art education in your state, e.g., art
requirements; budget for art education; requirements for art instruction at
elementary, middle, and high school levels; art requirements for
graduation, instruction by art specialists, and so forth.

* Use this opportunity to describe art learning in your program
(local, district, state) and promote the need for assessment of student
progress and program effectiveness.

* Use documents such as the Arts Education Assessment Framework and
the National Standards for the Visual Arts in your communications.

* Alert administrators, school boards, parent organizations, and
others to the anticipated release of the 1997 NAEP Arts Report. Assist them
with information they will need to respond to the results.

* Hold a press conference in a school with an outstanding art
program, and show examples of student learning, student work, and
assessment strategies.

* Communicate and collaborate with colleagues in other arts
organizations within the state, such as arts councils, education
departments, colleges and universities with art education programs, and
educators in music, theatre, and dance. Send a unified message on the
importance of the arts in education.

* Reinforce the place of art in the regular curriculum for all
students as an essential component for general education. Every child
should receive a balanced, sequential, and high quality program of
instruction in the arts taught by qualified art, music, theatre, and dance
teachers and supported by artists and arts organizations.

If we make the effort to prepare in advance of the 1997 NAEP Arts Report,
we might take advantage of opportunities to communicate with a wide
audience of citizens willing to support and improve art education. NAEA
will continue to publish ideas and strategies that relate to the 1997 NAEP
Arts Report.
-----------
*Sample questions can be obtained from NCES, NAEP Released Exercises, 555
New Jersey Avenue NW, Washington, DC 20208-5653.

References
Consortium of National Arts Education Associations (1994). National
Standards for Arts Education: Dance, Music, Theatre, Visual Arts. Reston,
VA: Music Educators National Conference.

Council of Chief State School Officers (1998). The 1997 NAEP in Arts
Education. Washington, DC: Two-page flyer published by CCSSO.

National Art Education Association (1995). Visual Arts Education Reform
Handbook. No. 216: The National Visual Arts Standards, Jeanne Rollins,
Chair. Prepared in response to the Goals 2000: Educate America Act. Reston,
VA: NAEA.

National Art Education Association (November 1997). National Assessment
Gears Up for Reporting Arts Results, press release. Reston, VA: NAEA.

National Assessment Governing Board (1994). Arts Education Assessment
Framework, pre-publication edition. Washington, DC: U.S. Department of
Education.

National Assessment Governing Board, (1994). 1997 NAEP Arts Assessment and
Exercise Specifications, Excerpts for the Visual Arts, provided by The
National Art Education Association, Reston, VA.

National Assessment Governing Board (1997). What Do Students Know?: 1996
NAEP Science Results for 4th, 8th, & 12th Graders. Washington, DC: U.S.
Department of Education.

National Center for Education Statistics (1997). The NAEP Guide: A
Description of the Content and Methods of the 1997 and 1998 Assessments.
Washington, DC: U.S. Department of Education.

Resources from NAEA

A Priority for Reaching High Standards
An overview of the importance of standards, how they relate to state
frameworks and district curriculum guides. Also includes extensive Goals
2000 and visual arts resources. 8 1/2" x 11." 11 pgs. Bulk copies are
available, while supplies last, from NAEA at $1.00 per copy, plus shipping
and handling.

Art Content and Student Learning in Art Education
Describes the nature of art content and substantive student learning. Also
includes examples of content and checklists for short and long range
planning. 8 1/2" x 11." 10 pgs. Bulk copies are available, while
supplies last, from NAEA at $1.00 per copy, plus shipping and handling.

A Look at Performance Assessment for Art Education
Excerpts from The ERIC Review, includes key features of performance
assessment, examples of assessment techniques, and steps for designing
performance-based assessments. 8 1/2" x 11." 15 pgs. Bulk copies are
available, while supplies last, from NAEA at $1.00 per copy, plus shipping
and handling.

NAEP Visual Arts Assessment and Exercise Specifications
Includes excerpts for the visual arts from the NAEP specifications.
Includes specifications used to develop the NAEP assessment, sample
rubrics, and example assessment exercises. 8 1/2" x 11." 71 pgs. Bulk
copies are available, while supplies last, from NAEA at $2.00 per copy,
plus shipping and handling.

No. 216 The National Visual Arts Standards
Jeanne Rollins, Chair. Prepared in response to the Goals 2000: Educate
America Act, lists what every student should know and do in the visual
arts. Includes six content standards K-12. Standards are organized K-4,
5-8, and 9-12. These standards are essential for all art educators as the
framework upon which to design art curricula and instruction for all grade
levels, as well as for art teacher preparation programs. Officially
presented to the Secretary of Education in 1994. A cardinal resource for
curriculum and framework development. 36 pgs. {1994} ISBN 0-937652-65-2
$14.00

No. 409 Purposes, Principles, and Standards For School Art Programs
This newly revised publication is directed toward the promotion and
recognition of educationally sound visual art programs in elementary,
middle/junior, and high schools. It is designed as a self-assessment
evaluation of the seven art education program components: Organization,
Curriculum, Personnel, Scheduling, Facilities, Materials/Equipment, and
Budgets. A nomination form and self-assessment checklist for the Standards
Award is included. 8 1/2" x 11". 33 pgs. {1994} ISBN 0-937652-83-0
$14.00

No. 204 Design Standards for School Art Facilities
Mac Arthur Goodwin, Editor. This visual resource from NAEA includes over
60 photos and floor plan drawings of specialized art studio rooms. The
guide contains Art Room Planning in elementary, middle/junior, and senior
high schools; General Specifications (space, lighting, safety, computers);
and Specialized Art Rooms (ceramics, kiln room, printmaking, technology)
and much, much more. Also included are numerous resources for state and
federal agencies, manufacturers, organizations, and others that keep
current on specifications, codes, health hazard regulations, and
legislation. Includes application forms for Art Facilities Award 8 1/2" x
11."
34 pgs. {1993} ISBN 0-937652-66-0 $14.00

No. 248 Elementary Art Programs: A Guide for Administrators
A landmark volume from the NAEA Elementary Division that addresses
fundamental issues central to the administration of elementary art
education in American schools. It answers questions about key standards
concerning content, materials, instruction, and more. This guide also
addresses 16 fundamental questions school administrators should ask about
elementary art programs and is an important policy resource. It is also
designed to provide suggestions on organizing, implementing, and assessing
elementary art programs. Use with parents and community groups. 24 pgs.
{1992} ISBN 0-937652-58-X $10.00

No. 250 School Art Programs: A Guide for School Board Members and
Superintendents
Guidelines for school administrators concerning what students should learn
in art; components of the art program; curriculum and instruction
essential; professional development; scheduling, facilities, and
equipment/materials; evaluation; staffing; budgeting; and related issues.
Can be utilized as an excellent policy and advocacy resource.
28 pgs. {1992} ISBN 0-937652-64-4 $10.00

ORDER INFORMATION: Payment must accompany order. Shipping and Handling:
Canadian add 25%; foreign add 40% shipping. Virginia residents add 4.5%
sales tax. U.S. shipping/handling: up to $10.00- $2.50; $10.01-$20.00-
$3.50; $20.01-$35.00- $4.50; $35.01-$50.00-$5.50; over $50.00-$7.00. Sorry,
no purchase orders under $75.00. MAIL TO: National Art Education
Association, 1916 Association Drive, Reston, VA 20191-1590.
EXPRESS ORDERS using Visa and MasterCard may be faxed to 703-860-2960 or by
toll free phone to 800-299-8321 (8:30am to 4pm EST).

About NAEA-The National Art Education Association is the world's largest
professional art education association and a leader in educational
research, policy, and practice for art education. NAEA's mission is to
advance art education through professional development, service,
advancement of knowledge, and leadership. Membership includes elementary
and secondary art teachers, artists, administrators, museum educators, arts
council staff, and university professors from throughout the United States
and several foreign countries. It also includes publishers, manufacturers
and suppliers of art materials, parents, students, retired art educators,
and others concerned about quality art education in our schools.

naea
http://www.naea-reston.org