PROFILE RESULTS
Below
is a web example demonstrating a prototype layout that may be employed
by the automated online rubric/profile tool. The examples below
depict how the results might look using histograms
should multiple users (trained in the application of the rubric)
aggregate their responses when evaluating a single instructional
material.
At the bottom of
this page is an graphic example of
how the alignment results might look when comparing alignment across
multiple sites.
NOTE: The
profile below is still in reversionary stages for layout and content.
This is a static profile and is not based off the online rubric
section B.
Histogram Examples
An example
explaining histograms is also available. Just close the pop-up
window when finished reviewing the window contents.
Descriptor:
B1a.
Material provides an opportunity to learn how different kinds
of questions based on prior scientific knowledge suggests
different kinds of investigations. |
 |
Data Table:
Seven evaluators selected the following choices:
1, 2, 2, 2, 3, 2, 3 Mean
= 2.1
Median = 3.0
Mode = 2
Std. Dev = .69
N = 7 |
An interpretation of histogram
B1a is also available. Just close the pop-up window when
finished reviewing the window contents. |
|
|
|
Descriptor:
B1b.
Material provides an opportunity to learn that scientists
conduct investigation for a variety of reasons. |
 |
Data Table:
Seven evaluators selected the following choices:
1, 2, 2, 3, 3, 3, 4 Mean
= 2.6
Median = 3.0
Mode = 3
Std. Dev = .69
N = 7 |
An interpretation of the histogram
B1b above is also available. Just close the pop-up window
when finished reviewing the analysis. |
|
Descriptor: B1c.
Material provides an opportunity
to learn that scientists use a variety of tools, technology,
and methods to extend the senses. |
 |
Data Table:
Seven evaluators selected the following choices:
2, 3, 3, 3, 3, 2, 3 Mean
= 2.7
Median = 3.0
Mode = 3
Std. Dev = .49
N = 7 |
| An
interpretation of the histogram
B1c above is also available. Just close the pop-up window
when finished reviewing the analysis.
|
|
Descriptor:
B1d.
Material provides an opportunity to learn that mathematics
is essential in scientific inquiry. |
 |
Data Table:
Seven evaluators selected the following choices:
3, 4, 4, 3, 3, 3, 2 Mean
= 3.1
Median = 3.0
Mode = 3
Std. Dev = .69
N = 7 |
|
|
|
|
Descriptor:
B1e.
Material provides an opportunity
to learn that scientists use evidence, logic, and current
scientific knowledge to propose explanations. |
 |
Data Table:
Seven evaluators selected the following choices:
3, 2, 1, 1, 1, 1, 2 Mean
= 2.6
Median = 1.0
Mode = 1
Std. Dev = .79
N = 7 |
Back to Top of Page |
|
|
|
|
|
Graphic
Example:
Comparing Different
web sites
Now instead
of presenting the graphic profile for the entire rubric
as aligned against one site, the example below depicts how
the profile might be generated should an evaluator or curriculum
specialist want to compare a single section of the rubric
against multiple sites that have been evaluated. Only one
criterion in section C of the rubric will be used for this
example profile layout. Please look below the example for
cautions when numerical ratings and comparing different
types of web sites.
|
C3.Proposing Answers
Material... |
C3a.
...engages learners in proposing answers and explanations
to questions
|
|

|
|
|
Caution:
It may be helpful to reiterate
that sites varying by several tenths in alignment are not
significantly different from one another with respect to the
NLIST rubric.
The numeric values displayed when comparing several web sites
within a specific section of the rubric section will actually
be displaying the "average" degree of alignment as determined
by multiple, trained and proficient users of the rubric. The
profiles are generating overall averages of alignment and
not holistic summative point values or individual frequency
distributions.
Finally, it would seem erroneous to compare an entire web
like NASA CONNECT to an individual activity like AAAS Peanut.
This would be comparing apples to oranges. It would also seem
difficult to compare one large site like GLOBE to another
large site like CONNECT because of the enormous amount of
information contained in each web. The difficulty in comparing
large web sites lies in defining/classifying which portion
of each web the rubric is being aligned with. Our rubric at
this point in its development appears more geared toward aligning
one specific learning experience against another versus evaluating
one large web site against another large web site. This is
an issue that will need to be addressed by NLIST and future
users of the instructional materials rubric.
|
| Back
to Top of Page |
|
|