Enter Current Phase Contents Search Site Map
Profile Sample

-Back-

Online Example

Rubric Tutorial

Section C

Section D

Profile Results

 

 
 

PROFILE RESULTS

Below is a web example demonstrating a prototype layout that may be employed by the automated online rubric/profile tool. The examples below depict how the results might look using histograms should multiple users (trained in the application of the rubric) aggregate their responses when evaluating a single instructional material.

At the bottom of this page is an graphic example of how the alignment results might look when comparing alignment across multiple sites.

NOTE: The profile below is still in reversionary stages for layout and content. This is a static profile and is not based off the online rubric section B.

 


Histogram Examples

An example explaining histograms is also available. Just close the pop-up window when finished reviewing the window contents.



Descriptor:

B1a.
Material provides an opportunity to learn how different kinds of questions based on prior scientific knowledge suggests different kinds of investigations.


Data Table:

Seven evaluators selected the following choices:
1, 2, 2, 2, 3, 2, 3

Mean = 2.1

Median = 3.0

Mode = 2

Std. Dev = .69

N = 7


An interpretation of histogram B1a is also available. Just close the pop-up window when finished reviewing the window contents.
 

 

 

 



Descriptor:

B1b. 

Material provides an opportunity to learn that scientists conduct investigation for a variety of reasons. 


Data Table:
Seven evaluators selected the following choices:
1, 2, 2, 3, 3, 3, 4

Mean = 2.6

Median = 3.0

Mode = 3

Std. Dev = .69

N = 7


An interpretation of the histogram B1b above is also available. Just close the pop-up window when finished reviewing the analysis.



Descriptor:

B1c.

Material provides an opportunity to learn that scientists use a variety of tools, technology, and methods to extend the senses.



Data Table:

Seven evaluators selected the following choices:
2, 3, 3, 3, 3, 2, 3

Mean = 2.7

Median = 3.0

Mode = 3

Std. Dev = .49

N = 7

An interpretation of the histogram B1c above is also available. Just close the pop-up window when finished reviewing the analysis.

 

 

 

Descriptor:

B1d. 

Material provides an opportunity to learn that mathematics is essential in scientific inquiry.



Data Table:

Seven evaluators selected the following choices:
3, 4, 4, 3, 3, 3, 2

Mean = 3.1

Median = 3.0

Mode = 3

Std. Dev = .69

N = 7

 

Descriptor:

B1e.

Material provides an opportunity to learn that scientists use evidence, logic, and current scientific knowledge to propose explanations. 



Data Table:

Seven evaluators selected the following choices:
3, 2, 1, 1, 1, 1, 2

Mean = 2.6

Median = 1.0

Mode = 1

Std. Dev = .79

N = 7


Back to Top of Page

 


Graphic Example:  
Comparing Different web sites

Now instead of presenting the graphic profile for the entire rubric as aligned against one site, the example below depicts how the profile might be generated should an evaluator or curriculum specialist want to compare a single section of the rubric against multiple sites that have been evaluated. Only one criterion in section C of the rubric will be used for this example profile layout. Please look below the example for cautions when numerical ratings and comparing different types of web sites.

C3.Proposing Answers

Material...
C3a. ...engages learners in proposing answers and explanations to questions


Caution:
It may be helpful to reiterate that sites varying by several tenths in alignment are not significantly different from one another with respect to the NLIST rubric. 

The numeric values displayed when comparing several web sites within a specific section of the rubric section will actually be displaying the "average" degree of alignment as determined by multiple, trained and proficient users of the rubric. The profiles are generating overall averages of alignment and not holistic summative point values or individual frequency distributions.

Finally, it would seem erroneous to compare an entire web like NASA CONNECT to an individual activity like AAAS Peanut. This would be comparing apples to oranges. It would also seem difficult to compare one large site like GLOBE to another large site like CONNECT because of the enormous amount of information contained in each web. The difficulty in comparing large web sites lies in defining/classifying which portion of each web the rubric is being aligned with. Our rubric at this point in its development appears more geared toward aligning one specific learning experience against another versus evaluating one large web site against another large web site. This is an issue that will need to be addressed by NLIST and future users of the instructional materials rubric.


Back to Top of Page

 

 

    Send comments to webmaster@inquiryscience.com
© NLIST 2004 Last modified: February 1, 2004