|
IMS Question and Test Interoperability Meta-data and Usage DataVersion 2.0 Final Specification |
Copyright © 2005 IMS Global Learning Consortium, Inc. All Rights Reserved.
The IMS Logo is a registered trademark of IMS/GLC.
Document Name: IMS Question and Test Interoperability Meta-data and Usage Data
Revision: 24 January 2005
| Date Issued: |
24 January 2005 |
| Latest version: |
http://www.imsglobal.org/question/qti_v2p0/imsqti_mdudv2p0.html |
| Register comments or implementations: |
http://www.imsglobal.org/developers/ims/imsforum/categories.cfm?catid=23 |
|
IPR and Distribution Notices Recipients of this document are requested to submit, with their comments, notification of any relevant patent claims or other intellectual property rights of which they may be aware that might be infringed by any implementation of the specification set forth in this document, and to provide supporting documentation. IMS takes no position regarding the validity or scope of any intellectual property or other rights that might be claimed to pertain to the implementation or use of the technology described in this document or the extent to which any license under such rights might or might not be available; neither does it represent that it has made any effort to identify any such rights. Information on IMS's procedures with respect to rights in IMS specifications can be found at the IMS Intellectual Property Rights web page: http://www.imsglobal.org/ipr/imsipr_policyFinal.pdf. Copyright © IMS Global Learning Consortium 2006. All Rights Reserved. If you wish to distribute this document or use this document to implement a product or service, you must complete a valid license registration with IMS and receive an email from IMS granting the license. To register, follow the instructions on the IMS website: http://www.imsglobal.org/specificationdownload.cfm. This document may be copied and furnished to others by Licensee organizations registered on the IMS website provided that the above copyright notice and this paragraph are included on all such copies. However, this document itself may not be modified in any way, such as by removing the copyright notice or references to IMS, except as needed for the purpose of developing IMS specifications, under the auspices of a chartered IMS work group. Use of this specification to develop products or services is governed by the license with IMS found on the IMS website: http://www.imsglobal.org/question/qti_v2p0/qtiv2p0speclicense.html. The limited permissions granted above are perpetual and will not be revoked by IMS or its successors or assigns. THIS SPECIFICATION IS BEING OFFERED WITHOUT ANY WARRANTY WHATSOEVER, AND IN PARTICULAR, ANY WARRANTY OF NONINFRINGEMENT IS EXPRESSLY DISCLAIMED. ANY USE OF THIS SPECIFICATION SHALL BE MADE ENTIRELY AT THE IMPLEMENTER'S OWN RISK, AND NEITHER THE CONSORTIUM, NOR ANY OF ITS MEMBERS OR SUBMITTERS, SHALL HAVE ANY LIABILITY WHATSOEVER TO ANY IMPLEMENTER OR THIRD PARTY FOR ANY DAMAGES OF ANY NATURE WHATSOEVER, DIRECTLY OR INDIRECTLY, ARISING FROM THE USE OF THIS SPECIFICATION. |
|
In QTI version 2.0, QTI-specific meta-data has been brought into line with the IEEE LOM in accordance with the IMS Meta-data Best Practice and Implementation Guide for [LOM]. The IEEE LOM standard defines a set of meta-data elements that can be used to describe learning resources, but does not describe assessment resources in sufficient detail. The application profile provided in this document therefore extends the IEEE LOM to meet the specific needs of QTI developers wishing to associate meta-data with items (as defined by the accompanying Item Information Model).
Secondary meta-data, sometimes known as 'usage data' (item statistics), is defined separately in its own data model. See Usage Data later in this document.
The following class describes a new category of meta-data for the recording of QTI specific information. It is designed to be treated as an additional top-level category to augment the LOM profile described in the next section.
Contains : itemTemplate boolean [0..1]
True if the
item is actually an item template, in other words, the item changes its
appearance based on some random or external factor. An assessmentItem that contains a templateProcessing
section.
Contains : timeDependent boolean [0..1]
Whether or
not the item is time dependent. A time dependent item takes the length of time
taken for an attempt into consideration when scoring.
Contains : composite boolean [0..1]
True if the item comprises more than one interaction, for example, an
assessmentItem that contains more than one
interaction.
Contains : interactionType [*]
The
interaction type(s) of the item. The vocabulary is comprised of the names, as
defined in the information model, of the leaf classes derived from interaction.
Contains : feedbackType [0..1]
Describes
the type of feedback, if any, available in the item. If feedback is available
then it is described as being non-adaptive or adaptive depending on whether the
item is itself adaptive. A non-adaptive item generates feedback based on the
responses submitted as part of (the last) attempt only. An adaptive item
generates feedback that takes into consideration the path taken through the
item, in other words, feedback based on the accumulation of all attempts and not
just the last.
Contains : solutionAvailable boolean [0..1]
Set to
true if a model solution is available for the item. For example, an assessmentItem that provides correct responses for all declared
responseVariables.
Contains : toolName string256 [0..1]
The
name of the tool used to author the evaluation object.
Contains : toolVersion string256 [0..1]
The
version of the tool used to author the evaluation object.
Contains : toolVendor string256 [0..1]
The
company which produced the tool used to author the evaluation object.
none
No feedback is available.
adaptive
Feedback is available and is adaptive. In other words, the
item is an adaptive item.
Note that the LOM-defined Structure and AggregationLevel fields are not recommended by this profile.
One of the values given for the identifier must have an entry that matches the associated item's identifier.
The title must have a value that matches the value of the associated item's title attribute. The language used to interpret the title is taken from the associated item's lang attribute.
There must be one value for each of the languages referred to by the language attributes on the associated assessmentItem and its bodyElements.
See comment in status below for important information about the use of this field.
It is anticipated that systems for handling items would prefer to draw from wider vocabularies than the one defined by [LOM]. However, in order to facilitate the transformation of meta-data instances to systems that require the use of the LOM vocabulary for this field it is recommended that the version is used to achieve the tracking of items through more complex production processes.
A globally unique label that identifies this meta-data record.
There should be at least one instance of format with the value text/x-imsqti-item-xml
QTI items are designed to be reusable in a variety of assessment scenarios. Therefore, the LOM-defined values self assessment and exam are forbidden. If the standard LOM vocabulary is used then only the values exercise or questionnaire should be used to describe an item. An alternative vocabulary for this field has been defined in [RDN], when using that vocabulary the value AssessmentItem is recommended.
This is used to provide an educational context for the value given in typical learning time.
Item objectives should be included in this field if required.
Usage data, most commonly item statistics, do not form part of an assessmentItem directly because they always relate to some context or domain in which the statistics are valid. Therefore, this specification defines a separate class for describing these statistics.
Each statistic refers to both its context and to the assessmentItem(s) it relates to. Therefore, instances of this class are bound and packaged separately for interoperability.
Attribute : glossary [0..1]: uri
An
optional URI that identifies the default glossary in which the names of the
itemStatistics are defined.
Abstract class : itemStatistic
categorizedStatistic, ordinaryStatisticusageDataA value or set of values that describe the performance of the item within a specific context. Common measures include the item's difficulty and how well it discriminates between various candidate ability levels
Attribute : name [1]: identifier
The unique identifier of
the item statistic. Glossaries of identifiers defined by
this specification for commonly used item and distractor statistics are
defined and should be used where possible. See Vocabulary for the Exchange of Item Statistics for more details.
Attribute : glossary [0..1]: uri
An optional
URI that identifies the glossary in which the name is defined. This value overrides any default
glossary provided by the glossary attribute of
the parent usageData.
Attribute : context [1]: uri
A Uniform Resource Identifier
that points to information about the context within which the item statistic was
created. For example, the URI may point to the sample of item scores and the
specifics of computations that created item statistics. The URI may be a URL, a
database index, or other valid identifier
Attribute : caseCount [0..1]: integer
The number of cases
in the sample used to create the item statistic.
Attribute : stdError [0..1]: float
The standard error of
the item statistic, also known as the variance.
Attribute : stdDeviation [0..1]: float
The standard
deviation of the item statistic (i.e. the square root of the standard error).
Attribute : lastUpdated [0..1]: date
Date of the last
update to the item statistic value.
Contains : targetObject [1..*]
The targetObject is used to refer to an assessment object. This object may be an assessmentItem or some other type of object defined outside the scope of this specification, for example, an entire test. In some cases it is desirable to refer not just to the assessment object but to a specific part of that object, in which case the optional partIdentifier can be used.
Attribute : identifier [1]: string
The identifier of the
assessmentItem or other target object.
Attribute : partIdentifier [0..1]: identifier
An optional
identifier to a specific part (e.g. an itemVariable)
defined within the assessment object. In the case of an assessmentItem the partIdentifier typically refers to an outcomeVariable but can refer to other objects identified in the same
namespace, such as a specific choice within an interaction. If
no partIdentifier is given the statistic is considered to refer to the
target object as a whole.
An item statistic that consists of a single numeric value.
Contains : value [1]
An item statistic that consists of multiple values, e.g. IRT Dispersion Parameters.
Contains : mapping [1]
Item Statistics
glossaries/item_statistics.xml
The main item statistics glossary defines statistics that refer to a specific outcome of an item (typically the outcome variable SCORE).
Distractor Statistics
glossaries/distractor_statistics.xml
The distractor statistics glossary defines statistics that refer to a specific response (typically a simpleChoice) within an item.
The accompanying XML binding provides a binding for the qtiMetadata object that is consistent with the binding given in [IMS_MD_Binding]. The qtiMetadata class defines a new category that could appear alongside LOM categories such as General, Lifecycle, etc. In the context of the IMS binding, that means it would naturally appear as a direct descendant of the <lom> object itself. The IMS binding does not support extension at this point in the XML binding, however, so qtiMetadata is bound separately and must be used in parallel to the lom object as an additional meta-data object.
At the time of writing, the IEEE itself is working on a binding document for [LOM]. In the future, an XML binding more consistent with the approach taken by the IEEE is expected to be recommended.
| Title |
IMS Question and Test Interoperability Meta-data and Usage Data |
| Editor |
Steve Lay (University of Cambridge) |
| Version |
2.0 |
| Version Date |
24 January 2005 |
| Status |
Final Specification |
| Summary |
This document describes the QTI Meta-data and Usage Data specification. |
| Revision Information |
24 January 2005 |
| Purpose |
This document has been approved by the IMS Technical Board and is made available for adoption. |
| Document Location |
http://www.imsglobal.org/question/qti_v2p0/imsqti_mdudv2p0.html |
| To register any comments or questions about this specification please visit:
http://www.imsglobal.org/developers/ims/imsforum/categories.cfm?catid=23 |
The following individuals contributed to the development of this document:
| Name | Organization | Name | Organization |
|---|---|---|---|
| Niall Barr |
CETIS |
Joshua Marks |
McGraw-Hill |
| Sam Easterby-Smith |
Canvas Learning |
David Poor |
McGraw-Hill |
| Jeanne Ferrante |
ETS |
Greg Quirus |
ETS |
| Pierre Gorissen |
SURF |
Niall Sclater |
CETIS |
| Regina Hoag |
ETS |
Colin Smythe |
IMS |
| Christian Kaefer |
McGraw-Hill |
GT Springer |
Texas Instruments |
| John Kleeman |
Question Mark |
Colin Tattersall |
OUNL |
| Steve Lay |
UCLES |
Rowin Young |
CETIS |
| Jez Lord |
Canvas Learning |
| Version No. | Release Date | Comments |
|---|---|---|
| Base Document 2.0 |
09 March 2004 |
The first version of the QTI Item v2.0 specification. |
| Public Draft 2.0 |
07 June 2004 |
The Public Draft version 2.0 of the QTI Item Specification. |
| Final 2.0 |
24 January 2005 |
The Final version 2.0 of the QTI specification. |
IMS Global Learning Consortium, Inc. ("IMS/GLC") is publishing the information contained in this IMS Question and Test Interoperability Meta-data and Usage Data ("Specification") for purposes of scientific, experimental, and scholarly collaboration only.
IMS/GLC makes no warranty or representation regarding the accuracy or completeness of the Specification.
This material is provided on an "As Is" and "As Available" basis.
The Specification is at all times subject to change and revision without notice.
It is your sole responsibility to evaluate the usefulness, accuracy, and completeness of the Specification as it relates to you.
IMS/GLC would appreciate receiving your comments and suggestions.
Please contact IMS/GLC through our website at http://www.imsglobal.org
Please refer to Document Name: IMS Question and Test Interoperability Meta-data and Usage Data Revision: 24 January 2005