|
IMS Question and Test Interoperability Conformance GuideVersion 2.1 Public Draft (revision 2) Specification |
Copyright © 2006 IMS Global Learning Consortium, Inc.
All Rights Reserved.
The IMS Logo is a registered trademark of IMS GLC.
Document Name: IMS Question and Test Interoperability Conformance Guide
| Date Issued: |
8 June 2006 |
|
Caution: this specification is incomplete in its current state. The IMS QTI project group is in the process of evolving this specification based on input from market participants. Suppliers of products and services are encouraged to participate by contacting Mark McKell at [email protected]. This specification will be superseded by an updated release based on the input of the project group participants. Please note that supplier's claims as to implementation of QTI v2.1 and conformance to it HAVE NOT BEEN VALIDATED by IMS GLC. While such suppliers are likely well-intentioned, IMS GLC member organizations have not yet put in place the testing process to validate these claims. IMS GLC currently grants a conformance mark to the Common Cartridge profile of QTI v1.2.1. The authoritative source of products and services that meet this conformance is contained in the IMS online product directory http://www.imsglobal.org/ProductDirectory/directory.cfm Thank you for your interest in and support of IMS QTI. IPR and Distribution Notices Recipients of this document are requested to submit, with their comments, notification of any relevant patent claims or other intellectual property rights of which they may be aware that might be infringed by any implementation of the specification set forth in this document, and to provide supporting documentation. IMS takes no position regarding the validity or scope of any intellectual property or other rights that might be claimed to pertain to the implementation or use of the technology described in this document or the extent to which any license under such rights might or might not be available; neither does it represent that it has made any effort to identify any such rights. Information on IMS's procedures with respect to rights in IMS specifications can be found at the IMS Intellectual Property Rights web page: http://www.imsglobal.org/ipr/imsipr_policyFinal.pdf. Copyright © 2006 IMS Global Learning Consortium. All Rights Reserved. If you wish to copy or distribute this document, you must complete a valid Registered User license registration with IMS and receive an email from IMS granting the license to distribute the specification. To register, follow the instructions on the IMS website: http://www.imsglobal.org/specificationdownload.cfm. This document may be copied and furnished to others by Registered Users who have registered on the IMS website provided that the above copyright notice and this paragraph are included on all such copies. However, this document itself may not be modified in any way, such as by removing the copyright notice or references to IMS, except as needed for the purpose of developing IMS specifications, under the auspices of a chartered IMS project group. Use of this specification to develop products or services is governed by the license with IMS found on the IMS website: http://www.imsglobal.org/license.html. The limited permissions granted above are perpetual and will not be revoked by IMS or its successors or assigns. THIS SPECIFICATION IS BEING OFFERED WITHOUT ANY WARRANTY WHATSOEVER, AND IN PARTICULAR, ANY WARRANTY OF NONINFRINGEMENT IS EXPRESSLY DISCLAIMED. ANY USE OF THIS SPECIFICATION SHALL BE MADE ENTIRELY AT THE IMPLEMENTER'S OWN RISK, AND NEITHER THE CONSORTIUM, NOR ANY OF ITS MEMBERS OR SUBMITTERS, SHALL HAVE ANY LIABILITY WHATSOEVER TO ANY IMPLEMENTER OR THIRD PARTY FOR ANY DAMAGES OF ANY NATURE WHATSOEVER, DIRECTLY OR INDIRECTLY, ARISING FROM THE USE OF THIS SPECIFICATION. |
|
A system vendor or data publisher makes a conformance statement that can be used by the community to compare the capabilities of their product with others. To facilitate creation of conformance statements contentProfile and bankProfile classes are defined that enable a rigorous approach to describing the extent to which the item information and packaging models are supported. The same classes can of course be used to describe a set of requirements. Used in this way they enable smaller communities to express profiles of this specification. For information and advice about setting up and running such communities, readers are referred to the IMS Application Profile Guidelines Whitepaper [IMS_AP].
This specification defines two profiles that can be used as the basis for determining interoperability needs in the absence of any more specific profiling requirement. These profiles are called QTI-Lite Version 2 (which applies only to content) and QTI-All Version 2 and can be used to interpret statements such as "conforms to all of QTI Version 2".
Communities that define their own profiles are strongly encouraged to ensure that all objects conforming to their profile also conform to the QTI-All Version 2 profile described in this document except with respect to additional media types (see objectType and imageType). Profiles that allow (or even require) objects that do not conform to QTI-All Version 2 should describe themselves as extensions of QTI.
Assessment Items must be XML documents that conform to the XML schema for assessmentItem defined by this specification and to the additional content constraints described in the information model.
Item packages must conform to the IMS Content Packaging specification and contain assessment items packaged in accordance with the requirements described in the Integration Guide.
Item statistics must be XML documents that conform to the XML schema for usageData defined by this specification.
Response Processors must be XML documents that conform to the XML schema for responseProcessing defined by this specification and to the additional content constraints described in the information model.
A conformant publishing system is any system that can export conforming assessment items packaged as item packages without requiring the use of the extension elements customInteraction and customOperator.
A publishing system may also publish content in a variety of other formats, including some QTI-based formats that make use of the extension elements, but it must be possible to separate this output or the modes of operation that generate it. For example, a publishing system may contain a flag to turn off the use of QTI extensions when publishing content and skip items from the selected data set that would have required them.
A publishing system should create a contentProfile that describes the range of content it can export. The main purpose of such a profile is to describe the requirements for a system that needs to import the data and does not imply that the publishing system exploits the full range of functionality it describes. For example, a publishing system that exports only single response multi-choice questions as conformant QTI assessment items would still add choiceInteraction as an interactionType to its contentProfile even though this describes multiple-response multi-choice questions too (these two question types being inseparable in the contentProfile).
Authoring systems must set or adjust the toolName and toolVersion appropriately when exporting items (unless no changes have been made). When exporting items, all use of extensions must be consistent with the conventions of the tool referred to by these attributes. The extension mechanisms are:
Authoring systems should ignore information represented by the extension mechanisms when importing an item that was created by an incompatible tool.
Authoring systems should also ensure that data that can be represented by the information model defined by this specification is represented in that way. In other words, authoring systems should not make use of the extension mechanisms to represent information that could have been represented without them.
This requirement is made to ensure that authoring systems meet the reasonable expectations of authors when exporting assessment items. For example, an author who creates a question containing a simple choice represented by hotspots on a background image can reasonably expect the exported data to contain a hotspotChoice and not a customInteraction containing a proprietary applet that implements the same functionality on a limited set of delivery engines.
A system that uses an extension mechanism to represent data that can be represented directly in the information model must not claim conformance for that part of the information model in its conformance profile.
Note that a tool may combine the functions of authoring system and delivery engine, to allow authors to try out their items, but it is not required to do so. Where a tool contains a conformant authoring system and a delivery engine it should ensure that the delivery engine is also conformant to prevent authors being misled.
An authoring system should create a contentProfile to describe the range of QTI content that it supports.
A conformant item bank system allows item bank managers to import and export collections of items from item packages. Item bank systems must not alter the items' assessmentItem data. Though a given tool may combine the features of an item bank system with an authoring system, to be a conformant item bank system it must still be capable of importing, managing, and exporting collections of items without modification of the associated assessmentItem data.
An item bank system should create a bankProfile to describe the range of features that it supports. Version 1 of this specification described an information model for objectbanks, assessments, and results which have not been updated by this version but may be updated by future versions. Therefore, the conformance of item bank systems with respect to the interoperability of item banks, assessments, and results and the associated bankProfile class is subject to change.
Contains
: composite boolean
[1]
Whether or not the system supports composite items.
Contains
: adaptive boolean
[1]
Whether or not the system supports adaptive items.
Contains
: timeDependent boolean
[1]
Whether or not the system supports time dependent items.
Contains
: templates boolean
[1]
Whether or not the system supports item templates.
Contains
: textElements boolean
[1]
Whether or not the system supports the XHTML text elements. A profile
that supports any of the other XHTML element groups should support this
one too.
Contains
: listElements boolean
[1]
Whether or not the system supports the XHTML list elements.
Contains
: objectElements boolean
[1]
Whether or not the system supports the XHTML object elements.
Contains
: objectType mimeType
[*]
For systems that support the object element, a list of the types of
object supported. For example: image/jpeg, audio/aiff, etc.
Contains
: presentationElements boolean
[1]
Whether or not the system supports the XHTML presentation elements.
Contains
: tableElements boolean
[1]
Whether or not the system supports the XHTML table elements.
Contains
: imageElement boolean
[1]
Whether or not the system supports the XHTML image element.
Contains
: imageType mimeType
[*]
For systems that support the image element, a list of the types of
images supported. For example: image/png, image/jpeg, etc.
Contains
: hypertextElement boolean
[1]
Whether or not the system supports the XHTML hypertext element.
Contains
: mathElement boolean
[1]
Whether or not the system supports the MathML <math>
element.
Contains
: mathVariable boolean
[1]
Whether or not the system support the expansion of template variable
names in MathML expressions.
Contains
: feedbackIntegrated boolean
[1]
Whether or not the system supports integrated feedback, i.e., the feedbackBlock
class.
Contains
: feedbackModal boolean
[1]
Whether or not the system supports modal feedback, i.e., the modalFeedback
class.
Contains
: rubric boolean
[1]
Whether or not the system supports rubric blocks, i.e., the rubricBlock
class.
Contains
: printedVariables boolean
[1]
Whether or not the system has core support for the printedVariable
element. Note that support for the r conversion
type specifier is controlled separately rounding.
Contains
: interactionType
[*]
The supported interaction type(s). The vocabulary is comprised of the
names, as defined in the information model, of the leaf classes derived
from interaction
with the exception of customInteraction.
See below for interaction-specific conformance notes.
Contains
: responseRules boolean
[1]
Whether or not the system supports response rules in response
processing. Systems that set this to true are assumed to be able to
process arbitrary templates so need not list these individually. Note
that support for the equalRounded
and patternMatch
operators is optional, see rounding
and regexp respectively.
Contains
: rpTemplate uri [*]
For systems that only support response processing templates, a list of
the templates supported.
Contains
: rounding boolean
[1]
Whether or not the system supports advanced rounding: if printedVariables is supported
then the r conversion type specifier is also
supported.
Contains
: regexp boolean
[1]
Whether or not the system supports regular expression matching: if the textEntryInteraction
or extendedTextInteraction
then the patternMask
attribute is also supported; if responseRules
is supported then the patternMatch
operator is also supported.
Contains
: metadataProfile [1]
The parameters concerning the range of meta-data supported are
described by a separate class.
Contains
: imsmd boolean
[1]
The system supports meta-data described by and bound according to the
IMS meta-data specification [IMS_MD_Binding].
Contains
: lomMetadata boolean
[1]
The system supports meta-data described by [LOM]
and bound according to the associated XML binding.
Contains
: imsqtimd boolean
[1]
The system supports meta-data described by and bound according to the qtiMetadata
class defined in the associated Meta-data
and Usage Data.
Most of the simple interactions can be supported in isolation. For example, it is possible to define a meaningful profile with the a single value of choiceInteraction for interactionType and no other conforming features.
Some interaction types require the use of XHTML-based elements that are subject to their own flag in the profile. A profile that contains an interactionType indicating support for one of these types must also set the flags for any required XHTML-based element to be valid. These requirements are listed below.
| gapMatchInteraction | Requires textElements. If a system supports gapMatchInteraction and objectElements then it must support use of gapImg with any image objectTypes in the profile. A system that supports gapMatchInteraction but no image objectTypes does not support gapImg. |
|---|---|
| inlineChoiceInteraction, textEntryInteraction, hotTextInteraction, endAttemptInteraction | Require textElements. |
| hotspotInteraction, selectPointInteraction, graphicOrderInteraction, graphicAssociateInteraction, graphicGapMatchInteraction, positionObjectInteraction, drawingInteraction | Require objectElements and at least one suitable objectType. |
This class provides a framework for describing the capabilities or requirements of an item bank system. It has a similar dual use for specifying capabilities and requirements as the contentProfile class.
Note that item bank systems must be able to import and export items from content packages and must be able to operate in a mode whereby all imported usage data and meta-data from a vocabulary or scheme to which conformance is claimed can be exported again with the same set of items.
Contains
: usageDataVocabulary uri [*]
The URI of a vocabulary file (or files) describing the vocabulary of
supported usage data. Reference to a vocabulary indicates that a system
supports usage-data files packaged according to the method described in
Integration Guide.
Contains
: metadataProfile [1]
The flags describing the range of meta-data supported are the same as
those used in the contentProfile.
QTI-Lite
Profile Definition
conformance/imsqti_lite_profile.xml
The key differences between the QTI-Lite and the QTI-All profile are:
Note that the inclusion of multiple-response questions represents an expansion of the scope of QTI-Lite since version 1 of this specification but that the restrictions on response processing, in particular the lack of support for the Map Response template, should not present a significant burden to implementors.
QTI-All
Content Profile Definition
conformance/imsqticontent_all_profile.xml
QTI-All
Bank Profile Definition
conformance/imsqtibank_all_profile.xml
| Title |
IMS Question and Test Interoperability Conformance Guide |
| Editors |
Steve Lay (Cambridge Assessment), Pierre Gorissen (SURF) |
| Version |
Public Draft v2.1 (revision 2) |
| Version Date |
8 June 2006 |
| Status |
Public Draft (revision 2) Specification |
| Summary |
This document describes the QTI Conformance Guide specification. |
| Revision Information |
8 June 2006 |
| Purpose |
This document has been approved by the IMS Technical
Board and is made available for public review and comment. |
| Document Location |
http://www.imsglobal.org/question/qtiv2p1pd2/imsqti_confv2p1pd2.html |
| To register any comments or questions about this
specification please visit:
http://www.imsglobal.org/developers/ims/imsforum/categories.cfm?catid=23 |
The following individuals contributed to the development of this document:
| Name | Organization |
|---|---|
| Dick Bacon |
University of Surrey |
| Niall Barr |
Question Mark |
| Lance Blackstone |
Pearson VUE |
| Jeanne Ferrante |
ETS |
| Pierre Gorissen |
SURF |
| Regina Hoag |
ETS |
| Gopal Krishnan |
Pearson VUE |
| Steve Lay |
Cambridge Assessment |
| Rowin Young |
CETIS |
| Version No. | Release Date | Comments |
|---|---|---|
| Base Document 2.1 |
14 October 2005 |
The first version of the QTI v2.1 specification. |
| Public Draft 2.1 |
9 January 2006 |
The Public Draft v2.1 of the QTI specification. |
| Public Draft 2.1 (revision 2) |
8 June 2006 |
The Public Draft v2.1 (revision 2) of the QTI
specification. |
IMS Global Learning Consortium, Inc. ("IMS/GLC") is
publishing the information contained in this IMS Question
and Test Interoperability Conformance Guide ("Specification")
for purposes of scientific, experimental, and scholarly collaboration
only.
IMS/GLC makes no warranty or representation regarding the accuracy or
completeness of the Specification.
This material is provided on an "As Is" and "As Available" basis.
The Specification is at all times subject to change and revision
without notice.
It is your sole responsibility to evaluate the usefulness, accuracy,
and completeness of the Specification as it relates to you.
IMS/GLC would appreciate receiving your comments and suggestions.
Please contact IMS/GLC through our website at http://www.imsglobal.org
Please refer to Document Name: IMS Question and Test
Interoperability Conformance Guide Revision: 8
June 2006