Registration is currently closed.
Innovative Item Initiative: One Testing Program's Story
Presenter: Timothy J., Muckle, Ph.D., Director, Testing Services, NBCRNA
In recent years, a number of testing programs in certification/licensure have extended item writing efforts to include innovative, objective item formats alternative to the single-response, multiple-choice question (MCQ) format. Several item types, including multiple correct response (MCR), short answer/calculation, hotspot, and drag-and-drop (matching or ordering), have been available for several years and are being used more widely. However, the lack of fundamental research to establish the efficacy and value of these item types lead us to conduct this investigation in the hope of advancing a delineation of best practice for other testing programs. In this presentation, we will explore a number of facets and considerations of one organization's (NBCRNA) foray into the development of innovative items.
The presentation will comprise a summary of the issues encountered chronologically throughout the innovative item project:
· Compare the relative risks and benefits of selection of available off-the-shelf item applets to the development of new applets
· Discuss the training of item authors in the new formats, creation and review of initial work-products, and the value of usability testing of the software
· Discuss the communication of change to examinees and stakeholders, including development of informational materials and online tutorials, with the goal of reducing examinees' anxiety about the changes to the examination
· Explore psychometric considerations related to the new item types, including presentation and scoring (dichotomous vs. partial credit), as well as pilot testing and statistical analysis of examinee response
· Evaluate the success of the program through eliciting examinee feedback and a subsequent research agenda
· Discuss overall perceived benefits and value of the innovative item project, as well as lessons learned and recommendations for other credentialing organizations
Presenter Bio:
Dr. Muckle is currently employed as the Director of Testing Services at the National Board of Certification and Recertification for Nurse Anethetists. While employed there, he has been responsible for managing test development and psychometric quality of the National Certification Examination, developing innovative item types, and spearheading an exam-related research agenda. He received his B.S. degree in Mathematics from the University of Notre Dame and received his Ph.D. in Educational Psychology (Measurement, Evalutation, Statistics, and Assessment) from the University of Illiniois at Chicago. His research interests include computerized adaptive testing (CAT), alternative item types, and performance-based assessments using simulation. Dr. Muckle resides in Michigan with his wife and three children.
Innovative Item Initiative: One Testing Program's Story Webcast Sponsors:
Past ICE Academy Webcasts and Webinars
If you were unable to attend one of our recent ICE Academy presentations, the recorded webcasts are now available for purchase in our online store. Price: $50 for nonmembers and $30 for members. Please click here to view the available recordings and purchase your webcast now!
Sponsor an ICE Academy Webcast
As a sponsor, your company logo will be displayed on our website leading up to the On-demand Webcast Series and in e-blasts to potential participants. Plus, your company name will be announced during the webcast call. Don't miss out on this great opportunity for visibility during these well-attended online events! (These events are non-exclusive sponsorships).
Webcast Sponsorship $1500 (each)
3 Webcast Sponsorships $3500
4 Webcast Sponsorships $5000
6 Webcast Sponsorships $8000
To sponsor a webcast or to learn of our other new year-round sponsorship opportunities, please view our ICE Year-Round Sponsorship Opportunities Prospectus and Contract.