Store

Testing

Psychometrics Boot Camp

This one-day boot camp workshop on the fundamentals of psychometrics will help credentialing organizations and leaders learn essential testing, measurement and psychometric principles.

WEB18 Test Security: Policies and Procedures for Managing Breaches

This on-demand webinar will discuss each approach and highlight the policies and procedures organizations use to deter, detect, and decide how to manage test security breaches across the testing lifecycle, putting you in a more informed position to choose which approach is right for your program.

REC17 Technology-enhanced Assessment: Applications and Opportunities in Credentialing

A panel of experts in technology enhanced assessment lead an engaging and interactive discussion that highlight issues, challenges, and solutions in the application of technology for the design and delivery of credentialing exams.

REC17 ICE Exchange: 2017 ICE Exchange Taste of Conference

This package offers you recordings of 8 concurrent sessions from the 2017 ICE Exchange.

REC17 Fair does not always mean equal: Evaluating and maintaining fairness in your program

Review how fairness should be considered and incorporated during the design, development, and documentation/maintenance phases of a credentialing program.

REC17 Best Practices: Exam Integrity in the Age of Convenience

Hear legal and exam integrity experts describe the unique challenges presented when trying to balance modern technology and disability accommodations with exam security considerations.

REC17 Best Practices in Subject Matter Expert Talent Management

Learn best practices in SME talent management (recruitment, engagement, and retention), and strategies to ensure SMEs are effective contributors.

WP18 Impact of the Internet on Exam Security

This white paper focuses on exam security for high-stakes exams. Throughout, the authors provide practical business-related considerations for addressing the increasingly complex landscape that assessment organizations face today as they seek to securely navigate the internet.

WEB18 Test Security: The Psychometric Side of Test Security

This on-demand webinar introduced test security from a psychometric perspective.

CEOWEBLIVE18 Remote Proctoring and Strategies for Implementation

Remote proctoring continues to be discussed extensively in certification, with many questions abounding. Attend this webinar to understand what types of remote proctoring are available, the pros and cons of remote proctoring, and lessons learned in implementation.

WEB18 Setting and Communicating Your Cut Score Method

Hear a complete overview of standard setting methods that are used in various assessment settings. Learn the practical aspects of selecting and training a group of Subject Matter Experts, and how to communicate standard setting results to both the governing body as well as the candidates.

RSRCH17 Assessing Noncognitive Competence

The Measuring Non-cognitive Competence Report Task Force was assembled to inform the ICE community on the topic of noncognitive assessment and its relevance to professional credentialing. To this end, this questions and answers document is provided to serve as an initial introduction and to provide references for those interested in a deeper dive into the underlying literature.

WEB17 Introduction to Computerized Adaptive Testing

This on-demand webinar provides a focused introduction to computerized adaptive testing (CAT), allowing credentialing professionals to better understand the benefits of the approach and evaluate its applicability to their organization.

Fundamental Topics in Certification: Six Module Package

Designed for new credentialing staff, new volunteer board members, or staff who are developing a new certification program, set up your staff and volunteers for success by providing them basic knowledge and good practices for administering a certification program.

RSRCH17 Validation Strategies for Credentials

This research report documents common methods licensure and certification programs use to establish their programs’ validity.

WEB17 Innovative Item Types

Hear an overview of the various types of alternative item types and why an organization might benefit from incorporating them into its assessment(s).

ICE Handbook Chapter 5: Basic Psychometric Principles

This chapter discusses the basic psychometric principles relevant to certification testing.

ICE Handbook Chapter 6: Examination Validation & Job Analysis

This chapter discusses job analysis by presenting the rationale for using a job analysis as the basis for validating content specifications for a certification assessment, explaining the process of a job analysis, conducting a job analysis meeting, validating the job analysis, and developing the test specifications. The last section of the chapter discusses trends in job analysis at the time of publication.

ICE Handbook Chapter 7: Examination Development

This chapter covers examination development, identifying the professional standards related to examination development and describing examination development as an onging endeavor that requires process management and control tools. The chapter is organized around two stages of examination development: design and construction.

ICE Handbook Chapter 8: Performance Testing Methodologies

This chaptercovers performance testing methodologies, recommending practices in order for performance tests to meet NCCA Standards along with associated samples. This chapter addresses performance test design, types, and construction and is designed to present performance test design considerations including pschomotor, affective, and cognitive testing; context-based testing; criterion referenced testing; and process results testing.

ICE Handbook Chapter 10: Test Administration

This chapter discusses how the paper-and-pencil and computer adminstration of achievement tests used for credentialing purposes can be designed to achieve the greatest consistency and accuracy possible.

ICE Handbook Chapter 11: Standard Setting

This chapter describes "best practice" guidelines available for setting performance standards, to review the numerous methodologies that are available to certification bodies to set performance standards for their certification programs, to compare the available methodologies to methods being used in practice by NCCA accredited programs, and to provide additional guidance and suggestions about standard setting.

ICE Handbook Chapter 12: Examination Security

This chapter provides a comprehensive overview of the elements and issues surrounding the process of ensuring examination security from development through administration, and beyond.

ICE Handbook Chapter 13: Technology and Certification

This chapter provides an overview of how technology has been used by certifying agencies and suggests criteria for making better technology choices. Unlike other chapters in the book, technology is not a specific subject of the NCCA Standards.

RSRCH10 Guidelines for Performance Examinations

This publication summarizes current principles related to performance examinations and accepted methods for their development, validation, and use. It is an update to Guidelines for Non-Written Examinations, published by the National Commission for Certifying Agencies (NCCA) in January 1991.

RSRCH11 Job Analysis Study for the Credentialing Professional

In 2010 ICE conducted a large scale job analysis, the first in the field, to identify the responsibilities and duties of the credentialing professional. The study consists of the following major phases, which provide the organization of this report: 1) Initial Development and Validation 2) Pilot Study 3) Validation Study, and, 4) Development of Specifications.

Fundamental Topics in Certification: Module 4, Psychometric Concepts and Analyses

The Psychometric Concepts and Analyses module from the Fundamental Topics in Certification online course explains basic psychometric principles and examines the type of analyses used to evaluate the quality of a certification candidate.

Fundamental Topics in Certification: Module 5, Assessment Development and Delivery

The Assessment Development and Delivery module from the Fundamental Topics in Certification online course reviews the major steps in developing fair and accurate assessments and how to best administer these assessments based on the nature of the program.

WP11 Beyond Multiple Choice: Strategies for Planning and Implementing an Innovative Item Initiative

his 2011 white paper, authored by Timothy Muckle, PhD, will explore a number of facets of the foray into the development of innovative item formats by one credentialing organization (National Board of Certification and Recertification for Nurse Anesthetists, or NBCRNA).

In addition to summarizing the implementation of alternative item types, the paper will discuss overall benefits of the project, with a particular focus on value added to the credential, as well as lessons learned and recommendations for decision-making for other organizations.

WEB10 Bundled Pack: Testing

Access on-demand webinar recordings related to testing.

REC13 ICE Exchange Full Conference Recordings

This package offers you recordings of 25 concurrent sessions (1 hour each) from the 2013 ICE Exchange a

REC13 ICE Exchange Administration & Governance for Certification Programs Recordings

This package offers you recordings of 19 concurrent sessions (1 hour each) from the 2013 ICE Exchange that focus on issues related to the administration and governance of certification programs.

REC13 ICE Exchange Testing for Certification Programs Recordings

This package offers you recordings of 12 concurrent sessions (1 hour each) from the 2013 ICE Excahgne that focus on testing concepts and issues for certification programs. Most sessions are suitable for all levels of credentialing professionals in both the public and private sectors.

WEB14 Test Security: An Approach to Identify and Fight Disclosure of Exam Content on the Internet

This webcast will discuss ways to identify discussions or disclosure of exam content on the internet. Heather Mullen & Aimée Hobby Rhodes will review an approach to positively identify the individuals who have posted the exam content and how to determine the manner in which the information was gathered.

WEB14 Concepts for an Improved Job Analysis

Arm yourself with a fundamental working knowledge of the varied aspects of job analysis methodology to better navigate the considerations necessary when conducting a job analysis.

RSRCH14 Eligibility Requirements Report

ICE's Research & Development (R&D) committee noted the limited guidance and resources available on how to set eligibility requirements. To meet this need, the committee conducted interviews with existing certification programs, completed a thorough review of the topic, and produced the Eligibility Requirements Report. The report provides a glimpse of industry perspectives and best practices, alongside a review of the policies in place for determining credential eligibility and the methods for setting and changing these requirements.

Certificate Program for the Credentialing Specialist

The "Credentialing Specialist" Assessment-based Certificate Program is designed for certification staff who want to gain insights into the eco-system of certification from a program's conception, through its development and delivery, to maintenance and improvement.

Advanced Topics in Certification: Psychometrics Module

Use Advanced Topics in Certification online modules to guide your staff's conversations and decisions on expanding, elevating, or differently marketing your established program. This purchase is for a single user of the Legal Issues module.

REC14 ICE Exchange Taste of Conference Recordings

This package offers you recordings of 11 concurrent sessions from the 2014 ICE Exchange, covering the business of certification, testing, and continuing competence.

REC14 ICE Exchange Business of Certification Session Samples

This package offers you recordings of 6 concurrent sessions from the 2014 ICE Exchange on testing and administration. on the business of certification.

REC14 ICE Exchange Testing

This package offers you recordings of 6 concurrent sessions from the 2014 ICE Exchange on testing and administration.

WEB15 Critical Psychometric Concepts for Credentialing Personnel

Learn how to speak like a psychometric nerd in just one hour’s time. View this on-demand webinar to learn secret phrases and meanings.

WEB15 Exam Results & Score Reports: Do's and Don'ts

Learn the basics of score reporting, including the essential elements of a successful score report, various standards that pertain to score reporting, and best practices for score reporting..

WP15 Score Reporting: Where Policy Meets Psychometrics

The purpose of this white paper is to offer practitioners guidance on designing and evaluating score reports along with examples of various practices from programs within the industry.

WEB15 How To Use a Job Analysis To Help Inform Your Standard Setting Process

Your job analysis plays a critical part in the test development and administration decisions that you make. Learn the information you could collect in your job analysis to help set your cutoff scores, particularly for content valid tests.

REC15 2016 NCCA Standards Training

A free on-demand training on the NCCA Standards for Certification Programs. The training highlights the application process and summarizes the intent and requirements of each Standard.

WEB15 Key Considerations: In-Person Versus Virtual Item Development

Consider the pros and cons of each setting, and identify programmatic considerations (goals, budget, resources, etc.) that should factor in to the decision to develop test items in-person or in the virtual environment.

WEB15 How Job Task Analysis Informs Test Blueprint Development

What is a job analysis and why do we do them? Hear an overview of the process of conducting a job analysis including the purpose behind the activities, what the law has to say about it, and what methods can be used.

RSRCH15 Remote Proctoring Test Delivery: A Report on Options and Considerations

This paper intends to provide an impartial view of the strengths and weaknesses of remote proctoring test delivery (RPTD).

WP15 What Is the Optimal Number of Distractors in Exam Items? Case Study

A case study is provided that documents the Chartered Financial Analyst (CFA) exam’s transition to a three-option item format. The CFA program is the gold standard credential among investment professionals globally, with 124,000 CFA charterholders residing in 145 countries. This case study is intended to be of value to other testing programs considering a similar change with respect to understanding the motivation for change, the challenges faced with stakeholders and constituents, and the psychometric impacts of change that align with literature-based expectations.

REC15 ICE Exchange Taste of Conference (8 sessions)

This package offers you recordings of 8 concurrent sessions from the 2015 ICE Exchange, covering the business of certification, testing, and marketing.

REC15 ICE Exchange: A Game Plan for Managing Test Security Incidents

The 2015 ICE Exchange concurrent session, A Game Plan for Managing Test Security Incidents, provides a case study approach to introduce a security incident response framework and a flow chart to help navigate game-changing test security incidents.

REC15 ICE Exchange: Considering Online Proctoring? Tips, Guidelines, & Lessons Learned

The 2015 ICE Exchange concurrent session, Considering Online Proctoring? Tips, Guidelines, & Lessons Learned, shares insights on the psychometric, policy and standards, product feature, privacy, and security aspects of the decision to use online (remote) proctoring.

WEB16 Communicating with Security in Mind

Learn how to take a proactive approach to including security in communications before, during, and after the test experience; analyze current communications (e.g., handbooks, candidate agreements) for security language; and present examples. The presentation will take an in-depth look at the steps to achieve these objectives by exam vendors and sponsors.

WEB16 Technical Reports: What Should Be Included & How To Interpret Them

This on-demand webinar introduces test users to the topic of examination performance and the exam features that are measured to indicate that performance.

WEB16 Remote Online Proctoring

This on-demand webinar outlines the key considerations for programs that are thinking about implementing remote proctoring. Leave armed with sufficient insight into the benefits, drawbacks, and challenges of remote proctoring to determine if it is worth further consideration.

ICE Handbook: 2nd Edition - Digital Copy

A digital copy of the ICE Handbook, a step-by-step guide to designing and implementing effective professional certification examinations was written by recognized experts with applied knowledge of practical experience.

WEB16 Creating & Maintaining a Test Security Plan

Learn the basics of how to build a strong security plan from the ground-up, provide recommendations for prioritizing limited budget resources, and offer advice for maintenance of your security plan as your program grows.

WEB17 Job analysis, a starting point for your program

An overview of different methods for conducting a job analysis, review of best practices, and discussion of the value and importance of job analysis for credentialing programs.

REC16 ICE Exchange: Lost In Translation

The concurrent session, Lost In Translation: Facilitating The Conversation Between Psychometricians and Non-Psychometricians, provides a framework for understanding and resolving conflicting program priorities, and illustrates a way to create a common understanding so all stakeholders can work together for the betterment of the program.

REC16 ICE Exchange: Establishing and Maintaining Firewalls Between Certification and Education

This concurrent session, Establishing and Maintaining Firewalls Between Certification and Education, presents the five most frequent problem areas with applications for initial and continuing accreditation under the NCCA Standards for the Accreditation of Certification, and is based on the ICE white paper with the same title.

REC16 ICE Exchange: Online Proctoring: Dipping Your Toes or Cannon Balling - It's Time to Jump In

The Online Proctoring: Dipping Your Toes or Cannon Balling - It's Time to Jump In concurrent session shares a framework for navigating security/privacy risks; an understanding psychometric considerations, candidate reactions, and NCCA’s perspective on this emerging delivery format; and some key decision points before “jumping” into online proctoring.

REC16 ICE Exchange:2016 ICE Exchange Taste of Conference Bundle

This package offers you recordings of 8 concurrent sessions, with session on the business of certification, testing, continuing competence, accreditation, and certificate programs

WP17 Becoming the SME Whisperer

This Institute for Credentialing Excellence (ICE) white paper provides insight into how one testing organization—the Association of Social Work Boards (ASWB)—created a strong SME culture with low turnover and high engagement at all levels. This paper presents a case study, but is also intended to provide a set of conceptual tools for organizations interested in creating not only a sense of investment among their SMEs but also a sense of group cohesion and overall program continuity.

WEB17 Item Writer Development: Training Volunteer Writers

Explore the cognitive level schemes and how the various levels are applicable to item writing and discuss ways to guide item writers in developing higher order questions. By the end of the on-demand webinar, know two strategies to improve the quality of your items.