Research & Development Summit

Research Snapshot: A Look at ICE Research

Wednesday, November 7 | 2:00 pm - 3:30 pm CDT

Presenters: John Wickett, PhD; Lawrence J. Fabrey, Ph.D.; J.G. Federman, Ed.D., MS, PgC; Michelle Gross, MBA, MEd, NCC, NCSC, LPC;  Patricia M. Muenzen, MA; John Weiner, MA; Daniel Wilson; Patricia Young, MA; Anthony Zara, PhD

Join ICE's Research and Development Committee to discuss topics, projects, and activities the committee has been pursing through the year. This is your opportunity to ask questions, provide real-time feedback, and influence the research ICE publishes.

This year’s session will be comprised of two parts: a presentation followed by roundtable discussions. The roundtables provide a deeper dive into the topics that resonate best with your interests. Current research projects are listed below:

ICE Online Resource Library

Please join the ICE Online Library of Credentialing Industry Research Task Force for a roundtable discussion of an exciting member benefit! The library's goal is to serve as a primary resource for credentialing organizations to share best practices, benchmarks, current research and industry trends: within a secure, accessible environment. The discussion will include submission materials, publication requirements and expectations. We welcome input from interested attendees on the development of this membership tool and expect our future Task Force activities to be shaped by the dialogue and interests of participants. 

International Expansion

The International Expansion Task Force has been formed by ICE to provide membership with information related to issues surrounding expansion of credentialing programs from domestic-only to international. We will present highlights of our research paper which summarizes 2 years of survey data regarding the ICE community’s international expansion experience, interest, and resource needs.

Measuring Non-Cognitive Competence

In 2017, an ICE Research and Development taskforce report was published for the credentialing community on the topic of “Assessing Noncognitive Competence (Weiner, Stobinski, Friedman & Gray, 2017). The report was discussed at the 2017 ICE exchange and attendees expressed in interest in continued research on this topic. Accordingly, a new taskforce was assembled to conduct a continuation (Part 2) of the original NCA project to explore case studies and survey organizations to describe industry trends in the assessment of “soft skills” for professional learning and credentialing.  This roundtable session provides an opportunity to discuss the part-2 initiative, gather input and share perspectives and experiences in this area.

Recertification Benchmarking Survey

The ICE R&D Task Force on Recertification and Renewal Benchmarks was established in 2017 to gather industry data that credentialing organizations in licensure and certification can use to benchmark their own policies and practices related to recertification and renewal including, but not limited to: components; fees; program philosophy; recent/anticipated changes; renewal rates; resource requirements; and time frames.

During the roundtable discussion, participants will have the opportunity to discuss findings from the pilot testing conducted during the summer of 2018.

Small Program Statistical Issues

The ICE R&D Task Force on Small Program Issues was established in 2016 to explore the challenges facing small credentialing programs. During the roundtable discussion, participants will have the opportunity to discuss findings from interviews conducted with individuals working with small programs on the solutions they implement to overcome these challenges. They will also have the opportunity to be part of the continuing research on the topic.  

Standard Setting

The Standard Setting research paper was released in September 2018. The purpose of this paper is to provide an introductory overview of standard setting processes, methods, approaches, challenges, issues, and policies for credentialing organizations.  Major sections of the paper include general components of standard setting, methods, policy issues, and current areas for further discussion.  These areas currently include:

  • Frequency of standard setting studies
  • Normative considerations
  • Equating vs. a standard setting study
  • Issues for a new certification program or for low candidate counts

For possible discussion:

  1. Frequency of Standard Setting Studies
  2. Normative Considerations
  3. Equating vs. Standard Setting
  4. New Certification Program
  5. Low Candidate Counts
  6. In-person vs. Remote Standard Setting Meetings
  7. Alternative Item Types

Business of Certification Benchmarks

ICE conducts the Business of Certification Survey every two or three years.  The fourth iteration of the survey was offered this year in an exciting new platform.  The survey gathers information and financial metrics of interest to CFOs credentialing organizations. The survey includes questions surrounding revenue, expenses, staff size, outsourced activities, marketing efforts, etc.

Join the Business of Certification Task Force’s roundtable discussion for an opportunity to review this year’s survey findings in more detail. Participants can ask questions and preview the dynamic reporting features of the survey platform.

Future of Credentialing

With the onset of new demands in the credentialing marketplace for smaller, educational or product specific skill set training to the demands of employers for a trained workforce, the accepted model of credentialing is experiencing pressure.  This taskforce has been conducting an environmental scan to better understand the current state and future trends of credentialing. This roundtable session provides an opportunity to discuss the language and characteristics of the traditional model of certification compared to new trends and terminology in the market. Participants will to help shape a white paper around this topic.