Research Summit

Research Snapshot: A Look at ICE Research

Wednesday, November 7 | 2:00 pm - 3:30 pm CDT

Presenters: Lawrence Fabrey, Ph.D.; Michelle Gross, MBA, MEd; Patricia Muenzen, MA; Lisa Nepi, EdM; John Weiner, MA; John Wickett, PhD; Daniel Wilson; Patricia Young, MA; Anthony Zara, PhD 

Join ICE's Research and Development Committee to discuss topics, projects, and activities the committee has been pursing through the year. This is your opportunity to ask questions, provide real-time feedback, and influence the research ICE publishes.

This year’s session will be comprised of two parts: a presentation followed by roundtable discussions. The roundtables provide a deeper dive into the topics that resonate best with your interests. Current research projects are listed below:

International Expansion

The International Expansion Task Force has been formed by ICE to provide membership with information related to issues surrounding expansion of credentialing programs from domestic-only to international. We will present highlights of our research paper which summarizes 2 years of survey data regarding the ICE community’s international expansion experience, interest, and resource needs.

Measuring Non-Cognitive Competence

In 2017, an ICE Research and Development taskforce report was published for the credentialing community on the topic of “Assessing Noncognitive Competence (Weiner, Stobinski, Friedman & Gray, 2017). The report was discussed at the 2017 ICE exchange and attendees expressed in interest in continued research on this topic. Accordingly, a new taskforce was assembled to conduct a continuation (Part 2) of the original NCA project to explore case studies and survey organizations to describe industry trends in the assessment of “soft skills” for professional learning and credentialing.  This roundtable session provides an opportunity to discuss the part-2 initiative, gather input and share perspectives and experiences in this area.

Recertification Benchmarking Survey

The ICE R&D Task Force on Recertification and Renewal Benchmarks was established in 2017 to gather industry data that credentialing organizations in licensure and certification can use to benchmark their own policies and practices related to recertification and renewal including, but not limited to: components; fees; program philosophy; recent/anticipated changes; renewal rates; resource requirements; and time frames.

During the roundtable discussion, participants will have the opportunity to discuss findings from the pilot testing conducted during the summer of 2018.

Small Program Statistical Issues

The ICE R&D Task Force on Small Program Issues was established in 2016 to explore the challenges facing small credentialing programs. During the roundtable discussion, participants will have the opportunity to discuss findings from interviews conducted with individuals working with small programs on the solutions they implement to overcome these challenges. They will also have the opportunity to be part of the continuing research on the topic.  

Standard Setting

The Standard Setting research paper was released in September 2018. The purpose of this paper is to provide an introductory overview of standard setting processes, methods, approaches, challenges, issues, and policies for credentialing organizations.  Major sections of the paper include general components of standard setting, methods, policy issues, and current areas for further discussion.  These areas currently include:

  • Frequency of standard setting studies
  • Normative considerations
  • Equating vs. a standard setting study
  • Issues for a new certification program or for low candidate counts

For possible discussion:

  1. Frequency of Standard Setting Studies
  2. Normative Considerations
  3. Equating vs. Standard Setting
  4. New Certification Program
  5. Low Candidate Counts
  6. In-person vs. Remote Standard Setting Meetings
  7. Alternative Item Types

Business of Certification Benchmarks

ICE conducts the Business of Certification Survey every two or three years.  The fourth iteration of the survey was offered this year in an exciting new platform.  The survey gathers information and financial metrics of interest to CFOs credentialing organizations. The survey includes questions surrounding revenue, expenses, staff size, outsourced activities, marketing efforts, etc.

Join the Business of Certification Task Force’s roundtable discussion for an opportunity to review this year’s survey findings in more detail. Participants can ask questions and preview the dynamic reporting features of the survey platform.

Future of Credentialing

With the onset of new demands in the credentialing marketplace for smaller, educational or product specific skill set training to the demands of employers for a trained workforce, the accepted model of credentialing is experiencing pressure.  This taskforce has been conducting an environmental scan to better understand the current state and future trends of credentialing. This roundtable session provides an opportunity to discuss the language and characteristics of the traditional model of certification compared to new trends and terminology in the market. Participants will to help shape a white paper around this topic.

Competency Modeling

This project was initiated in 2018 to inform the ICE community regarding the question, What is competency modeling and how is/can it be used in the certification context? This year, we collected data via a literature review and interviews with subject-matter experts. We are ready to synthesize our findings into a written report.

Join us at the roundtable to share your burning questions about competency modeling and help shape the direction of the report to be published in 2019.