Sunshine and Roses or Doom and Gloom? Debating the Future of Testing

Business of Certification; Level of Content: Intermediate

I.C.E. Exchange Program Description: The opt out movement is in full swing in the education space. From K-12 to admissions, critics are vocally urging leaders to forego standardized testing and their advocacy is seeing results. Today, more colleges and universities are test optional than at any time in the past. Does this foreshadow changes in the credentialing and licensure space? Is it possible that testing will become just one of several options individuals can use to demonstrate their qualifications for a job or profession? As we look to the future, how will verification of skills and knowledge will evolve - will apprenticeships and diploma privilege render testing obsolete? Or will the intersection of the worlds of academia and credentialing include more certifications as part of a course or degree requirement? And perhaps most importantly, are there steps we can take as testing professionals to make the path ahead one of sunshine and roses, rather than doom and gloom? Join seasoned professionals for a spirited debate on the future of testing. Explore these issues and leave with key considerations to help shape the journey ahead for the assessment industry. It’s a session you won’t want to miss!

Teaching format, methods and strategies: Combined debate and panel discussion.

Speakers: Donna McPartland, JD, FIP, CIPM, CIPP/US, McPartland Privacy Advising; Stephanie R. Dille, MBA, Meazure Learning; Kellie Early, JD, Examining Solutions LLC; Isabelle Gonthier, PhD, ICE-CCP, PSI Services

We know it’s important but what can we do about it? Considerations and guidance on how credentialing bodies can put DEI principles into practice.

I.C.E. Exchange Program Description: Diversity, Equity, and Inclusion (DEI) are important inter-related principles that are rightly receiving more attention now than ever. Recognizing that each individual and each organization is on a different step of their DEI journey, we must turn our attention to tools and resources available for those who wish to advance and advocate for DEI. In this session, members of the I.C.E. DEI Task Force present an introduction to DEI and three resources they’ve developed or identified for credentialing bodies: DEI End Statements, some key DEI concepts and terms, and a DEI Maturity Model. The DEI End Statements show how I.C.E. has put DEI into practice as a strategic guide. The primer on DEI concepts and terms can help the recognition and identification of the many human characteristics that can contribute to DEI. The DEI Maturity Model can help organizations identify appropriate next steps toward advancing and organizing DEI efforts, showing how DEI can start with legal and regulatory compliance, move to a more programmatic or tactical level, then on to business strategy, and finally toward organizational culture.

Teaching format, methods and strategies: Panel Discussion

Speakers: Amin Saiar, PhD, Board of Pharmacy Specialties; Amine Issa, GPHR, PHR, HR Certification Institute; Denise Roosendaal, FASAE, CAE, Institute for Credentialing Excellence; Tracy Lofty, MSA, CAE, International Board of Heart Rhythm Examiners

Does your Organization have a Legally Defensible Disciplinary Process?

I.C.E. Exchange Program Description: How much thought have you put into your organization’s disciplinary processes? Do your procedures provide certificants with adequate due process? Is your disciplinary review committee making legally defensible decisions? Are your committee members adhering to the organization’s written rules and procedures? Legal challenges to an organization’s disciplinary decisions can be costly. Even more concerning is the damage these challenges can do to an organization’s reputation and the value of its credential. Therefore, it is essential that your disciplinary process is structured and administered properly. This session will discuss the legal concepts every organization should consider when creating its disciplinary process. Additionally, it will set forth ways to ensure your program provides sufficient due process to certificants. Presenters will also discuss the proper way to administer a disciplinary program so that decisions are consistent and legally defensible. They will set forth steps all organizations can take to prevent arbitrary and capricious decision making. Finally, session presenters will address legal issues that may arise during the complaint process, including breaches of confidentiality and conflicts of interest.

Teaching format, methods and strategies: Traditional Concurrent Session and Q&A

Speakers: Katharine Meyer, ESQ, American-Speech-Language Hearing Association; Richard Bar, Esq., GKG Law, P.C

Trends in Governance: Key Findings of an Industry Survey of Governance Models

I.C.E. Exchange Program Description: Credentialing programs take various approaches to building organizational structure and selecting models for efficient and effective governance. Taking the time to understand governance best practices and benchmark against other credentialing organizations aids in selecting the right model. In 2022, SeaCrest conducted a survey to gather data and feedback on program governance issues . The 2022 project is the third version of the survey, and the results will be presented with a focus on identifying best practices along with trends and differences from previous years. The survey addresses the following topics specific to certification governing bodies: • Incorporation status • Composition & terms • Selection & criteria • Meetings • Training, orientation, & evaluation • Financial management • Quality improvement & policy review • Strategic development Results of the 2022 survey will be presented with a summary of trends and differences from previous surveys administered in 2013 and 2008. Survey results will be shared with conference attendees.

Teaching format, methods and strategies: Traditional concurrent session

Speakers: Janice Moore, ICE-CCP and Cynthia Allen, ICE-CCP, SeaCrest; Sheri Sesay-Tuffour, PhD, CAE, Pediatric Nursing Certification Board, Inc.

Hard Facts About Soft Skills

Test Development and Administration; Level of Content: Intermediate

I.C.E. Exchange Program Description: Dramatic and accelerating changes in work and workplaces are elevating the importance of noncognitive competency assessment vis-à-vis traditional assessment of knowledge, skills, and abilities. Technological changes, including automation, are transforming the nature of work. Growing appreciation for the importance of communication and teamwork pulls in one direction while the ballooning phenomenon of remote work demands a different set of adaptations. This session will explore in depth the rapidly evolving trends, applications, and considerations for noncognitive assessment in credentialing. An expert panel will discuss key topics related to assessment of noncognitive competencies.

Teaching format, methods and strategies: Panel discussion, on questions probing why non cognitive skills assessment in credentialing is important for public protection, for meaningful recertification decisions, and for the credibility of credentials.

Speakers: Rebecca LeBuhn, National Board of Certification and Recertification of Nurse Anesthetists; John Weiner, MA, PSI Services; Ibi Layi-Ojo, MS, SPHR, SHRM-SCP, ICE-CCP, Certified Financial Planner Board of Standards, Inc.; Chad Buckendahl, PhD, ACS Ventures, LLC

Instructionally Sound Certificate Study Prep

I.C.E. Exchange Program Description: What is the best way to develop certification review courses and study prep? By utilizing the principles of adult learning, and ensuring the offering(s) are appropriate for the delivery methods (virtual classroom, face-to-face, eLearning, or a hybrid), the needs and preferences of candidates, and the scope and intent of the certification. Can you do that while honoring firewalls? You bet, and this session will show you how, with ideas for effective study prep design and real world examples from an association who integrated instructional design in their study materials.

Teaching format, methods and strategies: Traditional concurrent session

Speakers: Michelle Nolin, CPTD, Learn Ethos LLC

Research Summit: A Look at I.C.E. Research

I.C.E. Exchange Program Description: I.C.E.'s Research and Development Committee shared the activities, research findings, and projects the committee pursued through the year. Topics include: Eligibility Criteria, Forensic Data Analysis, Job Analysis, Live Remote Proctoring, Pandemic Pass Rate Trends, Subject Matter Expert Qualifications, and Test Disruptions.

I.C.E. R&D Committee Members

Innovative assessment strategies: Are they accessible to candidates with disabilities?

Test Development and Administration; Level of Content: Intermediate

I.C.E. Exchange Program Description: Innovative credentialing programs consistently review and evaluate the effectiveness of assessment design. Credentialing organizations have developed and implemented innovative assessment strategies, including unique item types, simulations, gaming, performance testing, and multi-modal forms of assessment. Indeed, the industry has witnessed a myriad of technological advances which have evolved test development and delivery to mirror the knowledge, skills, abilities, and attributes of candidates in their job roles. But while these advances are exciting to test developers, they may be problematic for candidates with disabilities. Can we develop innovations in our test design and test delivery, while still accommodating candidates with disabilities who have unique accessibility needs? This session will focus on key areas of consideration for test developers as they pursue new and innovative assessment content and methods for delivery. The presenters will address types of test adaptations that might be problematic for candidates with various types of disabilities. The presenters will emphasize practical considerations for accessible test development, and strategies to avoid potentially costly and time-consuming remediation efforts if your organization develops a test that isn’t accessible.

Teaching format, methods and strategies: Panel discussion.

Speakers:  Maria Incrocci, PhD, RPh, Scantron; John Hosterman, PhD, Paradigm Testing, LLC; Bill West, MBA, Cornerstone Strategies

When you say test center, what kind of test center do you mean?  Evaluating test centers and their respective features and tradeoffs

Test Development and Administration; Level of Content: Intermediate

I.C.E. Exchange Program Description: It’s clear that the COVID-19 pandemic disrupted the prevailing mode of high-stakes testing with the necessity of quarantines, social distancing, and lockdowns, all of which impacted the availability of brick-and-mortar test centers. Over the past two years, many test sponsors have sought alternative delivery methodologies, beyond traditional test centers. Remote online proctored testing existed prior to the pandemic, of course, but its growth and acceptance has accelerated significantly in just the past two years. As programs continue to explore the viability of online proctoring for their specific exams and credentials, much consideration has been devoted to the different features and capabilities of remote online proctoring platforms and tools and how they compare with the generic notion of traditional “test centers”. However, a weakness with those comparisons is that many in-person brick-and-mortar test centers have different features, advantages, capabilities, and risks. So, when you say test center, what do you mean? This session will explore the significant and meaningful variations between different kinds of test centers and candidate populations, including: the continuum of access and control, candidate experience and exam delivery, and security frameworks and protocols. Leave with an understanding of the tradeoffs between the options for test center delivery and be better prepared to decide the appropriate modality for their credentialing program.

Teaching format, methods and strategies: Presentation with audience questions and answers

Speakers: Casey Marks, PhD,ISC2; Levi Boren, PhD, Pharmacy Technician Certification Board; Anthony Zara, PhD and Brenda Aubin,Pearson VUE

Certifying the Certifiers: Design, Development, and Implementation of the ICE-CCP Credential

Business of Certification; Level of Content: Intermediate

I.C.E. Exchange Program Description: In 2020, the Institute for Credentialing Excellence (I.C.E.) embarked on a process to develop the certified credentialing professional (ICE-CCP) certification program designed for individuals working in the credentialing industry. The program was built from the ground up, with several industry partners collaborating with I.C.E. to design and develop the key components of a credentialing program. This work culminated with the launch of the ICE-CCP pilot examination in November 2021. As members of our credentialing community may expect, this was a program without precedent. Both the subject matter expert volunteers who supported the test development process and the pilot test candidates represented a unique population of individuals: those who are currently employed in the credentialing business representing the variety of roles across governance, operations, and assessment development. In other words, no credentialing examination has ever been taken by such an informed group of test takers. Moderated by Linda Anguish, Director of Accreditation Services at I.C.E., this panel will include measurement professionals from the credentialing industry who contributed to the job analysis, item development, test publishing, test delivery, statistical analysis, standard setting, scoring, and reporting of the inaugural ICE-CCP examination. Hear about their challenges and reflections throughout the process, along with insights and recommendations for future program activities. Attendees are certain to be enlightened and entertained by the several unique and occasionally humorous observations and encounters. Attendees will have the opportunity to ask questions of the presenters and to learn more about the ICE-CCP if they are considering earning the credential themselves.

Teaching format, methods and strategies: A panel discussion among four psychometricians plus an I.C.E. staff member to serve as moderator and a resource to answer operational questions about the program.

Speakers:  Amin Saiar, PhD, Board of Pharmacy Specialties; Chris M. Beauchamp, PhD, Meazure Learning; Maria Incrocci, PhD, RPh, Scantron; Paul E. Jones, Ph D, Pearson VUE; Moderator: Linda Anguish, SPHR, Institute for Credentialing Excellence

Meeting Stakeholder Needs through Training and Credentialing

Business of Certification; Level of Content: Introductory

I.C.E. Exchange Program Description: Micro-credentials have been the topic of conversation for credentialing professionals for many years, and the industry is looking for concrete examples of how credentialing organizations are using them to expand their product portfolio. Attend this session to hear how a mission-driven organization used micro-credentials to meet the training needs of professionals in the field while also establishing the groundwork for a future professional certification program. In 2021, the Institute for Healthcare Advancement (IHA) launched a portfolio of seven micro-credentials for individuals working in the field of health literacy. The launch was the result of several years of planning and development to identify and understand the needs of the target audience, determine the appropriate credentialing product to meet those needs, and create a long-term strategy for the future. IHA engaged a team of credentialing experts to guide them through this journey using a framework based on in best practice and accreditation compliance. Leave understanding the challenges in the process and lessons learned through each project milestone.

Teaching format, methods and strategies: The session will be a panel format from three perspectives: (1) psychometrician; (2) staff and learning design; and (3) credentialing consultant

Speakers:  Cynthia Allen, ICE-CCP, SeaCrest; Rachel Roberts, MPH, CHES, Institute for Healthcare Advancement (IHA); Joy Matthews-López, PhD, JML Measurement and Testing Services; Shannon Carter, Ed., CAE, American College of Veterinary Internal Medicine (ACVIM)

Getting Beyond “It Depends”: Psychometricians Debate Hot Topics in Credentialing - Part Three

Credentialing Innovations; Level of Content: Intermediate

I.C.E. Exchange Program Description: Attend this lively debate on hot topics and current challenges faced by credentialing programs. Join a panel of psychometricians as they spar over topics such as whether a firewall between assessment and education is truly needed, whether different groups should have different passing standards, whether the typical approach to testing for item bias is sufficient, and whether common credentialing practices yield sufficient validity evidence. After presenting positions and rebuttals on each issue, the panel will entertain questions from the audience and discuss their own opinions on each topic.

Teaching format, methods and strategies: Debate

Speakers:Amin Saiar, PhD, Board of Pharmacy Specialties; Daniel H. Breidenbach, PhD, ICE-CCP, PSI; Tim Muckle, PhD, NBCRNA; Sarah Carroll, PhD, Board for Certification in Occupational Therapy; Andrew C. Dwyer, PhD, ICE-CCP, American Board of Pediatrics:

Thinking outside the box: Leveraging microcredentials across multiple credentialing programs.

Beyond Traditional Credentials; Level of Content: Introductory

I.C.E. Exchange Program Description: What are microcredentials? How might they apply or be an option for credentialing in various disciplines? Why are we even talking about this and what are key considerations and benefits of microcredentials that make this discussion critical and timely? A panel of credentialing program leaders discuss and brainstorm potential applications of micro-credentials within and across nursing specialties as well as applications across other disciplines. Hear key benefits as well as challeges related to microcredentialing, generate ideas, and review future opportunities and how microcredentials could be leveraged to continue support the mission of credentialing organizations.

Teaching format, methods and strategies.: Panel Discussion, with key questions posed to the panelists and then additional questions for the audience.

Speakers: Isabelle Gonthier, PhD, ICE-CCP, PSI Services; Tony Ellis, CAE, ICE-CCP, Oncology Nursing Certification Corporation; Terri Hinkley, EdD, MBA, BScN, RN, CAE, Medical-Surgical Nursing Certification Board; Janie Schumaker, MBA, RN, CEN, CENP, CPHQ, FABC, Board of Certification for Emergency Nursing

Three Case Studies of Innovative Certifications

Beyond Traditional Credentials; Level of Content: Advanced

I.C.E. Exchange Program Description: Attend this session to hear from representatives from three organizations: - the International Society for Performance Improvement (ISPI) that has a 20 year old portfolio-based certification whose certificants work across all industries in 60 countries, the National Association for Roofing Contractors (NRCA), that rolled out its first of 17 performance-based certifications in 2019 each with a hands-on assessment, and the Institute for Performance Improvement (TIFPI) that offers a project-based certification for facilitators of multi-sector initiatives to advance the development of people in careers where there is significant skill shortage (airline industry for example). The panelists will answer four questions: What was the problem you were trying to solve?What is different about your certification compared to traditional test-based credentials?How does your model address your business or societal need? What have you learned that others might benefit from knowing?

Tenaching format, methods and strategies: Panel discussion with moderated Q&A.

Speakers:Nancy C. Burns, PhD., CPT, PMP, CPIF, International Society for Performance Improvement; Deb Page, CPT, CPIF, HPLJ, Institute for Performance Improvement; Jeanne Schehl, EdD, National Roofing Contractors Association; Moderator: Judith A. Hale, Center for International Credentials

Applying for Accreditation under the NCCA 2021 Standards (NCCA Session): A session with NCCA Commissioners

Standards and Accreditation; Level of Content: Beginner

I.C.E. Exchange Program Description: As part of its continuous process of quality improvement, the NCCA initiated a review and update of the Standards beginning in August 2019. The intent of the revisions was to clarify, reorganize/increase efficiency, and address challenges that have arisen in applying the Standards over the past four years. Through this process, the 2021 NCCA Standards clarifies the requirements that programs have been addressing through inquiry and compliance reporting processes over the last several years. Attend this session to improve your understanding of the 2021 NCCA Standards, the practical implications of the revisions, and how to submit a well-documented and supported accreditation package. This session will be especially helpful for programs who are preparing reaccreditation applications.

Teaching format, methods and strategies: Traditional concurrent session.

Speakers: Kevin Bradley, PhD, Human Resources Research Organization (HumRRO); Natalya Mytareva, MA, CoreCHI™, Certification Commission for Healthcare Interpreters; Michele Warholic

Privacy and Data Protection: Compliance Annoyance or Candidate Safeguard? Guidance on Effective Privacy within a Certification/Credentialing Program

I.C.E. Exchange Program Description: This session by two experts in assessment and privacy sets out the key steps for a certification or credentialing program to ensure that it respects the privacy of its candidates and is likely to meet data protection regulatory requirements. Privacy rules and regulations are in flux worldwide. Europe is stepping up its enforcement of the GDPR, and there are several newly enacted US State and international privacy laws with even more proposed laws circulating through legislative channels. This session will give an overview of the privacy requirements faced by credentialing and certification bodies, focusing primarily on the US and Europe. Some credentialing specialists see privacy and data protection as a compliance burden. However, this session will suggest ways in which programs can comply with multiple laws and regulations and actually show respect for candidate privacy by ensuring personal data is safeguarded and only used for the purpose of an assessment, which can also be a candidate safeguard and a marketing benefit. The session will also suggest that by preparing properly to meet privacy needs, you will save time and effort in the long term.

Teaching format, methods and strategies: Presentation with pre- and post-presentation audience participation

Speakers: John Kleeman, MA FBCS C.Eng CIPP/E, Questionmark; Allison Mulford, ESQ, MBA, CIPP/E, Caveon, LLC