Crafting Security and Privacy Policies for a Multi-Modal Delivery
Presenters: Rachel R. Watkins Schoenig, Esg., Cornerstone Strategies LLC; Jeff M. Marsh, Ascend Learning; Linda Adler, National Board of Medical Examiners; Kellie Early, National Conference of Bar Examiners
Many testing programs have embraced multi-modal delivery during the pandemic, meaning they are offering their tests at both test centers and remotely at locations selected by their test takers. This has required testing programs to reconsider long-standing policies designed to protect test content and integrity as well as address test-taker concerns regarding online proctoring.
What can testing programs do to adequately protect their exams while adapting to multiple delivery modalities? What tools are available to help programs select policies and procedures that are right for both test-takers and the broader stakeholder community? How can programs ensure that changes are properly implemented and expectations are aligned across the testing ecosystem?
Join testing professionals who have successfully navigated multi--modal delivery in an engaging and informative workshop to explore the processes, tools, and key considerations needed to craft multi-modal policies.
Strategic Leader Workshop: The Business of Credentialing and The Science of Innovation
Presenters: Phil Gibbs, PhD and Steve Little, DBA, The Disruption Lab
The often repeated saying that “everything changed” with the pandemic is true in terms of how we office, work and learn. Like many sectors under this umbrella of activities, how we recognize stages of skill development and learning was already changing. Traditional diplomas and degrees from traditional institutions were already being supplemented with all types of badges, certificates, and credentials. Post pandemic this is likely to accelerate rapidly.
The objective of this workshop is to enable credentialing professionals to move from a reactive mode in this new environment to a proactive mode. These professionals have the opportunity to be innovative and adopt disruptive innovation processes that will allow them to grow their organizations in this time of change and transition.
An Exercise in Perspectives: An interactive stakeholder exchange on licensure and certification.
Presenters: Dale Atkinson, JD and Margo Adams Larsen, PhD, Atkinson & Atkinson, LLC/The Atkinson Firm
It is often difficult to appreciate the roles in the day to day context of the business of credentialing. This session will focus on, explore, and discuss the various stakeholder perspectives in the world of licensing and credentialing.
During the workshop, the presenters will share practical knowledge and challenge common misconceptions related to licensing and credentialing, and focus on developing the participant’s broader view of the role government, private sector, and consumers play in protecting the public and ensuring competency within practice and service delivery areas.
Integrating Decisionmakers in the Standard Setting Process: A How-to for Licensure and Certification
Primary Presenter: Corina Owens and Brett P Foley, PhD, Alpine Testing Solutions, Inc.
Standard setting is arguably one of the most critical aspects of any certification exam program. It defines the expectations for the exam or the performance standard and then translates that performance standard into an exam cut score. Credentialing organizations often rely on psychometricians and subject matter experts when determining exam cut scores. However, it is important to keep in mind that standard setting is ultimately a policy decision. Although decision-makers often have the final say on a test’s cut score, they sometimes lack the background and training to make a fully informed, psychometrically sound decision.
This workshop will present a systematic, multi-tiered, standard setting framework to help decision-makers integrate a broader range of considerations into their process while still honoring the experience, expertise, and judgment of subject matter experts.
Workshop presenters will guide attendees through two examples of implementing a role responsibility assignment matrix; one example in a licensure setting and one example in a certification setting. Further, workshop presenters will describe various types of feedback that could be used to inform the standard setting and decision-making process. Attendees will leave with a completed role responsibility matrix to support their next standard setting study.
NCCA Standards Revision Town Hall
Presenters: Representatives from both the Standards Revision Main Committee and the NCCA
The NCCA Standards Revision project started in November 2019 with the intention to clarify, reorganize, and address challenges that have arisen in applying the NCCA Standards since the prior revision. Hear an overview of the project, what the upcoming changes entail, and an update regarding the implementation phase.
First Time Attendee Reception
Hosted by I.C.E.'s Program Committee, this reception is designed to encourage networking among other first-time attendees and provide an opportunity for you to meet I.C.E.'s volunteer leaders. This is an invitation-only event for first-time attendees.
Opening Welcome Reception in the Innovation Hall, sponsored by Pearson Vue
Attend the opening reception in the Innovation Hall. Thank you to Pearson Vue for sponsoring this session.
Audience Interactive: ISO/IEC I7024
Presenter: Dr. George Anastasopoulos, International Accreditation Service, Inc. (IAS)
Attend this session to learn about the ISO/IEC 17024 Standards. This is your opportunity to meet and ask questions with representatives from the International Accreditation Service.
Maximizing the Subject Matter Expert (SME) Lifecycle: Successful Case Studies on being Intentional
Presenters: Guillermo Ortiz de Zarate, President, Lineup; Jared Zurn, NCARB; Charles Glover, SHRM
Every exam program relies on subject matter experts (SMEs) to write and review items, inform and analyze job analyses, as well as to possibly lead and serve as part of organizational strategy. When it comes to SMEs, every program faces the same four critical challenges: attracting the best, assembling them efficiently and effectively, motivating them to accomplish organizational goals, and evaluating individual and group performance. Gain insights from the trenches and participate in facilitated discussions to learn how to better focus on individual skill and group diversity across the entire volunteer lifecycle to create better outcomes for your organization.
Remote Proctoring and Security: What Have We Learned?**
Presenters: Carl Bowman, CompTIA; Corina Owens, Alpine Testing Solutions
Remote proctoring is a very relevant and timely topic of concern, both from certification validity and content security perspectives for many certification bodies. Further, remote proctoring will be used for the foreseeable future and will, at a minimum, continue to be a topic of research and ongoing concern throughout 2021. Hear high-level comparative results from the four psychometric studies, lessons learned from internal secret shops of the remote proctoring service, and recommendations to enhance future innovations in remote proctoring delivery. Remote proctoring services provide most of the essential security features required for high-stakes testing; however, there is still plenty of opportunity for growth and improvement.
Show Me the Documentation!: Avoiding the Pitfalls of Substandard Learning Outcomes, Incongruent Cognitive Rigor, and Deficient Assessment
Presenters: Shelly Segre McDowell-Porter, PhD, Marisa Peyton, and Mike McGraw, Global Skills Exchange
Constructing measurable learning outcomes to align with assessments that demonstrate an appropriate level of cognitive rigor for your program's certificate or credential content is paramount to the NCCA and ACAP application and recertification process. This session will help participants avoid the pitfalls of writing substandard learning outcomes (LOs) and arbitrarily selecting assessment models that are not defensible. Participants will learn how to gather information and provide appropriate documentation to justify their program's selected assessment methodology (e.g., criterion-referenced or performance-based). Learn simple tools, techniques, and strategies to exceed documentation requirements for ACAP and NCCA standards for initial applications and recertification.
Debating and Discussing 5 Controversial Credentialing Topics**
Business of Certification, Level: Intermediate
Presenters: Cynthia Allen and Janice Moore, SeaCrest Consulting; Morgean Hirt, ATD Certification Institute; Shannon Carter, CAE, American College of Veterinary Internal Medicine; Mickie S. Rops, MAEd, FASAE, CAE, Mickie S. Rops Consulting LLC
Certification programs provide value to professionals, employers, associations, and the public. The certification business has evolved and meeting the needs of a diverse stakeholder base poses both strategic challenges and potential opportunities. In this session, a panel of certification leaders will discuss and debate 5 questions certifiers face including remote proctoring, micro-credentials, training & certification, accreditation, and struggling programs.
Facebook & LinkedIn Analytics: Leveraging the recent changes to Facebook LinkedIn's reporting tools
Presenter: Amy Jauman, SMS, GPHR, National Institute for Social Media
Facebook and LinkedIn are two of the most critical platforms for professional organizations, and both organizations have robust reporting systems that can be leveraged to drive success for your certification. Are you watching what the data is telling you about your audience?
In 2021, Facebook announced what seemed like big changes to reporting options. But to what extent would the changes really affect how businesses used the data gathered? On LinkedIn, meaningful connections are possible through individual employee profiles, company pages, and groups to thought leadership and promotion through blogging and paid advertising. How many of the small things any organization can do to connect with the right people through this powerful platform are happening in your organization? In this session, we'll explore both Facebook and LinkedIn and what organizations should consider for their own growth in their industry.
Federal and State Legislative Initiatives Affecting The Certification Community
Presenters: Julia Judish, Esq, Pillsbury Winthrop Shaw Pittman LLP; Jeff Evans, ASAE: The Center for Association Leadership
This presentation by Julia Judish, legal advisor to the Professional Certification Coalition (PCC), and Jeff Evans, Director, Public Policy, at the American Society of Association Executives (ASAE), will discuss important federal legislative opportunities benefiting the certification community for which the PCC and ASAE have advocated. The session will also address legislative threats to the certification community at the state level in the past year and major legislative trends the PCC is tracking that may affect certification organizations, both in regulated professions and for wholly voluntary certifications.
Certification’s Role in State Licensure
Business of Certification
Author: Margaret "Misty" Bloom, Behavior Analyst Certification Board
In early 2021, the I.C.E. Government Affairs Committee in collaboration with the Research & Development Committee convened a subgroup to gather survey information related to certification boards that are recognized in licensure and regulatory requirements. The goal of the study was to address the IRS classification of professional/private certification as typically being a 501(c)(6) (trade association) activity and not a 501(c)(3) (charitable/educational) activity. Of particular interest was the need to assess the extent to which private certification is of benefit to licensure and regulatory activities. The subgroup is very grateful to the survey participants. The survey outcome has provided valuable research for certification boards to assert that their activities lessen the burden of a governmental activity. This e-poster will summarize the survey results.
Credentialism in Pandemics
Author JG Federman, EdD, Creighton University
This e-poster provides operational information about credentialism and its effects during the Covid-19 pandemic on industry members. Strategic insight into post-pandemic practices - in light of credentialism forces - will be provided for credentialing institutions and their members to use in FY2022 operations.
How to utilize chameleon clones to strengthen exam security
Security, Records and Data Management
Authors: Brooke Houck, Ph.D. and Jill Bryant, OD, National Board of Examiners in Optometry; Sarah Toton, Caveon Test Security
Have you ever wished you could build your exam with internal security features? Chameleon clones are an innovative exam security feature that consists of an item type designed to detect pre-knowledge. This e-poster will provide attendees information about chameleon clones – what they are, how they are used, and how to create them.
12:00 - 12:15 pm: Microcredentialing Toolkit
Alternative Credentials, Level: Introductory
Presenters: Microcredentialing Task Force Members
Thinking about developing microcredentials – or just want to learn more about them? Hear about the new Microcredentialing Toolkit developed by the I.C.E. Microcredentialing Task Force and walk away with tips on how to make the best use of these resources.
12:45 - 1:00 pm: To Continue or Not Continue…That is the Question: The Unique Use of a Feasibility Study to Determine the Future of Two Certification Programs
Presenters: Keisha Davidson, Hospice and Palliative Credentialing Center; Cynthia Allen, SeaCrest
Review a unique situation in which a feasibility study, normally completed prior to a certification program’s launch, was conducted to help determine the future of two long established, but under-performing certification programs. Hear how data from feasibility studies empowered organizational leaders to re-calibrate expectations for underperforming programs.
1:15 - 1:30 pm: An Analysis of Credential Candidates’ Testing Behavior in COVID-19 Pandemic
Test Development and Administration, Level: Intermediate
Presenters: Isbah Ali Farzan and Unber Ahmad, National Board of Certified Counselors
COVID-19 resulted in many new restrictions but also new opportunities for credentialing examinations. Explore the impact of these restrictions and opportunities on candidates by analyzing the application, registration, test completion time, and passing trends before and after the start of COVID-19. The presenters will also examine candidates’ performance on online examinations.
Changes in Work: Implications for Credentialing Assessment
Test Development and Administration, Level: Intermediate
Presenters: John Weiner, PSI Services; Alexander Alonso, PHD, SHRM-SCP, Society for Human Resource Management; Grady Colson Barnhill, MEd, National Commission on Certification of Physician Assistants
Occupations have been rapidly evolving in recent years with advances in technology, digitalization and automation of tasks and processes. The rate of change has been accelerated by the pandemic and the push towards virtual/remote work and learning. The effects of these changes have been far reaching and pose new challenges for the design of credentialing assessments. In this session, experts in credentialing assessment will explore these changes and challenges and discuss the implications for those who design, develop, and use tests for high stakes credentialing programs.
The panel will examine questions related to technology- and pandemic-driven changes in work and the workplace, new and shifting competency requirements, and the impact on test design and development processes such as job analysis, competency modeling, what is measured, and when it is measured in the credentialing process. In discussing these topics, the panel will draw from their vast experience and expertise in credentialing testing, representing the perspectives of two different credentialing programs, as well as a global assessment services organization. Audience members will be encouraged to participate in the discussion to share additional perspectives and engage with the community.
Does your industry need a stackable credential?
Alternative Credentials, Level: Intermediate
Presenters: Johnna Gueorguieva, Ph.D., CAE, Dental Assisting National Board; Kim Cohen, ISACA; Kate Slagoski Kahoa, MEd, PSI Services
Stackable credentials are not new, but what are they really? We may consider them a micro-credential or building blocks or milestones to indicate incremental career growth which eventually lead to a certification. These types of credentials can be an opportunity to grow an existing credentialing program and can be considered when developing a new program.
This session will describe stacked credentials and the different types of stackable credential models. Learn a decision-making framework that assists a program in deciding whether this is right for their program and if yes, which model may be the best fit. Talk with two organizations that have created stackable credentials: one that did it before it was called credential stacking and one that recently started developing stacked credentials.
Going the Way of Blockbuster: Will Test Centers Become Extinct?**
Presenters: Rachel R. Watkins Schoenig, Esg., Cornerstone Strategies LLC; Bill West, Examity; Jeff M. Marsh, Ascend Learning; Linda Adler, National Board of Medical Examiners; Stephanie Dille, ProctorU
We’ve spent years debating whether online proctoring is a viable delivery option for high-stakes assessments, including certification and licensure exams. The pandemic moved several organizations down that path more quickly than anticipated. Now that programs, and test-takers, know what it takes to test remotely, will it further alter our testing model to the point where test centers become used so seldom that they go the way of Blockbuster? Join testing professionals with both test center and online testing experience as they debate the future of test delivery
Hey! Why Doesn’t Anybody Look Like Me?**
Business of Certification, Level: Introductory
Presenters: Mihaiela Ristei Gugiu, National Registry of Emergency Medical Technicians; Dawn Morton-Rias, EdD, PA-C, National Commission on Certification of Physician Assistants; Robin Rone, APRA International; Moderator: Beverly Black, National Commission on Certification for Physician Assistants
This session will focus on strategies for enhancing equity, diversity, and inclusion among testing and credentialing professionals. There are qualified professionals from minority groups such as black, indigenous, and people of color (BIPOC), people with disabilities, lesbian, gay, bisexual, queer, and transgender (LGBTQ+) etc.), but they are not equally represented in the credentialing profession.
Do those involved in examination development and administration currently reflect the diversity of the candidates? What organizational strategies would open the pipeline so that the professionals developing and administering credentialing exams reflect the diversity of the overall population? How can the industry attract more diverse people into the credentialing profession? Is there a systemic bias that creates a barrier to entry? How can the obstacles that interfere with obtaining the education and experience needed to qualify for positions in the credentialing industry be removed?
Success in the profession requires a range of knowledge and skills, including communication, research, data management, collaboration, team building, networking, project management, and leadership. Learn about organizational assessments to determine: the diversity and inclusiveness of the current staff and board; the organizational attitude about equity, diversity, and inclusion; and the commitment to diversity in recruitment to fill available positions. Learn how forging new alliances with historically black colleges and universities can be part of a deliberate effort to diversify the pool of candidates.
Audience Interactive: An Update from the I.C.E. Membership Structure Task Force
Presenters: Isabelle Gonthier, PhD, PSI Services; Janice Moore, SeaCrest Consulting, Membership Structures Task Force Members
Attend this discussion to learn about the work for the I.C.E. Membership Structures Task Force. Have the opportunity to provide feedback to the task force.
Level Up Your SMEs: Build Better Banks through Gamification, Revenue Sharing, Crowdsourcing, and AI
Credentialing Innovations, Level: Intermediate
Presenters: Clyde Seepersad, The Linux Foundation; Alan D. Mead, Ph.D., Certiverse
As more testing programs move to virtual development and remote delivery, security depends heavily on creating large item banks. By opening up content development to a broader group of contributors, test sponsors have a greater chance of reaching this higher bar. The key is providing guidance and engagement to SMEs who know plenty about their topics but may not be experts in testing.
This sessil will detail how a virtual test development platform enabled a testing program to expand their SME pool and create a new pre-professional certification within a three-month period. The platform helped SMEs learn and apply proper item writing practices, all on their own schedules and locations. They were motivated to contribute through internal and external recognition, and a revenue-sharing compensation model provided an incentive to write high-quality items. Hear how innovative engagement can enable your expert community to create the item banks of the future.
Strategies to Promote the Value of Your Certification Program
Marketing and Communication, Level: Intermediate
Presenters: William Ellis, RPh, MS, Board of Pharmacy Specialties, Todd Galati, American Council on Exercise
While the world is rapidly changing (especially the post-pandemic world) there has been increasing discussion about the knowledge and skills needed for employment. If certifying agencies wish to remain relevant, there needs to be a comprehensive, multi-faceted effort to understand and promote the value of your certification to important stakeholders such as the public, professional colleagues, employers, and government agencies.
This session will explore consdierations in describing your certification programs’ value including alignment with market needs and the expectation of stakeholders. Leave with ideas to promote value and help assure their credentials continued viability in a competitive marketplace.
Testing Accommodations through Different Exam Delivery Modalities: Challenges and Opportunities**
Test Development and Administration, Level: Introductory
Speakers: Ashley Norris, PhD, ProctorU; Carlie Davies, American Medical Certification Association; Dana Kelly, National Association of Student Financial Aid Administrators; Greg Pope, APEGA
Credentialing organizations are faced with increased volumes of requests for testing accommodations and must carefully balance the access needs of candidates with disabilities with their mission to ensure safe and effective practice. With the increased use of online proctoring as an exam delivery modality, as an alternative or in conjunction to test center delivery, there are a number of considerations to review and evaluate in providing testing accommodations.
The panel will discuss challenges and opportunities as it relates to testing accommodations through different modalities, including online proctoring and in test center, or from a hybrid offering. Key topics to be addressed include:
Examples will be discussed along with key applications from a program perspective, leveraging the experience from the three individuals representing different testing or regulatory organizations. This discussion will provide an opportunity to outline options for testing accommodations and appropriate parameters for reviewing accommodations requests, communicating decisions, and implementing accommodations while preserving the integrity of the testing program.
Best Practices for Disciplinary Policies and Procedures
Standards and Accreditation, Level: Intermediate
Presenters: John Zarian, Esq.and Christina Hebdon, National Commission for the Certification of Crane Operators
Credentialing programs are generally required to implement ethics and discipline policies and procedures. This session will review the legal risks and considerations surrounding such a program. The session will also discuss recommended procedures and best practices for handling disciplinary matters, including considerations of case intake, investigation, documentation, appellate procedures, and appropriate escalation. In addition, the session will consider related issues such as identifying opportunities for improvement, the best use of written agreements and websites, and the need to view disciplinary procedures in a broad context of program integrity.
Certification Program for Credentialing Professionals
Business of Certification, Level: Introductory
Presenters: Linda Anguish, SPHR and Douglas Weinbaum, Institute for Credentialing Excellence
I.C.E. launched the premier certification program for credentialing professionals. The I.C.E. Certified Credentialing Professional (ICE-CCP) allows credentialing professionals to demonstrate their knowledge, skills and abilities in governance, program operations, and assessment development and validation. Attend this session to learn about the program and ask questions of I.C.E. staff.
Lead change, audit yourself: a process review of content development DEI and bias reduction.**
Presenters: Christine Mills, Ph.D.,and Kelly Von Lunen, Ascend Learning; Grace DeLee, MA, and Marielle Lerner, Ph.D., cApStAn Inc.
For decades test sponsors have employed bias review committees and DIF analysis to address bias in test content. With recent events in the United States infusing energy into how our culture addresses Diversity, Equity, and Inclusion, test sponsors are prompted to take a fresh look at their processes and ask, “How can we do better”?
In this session attendees will hear about the audit process and lessons learned from one organization’s effort to audit their diversity, equity, inclusion, and bias reduction (DEI-BR) processes.
Audience Interactive: The Whole Candidate: Developing “Soft Skills” in Progressive Certification
Credentialing Innovations, Level: intermediate
Presenters: Beth L Kalinowski, MBA, SPHR, AMA-CPM, PSI Services; Carissa Homme, PhD, PMP, Competency and Credentialing Organization (CCI)
Is your ability to work in a team as good as you think it is? How effective are you at managing conflict? When delivering a service, how important is quality to you? Imagine a way to answer these questions. Would you approach a job analysis differently? Would you provide learning opportunities for “soft skill” evaluation and development applicable to your industry?
One program is tackling these questions through incorporation of soft skill and self-assessment activities in a newly developed credential for early career perioperative nurses. Participants are required to complete the following four components: 1) the 16pf – a personality assessment, 2) the Perceived Perioperative Competence Scale – Revised, a self-evaluation of professional competencies, 3) a 120-item knowledge-based exam, and finally 4) review of assessment results and construction of a development plan for specifically identified areas. Learn how the program came to be, the results so far, and how you can apply these tools to enrich your programs or develop a novel offering.
Happy Hour in the Innovation Hall, Sponsored by Prometric
Join your fellow attendees in the Innovation Hall for Happy Hour. Special thank you to Prometric for sponsoring this event.
Evaluation of item banks and test constraints for LOFT
Speakers: Kirk Becker, PhD, Pearson VUE; Timothy Joseph Muckle, NBCRNA
Test assembly, especially when automated for LOFT or CAT exams, requires careful consideration of item bank characteristics and test specifications. This session shows how a simple approach developed for CAT item selection (the maximum priority index) can be repurposed to quickly evaluate different test specifications. Review of the forms selected, item exposure, form overlap, and test statistics can provide direction for revising or implementing test specifications for operational use.
Exploring the Return on Investment with Automated Item Generation: ROI of AIG**
Presenters: Ada Woo, PhD, Ascend Learning; Xin Li, PSI Services; Christine Mills, Ascend Learning; Saad Khan, FineTune Learning
The COVID-19 pandemic has accelerated the push towards remote delivery of formative and summative assessments, further exacerbating longstanding security concerns of item exposure. One approach to mitigate these concerns would be to maintain a dynamically updated item pool that is continuously replenished with new items. Unfortunately, this is challenging to implement and scale up as traditional processes of creating assessment content rely in large part on manual labor and highly dependent on subject matter expertise.
In this session we explore the promise of artificial intelligence (AI) and automated item generation (AIG) to help address these challenges in assessment content creation and potentially opening up new opportunities for real-time and personalized assessments creation. We provide an overview of the current state of the art in AIG and how recent advances in AI are revolutionizing this domain. We discuss the potential return on investments with such tools and technologies in increasing item writer productivity and throughput.
Looking Forward: Results from the COVID-19 Impact on Cert. Survey, Lessons Learned, & Future Plans
Presenters: Janice Moore, SeaCrest Consulting; Dennis Lee Spence, PhD, MS, CRNA, FAAN, NBCRNA; Denise Roosendaal, CAE, I.C.E.; Sheri Sesay-Tuffour, PhD, CAE, Pediatric Nursing Certification Board
Results from the COVID-19 Impact on Certification Survey serve as a launching point for this interactive discussion. Panelists will highlight key survey findings and discuss lessons learned that they have carried into 2021. Audience members are encouraged to share their own adaptations and creative solutions to benefit the credentialing community as we leverage new tools and skills moving forward.
NCCA Session: Developing and Implementing a Test Security Plan
Presenters: Joy Matthews-Lopez, PhD; Johnna Gueorguieva, PhD; Linda Waters, PhD; William Ellis, MS, RPh
This session will address how to develop and use a test security plan (TSP) to improve testing outcomes across all delivery/proctoring models and enhance alignment with accreditation standards. TSPs consist of a comprehensive collection of policies, procedures, and documents that guide actions related to test security and address nearly every aspect of the testing process. A well-designed TSP supports program decision-making and identifies strengths, threats and actions required to protect a program’s intellectual property, defensibility, and the integrity of exam outcomes.
The Americans With Diagnoses Act? Legal and Practical Implications for Test Accommodations
Presenters: John A Hosterman, PhD, Paradigm Testing; Donald A. Balasa, American Association of Medical Assistants; Heather Case, DVM, International Council for Veterinary Assessment
The 3 Ds: What is the difference between a diagnosis, a disorder, and a disability? Under federal laws, we are required to provide reasonable accommodations to test-takers who have a bona fide disability, but not necessarily to every person who has been diagnosed with something. how does one make the leap from "diagnosis" to disability? Candidates who request testing accommodations are often confused by these terms. A short note on a script pad that states the name of the diagnosis was good enough for Billy to get whatever accommodations he wanted at university, so why shouldn't the licensure organization accept this note?
The presenters-- seasoned attorneys and disability experts in the testing industry-- will discuss the distinction between diagnosis and disability, and provide participants with best practices in how to communicate this distinction to candidates and their evaluators so we can make informed decisions about approving accommodations requests.
We know we need a public member but why exactly? And how do we go about it?**
Presenters: Karen Plaus, Ph.D., CRNA, FAAN, CAE, Consultant; Rebecca (Becky) LeBuhn, MA, Citizen Advocacy Center; Kevin Keller, CAE, Certified Financial Planner Board of Standards; Denise (Denny) Voigt Crawford, JD; Moderator: Catherine Dower
I.C.E. member boards usually need at least one public member, in part to meet accreditation requirements (such as those for ABSNC and NCCA). Some boards have long had public members and want to ensure their success. For other organizations, public board membership is a new concept. This session will explore the reasons behind encouraging or requiring public members on boards and also look at the pragmatic issues of:
This panel includes individuals with experience in the C-suite or as public members in organizations in health care and financial services that have strong onboarding and support processes. The panelists will be interviewed by a member of the Public Member Committee.
Demonstrating value: Efficacy research and proven results**
Presenters: Elisa Kahn, PMP, American Management Association; Carla Caro, MA, ACT
We all believe in the value of credentials—or else we wouldn’t be here! It is not always the case, however, that organizations, industries, and practitioners around the world recognize and appreciate how credentialing can improve outcomes and advance a profession. Before investing time, energy, and funds in credentials stakeholders want to know—does the credential make a difference? What’s the benefit? This session will focus on how credentialing organizations can PROVE the value of their offerings and communicate this value to stakeholders. The implementation and integration of value proposition studies and efficacy research in credential development, maintenance, and marketing, can help support and substantiate organizations’ claims regarding their certification offerings.
The session will provide an introduction to the conduct of value proposition studies and efficacy research, including a discussion of strategic considerations and methodological approaches. The results of a recently completed efficacy and outcomes research study for the AMA Certified Professional in Management™ (AMA-CPM™) will then serve as an illustrative example of how credentialing organizations can identify, support, and prove the value of their credentials.
Eligibility Criteria – Not Just Prerequisites for an Exam
Presenters: Patricia M. Muenzen, PhD, ACT; Kevin M. Bradley, Human Resources Research Organization
Certification eligibility criteria are the education, experience, and other non-examination requirements for the award of a credential. While sometimes viewed simply as exam prerequisites, eligibility criteria can be considered more broadly as a means of evaluating attributes, competencies, or background experiences that are central to the certification construct but are not efficiently or effectively assessed by the certification examination. This session will provide an overview of eligibility at both a conceptual and a practical level. Conceptually, it will address the purpose and alignment of eligibility criteria relative to an organization’s overall credentialing mission. Practically, it will outline best practices in setting the criteria, applicable NCCA standards, the purpose and practical implications of offering multiple pathways to eligibility, and fairness and equity considerations. Presenters include an author of the I.C.E. handbook chapter on eligibility and the chair of an I.C.E. R&D task force on eligibility criteria.
Getting Beyond “It Depends” – Psychometricians Debate Hot Topics in Credentialing, 2nd Edition
Speakers: Danny Breidenbach, PhD, PSI Services; Sarah Carroll, National Board for Certification in Occupational Therapy, Inc.; Andrew Callahan Dwyer, American Board of Pediatrics; Isabelle Gonthier, PhD, PSI Services; Timothy Joseph Muckle, NBCRNA
This session will be another lively debate on hot topics and current challenges faced by credentialing programs. Join a panel of psychometricians as they spar over topics such as the use of race/ethnicity data to evaluate potential bias, the role of soft skills in credentialing, whether longitudinal assessments are suitable for maintenance of certification, whether standard setting studies are really the best methodology for setting cut scores, and/or topics from a pre-conference survey. After presenting positions and rebuttals on each issue, the panel will entertain questions from the audience and discuss their own opinions on each topic.
Audience Interactive: How to leverage data insights to grow your business
Presenters: Isabel Cardenas-Navia, Workcred; Vanessa Brown, National Student Clearinghouse
One of the most pressing questions being asked by consumers, government agencies, employers, and policymakers is what is the value and/or return on investment of earning a credential. Learn how your credentialing body can become data-driven and leverage data insights to grow your business. Participants will have an opportunity to discuss the challenges to becoming a data-driven credentialing body and to provide input on tools and resources that can help them begin this journey.
If we survive COVID, political unrest, racial bias and climate change, What will 2030 look like?!**
Primary Presenter: Grady Colson Barnhill, MEd, National Commission on Certification of Physician Assistants; Co-Presenter 1: Denise Roosendaal, CAE, Institute for Credentialing Excellence; Co-Presenter 2: Tom Granatir, American Board of Medical Specialties; Co-Presenter 3: Marc Seale, A Prestigious UK University; Co-Presenter 4: Catherine Dower, JD, Catherine Dower Consulting
Going about our daily lives it is easy to focus on tasks at hand and what is required to complete them, but as members of the credentialing landscape, it is important that we sometimes step back to consider and evaluate how our programs intersect with the consumer, the public and society, and to anticipate how we might make improvements. Panelists have extensive experience in certification, licensure and regulation, but also in law, legislation and policy will use a discussion-style format to explore key credentialing, workforce and societal issues:
Re-credentialing Improvements: Through increased education and consumer awareness, the public, employers and other stakeholders may begin to demand more of credentialing processes. A more informed consumer may demand more meaningful recertification/renewal processes to provide practitioners with evidence-based tools to support better patient safety or other outcomes. Increased stakeholder awareness may help strengthen credentialing bodies’ credentialing maintenance processes, but only for activities that are relevant, cost-effective, meaningful and minimally burdensome. Longitudinal Assessment is likely to be a part of this landscape, which will represent a new trend – the marriage of assessment and education to not only document competence but to improve it at the same time.
Regulatory Reform: Increasing consumer awareness and a focus on public safety could fuel more interest in regulatory process, perhaps leading to improvements such as more public members on licensing or credentialing boards. Evaluation of risk could lead to improved regulatory structures with varying rigor reflective of public risk involved (e.g., more relaxed requirements for cosmetologists relative to nurses). Increased rigor could also be applied for individual practitioners shown to be at greater risk for harming the public or having poor outcomes, such as practitioners in isolated practice, those re-entering practice or those who have been in practice for a large number of years.
Credentialing Restructure: The drive for meaningful recertification may lead to more individualized processes that document expertise in specialty or areas of practice focus. Microcredentialing, stacked credentials and so on may facilitate increasingly diverse credentialing schemes within professions. As technology, knowledge and skills develop and expand, practitioners, by necessity may know more and more about less and less. Increased access to big data and AI may make it possible to “automatically” observe practitioner behaviors and help document practitioner competence. For example, access to Electronic Health Records could make it possible to verify physician compliance with best practices or positive health outcomes for a number of patients.
Covid Legacies: What will remain of credentialing changes implemented to survive 2020? More online proctoring, almost certainly, but what are the trade-offs in terms of risk to the public? Clinical rotations, internships or on-the-job training are hard to complete during a pandemic and are costly and time-consuming for both students and educators. Will these requirements be increasingly replaced by simulations? Will there be more regulatory flexibility with regard to scope of practice and reciprocity? Will state borders be more “fluid,” particularly during times of acute need? How will certification and licensing bodies improve their flexibility and responsiveness?
Diversity Issues: 2020 was a year of great unrest and increasing focus on racial bias, systemic racism and cultural issues. With the increased awareness one hopes we will have an increasing understanding of how these issues intersect with credentialing and how we can make improvements. In the credentialing testing space we are likely to see an increased focus on sensitivity reviews of test questions, more studies of bias (differential item functioning) and ways to meaningfully address testing bias. In the education space we will address admission strategies, recruitment and incentives to not only improve diversity in the professions but also improve access to care across the country.
Privacy, Security, and AI – Oh My!
Presenters: Rachel R. Watkins Schoenig, Esg., Cornerstone Strategies LLC; Jennifer Ancona Semko, Esq., Baker & McKenzie LLP; Donna McPartland, McPartland Privacy Advising
Testing programs capture a wide range of test-taker data for measurement and security purposes. Over the past year, however, the industry has experienced heightened interest by test-takers, legislators, and the media in the data captured and used during testing. Testing programs and their vendors are fielding questions about data privacy, exam security tools, test-taker access, and bias. How can a testing program assess whether its program and security tools can withstand this additional scrutiny? What steps should a program take when implementing new policies or expanding data collection to ensure it is acting in a legally defensible manner? Join seasoned attorneys as they highlight some of the issues that can arise during testing¸ and how programs can be prepared to successfully respond to questions or challenges.
What the Layperson Needs to Know about Developing Credentialing Assessments
Presenters: Nancy Ahluwalia; Brett P Foley, PhD, Alpine Testing Solutions, Inc.; Matthew Stanley; Moderator: Michele M. Warholic, Esq.
At this session, a panel composed of a retired test developer, a psychometrician, and a public board member from National Certification Commission for Acupuncture and Oriental Medicine will address the following topics:
Certification’s Role in State Licensure and the Impact on IRS Exemption Classification.
In early 2021, the ICE Government Affairs Committee in collaboration with the Research & Development Committee convened a subgroup to gather survey information related to certification boards that are recognized in licensure and regulatory requirements. The goal of the study was to address the IRS classification of professional/private certification as typically being a 501(c)(6) (trade association) activity and not a 501(c)(3) (charitable/educational) activity. Of particular interest was the need to assess the extent to which private certification is of benefit to licensure and regulatory activities. The subgroup is very grateful to the survey participants. The survey outcome has provided valuable research for certification boards to assert that their activities lessen the burden of a governmental activity. This e-poster will summarize the survey results.
12:00 - 12:15 pm: Solving for Better Certification Forms : The Use of Integer Programming to Automate Test Assembly
Presenter: Sean Baldwin, Human Resources Research Organization
Form assembly is a recurring, highly visible task that requires attention to multiple pieces of test-level information (e.g., content, statistical quality). The cognitive load and visible nature of this task have led many testing programs to introduce automation to improve the quality and consistency of their exams. In this session, we will describe the benefits of using mixed-integer programming to automate test assembly (ATA). Then, we will share a case study in which ATA was introduced and describe the conditions that may make ATA a favorable option for other certification testing programs.
12:45 - 1:00 pm: Increasing visibility and highlighting the value of a small certification program
Presenters: Roberta Pineda, Neonatal Therapy National Certification Board; Suzanne Schneider, NTCB
The neonatal therapy certification program was launched in November 2016 to validate the clinical experience and knowledge essential for effective delivery of neonatal therapy, specifically for occupational therapists, physical therapists and speech-language pathologists in the neonatal intensive care unit (NICU). The development and implementation of the certification program was spearheaded by a group of 14 neonatal therapy experts who were passionate about having standards to demonstrate experience and knowledge for practice in a highly complex setting. However, the expert knowledge of this group related to the NICU and not to complex business management. In addition, there were limited funds available for development and implementation of the certification program along with a small estimated pool of < 4000 neonatal therapists. Therefore, getting adequate traction and motivating neonatal therapists to engage in the certification process was necessary to enable a sustainable program. This required marketing and communications that increase visibility and highlight value.
1:15 - 1:30 pm: Fast Track Test Development: Maximizing Speed without Sacrificing Quality
Presenters: Marlene D. Dunham and Catherine Ellen Heeg, Professional Testing Corporation; Khris Berry, WPA Inc.
It’s more exciting on the fast track! With carefully planned multi-tasking by a dedicated team, test development can be expedited while maintaining quality. Development of a new credentialing exam often takes 1-2 years in a linear action plan. Our team successfully created a pet groomer’s certification exam in only 8 months without missing a step, including pet health and safety guidelines, job task survey, candidate eligibility, exam blueprint, item writing, exam creation, and administration while adhering to testing standards. Learn how we did it and take away tips for doing it yourself!
Lessons Learned from using Data Forensics to Invalidate Scores
Presenters: Sarah Toton, PhD, Caveon and Marc Weinstein, Caveon
When data forensics indicate score invalidation may be justified, several key decisions must be made, such as: (1) What level of evidence is sufficient to take action? (2) What actions are appropriate? and (3) Do the program's policies support prospective actions? This session discusses how those questions may be answered by testing programs as well as the types of data forensics evidence, determining the strength of evidence, and how to present evidence to credentialing boards and test-takers.
New Measurement Considerations in the Era of Online High Stakes Testing**
Presenters: John Weiner, PSI Services; Isabelle Gonthier, PhD, PSI Services; Timothy Joseph Muckle, NBCRNA; Kimberly Ann Swygert, PhD, National Board of Medical Examiners
Online remote proctored testing is a growing trend that was accelerated by the pandemic, with social distancing and remote learning/work becoming predominant to the point that even accredited high-stakes exams began utilizing this approach. With this surge to remote online testing, concerns have been amplified regarding security and the psychometric soundness and comparability of test scores obtained in different modalities (e.g., traditional bricks and mortar testing centers vs. online testing at home). Psychometric methods have been in place for decades to evaluate measurement quality and we can assume many of these are still suitable for today’s new test delivery modalities. However, new challenges require taking a fresh look at these time-tested methods to ensure that they remain suitable for the task at hand. A review is needed to see whether new methods and models are required for modern testing environments that yield new types of information about candidate test taking behavior, especially in the era of “Big Data” collection and AI-assisted proctoring.
In this session, a panel of seasoned experts in credentialing testing will discuss the challenges posed by online high stakes testing, the suitability of proven psychometric methods and models, and potential new approaches and frameworks. This diverse panel is comprised of senior leaders and psychometricians from several certification organizations (medical, pharmacy, language testing), as well as a global assessment services company responsible for multimodal delivery of many thousands of high stakes examinations. Session attendees will be encouraged to participate in the discussion to share perspectives and engage with the credentialing community.
Audience Interactive: Not the Same Ol' Job Analysis - Innovating for an Analysis of Practice
Presenters: Susan Cooley, PMP, and Brett Foley, PhD, Alpine Testing Solutions; Andrew McIntyre and Jared N. Zurn, AIA, NCARB, CAE NCARB
Are you making full use of the job analysis process? Is your current job analysis capturing the full essence and diversity of the practice? Do you wish you could do more with the information you learn during a job analysis? Join us for an interactive discussion on ways to bring innovation to an analysis of practice. The National Council of Architectural Registration Boards (NCARB) is currently undergoing such an analysis and will share some of the approaches they are using and open the floor for programs to share ideas and innovate together.
Revenue is not a Four Letter Word: Pricing and Revenue Stability for Financial Sustainability**
Presenters: Terri Hinkley, EdD, MBA, BSN, RN, CAE, Medical-Surgical Nursing Certification Board; Carlos Restrepo, Agilutions; Michael Tatonetti, Pricing for Associations
Certification boards have not traditionally diversified their revenue models. 2020 saw many certification boards financially impacted because of global testing suspension. Further, increasing competition from for-profit entities are challenging certification programs. Associations have long embraced non-dues revenue streams for financial sustainability and provide a model for certification boards to examine ways to expand their revenue through existing product offerings. This session will explore how certification boards can evaluate existing products/opportunities and coalesce them into revenue streams for the organization.
The Value of Certification Phase 2: The Employer Perspective
Presenter: Stephanie Dille, MBA, ProctorU; Panelists
The I.C.E. External Stakeholders Working Group (ESWG) is charged with assisting I.C.E. in articulating the value of certification and providing tools that help credentialing organizations communicate their value to the external stakeholder audience. In 2019, the ESWG worked with an external market research consultant to administer a survey designed to identify the value that credentials bring to credential holders and presented the results at the 2019 ICE Exchange. In 2021, the ESWG has reignited its work and has now turned its attention to the employer community based on member interest in 2019.
As phase 2 of this research, the ESWG is building on the research done in phase 1 and reaching deeper into the stakeholder community, this time with employers. The objective of the research is to conduct both qualitative and quantitative research to determine different ways that credentials bring value to the employer community. The goal of the research is to provide the I.C.E. membership with data and tools they can use to better position their credentials. Research results will include a summary of findings, value of certification messaging, case studies and other marketing examples. This presentation will focus on the qualitative research and work accomplished in 2021. The presentation will also include highlights from a series of case studies that showcase what employers value about certification and the different ways they promote it in their organizations and with external stakeholders.
What is your post-COVID gameplan? A credentialing program perspective.
Presenters: Danielle Geddes, Meazure Learning;Autumn Saylor, International Code Council; Larry Lynch, National Restaurant Association; Johnna Gueorguieva, Ph.D., CAE, Dental Assisting National Board
Credentialing programs have been challenged from a number of angles over the past year considering the impact of COVID. They had to quickly adjust to ensure sustainability and continue to demonstrate value to certificants and test takers. From changes to exam administration modality or schedule, review and redesign of exam development processes, or modification of policies to address concerns from existing certificants or new certificants, it required creativity, flexibility, and resilience. The participants on this panel will discuss how they have tackled these challenges and the solutions they have put in place to ensure they meet their test takers and certificants’ needs. They will also discuss what measures and solutions initially considered as temporary that are now here to stay, as well as the why and how. They will outline any additional plans or initiatives they are working on now that they have moved past the state of crisis management. Finally, the panel will share any new disaster planning/recovery strategies implemented to prepare for the next yet unknown crisis.
I.C.E. Awards Ceremony
Assessing Competencies and Performance: Where are we in 2021?
Presenters: Alexander Alonso, PHD, SHRM-SCP, Society for Human Resource Management; Chad W. Buckendahl, ACS Ventures, LLC; Ibi Layi-Ojo, CFP Board; Rebecca (Becky) LeBuhn, MA, Citizen Advocacy Center
Certifiers and regulators are comfortable and confident about their ability to test the knowledge and skills of candidates seeking certification. For many professions, especially healthcare professions, actual performance – the application of knowledge and execution of skills - is easily as important as book learning. So, shouldn’t we expect credentialing bodies to predict how someone is likely to perform in practice before granting a credential? Just as important, shouldn’t certifiers assess their certificants’ real life performance as a condition of renewing their credentials?
Learn about the evolution of techniques for evaluating traits and behaviors (often called “soft skills” or “non-cognitive competencies”), how to determine what is right for your program, as well as ways to augment current knowledge-based assessments with competencies. Hear current competency assessment techniques such as workplace-based assessment, individualized competency profiles, and longitudinal assessment.Expert panelists will discuss trends and applications in competency modeling, noncognitive assessment, and performance-based testing. The panel will explore the importance of assessing more than knowledge, provide an overview of developments in non-cognitive and performance-based assessment techniques, and also direct attendees to resources where they can immerse themselves far more deeply in this important topic.
Creating a Level Playing Field in Testing and Credentialing
Presenters: Brett P Foley, PhD, Alpine Testing Solutions, Inc.; Karen B. Hoeve; Jared N. Zurn, AIA, NCARB, CAE, NCARB; J.B. Weir, PhD
The avoidance of bias is one tenet of fairness espoused by both the Standards for Educational and Psychological Testing (AERA, APA, & NCME, 2014) and the NCCA Standards. One way that bias and discrimination can affect the existing testing and credentialing processes is through exam content.
This session will examine the sources of inherent bias and discrimination in testing and credentialing processes, and will discuss two commonly used psychometric methods for identifying problematic content: bias and sensitivity reviews, and differential item functioning (DIF) analysis. Related policy issues will also be discussed: diversity considerations when conducting exam development activities (e.g., subject matter expert recruitment and representation), policies that may delay/prevent increased diversity and representation and developing data collection plans that support related psychometric analyses.
Diversity, Equity & Inclusion – What does that mean for credentialing bodies?
Alternative Credentials, Level: introductory
Presenters: Mark Carlos Franco, Esq., Whiteford, Taylor & Preston, L.L.P.; Tracy Lofty Brown, MSA, CAE, International Board of Heart Rhythm Examiners; Denise Roosendaal, CAE, Institute for Credentialing Excellence
Like many other industries, the credentialing world has been working to understand how to address diversity, equity and inclusion in meaningful ways. For certification bodies, this may involve looking internally at the composition of the staff and volunteers and also externally at the various stakeholder groups including candidates, certificants and other groups within the profession or field. Unfortunately, this can be a difficult and sensitive task. The good news is that I.C.E. has created a new Diversity, Equity and Inclusion Task Force to serve as a resource to its members in this area.
This session will involve a panel and audience discussion on the questions and potential issues credentialing bodies may encounter or may have.
Going Virtual – Reflections and Lessons Learned from Moving SMEs to Online Meetings
Test Development and Administration, Level: introductory
Presenters: Scott R. Frohn and Danny Breidenbach, PhD, PSI Services; Mary Ellen Rich, Oncology Nursing Certification Corporation; Alyssa Meyer, National Association for Healthcare Quality; Ben D Price, National Board of Surgical Technology and Surgical Assisting
The COVID-19 pandemic broadly impacted the credentialing industry, with one of the most significant changes being the need to conduct work remotely. More than a year into the pandemic, many of us have adapted to working from home and meeting with colleagues online, however working purely in a virtual setting has had its challenges. One unique challenge for our industry has been engaging subject matter experts (SMEs) in program activities and meetings. There are certainly benefits to credentialing programs holding meetings with SMEs in-person (e.g., more opportunities for interaction, travel perks), but how have programs adapted to online SME meetings? What have been the benefits and challenges associated with moving these meetings online? What’s worked and what hasn’t? And will credentialing organizations change their approach to SME meetings in the future? This panel discussion will explore the experiences of leaders from three credentialing organizations, with reflections and lessons learned from moving SMEs to online meetings.
Tell me how you really feel about it: What’s trending in recertification/renewal?**
Business of Certification, Level: intermediate
Presenters: Kevin M. Bradley, Human Resources Research Organization; Michael R. Peabody, National Association of Boards of Pharmacy
Over the past few years, the presenters have been exploring recertification and renewal practices. At a previous I.C.E. Exchange we shared the results of a survey administered during the first phase of our work. When the presenters conducted a live poll during the session, they noted significant differences between survey and session responses. Here, we present qualitative results of a follow-up survey to highlight the changing landscape of recertification and renewal requirements, especially in light of changes triggered by the COVID-19 pandemic. Specific organizations were targeted to represent diverse industry sectors.
Virtual Standard Setting Models for Success**
Presenters: Charis Walikonis, Prometric LLC; Jillian Nelson, Prometric Shroeder Measurement Technologies, LLC; Stephen Fletcher, American Board for Cert. in Orthotics, Prosthetics & Pedorthics; Natalya Mytareva, Certification Commission for Healthcare Interpreters
No matter the context or complexity of your standard setting, you can successfully undertake a virtual process! This session will discuss several models of virtual standard setting from a variety of perspectives, including customized processes for unique situations. You will learn tips for overcoming common challenges and pitfalls that you can apply to your program, as well as key best practices to help you maintain the validity, reliability, or fairness of the process.
Audience Interactive: Exploring New Frontiers II: Using SJTs in High-Stakes, High-Volume Certification Testing Programs
Test Development and Administration, Level: intermediate
Presenters: Taylor Sparks Sullivan, PhD, and Bethany Bynum, Human Resources Research Organization; George Rogers, International Coaching Federation; Nancy A Woolever, MAIS, SHRM-SCP, Society for Human Resource Management
The use of situational judgment tests (SJTs) in high-volume, high-stakes certification testing programs creates unique challenges. Building on issues identified during our successful 2020 Exchange session, the same panelists will continue the dialog via roundtable discussion to engage broader perspectives from audience members. The goal of the session is to further our collective understanding and identify strategies for overcoming challenges associated with using SJTs in this unique testing context. Discussions will touch on SJT design, development, and psychometric evaluation.
Benefits and Risks of Innovation to the Validity Argument of Credentialing Examinations**
Primary Presenter: James P Henderson, PhD., Credentialing Examination Consulting, LLC; Co-Presenter 1: Chad W. Buckendahl, ACS Ventures, LLC; Co-Presenter 2: Mark Carlos Franco, Esq., Whiteford, Taylor & Preston, L.L.P.; Co-Presenter 3: Sarah Carroll, National Board for Certification in Occupational Therapy, Inc.
With the current emphasis on innovation in credentialing, many organizations feel compelled to try new methods as they work to build the validity argument for their high stakes credentialing examination. An important question concerns how to weigh the benefit of innovation against the risk it may pose to the outcome of key projects and the case for validity. This session examines this question from the vantage point of law, accreditation, and research.
Instructionally Sound Certificate Study Prep
Michelle Nolin, CPTD, Learn Ethos LLC; Co-Presenter 1: Andrew Fitzsimons, Inc., Society for Corporate Governance, Inc.
What is the best way to develop certification review courses and study prep? By utilizing the principles of adult learning, and ensuring the offering(s) are appropriate for the delivery methods (virtual classroom, face-to-face, eLearning, or a hybrid), the needs and preferences of candidates, and the scope and intent of the certification. Can you do that while honoring firewalls? You bet, and this session will show you how, with ideas for effective study prep design and real world examples from an association who integrated instructional design in their study materials.
Job Analysis Study: Don’t Forget The Fundamentals
Primary Presenter: Johnna Gueorguieva, Ph.D., CAE, Dental Assisting National Board; Co-Presenter 1: Ibi Layi-Ojo, CFP Board
You have selected your method for validating the content of your exam and have educated yourself on how to implement the process. But did your research include the fundamental requirements for all job analysis studies that your specific method likely didn’t explain? Find out what you may be missing to conduct a reliable, valid and accreditation worthy job analysis study.
The COVID-19 Aftermath: Evidence-Based Observations of Online Proctoring
Primary Presenter: Taylor Sparks Sullivan, PhD, Human Resources Research Organization; Co-Presenter 1: Julie Marie Knutson Gleason, Pearson VUE ; Co-Presenter 2: Nicholas Howald, Human Resources Research Organization; Co-Presenter 3: Harry Samit, Pearson VUE; Co-Presenter 4: Alexander Alonso, PHD, SHRM-SCP, Society for Human Resource Management
With the onset of the COVID-19 pandemic, a number of testing programs experienced reduced capacity for in-person proctoring and moved to an online proctored (OP) environment. This session will present evidence-based observations of OP testing from several perspectives. Presenters will describe the OP environment and associated security precautions, discuss methods for detecting item compromise, and ways to identify whether scoring adjustments are needed for exams that we pre-equated under in-person proctored conditions.
UPDATE: CERTIFICATION IN THE EMERGING NORMAL**
Primary Presenter: Denise Roosendaal, CAE, Institute for Credentialing Excellence; Co-Presenter 1: Tom Granatir, American Board of Medical Specialties; Co-Presenter 2: David Swankin, Esq., Citizen Advocacy Center; Co-Presenter 3: Sally Irvin,