An Evaluation Process for Tools that Build or Evidence Competency in Cybersecurity: Development and Lessons Learned

Stephen Miller; Christopher Simpson; Eugene Vasserman; Susanne Wetzel

doi:10.1007/978-3-031-94924-1_3

An Evaluation Process for Tools that Build or Evidence Competency in Cybersecurity: Development and Lessons Learned

Stephen Miller
, Christopher Simpson
, Eugene Vasserman
, Susanne Wetzel

Department of Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

There is a non-trivial gap in skills students possess upon graduation and what employers expect from graduates when they join the workforce. To address this problem, various efforts are underway to shift from the traditional knowledge-based model of educational programs to one that includes a competency-based approach. To foster the introduction and implementation of competency-based concepts to academic programs in a timely fashion, it is necessary to provide the faculty with as many resources as possible. In this context, this paper describes the development, testing, and use of an evaluation process for tools meant to build or evidence competency in Cybersecurity and reports on the lessons learned.

Original language	English
Title of host publication	Information Security Education. Empowering People Through Information Security Education - 17th IFIP WG 11.8 World Conference, WISE 2025, Proceedings
Editors	Lynette Drevin, Wai Sze Leung, Suné von Solms
Pages	31-45
Number of pages	15
DOIs	https://doi.org/10.1007/978-3-031-94924-1_3
State	Published - 2026
Event	17th IFIP WG 11.8 World Conference on Information Security Education, WISE 2025 - Maribor, Slovenia Duration: 21 May 2025 → 23 May 2025

Publication series

Name	IFIP Advances in Information and Communication Technology
Volume	742 IFIPAICT
ISSN (Print)	1868-4238
ISSN (Electronic)	1868-422X

Conference

Conference	17th IFIP WG 11.8 World Conference on Information Security Education, WISE 2025
Country/Territory	Slovenia
City	Maribor
Period	21/05/25 → 23/05/25

Access to Document

10.1007/978-3-031-94924-1_3

Cite this

Miller, S., Simpson, C., Vasserman, E., & Wetzel, S. (2026). An Evaluation Process for Tools that Build or Evidence Competency in Cybersecurity: Development and Lessons Learned. In L. Drevin, W. S. Leung, & S. von Solms (Eds.), Information Security Education. Empowering People Through Information Security Education - 17th IFIP WG 11.8 World Conference, WISE 2025, Proceedings (pp. 31-45). (IFIP Advances in Information and Communication Technology; Vol. 742 IFIPAICT). https://doi.org/10.1007/978-3-031-94924-1_3

Miller, Stephen ; Simpson, Christopher ; Vasserman, Eugene et al. / An Evaluation Process for Tools that Build or Evidence Competency in Cybersecurity : Development and Lessons Learned. Information Security Education. Empowering People Through Information Security Education - 17th IFIP WG 11.8 World Conference, WISE 2025, Proceedings. editor / Lynette Drevin ; Wai Sze Leung ; Suné von Solms. 2026. pp. 31-45 (IFIP Advances in Information and Communication Technology).

@inproceedings{d50183d793a04027b31debcf1e119a0b,

title = "An Evaluation Process for Tools that Build or Evidence Competency in Cybersecurity: Development and Lessons Learned",

abstract = "There is a non-trivial gap in skills students possess upon graduation and what employers expect from graduates when they join the workforce. To address this problem, various efforts are underway to shift from the traditional knowledge-based model of educational programs to one that includes a competency-based approach. To foster the introduction and implementation of competency-based concepts to academic programs in a timely fashion, it is necessary to provide the faculty with as many resources as possible. In this context, this paper describes the development, testing, and use of an evaluation process for tools meant to build or evidence competency in Cybersecurity and reports on the lessons learned.",

author = "Stephen Miller and Christopher Simpson and Eugene Vasserman and Susanne Wetzel",

note = "Publisher Copyright: {\textcopyright} IFIP International Federation for Information Processing 2026.; 17th IFIP WG 11.8 World Conference on Information Security Education, WISE 2025 ; Conference date: 21-05-2025 Through 23-05-2025",

year = "2026",

doi = "10.1007/978-3-031-94924-1\_3",

language = "English",

isbn = "9783031949234",

series = "IFIP Advances in Information and Communication Technology",

pages = "31--45",

editor = "Lynette Drevin and Leung, \{Wai Sze\} and \{von Solms\}, Sun{\'e}",

booktitle = "Information Security Education. Empowering People Through Information Security Education - 17th IFIP WG 11.8 World Conference, WISE 2025, Proceedings",

}

Miller, S, Simpson, C, Vasserman, E & Wetzel, S 2026, An Evaluation Process for Tools that Build or Evidence Competency in Cybersecurity: Development and Lessons Learned. in L Drevin, WS Leung & S von Solms (eds), Information Security Education. Empowering People Through Information Security Education - 17th IFIP WG 11.8 World Conference, WISE 2025, Proceedings. IFIP Advances in Information and Communication Technology, vol. 742 IFIPAICT, pp. 31-45, 17th IFIP WG 11.8 World Conference on Information Security Education, WISE 2025, Maribor, Slovenia, 21/05/25. https://doi.org/10.1007/978-3-031-94924-1_3

An Evaluation Process for Tools that Build or Evidence Competency in Cybersecurity: Development and Lessons Learned. / Miller, Stephen; Simpson, Christopher; Vasserman, Eugene et al.
Information Security Education. Empowering People Through Information Security Education - 17th IFIP WG 11.8 World Conference, WISE 2025, Proceedings. ed. / Lynette Drevin; Wai Sze Leung; Suné von Solms. 2026. p. 31-45 (IFIP Advances in Information and Communication Technology; Vol. 742 IFIPAICT).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - An Evaluation Process for Tools that Build or Evidence Competency in Cybersecurity

T2 - 17th IFIP WG 11.8 World Conference on Information Security Education, WISE 2025

AU - Miller, Stephen

AU - Simpson, Christopher

AU - Vasserman, Eugene

AU - Wetzel, Susanne

N1 - Publisher Copyright: © IFIP International Federation for Information Processing 2026.

PY - 2026

Y1 - 2026

N2 - There is a non-trivial gap in skills students possess upon graduation and what employers expect from graduates when they join the workforce. To address this problem, various efforts are underway to shift from the traditional knowledge-based model of educational programs to one that includes a competency-based approach. To foster the introduction and implementation of competency-based concepts to academic programs in a timely fashion, it is necessary to provide the faculty with as many resources as possible. In this context, this paper describes the development, testing, and use of an evaluation process for tools meant to build or evidence competency in Cybersecurity and reports on the lessons learned.

AB - There is a non-trivial gap in skills students possess upon graduation and what employers expect from graduates when they join the workforce. To address this problem, various efforts are underway to shift from the traditional knowledge-based model of educational programs to one that includes a competency-based approach. To foster the introduction and implementation of competency-based concepts to academic programs in a timely fashion, it is necessary to provide the faculty with as many resources as possible. In this context, this paper describes the development, testing, and use of an evaluation process for tools meant to build or evidence competency in Cybersecurity and reports on the lessons learned.

UR - https://www.scopus.com/pages/publications/105012924871

UR - https://www.scopus.com/pages/publications/105012924871#tab=citedBy

U2 - 10.1007/978-3-031-94924-1_3

DO - 10.1007/978-3-031-94924-1_3

M3 - Conference contribution

AN - SCOPUS:105012924871

SN - 9783031949234

T3 - IFIP Advances in Information and Communication Technology

SP - 31

EP - 45

BT - Information Security Education. Empowering People Through Information Security Education - 17th IFIP WG 11.8 World Conference, WISE 2025, Proceedings

A2 - Drevin, Lynette

A2 - Leung, Wai Sze

A2 - von Solms, Suné

Y2 - 21 May 2025 through 23 May 2025

ER -

Miller S, Simpson C, Vasserman E, Wetzel S. An Evaluation Process for Tools that Build or Evidence Competency in Cybersecurity: Development and Lessons Learned. In Drevin L, Leung WS, von Solms S, editors, Information Security Education. Empowering People Through Information Security Education - 17th IFIP WG 11.8 World Conference, WISE 2025, Proceedings. 2026. p. 31-45. (IFIP Advances in Information and Communication Technology). doi: 10.1007/978-3-031-94924-1_3