AI in medical education: uses of AI in construction type A MCQs
The introduction of competency-based education models, student centers, and the increased use of formative assessments have led to demands for high-quality test items to be used in assessments. This study aimed to assess the use of an AI tool to generate MCQs type A and evaluate its quality. The stu...
Saved in:
| Published in | BMC medical education Vol. 24; no. 1; pp. 247 - 9 |
|---|---|
| Main Author | |
| Format | Journal Article |
| Language | English |
| Published |
England
BioMed Central Ltd
06.03.2024
BioMed Central BMC |
| Subjects | |
| Online Access | Get full text |
Cover
Loading…
| Abstract | The introduction of competency-based education models, student centers, and the increased use of formative assessments have led to demands for high-quality test items to be used in assessments. This study aimed to assess the use of an AI tool to generate MCQs type A and evaluate its quality.
The study design was cross-sectional analytics conducted from June 2023 to August 2023. This study utilized formative TBL. The AI tool (ChatPdf.com) was selected to generate MCQs type A. The generated items were evaluated using a questionnaire for subject experts and an item (psychometric) analysis. The questionnaire to the subject experts about items was formed based on item quality and rating of item difficulty.
The total number of recurrent staff members as experts was 25, and the questionnaire response rate was 68%. The quality of the items ranged from good to excellent. None of the items had scenarios or vignettes and were direct. According to the expert's rating, easy items represented 80%, and only two had moderate difficulty (20%). Only one item out of the two moderate difficulties had the same difficulty index. The total number of students participating in TBL was 48. The mean mark was 4.8 ± 1.7 out of 10. The KR20 is 0.68. Most items were of moderately difficult (90%) and only one was difficult (10%). The discrimination index of the items ranged from 0.77 to 0.15. Items with excellent discrimination represented 50% (5), items with good discrimination were 3 (30%), and only one time was poor (10%), and one was none discriminating. The non-functional distractors were 26 (86.7%), and the number of non-functional distractors was four (13.3%). According to distractor analysis, 60% of the items were excellent, and 40% were good. A significant correlation (p = 0.4, r = 0.30) was found between the difficulty and discrimination indices.
Items constructed using AI had good psychometric properties and quality, measuring higher-order domains. AI allows the construction of many items within a short time. We hope this paper brings the use of AI in item generation and the associated challenges into a multi-layered discussion that will eventually lead to improvements in item generation and assessment in general. |
|---|---|
| AbstractList | The introduction of competency-based education models, student centers, and the increased use of formative assessments have led to demands for high-quality test items to be used in assessments. This study aimed to assess the use of an AI tool to generate MCQs type A and evaluate its quality.
The study design was cross-sectional analytics conducted from June 2023 to August 2023. This study utilized formative TBL. The AI tool (ChatPdf.com) was selected to generate MCQs type A. The generated items were evaluated using a questionnaire for subject experts and an item (psychometric) analysis. The questionnaire to the subject experts about items was formed based on item quality and rating of item difficulty.
The total number of recurrent staff members as experts was 25, and the questionnaire response rate was 68%. The quality of the items ranged from good to excellent. None of the items had scenarios or vignettes and were direct. According to the expert's rating, easy items represented 80%, and only two had moderate difficulty (20%). Only one item out of the two moderate difficulties had the same difficulty index. The total number of students participating in TBL was 48. The mean mark was 4.8 ± 1.7 out of 10. The KR20 is 0.68. Most items were of moderately difficult (90%) and only one was difficult (10%). The discrimination index of the items ranged from 0.77 to 0.15. Items with excellent discrimination represented 50% (5), items with good discrimination were 3 (30%), and only one time was poor (10%), and one was none discriminating. The non-functional distractors were 26 (86.7%), and the number of non-functional distractors was four (13.3%). According to distractor analysis, 60% of the items were excellent, and 40% were good. A significant correlation (p = 0.4, r = 0.30) was found between the difficulty and discrimination indices.
Items constructed using AI had good psychometric properties and quality, measuring higher-order domains. AI allows the construction of many items within a short time. We hope this paper brings the use of AI in item generation and the associated challenges into a multi-layered discussion that will eventually lead to improvements in item generation and assessment in general. The introduction of competency-based education models, student centers, and the increased use of formative assessments have led to demands for high-quality test items to be used in assessments. This study aimed to assess the use of an AI tool to generate MCQs type A and evaluate its quality.BACKGROUNDThe introduction of competency-based education models, student centers, and the increased use of formative assessments have led to demands for high-quality test items to be used in assessments. This study aimed to assess the use of an AI tool to generate MCQs type A and evaluate its quality.The study design was cross-sectional analytics conducted from June 2023 to August 2023. This study utilized formative TBL. The AI tool (ChatPdf.com) was selected to generate MCQs type A. The generated items were evaluated using a questionnaire for subject experts and an item (psychometric) analysis. The questionnaire to the subject experts about items was formed based on item quality and rating of item difficulty.METHODSThe study design was cross-sectional analytics conducted from June 2023 to August 2023. This study utilized formative TBL. The AI tool (ChatPdf.com) was selected to generate MCQs type A. The generated items were evaluated using a questionnaire for subject experts and an item (psychometric) analysis. The questionnaire to the subject experts about items was formed based on item quality and rating of item difficulty.The total number of recurrent staff members as experts was 25, and the questionnaire response rate was 68%. The quality of the items ranged from good to excellent. None of the items had scenarios or vignettes and were direct. According to the expert's rating, easy items represented 80%, and only two had moderate difficulty (20%). Only one item out of the two moderate difficulties had the same difficulty index. The total number of students participating in TBL was 48. The mean mark was 4.8 ± 1.7 out of 10. The KR20 is 0.68. Most items were of moderately difficult (90%) and only one was difficult (10%). The discrimination index of the items ranged from 0.77 to 0.15. Items with excellent discrimination represented 50% (5), items with good discrimination were 3 (30%), and only one time was poor (10%), and one was none discriminating. The non-functional distractors were 26 (86.7%), and the number of non-functional distractors was four (13.3%). According to distractor analysis, 60% of the items were excellent, and 40% were good. A significant correlation (p = 0.4, r = 0.30) was found between the difficulty and discrimination indices.RESULTSThe total number of recurrent staff members as experts was 25, and the questionnaire response rate was 68%. The quality of the items ranged from good to excellent. None of the items had scenarios or vignettes and were direct. According to the expert's rating, easy items represented 80%, and only two had moderate difficulty (20%). Only one item out of the two moderate difficulties had the same difficulty index. The total number of students participating in TBL was 48. The mean mark was 4.8 ± 1.7 out of 10. The KR20 is 0.68. Most items were of moderately difficult (90%) and only one was difficult (10%). The discrimination index of the items ranged from 0.77 to 0.15. Items with excellent discrimination represented 50% (5), items with good discrimination were 3 (30%), and only one time was poor (10%), and one was none discriminating. The non-functional distractors were 26 (86.7%), and the number of non-functional distractors was four (13.3%). According to distractor analysis, 60% of the items were excellent, and 40% were good. A significant correlation (p = 0.4, r = 0.30) was found between the difficulty and discrimination indices.Items constructed using AI had good psychometric properties and quality, measuring higher-order domains. AI allows the construction of many items within a short time. We hope this paper brings the use of AI in item generation and the associated challenges into a multi-layered discussion that will eventually lead to improvements in item generation and assessment in general.CONCLUSIONItems constructed using AI had good psychometric properties and quality, measuring higher-order domains. AI allows the construction of many items within a short time. We hope this paper brings the use of AI in item generation and the associated challenges into a multi-layered discussion that will eventually lead to improvements in item generation and assessment in general. The introduction of competency-based education models, student centers, and the increased use of formative assessments have led to demands for high-quality test items to be used in assessments. This study aimed to assess the use of an AI tool to generate MCQs type A and evaluate its quality. The study design was cross-sectional analytics conducted from June 2023 to August 2023. This study utilized formative TBL. The AI tool (ChatPdf.com) was selected to generate MCQs type A. The generated items were evaluated using a questionnaire for subject experts and an item (psychometric) analysis. The questionnaire to the subject experts about items was formed based on item quality and rating of item difficulty. The total number of recurrent staff members as experts was 25, and the questionnaire response rate was 68%. The quality of the items ranged from good to excellent. None of the items had scenarios or vignettes and were direct. According to the expert's rating, easy items represented 80%, and only two had moderate difficulty (20%). Only one item out of the two moderate difficulties had the same difficulty index. The total number of students participating in TBL was 48. The mean mark was 4.8 [+ or -] 1.7 out of 10. The KR20 is 0.68. Most items were of moderately difficult (90%) and only one was difficult (10%). The discrimination index of the items ranged from 0.77 to 0.15. Items with excellent discrimination represented 50% (5), items with good discrimination were 3 (30%), and only one time was poor (10%), and one was none discriminating. The non-functional distractors were 26 (86.7%), and the number of non-functional distractors was four (13.3%). According to distractor analysis, 60% of the items were excellent, and 40% were good. A significant correlation (p = 0.4, r = 0.30) was found between the difficulty and discrimination indices. Items constructed using AI had good psychometric properties and quality, measuring higher-order domains. AI allows the construction of many items within a short time. We hope this paper brings the use of AI in item generation and the associated challenges into a multi-layered discussion that will eventually lead to improvements in item generation and assessment in general. BackgroundThe introduction of competency-based education models, student centers, and the increased use of formative assessments have led to demands for high-quality test items to be used in assessments. This study aimed to assess the use of an AI tool to generate MCQs type A and evaluate its quality.MethodsThe study design was cross-sectional analytics conducted from June 2023 to August 2023. This study utilized formative TBL. The AI tool (ChatPdf.com) was selected to generate MCQs type A. The generated items were evaluated using a questionnaire for subject experts and an item (psychometric) analysis. The questionnaire to the subject experts about items was formed based on item quality and rating of item difficulty.ResultsThe total number of recurrent staff members as experts was 25, and the questionnaire response rate was 68%. The quality of the items ranged from good to excellent. None of the items had scenarios or vignettes and were direct. According to the expert’s rating, easy items represented 80%, and only two had moderate difficulty (20%). Only one item out of the two moderate difficulties had the same difficulty index. The total number of students participating in TBL was 48. The mean mark was 4.8 ± 1.7 out of 10. The KR20 is 0.68. Most items were of moderately difficult (90%) and only one was difficult (10%). The discrimination index of the items ranged from 0.77 to 0.15. Items with excellent discrimination represented 50% (5), items with good discrimination were 3 (30%), and only one time was poor (10%), and one was none discriminating. The non-functional distractors were 26 (86.7%), and the number of non-functional distractors was four (13.3%). According to distractor analysis, 60% of the items were excellent, and 40% were good. A significant correlation (p = 0.4, r = 0.30) was found between the difficulty and discrimination indices.ConclusionItems constructed using AI had good psychometric properties and quality, measuring higher-order domains. AI allows the construction of many items within a short time. We hope this paper brings the use of AI in item generation and the associated challenges into a multi-layered discussion that will eventually lead to improvements in item generation and assessment in general. Abstract Background The introduction of competency-based education models, student centers, and the increased use of formative assessments have led to demands for high-quality test items to be used in assessments. This study aimed to assess the use of an AI tool to generate MCQs type A and evaluate its quality. Methods The study design was cross-sectional analytics conducted from June 2023 to August 2023. This study utilized formative TBL. The AI tool (ChatPdf.com) was selected to generate MCQs type A. The generated items were evaluated using a questionnaire for subject experts and an item (psychometric) analysis. The questionnaire to the subject experts about items was formed based on item quality and rating of item difficulty. Results The total number of recurrent staff members as experts was 25, and the questionnaire response rate was 68%. The quality of the items ranged from good to excellent. None of the items had scenarios or vignettes and were direct. According to the expert’s rating, easy items represented 80%, and only two had moderate difficulty (20%). Only one item out of the two moderate difficulties had the same difficulty index. The total number of students participating in TBL was 48. The mean mark was 4.8 ± 1.7 out of 10. The KR20 is 0.68. Most items were of moderately difficult (90%) and only one was difficult (10%). The discrimination index of the items ranged from 0.77 to 0.15. Items with excellent discrimination represented 50% (5), items with good discrimination were 3 (30%), and only one time was poor (10%), and one was none discriminating. The non-functional distractors were 26 (86.7%), and the number of non-functional distractors was four (13.3%). According to distractor analysis, 60% of the items were excellent, and 40% were good. A significant correlation (p = 0.4, r = 0.30) was found between the difficulty and discrimination indices. Conclusion Items constructed using AI had good psychometric properties and quality, measuring higher-order domains. AI allows the construction of many items within a short time. We hope this paper brings the use of AI in item generation and the associated challenges into a multi-layered discussion that will eventually lead to improvements in item generation and assessment in general. Background The introduction of competency-based education models, student centers, and the increased use of formative assessments have led to demands for high-quality test items to be used in assessments. This study aimed to assess the use of an AI tool to generate MCQs type A and evaluate its quality. Methods The study design was cross-sectional analytics conducted from June 2023 to August 2023. This study utilized formative TBL. The AI tool (ChatPdf.com) was selected to generate MCQs type A. The generated items were evaluated using a questionnaire for subject experts and an item (psychometric) analysis. The questionnaire to the subject experts about items was formed based on item quality and rating of item difficulty. Results The total number of recurrent staff members as experts was 25, and the questionnaire response rate was 68%. The quality of the items ranged from good to excellent. None of the items had scenarios or vignettes and were direct. According to the expert's rating, easy items represented 80%, and only two had moderate difficulty (20%). Only one item out of the two moderate difficulties had the same difficulty index. The total number of students participating in TBL was 48. The mean mark was 4.8 [+ or -] 1.7 out of 10. The KR20 is 0.68. Most items were of moderately difficult (90%) and only one was difficult (10%). The discrimination index of the items ranged from 0.77 to 0.15. Items with excellent discrimination represented 50% (5), items with good discrimination were 3 (30%), and only one time was poor (10%), and one was none discriminating. The non-functional distractors were 26 (86.7%), and the number of non-functional distractors was four (13.3%). According to distractor analysis, 60% of the items were excellent, and 40% were good. A significant correlation (p = 0.4, r = 0.30) was found between the difficulty and discrimination indices. Conclusion Items constructed using AI had good psychometric properties and quality, measuring higher-order domains. AI allows the construction of many items within a short time. We hope this paper brings the use of AI in item generation and the associated challenges into a multi-layered discussion that will eventually lead to improvements in item generation and assessment in general. Keywords: AI, Construction, MCQs, Item analysis, High quality |
| ArticleNumber | 247 |
| Audience | Academic |
| Author | Rezigalla, Assad Ali |
| Author_xml | – sequence: 1 givenname: Assad Ali surname: Rezigalla fullname: Rezigalla, Assad Ali |
| BackLink | https://www.ncbi.nlm.nih.gov/pubmed/38448870$$D View this record in MEDLINE/PubMed |
| BookMark | eNp9kkuLHCEUhSVMyDySP5BFKMgmm5ro1bKsbIamyaNhQggka7F8dGyqtaNVA_PvY3fNhO4hBBfK9dxPj55LdBZisAi9JviaEMHfZwId7moMrMYNNLimz9AFYS3UvAN8drQ-R5c5bzAmraDkBTqngjEhWnyBbharyodqa43XaqismbQafQwfqinbXEVXzQIdQx7TpPd71Xi_s9Wi-rr8nl-i504N2b56mK_Qz08ffyy_1LffPq-Wi9taN5yNtQMtjAFmy4Ae07bpS0E4rjF2iqu2oaB6Co0xGvcOuOlbRhUlmhuHe6BXaDVzTVQbuUt-q9K9jMrLQyGmtVRp9Hqw0gltCWNggfTMOtdBR4Era1UPghlaWDczazf1xbi2YUxqOIGe7gT_S67jnSS4I125fCG8eyCk-HuyeZRbn7UdBhVsnLKEjgERDQdcpG-fSDdxSqG8VVE1XDSMdkeqtSoOfHCxHKz3ULloCwgzRkRRXf9DVYaxW19-yDpf6icNb46d_rX4-P9FIGaBTjHnZJ3UfjwEoJD9UBzLfdTkHDVZoiYPUZP7V4QnrY_0_zT9AbMG0r4 |
| CitedBy_id | crossref_primary_10_1093_bib_bbae641 crossref_primary_10_1109_ACCESS_2025_3530474 crossref_primary_10_53685_jshmdc_v5i2_253 crossref_primary_10_3390_bdcc8100139 crossref_primary_10_7759_cureus_69151 crossref_primary_10_1080_10528008_2024_2417106 crossref_primary_10_1186_s12909_024_05297_2 |
| Cites_doi | 10.1016/j.mjafi.2020.11.007 10.5958/0974-9357.2017.00079.4 10.4103/1858-5000.171863 10.1201/9781003184157-8 10.4103/1658-631X.162027 10.1002/ets2.12042 10.3389/feduc.2023.858273 10.3390/app11125467 10.1097/SIH.0000000000000530 10.1007/978-981-19-6458-9_24 10.4103/2229-516X.186965 10.5116/ijme.4dfb.8dfd 10.54393/pjhs.v4i04.700 10.47102/annals-acadmedsg.V35N2p67 10.4103/0970-0218.126347 10.5964/ejop.v9i4.653 10.1609/aaai.v35i14.17553 10.1136/bmjopen-2020-047709 10.21315/eimj2017.9.3.4 10.18203/2319-2003.ijbcp20194106 10.4103/NJCA.NJCA_9_23 10.4103/2395-2296.189670 10.4324/9780203874776-25 10.5811/westjem.2018.11.39805 10.1001/jama.2019.21579 10.56026/imu.3.1.2 10.21608/puj.2023.192898.1200 10.1007/s40593-023-00333-6 10.1371/journal.pone.0229596 10.1080/08957347.2016.1171768 10.1186/s41039-019-0121-4 10.1007/s40593-019-00186-y 10.1186/s12909-019-1795-4 10.51253/pafmj.v71i4.3136 10.1038/s42256-020-0183-4 10.1055/s-0041-1722822 |
| ContentType | Journal Article |
| Copyright | 2024. The Author(s). COPYRIGHT 2024 BioMed Central Ltd. 2024. This work is licensed under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. The Author(s) 2024 |
| Copyright_xml | – notice: 2024. The Author(s). – notice: COPYRIGHT 2024 BioMed Central Ltd. – notice: 2024. This work is licensed under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. – notice: The Author(s) 2024 |
| DBID | AAYXX CITATION CGR CUY CVF ECM EIF NPM 0-V 3V. 7X7 7XB 88B 88C 88E 8FI 8FJ 8FK ABUWG AFKRA ALSLI AZQEC BENPR CCPQU CJNVE DWQXO FYUFA GHDGH GNUQQ K9. M0P M0S M0T M1P PHGZM PHGZT PIMPY PJZUB PKEHL PPXIY PQEDU PQEST PQQKQ PQUKI PRINS Q9U 7X8 5PM DOA |
| DOI | 10.1186/s12909-024-05250-3 |
| DatabaseName | CrossRef Medline MEDLINE MEDLINE (Ovid) MEDLINE MEDLINE PubMed ProQuest Social Sciences Premium Collection ProQuest Central (Corporate) Health & Medical Collection (ProQuest) ProQuest Central (purchase pre-March 2016) Education Database (Alumni Edition) Healthcare Administration Database (Alumni) Medical Database (Alumni Edition) Hospital Premium Collection Hospital Premium Collection (Alumni Edition) ProQuest Central (Alumni) (purchase pre-March 2016) ProQuest Central (Alumni) ProQuest Central UK/Ireland Social Science Premium Collection ProQuest Central Essentials - QC ProQuest Central Database Suite (ProQuest) ProQuest One Community College Education Collection ProQuest Central Korea Health Research Premium Collection Health Research Premium Collection (Alumni) ProQuest Central Student ProQuest Health & Medical Complete (Alumni) Education Database Health & Medical Collection (Alumni) Healthcare Administration Database (ProQuest) Medical Database ProQuest Central Premium ProQuest One Academic (New) Publicly Available Content Database ProQuest Health & Medical Research Collection ProQuest One Academic Middle East (New) ProQuest One Health & Nursing ProQuest One Education ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Academic ProQuest One Academic UKI Edition ProQuest Central China ProQuest Central Basic MEDLINE - Academic PubMed Central (Full Participant titles) DOAJ: Directory of Open Access Journal (DOAJ) |
| DatabaseTitle | CrossRef MEDLINE Medline Complete MEDLINE with Full Text PubMed MEDLINE (Ovid) Publicly Available Content Database ProQuest One Education ProQuest Central Student ProQuest One Academic Middle East (New) ProQuest Central Essentials ProQuest Health & Medical Complete (Alumni) ProQuest Central (Alumni Edition) ProQuest One Community College ProQuest One Health & Nursing ProQuest Central China ProQuest Central Health Research Premium Collection Health and Medicine Complete (Alumni Edition) ProQuest Central Korea Health & Medical Research Collection ProQuest Central (New) ProQuest Medical Library (Alumni) Social Science Premium Collection Education Collection ProQuest Central Basic ProQuest Education Journals ProQuest One Academic Eastern Edition ProQuest Health Management ProQuest Hospital Collection Health Research Premium Collection (Alumni) ProQuest Hospital Collection (Alumni) ProQuest Health & Medical Complete ProQuest Medical Library ProQuest Social Sciences Premium Collection ProQuest One Academic UKI Edition ProQuest Health Management (Alumni Edition) ProQuest One Academic ProQuest One Academic (New) ProQuest Education Journals (Alumni Edition) ProQuest Central (Alumni) MEDLINE - Academic |
| DatabaseTitleList | MEDLINE MEDLINE - Academic Publicly Available Content Database |
| Database_xml | – sequence: 1 dbid: DOA name: DOAJ Directory of Open Access Journals url: https://www.doaj.org/ sourceTypes: Open Website – sequence: 2 dbid: NPM name: PubMed url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 3 dbid: EIF name: MEDLINE url: https://proxy.k.utb.cz/login?url=https://www.webofscience.com/wos/medline/basic-search sourceTypes: Index Database – sequence: 4 dbid: BENPR name: ProQuest Central url: https://www.proquest.com/central sourceTypes: Aggregation Database |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Medicine |
| EISSN | 1472-6920 |
| EndPage | 9 |
| ExternalDocumentID | oai_doaj_org_article_f8ce1442e21b4eff929326aeeab284d3 PMC10919037 A785604418 38448870 10_1186_s12909_024_05250_3 |
| Genre | Journal Article |
| GroupedDBID | --- 0-V 0R~ 23N 2WC 53G 5GY 5VS 6J9 7X7 88E 8FI 8FJ AAFWJ AAJSJ AASML AAYXX ABUWG ACGFO ACGFS ACHQT ACIHN ADBBV ADRAZ ADUKV AEAQA AENEX AFKRA AFPKN AHBYD AHMBA AHYZX ALIPV ALMA_UNASSIGNED_HOLDINGS ALSLI AMKLP AMTXH AOIJS AQUVI ARALO AZQEC BAPOH BAWUL BCNDV BENPR BFQNJ BMC BPHCQ BVXVI C6C CCPQU CITATION CJNVE CS3 DIK DU5 DWQXO E3Z EBD EBLON EBS EMB EMOBN F5P FYUFA GNUQQ GROUPED_DOAJ GX1 HMCUK IAO IHR INH INR ITC IVC KQ8 M0P M0T M1P M48 M~E O5R O5S OK1 OVT P2P PGMZT PHGZM PHGZT PIMPY PQEDU PQQKQ PROAC PSQYO RBZ RNS ROL RPM RSV SHS SOJ SV3 TR2 UKHRP W2D WOQ WOW XSB CGR CUY CVF ECM EIF NPM PJZUB PPXIY PMFND 3V. 7XB 8FK K9. PKEHL PQEST PQUKI PRINS Q9U 7X8 5PM PUEGO |
| ID | FETCH-LOGICAL-c564t-f2c8dd24e4e42b0375bc8d8f6c00fa6a7532ab325ddc0bf26db743a31c6df0b23 |
| IEDL.DBID | M48 |
| ISSN | 1472-6920 |
| IngestDate | Wed Aug 27 01:03:00 EDT 2025 Thu Aug 21 18:35:34 EDT 2025 Fri Jul 11 08:12:52 EDT 2025 Fri Jul 25 07:41:43 EDT 2025 Tue Jun 17 22:15:45 EDT 2025 Tue Jun 10 21:13:46 EDT 2025 Mon Jul 21 06:05:21 EDT 2025 Tue Jul 01 03:14:29 EDT 2025 Thu Apr 24 23:01:36 EDT 2025 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 1 |
| Keywords | Item analysis AI Construction High quality MCQs |
| Language | English |
| License | 2024. The Author(s). Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data. |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c564t-f2c8dd24e4e42b0375bc8d8f6c00fa6a7532ab325ddc0bf26db743a31c6df0b23 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 content type line 23 |
| OpenAccessLink | http://journals.scholarsportal.info/openUrl.xqy?doi=10.1186/s12909-024-05250-3 |
| PMID | 38448870 |
| PQID | 2956854390 |
| PQPubID | 42593 |
| PageCount | 9 |
| ParticipantIDs | doaj_primary_oai_doaj_org_article_f8ce1442e21b4eff929326aeeab284d3 pubmedcentral_primary_oai_pubmedcentral_nih_gov_10919037 proquest_miscellaneous_2942185620 proquest_journals_2956854390 gale_infotracmisc_A785604418 gale_infotracacademiconefile_A785604418 pubmed_primary_38448870 crossref_citationtrail_10_1186_s12909_024_05250_3 crossref_primary_10_1186_s12909_024_05250_3 |
| ProviderPackageCode | CITATION AAYXX |
| PublicationCentury | 2000 |
| PublicationDate | 2024-03-06 |
| PublicationDateYYYYMMDD | 2024-03-06 |
| PublicationDate_xml | – month: 03 year: 2024 text: 2024-03-06 day: 06 |
| PublicationDecade | 2020 |
| PublicationPlace | England |
| PublicationPlace_xml | – name: England – name: London |
| PublicationTitle | BMC medical education |
| PublicationTitleAlternate | BMC Med Educ |
| PublicationYear | 2024 |
| Publisher | BioMed Central Ltd BioMed Central BMC |
| Publisher_xml | – name: BioMed Central Ltd – name: BioMed Central – name: BMC |
| References | 5250_CR41 5250_CR40 N Mirchi (5250_CR19) 2020; 15 A Burgess (5250_CR31) 2020; 20 D Kumar (5250_CR51) 2021; 1 V González-Calatayud (5250_CR17) 2021; 11 AS Khare (5250_CR8) 2023; 42 M Tavakol (5250_CR38) 2011; 2 5250_CR4 AL Licona-Chávez (5250_CR5) 2020; 9 5250_CR46 S Thorat (5250_CR7) 2019; 6 S Soraya (5250_CR58) 2021; 4 N Mitra (5250_CR50) 2009; 3 A El-Ashkar (5250_CR29) 2023; 16 C Rao (5250_CR55) 2016; 2 F Wu (5250_CR24) 2020; 2 S Hassan (5250_CR42) 2017; 9 JL D’Sa (5250_CR48) 2017; 9 5250_CR52 M Kaur (5250_CR43) 2016; 6 5250_CR11 5250_CR54 5250_CR15 5250_CR59 5250_CR14 AA Rezigalla (5250_CR33) 2015; 3 AP Date (5250_CR44) 2019; 8 OA Elfaki (5250_CR45) 2015; 10 RM Alareifi (5250_CR57) 2023; 20 5250_CR9 R Circi (5250_CR23) 2023; 8 G Kurdi (5250_CR27) 2020; 30 M Naidoo (5250_CR2) 2023; 65 X Zhai (5250_CR16) 2021; 2021 D Pugh (5250_CR1) 2020; 15 M Hooda (5250_CR13) 2022; 2022 W Suryono (5250_CR10) 2023; 41 MNS Adiga (5250_CR36) 2021; 11 5250_CR21 5250_CR20 P Panayides (5250_CR39) 2013; 9 5250_CR26 Z Swiecki (5250_CR22) 2022; 3 Y Attali (5250_CR60) 2014; 2014 KR Scott (5250_CR3) 2019; 20 S Gajjar (5250_CR49) 2014; 39 S-M Sim (5250_CR56) 2006; 35 V Sounderajah (5250_CR25) 2021; 11 AA Rezigalla (5250_CR28) 2020; 12 SM Case (5250_CR32) 2016 V González-Calatayud (5250_CR18) 2021; 11 ME Matheny (5250_CR12) 2020; 323 MN Joseph (5250_CR34) 2021; 16 J Kehoe (5250_CR53) 1994; 4 MJ Gierl (5250_CR61) 2016; 29 5250_CR37 D Kumar (5250_CR35) 2021; 77 M Ramzan (5250_CR6) 2021; 71 A Burgess (5250_CR30) 2019; 19 V Shenoy (5250_CR47) 2023; 12 |
| References_xml | – volume: 77 start-page: 85 year: 2021 ident: 5250_CR35 publication-title: Med J Armed Forces India doi: 10.1016/j.mjafi.2020.11.007 – volume: 6 start-page: 88 issue: 3 year: 2019 ident: 5250_CR7 publication-title: J Educ Technol Health Sci – volume: 9 start-page: 109 issue: 3 year: 2017 ident: 5250_CR48 publication-title: Int J Nurs Educ doi: 10.5958/0974-9357.2017.00079.4 – volume: 10 start-page: 123 issue: 4 year: 2015 ident: 5250_CR45 publication-title: Sudan Med Monit doi: 10.4103/1858-5000.171863 – ident: 5250_CR14 doi: 10.1201/9781003184157-8 – volume: 3 start-page: 220 issue: 3 year: 2015 ident: 5250_CR33 publication-title: Saudi J Med Med Sci doi: 10.4103/1658-631X.162027 – volume: 2014 start-page: 1 issue: 2 year: 2014 ident: 5250_CR60 publication-title: ETS Res Rep Ser doi: 10.1002/ets2.12042 – volume: 8 start-page: 858273 year: 2023 ident: 5250_CR23 publication-title: Front Educ doi: 10.3389/feduc.2023.858273 – ident: 5250_CR40 – volume: 11 start-page: 1 issue: 12 year: 2021 ident: 5250_CR18 publication-title: Appl Sci doi: 10.3390/app11125467 – volume: 16 start-page: e142 issue: 6 year: 2021 ident: 5250_CR34 publication-title: Simul Healthc doi: 10.1097/SIH.0000000000000530 – ident: 5250_CR11 doi: 10.1007/978-981-19-6458-9_24 – ident: 5250_CR37 – volume: 6 start-page: 70 issue: 3 year: 2016 ident: 5250_CR43 publication-title: Int J Appl Basic Med Res doi: 10.4103/2229-516X.186965 – volume: 4 start-page: 1 issue: 10 year: 1994 ident: 5250_CR53 publication-title: Practical Assess Res Evaluation – volume: 2022 start-page: 1 year: 2022 ident: 5250_CR13 publication-title: Math Probl Eng – volume: 2 start-page: 53 year: 2011 ident: 5250_CR38 publication-title: Int J Med Educ doi: 10.5116/ijme.4dfb.8dfd – ident: 5250_CR4 doi: 10.54393/pjhs.v4i04.700 – volume: 35 start-page: 67 issue: 2 year: 2006 ident: 5250_CR56 publication-title: Annals-Academy Med Singap doi: 10.47102/annals-acadmedsg.V35N2p67 – volume: 39 start-page: 17 issue: 1 year: 2014 ident: 5250_CR49 publication-title: Indian J Community Medicine: Official Publication Indian Association Prev Social Med doi: 10.4103/0970-0218.126347 – volume: 3 start-page: 100075 year: 2022 ident: 5250_CR22 publication-title: Computers Education: Artif Intell – ident: 5250_CR41 – volume: 9 start-page: 687 issue: 4 year: 2013 ident: 5250_CR39 publication-title: Europe’s J Psychol doi: 10.5964/ejop.v9i4.653 – ident: 5250_CR20 – volume: 4 start-page: 165 issue: 3 year: 2021 ident: 5250_CR58 publication-title: J Iran Med Council – volume: 41 start-page: 44 year: 2023 ident: 5250_CR10 publication-title: Technium Soc Sci J – volume: 9 start-page: 1 issue: 91 year: 2020 ident: 5250_CR5 publication-title: MedEdPublish – ident: 5250_CR21 doi: 10.1609/aaai.v35i14.17553 – volume: 11 start-page: e047709 issue: 6 year: 2021 ident: 5250_CR25 publication-title: BMJ open doi: 10.1136/bmjopen-2020-047709 – start-page: 31 volume-title: Constructing written test questions for the Basic and Clinical sciences year: 2016 ident: 5250_CR32 – ident: 5250_CR26 – ident: 5250_CR52 doi: 10.21315/eimj2017.9.3.4 – volume: 8 start-page: 1999 issue: 9 year: 2019 ident: 5250_CR44 publication-title: Int J Basic Clin Pharmacol doi: 10.18203/2319-2003.ijbcp20194106 – volume: 12 start-page: 94 issue: 2 year: 2023 ident: 5250_CR47 publication-title: Natl J Clin Anat doi: 10.4103/NJCA.NJCA_9_23 – volume: 65 start-page: e1 issue: 1 year: 2023 ident: 5250_CR2 publication-title: South Afr Family Practice: Official J South Afr Acad Family Practice/Primary Care – volume: 12 start-page: e6692 issue: 1 year: 2020 ident: 5250_CR28 publication-title: Cureus – volume: 20 start-page: 1 issue: 2 year: 2020 ident: 5250_CR31 publication-title: BMC Med Educ – volume: 2 start-page: 201 issue: 4 year: 2016 ident: 5250_CR55 publication-title: Int J Educational Psychol Researches doi: 10.4103/2395-2296.189670 – volume: 20 start-page: 124 year: 2023 ident: 5250_CR57 publication-title: J Eduction Hum Sci – ident: 5250_CR59 doi: 10.4324/9780203874776-25 – volume: 20 start-page: 11 issue: 1 year: 2019 ident: 5250_CR3 publication-title: West J Emerg Med doi: 10.5811/westjem.2018.11.39805 – volume: 323 start-page: 509 issue: 6 year: 2020 ident: 5250_CR12 publication-title: JAMA doi: 10.1001/jama.2019.21579 – volume: 3 start-page: 2 issue: 1 year: 2009 ident: 5250_CR50 publication-title: IeJSME doi: 10.56026/imu.3.1.2 – volume: 16 start-page: 64 issue: 1 year: 2023 ident: 5250_CR29 publication-title: Parasitologists United J doi: 10.21608/puj.2023.192898.1200 – ident: 5250_CR54 – volume: 2021 start-page: 1 year: 2021 ident: 5250_CR16 publication-title: Complexity – volume: 11 start-page: 5467 issue: 12 year: 2021 ident: 5250_CR17 publication-title: Appl Sci doi: 10.3390/app11125467 – ident: 5250_CR9 doi: 10.1007/s40593-023-00333-6 – ident: 5250_CR46 – volume: 15 start-page: e0229596 issue: 2 year: 2020 ident: 5250_CR19 publication-title: PLoS ONE doi: 10.1371/journal.pone.0229596 – volume: 9 start-page: 33 issue: 3 year: 2017 ident: 5250_CR42 publication-title: Educ Med J doi: 10.21315/eimj2017.9.3.4 – volume: 29 start-page: 196 issue: 3 year: 2016 ident: 5250_CR61 publication-title: Appl Measur Educ doi: 10.1080/08957347.2016.1171768 – volume: 15 start-page: 1 year: 2020 ident: 5250_CR1 publication-title: Res Pract Technol Enhanced Learn doi: 10.1186/s41039-019-0121-4 – volume: 30 start-page: 121 year: 2020 ident: 5250_CR27 publication-title: Int J Artif Intell Educ doi: 10.1007/s40593-019-00186-y – ident: 5250_CR15 – volume: 19 start-page: 1 issue: 1 year: 2019 ident: 5250_CR30 publication-title: BMC Med Educ doi: 10.1186/s12909-019-1795-4 – volume: 71 start-page: 1308 issue: 4 year: 2021 ident: 5250_CR6 publication-title: Pakistan Armed Forces Med J doi: 10.51253/pafmj.v71i4.3136 – volume: 42 start-page: 50 issue: 3 year: 2023 ident: 5250_CR8 publication-title: Lat Am J Pharm – volume: 2 start-page: 312 issue: 6 year: 2020 ident: 5250_CR24 publication-title: Nat Mach Intell doi: 10.1038/s42256-020-0183-4 – volume: 11 start-page: 130 issue: 03 year: 2021 ident: 5250_CR36 publication-title: J Health Allied Sci NU doi: 10.1055/s-0041-1722822 – volume: 1 start-page: 85 issue: 77 year: 2021 ident: 5250_CR51 publication-title: Med J Armed Forces India doi: 10.1016/j.mjafi.2020.11.007 |
| SSID | ssj0017831 |
| Score | 2.402113 |
| Snippet | The introduction of competency-based education models, student centers, and the increased use of formative assessments have led to demands for high-quality... Background The introduction of competency-based education models, student centers, and the increased use of formative assessments have led to demands for... BackgroundThe introduction of competency-based education models, student centers, and the increased use of formative assessments have led to demands for... Abstract Background The introduction of competency-based education models, student centers, and the increased use of formative assessments have led to demands... |
| SourceID | doaj pubmedcentral proquest gale pubmed crossref |
| SourceType | Open Website Open Access Repository Aggregation Database Index Database Enrichment Source |
| StartPage | 247 |
| SubjectTerms | Analysis Artificial intelligence Automation Competency based education Computational linguistics Construction Cross-Sectional Studies Deep learning Discrimination Education, Medical Feedback High quality Humans Item analysis Language processing Learning Processes MCQs Medical education Medical personnel Natural language interfaces Natural language processing Outcomes of Education Pilot projects Psychometrics Questionnaires Reading Materials Research Design Responsibilities Students Teaching Teams Training |
| SummonAdditionalLinks | – databaseName: DOAJ: Directory of Open Access Journal (DOAJ) dbid: DOA link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV3NS91AEB-KB-mlVKs21soWhB5KMNndbDZeylMUW3iFQgVvy35SoeYJ0f-_M_l4faHQXiS37CRkZ2d2fpPd_Q3Aia914yNVDWhqnktZF7kWyucYOp0oY13Vgs4OL7-p6xv59ba63Sj1RXvCBnrgQXGnSeOrpOSRl07GlDCcI-KwMVqHM2voeT4x5k3J1Lh-UGtRTkdktDrt6G9Lk2M8yqluG848szDUs_X_PSdvBKX5hsmNCHT1Gl6N0JEthk_egRex3YXt5bg4_gY-L76wu5bdD0svLE5bN87YUxc7tkpsEPCrP6yxjH7BsgVbXnzv9uDm6vLHxXU-1kfIfaXkY5641yFwGfHijorZOryhk_JFkayymIlw6wSvQvCFS1wFh3jBitKrkArHxT5stas2vgUWopABwQzCMSerwtrG6WAri-ljETCpyqCc1GX8SB5ONSx-mT6J0MoMKjaoYtOr2IgMPq2feRioM_4pfU6jsJYk2uv-BhqDGY3B_M8YMvhIY2jIOfHzvB3PGGAniebKLGqNCA8RoM7gaCaJTuXnzZMVmNGpO8PpaGWFCK7I4MO6mZ6kjWptXD2RjETQhKASZQ4Go1l3SWjMhXF-zEDPzGnW53lLe_ezp_wm-tYGR_jwObT0Dl7y3hWorscRbKHJxfcIrR7dce9FvwGfdRze priority: 102 providerName: Directory of Open Access Journals – databaseName: Health & Medical Collection (ProQuest) dbid: 7X7 link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV3ba9YwFA86QXwR71anRBB8kLA2SdPUl_E5HFP4BMHB9xZy1YG2027_v-e0abcijL41J6VJzuV3kpNzCHnrG936iFUD2oYzKZuSaaE8A9PpRBWbuhF4d3j7VZ2cyi-7epc33IYcVjnrxFFRh97jHvkBx3ttNZjP8vD8D8OqUXi6mkto3CZ3MHUZhnQ1u8XhqhotqvmijFYHA-65tAysEsPqbaB_VsZozNn_v2a-ZprWYZPX7NDxA3I_A0i6mVb8IbkVu0fk7jYfkT8mh5vP9Kyjv6cDGBrnAI4P9HKIA-0TnQh8f5U7luJGLN3Q7dG34Qk5Pf70_eiE5SoJzNdKXrDEvQ6BywgPd1jS1sELnZQvy2SVBX-EWyd4HYIvXeIqOEANVlRehVQ6Lp6Sva7v4nNCQxQyAKQBUOZkXVrbOh1sbcGJLAO4VgWp5ukyPqcQx0oWv8zoSmhlpik2MMVmnGIjCvJ-6XM-JdC4kfojrsJCicmvxxf93x8my5JJGrhLSh555WRMCRAegFAbo3VgbAN85B2uoUERhd_zNt80gEFisiuzaTTgPMCBuiD7K0oQLb9unrnAZNEezBUjFuTN0ow9MVyti_0l0kiATgAtgebZxDTLkIQGjxi0ZEH0ip1WY163dGc_x8TfmMS1hRV-cfN_vST3-MjkWLdjn-wBM8VXAJ0u3OtRPv4BlJwTmw priority: 102 providerName: ProQuest |
| Title | AI in medical education: uses of AI in construction type A MCQs |
| URI | https://www.ncbi.nlm.nih.gov/pubmed/38448870 https://www.proquest.com/docview/2956854390 https://www.proquest.com/docview/2942185620 https://pubmed.ncbi.nlm.nih.gov/PMC10919037 https://doaj.org/article/f8ce1442e21b4eff929326aeeab284d3 |
| Volume | 24 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3ra9RAEB_6APGL-G60HisIfpBostnsbgQpd6WlCle0eHD4ZdlXtFAT7bWg_72zm-TaYBEkkA-7kyU7O7Pzm33MALywQlbWh6wBlaApYyJLZcFtiqbTFLkXpSjC3eH5MT9asA_LcrkBQ7qjnoGrG127kE9qcX72-tfP33uo8O-iwkv-ZhXWUqoUrU0asrLhvLIJ22iZRFDUObvaVRAy5ifMGf4Wr2g2XKK5sY2RoYrx_P-eta-ZrfGRyms26vAu3OnBJZl20nAPNnxzH27N--3zB7A3fU9OG_K925whfjjc8ZZcrvyKtDXpCGx7FVeWhEVaMiXz_U-rh7A4PPi8f5T2GRRSW3J2kdbUSuco8_hQE9LdGiyQNbdZVmuu0Veh2hS0dM5mpqbcGUQUusgtd3VmaPEItpq28TtAnC-YQ7iDgM2wMtO6MtLpUqODmTl0uxLIB3Yp24cXD1kuzlR0MyRXHYsVslhFFqsigVfrb350wTX-ST0Lo7CmDIGxY0F7_lX1eqZqiZLHGPU0N8zXNaI_BKjae23QEDts5GUYQxUECn_P6v4WAnYyBMJSUyERAyJGlAnsjihR7ey4epACNUitouHyZYkYL0vg-bo6fBmOsjW-vQw0DGEVwk6kedwJzbpLhURvGWfQBORInEZ9Htc0p99iUPAQ4LXCEX7yXzx9CrdplPmQ4mMXtlC2_DNEWRdmAptiKSawPTs4_ngyiWsVk6hO-D6ZffkDg-Ug1Q |
| linkProvider | Scholars Portal |
| linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1ba9VAEF7KKagv4t3UqisoPkhosrtJNoKU09pyju05qLTQt-3eooWaVNMi_il_ozO5tUHoW8lbdjZkZ2dnvtndmSHktc1kbj1WDcgzFgqRRaHkqQ3BdBoe-yzJOMYOL5bp7FB8OkqOVsjfPhYGr1X2OrFR1K6yuEe-wTCuLQHzGW2e_QyxahServYlNFqx2PN_foPLVn-Yf4T5fcPY7s7B9izsqgqENknFeVgwK51jwsPDDJaANfBCFqmNokKnGvA704azxDkbmYKlzoCV1Ty2qSsig4kOQOWvCg6uzISsbu0sP38dzi0yyeM-NEemGzXu8uQh2MEQ68WBxhuZv6ZKwP-24IoxHF_UvGL5du-Rux1kpdNWxu6TFV8-ILcW3aH8Q7I5ndOTkv5oj3yo76-MvKcXta9pVdCWwFaX2Wopbv3SKV1sf6kfkcMb4eBjMimr0j8l1HkuHIAogIFGJJHWuZFOJxrc1siBMxeQuGeXsl3Scqydcaoa50WmqmWxAharhsWKB-Td0OesTdlxLfUWzsJAiem2mxfVr2-qW72qkCDPQjDPYiN8UQCmBNirvdcGzLuDj7zFOVSoFOD3rO5iG2CQmF5LTTMJyBKQpwzI-ogSFrMdN_dSoDplUqtL0Q_Iq6EZe-IFudJXF0gjAKwBmAWaJ63QDEPiEnxw0MsBkSNxGo153FKefG9SjWPa2BxmeO36_3pJbs8OFvtqf77ce0busEbgsWrIOpmAYPnnANzOzYtutVByfNML9B8KWFNG |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=AI+in+medical+education%3A+uses+of+AI+in+construction+type+A+MCQs&rft.jtitle=BMC+medical+education&rft.au=Rezigalla%2C+Assad+Ali&rft.date=2024-03-06&rft.issn=1472-6920&rft.eissn=1472-6920&rft.volume=24&rft.issue=1&rft_id=info:doi/10.1186%2Fs12909-024-05250-3&rft.externalDBID=n%2Fa&rft.externalDocID=10_1186_s12909_024_05250_3 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1472-6920&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1472-6920&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1472-6920&client=summon |