<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.0 20040830//EN" "journalpublishing.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="2.0" xml:lang="en" article-type="reviewer-report"><front><journal-meta><journal-id journal-id-type="nlm-ta">JMIRx Med</journal-id><journal-id journal-id-type="publisher-id">xmed</journal-id><journal-id journal-id-type="index">34</journal-id><journal-title>JMIRx Med</journal-title><abbrev-journal-title>JMIRx Med</abbrev-journal-title><issn pub-type="epub">2563-6316</issn><publisher><publisher-name>JMIR Publications</publisher-name><publisher-loc>Toronto, Canada</publisher-loc></publisher></journal-meta><article-meta><article-id pub-id-type="publisher-id">v6i1e69869</article-id><article-id pub-id-type="doi">10.2196/69869</article-id><article-categories><subj-group subj-group-type="heading"><subject>Peer-Review Report</subject></subj-group></article-categories><title-group><article-title>Peer Review for &#x201C;Checklist Approach to Developing and Implementing AI in Clinical Settings: Instrument Development Study&#x201D;</article-title></title-group><contrib-group><contrib contrib-type="author"><collab>Anonymous</collab></contrib></contrib-group><contrib-group><contrib contrib-type="editor"><name name-style="western"><surname>Hang</surname><given-names>Ching Nam</given-names></name></contrib><contrib contrib-type="editor"><name name-style="western"><surname>Meinert</surname><given-names>Edward</given-names></name></contrib><contrib contrib-type="editor"><name name-style="western"><surname>Leung</surname><given-names>Tiffany</given-names></name></contrib></contrib-group><pub-date pub-type="collection"><year>2025</year></pub-date><pub-date pub-type="epub"><day>20</day><month>2</month><year>2025</year></pub-date><volume>6</volume><elocation-id>e69869</elocation-id><history><date date-type="received"><day>10</day><month>12</month><year>2024</year></date><date date-type="accepted"><day>10</day><month>12</month><year>2024</year></date></history><copyright-statement>&#x00A9; Anonymous. Originally published in JMIRx Med (<ext-link ext-link-type="uri" xlink:href="https://med.jmirx.org">https://med.jmirx.org</ext-link>), 20.2.2025. </copyright-statement><copyright-year>2025</copyright-year><license license-type="open-access" xlink:href="https://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (<ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by/4.0/">https://creativecommons.org/licenses/by/4.0/</ext-link>), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIRx Med, is properly cited. The complete bibliographic information, a link to the original publication on <ext-link ext-link-type="uri" xlink:href="https://med.jmirx.org/">https://med.jmirx.org/</ext-link>, as well as this copyright and license information must be included.</p></license><self-uri xlink:type="simple" xlink:href="https://xmed.jmir.org/2025/1/e69869"/><related-article related-article-type="companion" ext-link-type="doi" xlink:href="10.1101/2024.08.08.24311701" xlink:title="Preprint (medRxiv)" xlink:type="simple">https://www.medrxiv.org/content/10.1101/2024.08.08.24311701v1</related-article><related-article related-article-type="companion" ext-link-type="doi" xlink:href="10.2196/69537" xlink:title="Authors' Response to Peer-Review Reports" xlink:type="simple">https://med.jmirx.org/2025/1/e69537</related-article><related-article related-article-type="companion" ext-link-type="doi" xlink:href="10.2196/65565" xlink:title="Published Article" xlink:type="simple">https://med.jmirx.org/2025/1/e65565</related-article><kwd-group><kwd>artificial intelligence</kwd><kwd>machine learning</kwd><kwd>algorithm</kwd><kwd>models</kwd><kwd>analytics</kwd><kwd>AI deployment</kwd><kwd>human-AI interaction</kwd><kwd>AI integration</kwd><kwd>checklist</kwd><kwd>clinical workflow</kwd><kwd>clinical setting</kwd><kwd>literature review</kwd></kwd-group></article-meta></front><body><p><italic>This is the peer-review report for &#x201C;Checklist Approach to Developing and Implementing AI in Clinical Settings: Instrument Development Study.&#x201D;</italic></p><sec id="s2"><title>Round 1 Review</title><p>The paper [<xref ref-type="bibr" rid="ref1">1</xref>] presents the Clinical Artificial Intelligence (AI) Sociotechnical Framework (CASoF), a structured approach to guide the planning, design, development, and implementation of AI systems in health care settings. The framework is designed to address the gap between technical performance and sociotechnical factors that are essential for successful AI deployment in clinical environments.</p><p>The authors conducted a literature synthesis and a modified Delphi study involving global health care professionals to develop and refine the CASoF checklist. The checklist emphasizes the importance of considering the value proposition, data integrity, human-AI interaction, technical architecture, organizational culture, and ongoing support and monitoring, to ensure that AI tools are not only technologically sound but also practically viable and socially adaptable within clinical settings.</p><p>The study found that the successful integration of AI in health care depends on a balanced focus on both technological advancements and the sociotechnical environment of clinical settings. The CASoF represents a step forward in bridging this divide, offering a holistic approach to AI deployment that is mindful of the complexities of health care systems. The checklist aims to facilitate the development of AI tools that are effective, user-friendly, and seamlessly integrated into clinical workflows, ultimately enhancing patient care and health care outcomes.</p><p>The authors acknowledge some limitations of the study, such as the need for continuous refinement of the CASoF through iterative feedback and broader engagement with more stakeholders. Future research should aim to include an even wider array of perspectives, particularly from underrepresented regions and specialties, to enhance the framework&#x2019;s comprehensiveness and applicability.</p><p>Overall, the paper provides a valuable contribution to the field of AI in health care by offering a practical and comprehensive approach to the development and implementation of AI systems in clinical settings.</p></sec></body><back><fn-group><fn fn-type="conflict"><p>None declared.</p></fn></fn-group><glossary><title>Abbreviations</title><def-list><def-item><term id="abb1">AI</term><def><p>artificial intelligence</p></def></def-item><def-item><term id="abb2">CASoF</term><def><p>Clinical Artificial Intelligence Sociotechnical Framework</p></def></def-item></def-list></glossary><ref-list><title>References</title><ref id="ref1"><label>1</label><nlm-citation citation-type="journal"><person-group person-group-type="author"><name name-style="western"><surname>Owoyemi</surname><given-names>A</given-names> </name><name name-style="western"><surname>Osuchukwu</surname><given-names>J</given-names> </name><name name-style="western"><surname>Salwei</surname><given-names>ME</given-names> </name><name name-style="western"><surname>Boyd</surname><given-names>A</given-names> </name></person-group><article-title>Checklist approach to developing and implementing AI in clinical settings: instrument development study</article-title><source>JMIRx Med</source><year>2025</year><volume>6</volume><fpage>e65565</fpage><pub-id pub-id-type="doi">10.2196/65565</pub-id></nlm-citation></ref></ref-list></back></article>