Review Process
All submissions will be reviewed by at least two subject matter experts from within or outside the Federal Government who will score the proposals based on the assessment criteria and provide a brief comment about the submission. The scores/comments on Phase 1 and Phase 2 submissions will be compiled, and a ranked summary provided to AHRQ staff. AHRQ will select winners based on quantitative and qualitative assessments.
Evaluation Criteria for Selecting Winning Applications
Assessment Criteria for Phase 1
- Approach (40 points)
- Inclusion of the context and rationale for why the preventive service(s) were chosen and demonstration of a specific need the data visualization will address.
- A clear description of the data visualization tool.
- A plan to investigate the root cause of disparities in preventive service(s) and potential intervention(s) to address root cause.
- The data source and the analytic approach: Does the described analytic approach provide the right balance of feasibility, rigor, and innovation for the project?
- Impact (40 points)
- Description of the generalizability of the approach and data visualization tools.
- The anticipated impact on clinical care and outcomes.
- Anticipated risks, barriers, and strategies to successfully complete the project.
- Team (20 points)
- Assessment of the team as having the right combination of expertise to support the proposed technical approach.
- Compliance (pass/fail)
- Assessment of the proposal to adequately address required accessibility standards of the final report (Section 508).
Assessment Criteria for Phase 2
- Implementation (40 points)
The final report must contain:
- Clear description of implementation in the context of the healthcare system.
- Presence of a framework to guide the implementation, with appropriate scope and measures (qualitative and/or quantitative).
- Evaluation (40 points)
- A description of how the tool and intervention were developed and implemented, what inequities were identified and addressed, and lessons learned, contained in the final report.
- Future Plans (20 points)
- Inclusion in the final report of implementation measures and direction for development and implementation of the data visualization tool and intervention at other sites.
- Inclusion of a sustainability plan.
- Compliance (pass/fail)
- Does the Phase 1 proposal adequately address required accessibility standards (Section 508)?