EJ2 Associates provides clients with innovative project evaluation, performance monitoring, and project management solutions that help ensure the success of any project or initiative.
Accreditation.
E2A provides a variety of services supporting and/or managing the teacher preparation program’s quality assurance system.
Support of Quality Assurance System
Management of Quality Assurance System:
Evaluation Design.
E2A evaluators have expertise in all areas of evaluation design including program development, logic modeling, and grant writing.
PROGRAM DEVELOPMENT
Program model development is a critical first step in the development of a strong grant proposal and evaluation design. Our process involves addressing five critical questions:
LOGIC MODELING
A logic model creates a graphical depiction of the logical relationships between the resources, activities, outputs, and outcomes of a program. Using information gleaned from the evaluation design meeting, our team of evaluators creates a logic model to guide project develop, implementation, and evaluation. For implementation, the logic model has a built-in feedback loop to provide timely and useful information to stakeholders for informed decision-making on needed changes in program activities. Short-term performance indicators will assess progress toward long-term outcomes. Annual benchmarks are established and embedded in outcomes.
The evaluation section of a proposal describes how the program will be evaluated, how the outcomes and impact will be measured, and how program results will be disseminated. Our team has expertise writing SMART (specific, measurable, achievable, realistic, and time-bound) goals and objectives, evaluation plans aligned to the program design, rigorous impact studies, and detailed evaluator qualifications. E2A assists in the writing of the evaluation section of grant proposals and other stand-alone projects to ensure evaluation activities align to the program design and answer questions most useful to funders and stakeholders.
Survey Development.
E2A uses valid and reliable instruments and pilot-test tools prior to full scale use to optimize data collection and analysis.
E2A uses a combination of nationally validated and reliable survey instruments in addition to customized, evaluator-developed, clinically designed questionnaires that provide a script for presenting a standard set of questions and response options depending on client need.
Data Analysis.
E2A uses a variety of statistical techniques, from descriptive statistics to advanced multivariate analysis.
DESCRIPTIVE
E2A uses descriptive statistics (i.e., means, standard deviations, frequencies, and percentages) to summarize features of the data collection.
MULTIVARIATE
E2A uses multivariate analysis (i.e., cross-tabulation, Pearson’s r, covariance, z-scores) to show the relationship between different variables.
FIDELITY SCORE
The fidelity score is based on regression analysis and provides a consolidated view of the performance of a program. This score uses various indicators from program performance metrics to provide an aggregate and weighted indication of the program’s performance. This score can be used as a succinct and easy measure to constantly monitor performance and continuous improvement.
Data Collection.
E2A incorporates a mixed-methods approach using qualitative and quantitative methods to triangulate data, increase the validity of findings, and ensure the results are useful for continuous quality improvement.
TRIANGULATING THE DATA FOR RELIABLE RESULTS
E2A incorporates a mixed-methods approach using qualitative and quantitative methods to triangulate data, increase the validity of findings, and ensure the results are useful for continuous quality improvement.
QUALITATIVE
E2A uses qualitative methods, such as open-ended survey questions for online and paper surveys, meeting minutes and administrative document review, observations, and focus groups (with clients and stakeholders). Qualitative data analysis is guided by code development informed by scholarly literature, stakeholder panels, and member checking.
QUANTITATIVE
E2A develops customized, quantitatively-based instruments, including surveys, checklists, and observation protocols. Quantitative data is analyzed using descriptive statistics (i.e., means, standard deviations, frequencies, and percentages); parametric and non-parametric inferential statistics (i.e., chi square, t-tests, ANOVA); and effect sizes disaggregated by subgroups.
Data Visualization.
We create snapshots, reports, and infographics using data visualization to engage stakeholders by providing clear, digestible data.
SNAPSHOTS
E2A uses cutting-edge data visualization to provide evaluation findings in easy-to-understand snapshots for timely reporting. Snapshots are provided at the site level to allow for continuous improvement throughout implementation.
INFOGRAPHICS
Infographics are user-friendly one-page depictions of evaluation findings that can be distributed to key stakeholders and community partners and used to inform program improvement.
REPORTS
E2A works with partners to complete interim, annual, and final performance reports as required by funders. Reports typically include status of progress and outcome performance measures and evaluation findings from the formative and summative evaluation activities.
Technical Assistance.
E2A places a high priority on effectively communicating evaluation results and provide training in data collection and interpretation.
HOW TO USE TOOLS
E2A develops customized data collection tools and then provides training to ensure data collectors and program leadership understand how to use the tools for secure and accurate data collection. Training may include in-person, virtual, video, or instructional guides based on individual program needs.
HOW TO INTERPRET DATA
E2A meets with program leadership and key stakeholders to explain how the data was collected, what the data shows, and what the data means to program implementation and impact. As independent evaluators, E2A takes an unbiased approach to data interpretation and works to ensure clients understand findings.
COMMUNICATING RESULTS
Project Management.
We understand how to manage the complexities of projects—and allow you to focus on running your organization.
The success of your project is not measured by your ability to conceive a great idea, but rather by your ability to put it into action. Whether managing the initial application process or strategically implementing project services, you’re looking to turn a great idea into a successful reality.
This is where E2A adds considerable value. We have evaluated large grant-funded programs with excellent strategies that have ultimately not had the impact they should have had simply because there was no effective management of the funded project. We provide innovative, high-quality, start-to-finish program management solutions that help organizations drive change and achieve their proposed impact by providing industry-leading program management consulting services, methods and tools. You can rely on us to help you turn a well-crafted strategy into a well-executed plan. Our Associate groups provide the innovative solutions our clients need to successfully initiate, plan, execute, control, and close any project.