PANACeA eHealth Evaluation

Scoring of KDS eHealth Evaluation Tool:

Scoring of KDS tool is done in following stages:

1. Stage I: Scoring of individual items by different groups of respondents:

The respondents in each group, i.e. Managers, health providers and clients respond to items in the eHealth evaluation tool based on the stage of eHealth lifecycle. It is important that the respondents answer the items for their own stage and also those of the previous stages. For example, if the eHealth project is in Integration phase, the respondents should answer items under the heading of integration, as well as implementation and development.

“Unsatisfactory” and “Don’t Know (DK)” would be scored as 1, “Below Expectations” would be scored as 2, “Meets Expectations” would be scored as 3, “Above Expectations” would be scored as 4 and “Extraordinary” would be scored as 5.

2. Stage II: Calculating cumulative scores for each Outcome Category and determine means for groups of respondents:

Cumulative scores should be calculated by adding the scores on likert scale for each item. The total scores for each outcome category for every group of respondents should be added and divided by the total number of respondents in that group to calculate the mean.

3. Stage III: Adding mean scores of different groups of respondents for each Outcome category and calculate percentages:

Total score for each Outcome category should be calculated by adding the mean scores for each respondent group for that particular category. The total score should be divided by the maximum score to calculate percentages.

4. Stage IV: Study the scores of each categories and identify areas of strength and needing improvement:

Total scores or percentages for each outcome category should be studied to identify areas of strength or the ones that need improvement.

Table 1: Scores for each respondent group and Outcome Categories according to the stage in eHealth life cycle