Clinical Significance and Interpretation of Quantitative Results

Chapter 21 Clinical Significance and Interpretation of Quantitative Results

 

Copyright © 2017 Wolters Kluwer Health | Lippincott Williams & Wilkins

 

 

Copyright © 2021 Wolters Kluwer Health | Lippincott Williams & Wilkins

1

 

Question #1

Tell whether the following statement is true or false:

Results of a study need to be evaluated with thought to the aims of the study.

 

 

 

 

Copyright © 2021 Wolters Kluwer Health | Lippincott Williams & Wilkins

Answer to Question #1

True

The results need to be evaluated and interpreted, giving thought to the aims of the study, its theoretical basis, the body of related research evidence, and limitations of the adopted research methods.

 

 

 

Copyright © 2021 Wolters Kluwer Health | Lippincott Williams & Wilkins

Question #2

Tell whether the following statement is true or false:

Methodologic decisions affect the inferences that can be made between study results and the real clinical world.

 

 

 

 

Copyright © 2021 Wolters Kluwer Health | Lippincott Williams & Wilkins

Answer to Question #2

True

Inference is central to interpretation. Methodologic decisions made by researchers affect the inferences that can be made about the correspondence between study results and “truth in the real world.”

 

 

Copyright © 2021 Wolters Kluwer Health | Lippincott Williams & Wilkins

Interpretation of Quantitative Research Results #1

Issues of interpretation

Aspects of interpretation

The credibility of the results

Precision of estimates of effects

Magnitude of effects

Underlying meaning of the results

Generalizability of results

Implications for future research, theory development, and nursing practice

 

 

 

Copyright © 2021 Wolters Kluwer Health | Lippincott Williams & Wilkins

6

 

Interpretation of Quantitative Research Results #2

Credibility of quantitative results

Proxies and credibility

Credibility and validity

Credibility and bias

Credibility and corroboration

Precision and meaning of results

Magnitude of effects and importance

Interpreting hypothesized results

 

 

 

 

 

Copyright © 2021 Wolters Kluwer Health | Lippincott Williams & Wilkins

7

 

Interpretation of Quantitative Research Results #3

Interpreting nonsignificant results

Interpreting unhypothesized significant results

Interpreting mixed results

Generalizability and applicability of the results

Implications of the results

 

 

 

 

Copyright © 2021 Wolters Kluwer Health | Lippincott Williams & Wilkins

8

 

Question #3

Tell whether the following statement is true or false:

Credibility assessments involve a careful assessment of validity threats and biases that could undermine the accuracy of the results.

 

 

Copyright © 2021 Wolters Kluwer Health | Lippincott Williams & Wilkins

Answer to Question #3

True

Credibility assessments can involve a careful assessment of study rigor through an analysis of validity threats and biases that could undermine the accuracy of the results.

 

 

Copyright © 2021 Wolters Kluwer Health | Lippincott Williams & Wilkins

Credibility Assessment

Approaches include

Evaluating the degree of congruence between abstract constructs and the proxies actually

Careful assessment of study rigor

Corroboration (replication) of results

 

 

 

Copyright © 2021 Wolters Kluwer Health | Lippincott Williams & Wilkins

11

 

Clinical Significance #1

Group-level results are often inferred on the basis of such statistics as effect size indexes, confidence intervals, and number needed to treat.

Individual results are discussed in terms of effects.

 

 

Copyright © 2021 Wolters Kluwer Health | Lippincott Williams & Wilkins

12

 

Clinical Significance #2

Benchmark: threshold that designates a meaningful amount of change

Ask whether

A change in the attribute is real

A patient in a dysfunctional state returns to normal functioning

A patient has achieved a symptom state that is acceptable to them

The amount of change in an attribute can be considered minimally important

 

 

Copyright © 2021 Wolters Kluwer Health | Lippincott Williams & Wilkins

13

 

Clinical Significance #3

Minimal important change (MIC)

Value for the amount of change score points that an individual patient must achieve in order to be credited with having a clinically important change

 

 

Copyright © 2021 Wolters Kluwer Health | Lippincott Williams & Wilkins

14

 

Clinical Significance #4

Methods of establishing the MIC

A consensus panel

An anchor-based approach

A distribution-based method

Bases the MIC on the distributional characteristics of the sample

Triangulation of approaches is increasingly common

 

 

Copyright © 2021 Wolters Kluwer Health | Lippincott Williams & Wilkins

15

 

Clinical Significance #5

MICs cannot be used to interpret

Group means

Differences in means

MICs can be used to interpret

If each person in a sample has or has not achieved a change greater than the MIC

Responder analysis compares the percentage of responders in different study groups.

 

 

 

Copyright © 2021 Wolters Kluwer Health | Lippincott Williams & Wilkins

16

 

Group Level

Group-level clinical significance (practical significance)

Involves using statistical information other than p values to draw conclusions about the usefulness or importance of research findings

Most widely used statistics

Effect size (ES) indexes

Confidence intervals (CIs)

Number needed to treat (NNT)

 

 

 

Copyright © 2021 Wolters Kluwer Health | Lippincott Williams & Wilkins

17

 

Individual Level

Individual-level clinical significance

Efforts to come to conclusions about clinical significance at the individual level can be directly linked to EBP goals

Benchmark

The Reliable Change Index (RCI)

Patient acceptable symptom state (PASS)

Minimal important change (MIC)

 

 

Copyright © 2021 Wolters Kluwer Health | Lippincott Williams & Wilkins

18

 

Critiquing Interpretations

Review discussion section of research reports for statements regarding

Limitations

Sampling deficiencies

Practical constraints

Data-quality problems

Methodology section

How limitations were considered in interpreting the results

 

 

Copyright © 2021 Wolters Kluwer Health | Lippincott Williams & Wilkins

19

 

Question #4

Which results are considered when interpreting the results of a quantitative research study? (Select all that apply.)

Magnitude of the effects

Underlying meaning of the results

Implication for nursing practice

Cost of the study

Credibility of the results

 

 

 

Copyright © 2021 Wolters Kluwer Health | Lippincott Williams & Wilkins

Answer to Question #4

A, B, C, E

The interpretation of quantitative research results (the outcomes of the statistical analyses) typically involves consideration of (1) the credibility of the results; (2) precision of estimates of effects; (3) magnitude of effects; (4) underlying meaning of the results; (5) generalizability of results; and (6) implications for future research, theory development, and nursing practice. Cost of the study is not generally considered relevant to the quality of the results.

 

 

Copyright © 2021 Wolters Kluwer Health | Lippincott Williams & Wilkins

You didn't find what you were looking for? Upload your specific requirements now and relax as your preferred tutor delivers a top quality customized paper

Order Now