FAQ Directory

Here are some of the most frequently asked questions about NCQA’s various programs. If you don’t see what you are looking for in one of the entries below, you can  ask a question through My NCQA.

Filter Results
  • Save

    Save your favorite pages and receive notifications whenever they’re updated.

    You will be prompted to log in to your NCQA account.

  • Email

    Share this page with a friend or colleague by Email.

    We do not share your information with third parties.

  • Print

    Print this page.

12.12.2008 Composite measures How does NCQA review Element A if a measure used to take action is a combination of a quality measure and a measure that is not in scope, where the quality measure is standardized?

For PHQ 1, Element A, NCQA determines whether individual quality measures (used on their own or in a composite with other criteria) meet the element as defined by the hierarchy of standardized measures. The organization may use additional criteria (e.g., board certification status) to determine performance designation, in combination with quality measures, but the additional criteria remain out of the scope for this element. The organization receives credit for the standardized quality measure.

12.12.2008 Organization accountability Are organizations responsible for confirming the factors in Element D, or is this the responsibility of an external vendor?

For Element D, the organization must demonstrate that it has a process to verify that it has followed the specifications outlined in Element C (e.g., sample sizes, attribution, statistical validity).

If the organization uses a vendor to administer the survey, this process may be performed by the vendor, but documentation demonstrating how the element is met must be included for the PHQ Survey.

12.12.2008 Survey measures How is Element A scored for non-NQF endorsed surveys? Is each question a measure or, if measures roll up to a composite, is the composite considered one measure?

Non-NQF endorsed patient experience surveys are counted as one measure for the entire survey. CAHPS-CG questions or composites count as separate measures.

12.12.2008 Patient experience measures Are all questions related to patient perception considered quality measures?

Yes. NCQA considers all patient experience results to be measures of quality.

12.12.2008 Taking action on collaborative and organization results How does the survey process work if an organization takes action on measure results from a collaborative and from its own measurement?

All measures on which the organization bases action are included in the scope of a PHQ Survey, including those developed and whose results are calculated as part of a collaborative and those calculated directly by the organization.

NCQA evaluates the organizations activities in one of two ways.

1.Evaluate the collaborative onceif the collaborative opts to undergo a PHQ surveyand apply the survey results to all participants

2.Evaluate the measures, methods and processes of the collaborative when each participant organization is surveyed

The organizations scores on any element are based on the performance of both the collaborative and the organization. The organization must meet the element for all measures, including the collaborative measures it uses. For example, for Element C: Methodology, NCQA evaluates the organizations methodology for each measure directly. It may evaluate the collaboratives methodology either once during a survey of the collaborative or for each organization during the organizations survey. Regardless of the process, all measures must meet the requirements of Element C in order to meet the element.

When a collaborative undergoes a survey directly, the process is streamlined for all involved (the collaborative, the organization and NCQA). In addition, the process may be more cost-effective, since NCQAs pricing is designed to reflect economies of scale.

12.12.2008 Notice for providing results Does a 45-day notice period apply when measurement is more frequent than annual (e.g., quarterly)?

The 45-calendar-day notice period for providing results and an opportunity for a physician to request a correction or change applies to each cycle of measurement and action an organization takes, regardless of frequency (e.g., biannual, annual, semiannual, quarterly); however, if an organization recalculates results without changing its methodology or measures, it does not need to provide the methodology again as long as it supplies information on how to obtain that methodology.

The exception to the minimum 45-calendar-day notice period for action is if the action involves only pay-for-performance activities that are not publicly reported (e.g., an action that is only between the organization and the physician). In this instance, the organization may provide the results and methodology concurrent with additional or bonus payment. The organization must still provide a process for the physician to request corrections or changes.

12.12.2008 Requests for corrections or changes For Elements F and G, how can patient experience of care data corrected, when this information is not disclosed to physicians?

The plan is not required to disclose member-specific results, nor is it expected that a physician can correct member responses. At a minimum, the physician must be given the methodology (e.g., sampling, attribution) and survey questions and, upon request, be allowed to confirm that the patients in the universe from which the sample was drawn are his or her patients, given the methodology.

12.12.2008 Measure specifications Since NQF does not publish the actual code sets for all its measures, how does NCQA determine whether an organization is following the measure specifications as written?

NCQA recognizes that some NQF-endorsed or AQA-approved specifications may require additional specifications to implement in specific contexts. Organizations may supplement endorsed specifications as long as they follow all endorsed specifications, and if supplementation does not alter the intended numerator, denominator and exclusion criteria for the measure.

11.17.2008 Survey Pricing If we go through provisional certification and are then required to go through full certification within 12 months, does our organization get a reduced price?

No. Survey prices apply to each discrete survey; NCQA does not apply credit forward to a future survey. Survey pricing reflects the amount and level of resources NCQA dedicates to evaluating an organization and at the time of the Full Certification Survey, NCQA must re-evaluate the organization on all requirements.

11.17.2008 Coding accuracy Is evaluation of coding accuracy and quality considered to be in scope for these measures?

NCQA does not evaluate coding accuracy and quality. Element D, Verifying Accuracy requires an organization to have a process to evaluate the accuracy of its measure results. The organization may use external auditors to verify its methodology, but is not required to do so. In the future, NCQA may develop standards for auditing physician measurement and a program for certifying auditors. With such standards, NCQA will consider making external audit a requirement.

11.17.2008 Measure reliability If a plan demonstrates a different methodology for statistical validity, would the methodology be considered?

Element C, Measurement Methodology requires the organization to have a method for determining measurement error and measure reliability. Element H, Principles for Use of Results sets requirements for minimum observations or levels of measure reliability or confidence intervalsas applicable for quality and cost, resource use or utilization measures.

For calculating measure reliability for PHQ, the organization must use the method described in the Explanation in Element C under the subhead Measurement error and measure reliability. Measure reliability is defined as the ratio of the variance between physicians to the variance within one physician, plus the variance between physicians.

NCQA does not prescribe the method used to calculate confidence intervals because the appropriate method may vary based on the parameter (e.g., mean or proportion).

11.17.2008 Measure specifications Expand on the minimum denominator criteria for quality measures. Do you mean minimum observations per measure? Or minimum observations per provider? Or is that already in the requirements?

In measuring physician performance and distinguishing among peers, the organization is required to specify minimum observations or denominators for each measure on which the action is based. Denominators are patient observations, which may include multiple observations for an individual.

Criteria must be defined at the level on which action will be taken.

Note: This applies if the organization uses minimum observations rather than confidence intervals or measure reliability.