FAQ Directory

Here are some of the most frequently asked questions about NCQA’s various programs. If you don’t see what you are looking for in one of the entries below, you can  ask a question through My NCQA.

Filter Results
  • Save
  • Email
  • Print
expand all

11.15.2012 Measure reliability If a plan demonstrates a different methodology for statistical validity, would the methodology be considered?

Element C, Define Methodology requires the organization to have a method for determining measurement error and measure reliability. Element D, Adhere to Key Principles sets requirements for minimum observations or levels of measure reliability or confidence intervalsas applicable for quality and cost, resource use or utilization measures. For calculating measure reliability for PHQ, the organization must use the method described in the Explanation in Element C under the subhead Measurement Error. Measure reliability is defined as the ratio of the variance between physicians to the variance within one physician, plus the variance between physicians. NCQA does not prescribe the method used to calculate confidence intervals because the appropriate method may vary based on the parameter (e.g., mean or proportion).

PHQ 2013

11.15.2012 Differentiating Between Programs If an organization measures and takes action on both primary care and for specialty care practitioners where the methodology and actions are the same but the measures vary by specialty, is this one or more program?

In general, if an organization has a measure set in which a subset of the measures apply only to some specialties (broadly including primary care as a specialty), where the methodology and actions are the same (e.g. public reporting in the same manner regardless of specialty), NCQA treats that as one program. However, if there is more than one action (e.g. public reporting, P4P), we may count them as two programs (a public reporting program and P4P program).

PHQ 2013

11.15.2012 Applicable factors for CM program If some factors are not applicable for our case management program, how would we address it to meet the requirements in CM 2, Element E: Initial Assessment?

For CM 2, Element E, which is a file review element, NCQA is looking for documentation of whether or not you completed the applicable activities listed in CM 2, Element D: Initial Assessment Process. For your program, you would note in your documentation that certain factors are not applicable for that particular patient population.

CM 2014

11.15.2012 Taking action on cost measures Is an organization prohibited from using cost efficiency if quality results are not available?

No. The organizations program must consider quality in conjunction with cost, resource use or utilization when taking action. However, if the organization is unable to identify standardized measures of quality for a particular specialty or if there is insufficient data on an individual physician, practice or group the organization can act on cost performance when quality performance is not known. This is allowed in order to maximize the availability of performance information but must be handled in a fully transparent manner so that it is very clear when a physician is designated as high value and when they are purely designated as low cost. Refer to the standards _ specifically the explanation in PQ1 D (on page 51) _ for further explanation.

PHQ 2013

11.15.2012 Methodology for evaluation of cost measures What constitutes an acceptable methodological approach to evaluation of cost?

NCQA does not prescribe the cost measures an organization selects, though it requires an organization to specify all aspects of its methodology (Element C). In addition, the organization must risk-adjust its measures (Element C, factor 8) and must meet the minimum statistical requirements for measurement error and measure reliability (PQ1 Element D, factor 2).

PHQ 2013

11.15.2012 Timing for Program Input In the Element B explanation under the head Feedback Timeframe requires the organization to seek feedback annually and Element C _ Program Impact requires the organization annually asses the program. Does the organization have to carry out these activities annually if its measurement cycle is every two years?

No. An organization that measures its physicians every two years can meet the requirement by seeking feedback and assessing the program every two years.

PHQ 2013

11.15.2012 Attribution Do the NQF or HEDIS provider-level measurement specifications define attribution? For example, to whom to attribute performance: the diagnosing MD, prescribing MD, provider with most encounters and so on? If not, does this not result in variation?

Neither NQF nor HEDIS provider-level measures specifications require a specific attribution method, although HEDIS measures provide options for an organization to consider. While this might result in variation from one organization to another, there is currently no single industry standard method for attribution.

PHQ 2013

11.15.2012 WHP Performance Measure Reporting What is the process for reporting performance measure results for Accredited With Performance Reporting (AWPR) status?

Organizations are responsible for reporting NCQA WHP performance measure results exactly as specified if they are seeking AWPR status. Organizations must submit performance measure results to NCQA and attain a score of 50% or higher on WHP 12, Element A.

In order to retain AWPR status, organizations must annually submit performance measure results. Organizations that are NCQA Accredited in Wellness and Health Promotion and want to upgrade to AWPR status must submit measure results by the next annual reporting date (April 15) in any year during the accreditation cycle.

Organizations typically complete the WHP Performance Measures Reporting Tool, an Excel workbook. They send the workbook to an NCQA-Certified Auditor to have their measure results audited before submission. The auditor completes the audit worksheet in the Reporting Tool and locks the workbook, the returns the workbook to the organization, which subsequently submits the tool to NCQA.

WHP 2013

11.15.2012 Use of patient experience data collected from external organizations Is the use of patient experience data considered part of the program in the following circumstances: 1. The organization incorporates third-party performance information data with its own and then takes action on it (i.e., integrates the third-party data with its own to develop a composite that it reports or uses as the basis of action, such as payment or network or benefit design) 2. The organization provides a link for members on a third-party site so the member can review that information?

For scenario 1, the data must be considered as part of the program being reviewed for PHQ because the organization has incorporated the data with its own or tailored the data and then used the data as a basis for its own action (e.g., reporting, payment or network or benefit design). For scenario 2, if _ as part of its program _ the organization simply provides a link to an external source of performance information on physicians without altering that data and represents it as such, and the organization does not take any action based on the data (e.g., pay any incentive or use data for network or benefit design) then it is not considered part of the program.

PHQ 2013

11.15.2012 Must-Pass: PQ 1 Element A Is PHQ 1, Element A a must-pass element? If so, is the change permanent?

PHQ 1, Element A is a must-pass element at the 50 percent scoring level; this is a permanent change.

PHQ 2013

11.15.2012 Frequency of re-measurement For plans using patient experience measures, must re-measurement occur every two years to meet Element E?

Yes. Plans that use patient experience measures must measure at least every two years to receive credit for this element.

PHQ 2013

11.15.2012 Definition of a Program How does NCQA define a program?

The definition of a program is clearly defined in Section 1 of the Policies and Procedures. A physician measurement program includes: 1) A defined group of physicians– the definition must include both physician type (e.g. specialty) and geographic area covered; 2) A defined set of clinical quality, service or patient experience measures– the program may also include a defined set of cost, resource use or utilization measures; 3) A defined methodology for producing measure results; 4) A specific action taken at a specific point in time based on the measure results.

A hospital transparency program includes: 1) A defined group of hospitals– the definition must include both hospital type and location; 2) A defined set of all-payer quality or cost measures whose results are publicly reported at a specific point in time.

Distinct programs are reviewed separately and a certification decision is issued for each. Physician measurement programs and hospital transparency programs are always distinct programs, even when operated by the same legal entity. NCQA reserves the right to determine that programs that are managed in a decentralized manner constitute distinct programs for review.

To the extent that one program is a derivative of another and share common aspects (e.g., an organization uses the same measures and methodology for a single defined physician group but takes two actions [reporting and network tiering]) and the organization seeks verification for both at the same time, NCQA can review common aspects once to streamline the survey process, although these are distinct programs.

PHQ 2013