Quality Control of PCR-Based Diagnostic Assays
19.6.1 IAC, or no IAC, that is the question...
It is clear that, given the challenging sample types that need to be tested, the potential for PCR inhibition is a major consideration in MAP PCR-based diagnostic tests to avoid false negatives.
This is commonly an issue with complex sample matrices such as faeces and there needs to be a balance between adding sufficient material to achieve the desired diagnostic sensitivity and carrying over too many inhibitors into the DNA extract.The goal of an internal amplification control (IAC) is to signal a potential false-negative result. Thus, delayed (higher Cq value) or lack of amplification of the IAC is an indicator of failure of the PCR. An internal extraction control is similar to an IAC but is added to the initial step of the extraction protocol and undergoes all processing and amplification steps. However, there is an assumption implicit with such controls, which is that both the PCR amplification of the IAC and the target sequence are equally impacted by any PCR inhibitors present in the DNA extract. This assumption has been challenged with findings of differential impact on the IAC and target-specific amplification (Schrader et al., 2012). This may depend on a number of factors, such as the primers used, the GC content of the target regions or competition between the reactions.
Furthermore, a repeat extraction of a sample with evidence of inhibition does not ensure that the issue will not be repeated, leading to challenges in a diagnostic setting with high sample throughout (Acharya et al., 2017c).
Alternative approaches include the dilution of the DNA extract, which can both identify and rectify the inhibition (Acharya et al., 2017c). This is an effective approach, however consideration must be given to possible loss of detection of low positive samples due to this effect of the dilution.
This is dependent on the diagnostic test setting and sensitivity requirements. A third alternative is the detection of an alteration in the amplification efficiency of individual reactions due to the presence of inhibitors, however this is only indicated if there is amplification in the first instance (King et al., 2009). In complex samples such as pooled cattle faeces, PCR inhibition can completely prevent amplification, even in samples with high quantities of specific DNA (Mita et al., 2016; Ly et al., 2019).Any approach to circumvent potential inhibition and the risk of false negatives in a MAP PCR detection assay, be that an IAC, DNA extract dilution and/or amplification curve efficiency assessment, requires validation in the appropriate setting.
19.6.2 Validation of assays
For any molecular diagnostic assay, validation of the analytical and diagnostic performance is critical prior to the application of the test. This is described in detail in the World Organisation for Animal Health (OIE) manual (OIE, 2019). PCR assays to detect MAP are generally compared with MAP culture as the ‘gold standard' test to determine the diagnostic accuracy. Though culture is considered the test for benchmarking, it is not perfect; rather it is the best option available. However, with increased analytical and diagnostic sensitivity, molecular-based tests can perform better than the gold standard, making determination of diagnostic specificity difficult in the absence of an unexposed animal population.
Considerations in relation to diagnostic test validation have been reviewed in detail (Nielsen et al., 2011); briefly these include the purpose and target condition that the diagnostic test aims to identify (e.g. herd- vs individual-level diagnosis, infected vs infectious), validation sample population selection to avoid bias (e.g. including randomly selected animals rather than a targeted group at a particular disease stage) and the classification of disease/infection status in the sample population (case definition).
19.6.3 Confirming PCR identification
OIE now states it ‘would be good practice to' include a subsequent sequencing step to confirm PCR positive results, especially when index cases from a previously unaffected location or low Cq positives are detected. This can be done by sequencing the PCR amplicon from a conventional PCR, which can be challenging for samples with low initial template quantities. Sequencing of IS 900 PCR products to confirm MAP identity has been performed in a number of studies, to confirm the sequence identity to MAP K10 (Lee et al., 2011; Garg et al., 2015).
19.6.4 International benchmarking
Standardization and harmonization of diagnostic testing (Ahmed et al., 2008, 2011) is gaining momentum at many levels, from local to international, for a number of microbial pathogens (Mcgiven et al., 2006; Mengoli et al., 2009; White et al., 2010; Nielsen et al., 2011; Xing etal., 2011; Makela etal., 2012; He et al., 2012; Johnson et al., 2012; McNerney et al., 2014; Henaux et al., 2018). Meaningful comparisons between results, such that inter-laboratory results can be more easily and reliably compared, are becoming increasingly important to support our understanding of the epidemiology of disease, disease outbreaks and to underpin trade agreements between countries. Improved epidemiological knowledge based on accurate prevalence data, supported by consistent, standardized tests, will also benefit policy decisions that support the aims and objectives of control programmes.
An earlier review of the scientific literature on direct faecal PCR for MAP in cattle demonstrated very little if any standardization of conventional or qPCR (Marsh et al., 2014). The majority of these assays failed to meet the minimum information for publication of quantitative real-time PCR experiments (MIQE) (Bustin et al., 2009) or standards for reporting of diagnostic accuracy studies (STARD) (Bossuyt etal., 2003; Bossuyt and Reitsma, 2003; Cohen et al., 2016) guidelines, particularly in terms of the number of animals tested and both analytical and diagnostic sensitivity and specificity data.
Furthermore, the diagnostic sensitivity values may have been inflated due to comparisons of PCR with culture techniques with differing analytical sensitivities and/or selection bias in the animal cohort tested. To date, an initiative to assist in the development and validation of standardized diagnostic PCR protocols for paratuberculosis is yet to be established internationally, but has been attempted in some countries. An inter-laboratory assessment of qPCR and culture methods was undertaken in the Netherlands to aid diagnostic test selection for the paratuberculosis control programme in that country (Heuvelink et al., 2017). In Australia, standardization was successfully undertaken for the high-throughput Johne's (HT-J) qPCR test (Plain et al., 2014). Following approval of the test, a national technical working group was convened that included representatives from each of the state laboratories, the test developers and representatives from the governing body for veterinary diagnostic tests in Australia, in order to develop a process to standardize the test and establish a national quality assurance programme.A similar international initiative would directly support the level of precision and accuracy required for control programmes and as new technologies such as whole genome sequencing become a desktop reality in laboratories. This could encompass medical research, to enable cross-validation of diagnostic protocols for MAP in Crohn's disease patients and animals with paratuberculosis through sharing of sample panels. It is critical now that new diagnostic assays and tests meet guidelines such as OIE, MIQE and STARD. An initiative such as this has been made easier for the paratuberculosis research community through the efforts of a group of well-established paratuberculosis researchers who have published STARD-based guidelines specifically for this disease (Gardner et al., 2011).
19.7
More on the topic Quality Control of PCR-Based Diagnostic Assays:
- Application and Interpretation of Findings From PCR-Based Diagnostic Tests
- FLOW CYTOMETRY-BASED ASSAYS
- Immunity and Immune-Based Diagnostic Tests
- Quality Control
- The informative phase of development of the planetary humanity is based on the fundamentally different approach to the theoretical schemes, as the objects which are studied differ in quality of those with whichwe used to work, and more precisely - they are noumenon formations of procedural character.
- PCR Techniques
- Choice of Target Genes for PCR
- What are Quality and Quality Improvement?
- What are Quality and Quality Improvement?
- MORPHOLOGICAL ASSAYS OF APOPTOSIS
- Commercial Diagnostic Kits
- Diagnosis of Paratuberculosis by PCR