This study describes the laboratory evaluation of a novel diagnostic platform for malaria. The Magneto Optical Test (MOT) is based on the bio-physical detection of haemozoin in clinical samples. Having an assay time of around one minute, it offers the potential of high throughput screening.
Blood samples of confirmed malaria patients from different regions of Africa, patients with other diseases and healthy non-endemic controls were used in the present study. The samples were analysed with two reference tests, i.e. an histidine rich protein-2 based rapid diagnostic test (RDT) and a conventional Pan-
The observed sensitivity/specificity of the MOT test in comparison with clinical description, RDT or PCR ranged from 77.2 - 78.8% (sensitivity) and from 72.5 - 74.6% (specificity). In general, the agreement between MOT and the other assays is around 0.5 indicating a moderate agreement between the reference and the index test. However, when RDT and PCR are compared to each other, an almost perfect agreement can be observed (k = 0.97) with a sensitivity and specificity of >95%.
Although MOT sensitivity and specificity are currently not yet at a competing level compared to other diagnostic test, such as PCR and RDTs, it has a potential to rapidly screen patients for malaria in endemic as well as non-endemic countries.
Initiation of malaria treatment largely depends on good, laboratory confirmed diagnosis. However, in many disease endemic countries clinical diagnosis is the only method used to decide whether or not to treat, since laboratory techniques to confirm the clinical suspicion are considered to be too labour-intensive or not sensitive enough [
One such platform for the fast (less than one minute) and easy detection of malaria parasites in a patient blood sample is the Magneto Optical Test (MOT) [
The study population (Table
Overview of samples included in the evaluation of the MOT device.
| Clinical description | Country of Origin | Number used for analysis |
|---|---|---|
| Healthy controls | The Netherlands | 100 |
|
|
||
| Microscopically confirmed malaria cases | Sudan | 72 |
|
|
||
| Microscopically confirmed malaria cases | Vietnam | 8 |
|
|
||
| Sickle cell anaemia patients* | Sudan | 20 |
|
|
||
| Sickle cell anaemia patients | Nigeria | 5 |
|
|
||
| Sickle cell anaemia patient | Tanzania | 1 |
|
|
||
| Arthritis patients | Tanzania | 2 |
|
|
||
| B-Thallesemia patients | Tanzania | 2 |
|
|
||
| Visceral leishmaniasis patients (returning travels) | The Netherlands | 7 |
|
|
||
| Total | 217 | |
* This set of samples was not analysed with microscopy, however RDT and PCR testing gave evidence that 3 patients in this group were in fact also suffering from a malaria infection.
From all patients and controls, 2 ml of venous EDTA blood was collected for DNA extraction and PCR analysis, immunochromatic histidine rich protein-2 (HRP-2) detection and MOT analysis. After collection the blood was stored at -20°C until further use. All blood samples were examined for the presence of
All analytical MOT measurements were taken using an experimental instrument having the same specifications and operational methodology described previously (figure
Calibration of the MOT instrument was by a serial dilution of β-haematin in phosphate buffered saline (PBS) prior to the initial testing of the patient samples. The instrument is sensitive to the presence of haemozoin in the blood down to concentrations of 5 ng/μl or better which as discussed in [
Before final analysis of the data, samples for which insufficient clinical or analytical information was available were removed from the study. Microscopy performed at initial diagnosis is considered as the golden standard for malaria diagnosis. Results of the MOT assay are consequently tested against this standard and also compared to the RDT and PCR obtained data.
Data were entered in 2 × 2 tables and analysed for sensitivity (i.e. the probability that the assay will be positive when the infection is present) and specificity (i.e. the probability that the assay will be negative when the infection is absent) using the formulas:
In the equations above, TN represents true negative, TP true positive, FN false negative and FP false positive. In addition likelihood ratios (LR) were calculated. The agreement between microscopy, RDT and PCR and the MOT assay was determined by calculating Kappa values with a 95% confidence interval [
In this retrospective laboratory-based evaluation, a total of 217 samples were analysed with three reference tests and the MOT as index test. Samples were collected in 2008 and analysed with MOT in July 2009. In total, 84 samples out of the 217 were confirmed (either microscopy or, in the case of the sickle cell patients, RDT and PCR positive) malaria positive. Parasitaemia of the positive samples ranged from 600 parasites/μl to 85,500 parasites/μl. When these samples were tested with MOT, 65 were scored positive (see Table
Results of confirmed malaria samples in comparison to the MOT results.
| Confirmed Malaria | ||||
|---|---|---|---|---|
|
|
|
|
||
|
|
||||
| Positive | 65 | 33 | 98 | |
|
|
||||
|
|
Negative | 19 | 100 | 119 |
|
|
||||
| Total | 84 | 133 | 217 | |
Also a direct comparison between the different alternative diagnostic methods (RDT and PCR) and MOT was done. When RDT results were compared to MOT, a sensitivity of 77.2% and a specificity of 72.5% were observed for the MOT test. For PCR, one sample could not be analysed, because the internal control was not amplified, leaving 216 samples for further analysis. If the inconclusive MOT results are not taken into consideration, then a sensitivity of 78.8% was found and a specificity of 74.6% for the MOT test.
Of the 30 samples from endemic negative controls, seven samples were found false positive with the MOT test while being negative with all other employed tests; they originated from Sudanese sickle cell patients. The Sudanese malaria confirmed patients that were missed in the MOT test (n = 17) had a parasitaemia ranging from 5,680 to 78,000 parasites/μl (mean: 32,615 parasites/μl). One sample from Vietnam missed with the MOT analysis had a parasitaemia of 10,000 parasites/μl. One sickle cell patient that was found positive with RDT and PCR for malaria was scored inconclusive with MOT.
In general with all comparisons, the agreement between MOT and the other assays was around 0.5, indicating a moderate agreement between the reference and the index test. However, when RDT and PCR were compared to each other only three samples out of the 216 samples that could be compared were discordant (two PCR negative RDT positive and one vice versa). Of the other samples 135 were negative by both tests and 78 positive by both tests thus showing an almost perfect agreement (k = 0.97), with a sensitivity and specificity of over 95% indicating that the reference tests are performing at a competing level. For a complete overview and statistical analysis of the different comparisons see Table
Overview of the RDT results in comparison to the MOT results
| RDT | ||||
|---|---|---|---|---|
|
|
|
|
||
|
|
||||
| Positive | 61 | 36 | 97 | |
|
|
||||
|
|
Negative | 19 | 101 | 120 |
|
|
||||
| Total | 80 | 137 | 217 | |
Overview of the PCR results in comparison to the MOT results
| PCR | ||||
|---|---|---|---|---|
|
|
|
|
||
|
|
||||
| Positive | 63 | 34 | 97 | |
|
|
||||
|
|
Negative | 19 | 100 | 119 |
|
|
||||
| Total | 82 | 134 | 216 | |
Statistical analyses of the different comparisons excluding inconclusive PCR or MOT results
| comparison | Sensitivity in % |
Specificity in % |
+ Likelihood ratio |
- Likelihood ratio |
Agreement |
k-value |
|---|---|---|---|---|---|---|
| Confirmed vs MOT | 78.3 (68.3-85.8) | 74.4 (65.8 -80.9) | 3.0 (2.2-4.1) | 0.2 (0.2-0.5) | 75.7 | 0.51 |
|
|
||||||
| RDT vs MOT | 77.2 (66.8-85.1) | 72.5 (64.3-79.4) | 2.8 (2.1-3.8) | 0.3 (0.2-0.5) | 74.3 | 0.48 |
|
|
||||||
| PCR vs MOT | 78.8 (66.6-84.6) | 74.6 (66.6-81.2) | 3.0 (2.2-4.1) | 0.3 (0.2-0.5) | 75.1 | 0.49 |
|
|
||||||
| PCR vs RDT | 98.7 (93.2-99.8) | 98.5 (94.8-99.6) | 67.6 (17.1-267.8) | 0.03 (0.02-0.09) | 98.6 | 0.97 |
This paper describes an extensive laboratory evaluation of a new and very rapid technology for the diagnosis of malaria by detecting the presence of haemozoin in the blood sample of suspected patients. Although several similar routes for the diagnosis of malaria via detection of the malarial pigment in a patient's blood have been explored in recent years this present technique uniquely utilises the magneto-optical properties of the blood-haemozoin system.
Automated blood count machines, such as Cell-Dyn® (Abbot, Santa Clara, California) utilize flow cytometry techniques to detect haemozoin-containing monocytes (PCM) during routine full blood count (FBC) in research settings but have not been applied in medical practice [
The MOT test described has been extensively tested in the present study on a large sample set of positive and negative samples and the results were compared against microscopy, RDTs detecting HRP-2 antigen and PCR. The performance, in terms of sensitivity and specificity, of RDT and PCR employed in the present evaluation was good since there was an almost perfect agreement between the comparative tests. The observed sensitivity/specificity of the MOT test in comparison with clinical description, RDT or PCR ranged from 72.5 - 74.6% (specificity) and from 77.2 - 78.8% (sensitivity) with a very low positive likelihood ratio between 2.8 and 3.0. Although in other studies false positivity is often attributed to circulating antigen from cleared parasites, this can in the present study only explain seven of the false positive samples. All these samples were obtained form Sudanese sickle cell patients that were negative with the other employed tests. It remains unclear whether the false positivity is caused by circulating antigen or is influenced by their sickle cell trait and this should be studied further on a larger set of samples of malaria negative endemic controls. The other false positive samples were obtained from healthy non-endemic controls. These non-endemic samples were obtained from healthy donors of the Dutch blood bank who have not traveled to a malaria endemic country within the last five years before their donation. The false positivity of this specific group of samples is concerning but is possibly attributable to contaminant structures introduced during the hand assembly of the sample cells which is currently conducted without quality control. Cells are fabricated from two components a thin glass window (7 mm in diameter) and a carbon injection moulded cylinder. The single use disposable cell is formed by using pre-cut adhesive inserts to cement the glass window to the cylinder. Although all sample cells were only used once and no contaminants form other samples could explain the false positivity, other contaminants introduced during assembly process, for example particles from the environment, which are free and able to respond to the application of a magnetic field will generate a false signal. Problems associated with sample cells can ultimately be easily addressed by employing an automated assembly and quality control procedure whilst further study on the response of various lysis buffers to magnetic field will fully characterize and possibly reduce their magneto-optical contribution such that changes to the measurement algorithm may be implemented to significantly reduce false positivity.
A substantial number (n = 19) of malaria confirmed cases are being missed by the MOT test. These samples all had a parasitaemia above 1,000 parasites/μl and should be readily detectable by the MOT instrument, which has an estimated analytical sensitivity of between 50 and 100 parasites/μl. There are several possible explanations for these false negatives; the most obvious being associated with the fact that the MOT diagnostic process was developed and calibrated using fresh blood samples spiked with β-haematin or live cultured parasitized red blood cells. The samples used in the present study had been stored at -20°C before testing and some had been freeze thawed several times. This may have caused agglutination of haemozoin crystals resulting in a non-homogenous sample and thus not representative anymore for the original sample. Furthermore, if the agglutinated crystals are not fully sonicated the mobility of the haemozoin under action of the magnetic field will be impaired. Either or both these effects could result in the Cotton-Mouton signal massively under representing the mass of haemozoin present and thus might result in a false negative signal. A second factor that currently further complicates the relationship between parasitaemia and haemozoin and which might also lead to false positivity or false negativity is the wide variation of haematocrit levels between patients. These can result in patients sampled at the same point in the parasites life cycle and found to have identical levels of parasitaemia registering vastly different levels of haemozoin. Variations in haematocrit also impact adversely on the measurement procedure by producing corresponding variations in sample transmittance and hence in the signal level and dynamic range recorded at the optical detector. None of the above issues are currently allowed for by the decision-making algorithms of the MOT instrumentation. Attention is drawn however to the point that although presented as a screening device, with a positive or negative diagnostic output, the MOT technique in returning a magneto-optic signal proportional to the haemozoin concentration (as evidenced by calibration data) together with an optical signal proportional to the haematocrit, offers a means of studying the complex inter-relationship between haemozoin, parasitaemia and haematocrit in blood samples. This may allow correlating haemozoin concentration against parasitaemia for the widest range of haematocrit levels experienced in practice. If necessary this process can be further extended to include the impact of other disease states such as anaemia on diagnostic sensitivity. These clinical parameters could be programmed into the decision-making algorithms of future MOT instrumentation and may substantially improve the performance of the instrument with respect to false reporting.
A commercially viable product must be able to compete with RDT and microscopy and the current sensitivity/specificity and predictive value of MOT is not yet at an appropriate level.
The principle limitations of the current study are the lack of fresh samples, lack of information on haemozoin and haemoglobin levels that may influence the outcome of the result, the limited amount of endemic controls and the influence of hand assembly of the sample cells making it difficult to asses the true potential of the device. These issues can however easily be addressed in a future trail. Having a large range of samples from the same setting with known malaria prevalence could give a better indication on its positive and negative predictive value which is not possible with the current sample set.
It is however very promising that the device has been designed and assembled in less than 3 years after the initial idea with still potential for substantial improvement in the design of the hard- and software. The simplicity of the device, low costs (a sample cell will only cost 25 euro cents), the straightforward operation with a limited number of handling steps and the possibility to operate the instrument without a constant supply of network electricity (i.e. it can operate on a battery) combined with the short assay time of 1 minute creates a technology with great potential for simple malaria screening in malaria endemic as well as non endemic countries.
This paper describes the evaluation of a novel and very rapid diagnostic device based Magneto Optical Technology (MOT) for the diagnosis of malaria by detecting haemozoin in a small patient blood sample. The MOT technology has been evaluated on a large panel of stored blood samples. Although the sensitivity and specificity are not yet at a competing level compared to other diagnostic test, such as microscopy and RDTs, it has a potential to rapidly screen patients for malaria in endemic as well as non-endemic countries. Therefore, the technique should be evaluated on a panel of fresh blood samples after the necessary adaptations of the device's algorithm.
The authors declare that they have no competing interests.
PM designed the study, conducted PCR analysis, was involved in sample collection, performed data analysis and wrote the manuscript; RM participated in study design, assisted in designing and building the prototype, performed MOT tests and helped to draft the manuscript; BN supervised sample collection and performed microscopical analysis of clinical samples, commenting on the manuscript; HS study design, RDT analysis, mediated in sample collection and performed statistical analysis and helped in drafting the manuscript; DN conceived the MOT principle, supervision of MOT prototype design and production, writing of manuscript. All authors read and approved the final manuscript.
We would like to thank all patients, blood donors and their families for their donation of blood for this study. We also thank our collaborators in Sudan, Nigeria, Tanzania, Vietnam and the Netherlands for their support in obtaining clinical material. We thank G. Schoone and I. Versteeg (KIT) for their assistance in the laboratory.
We would like to acknowledge all partners from the MOT consortium for their individual contributions and in particular Philips who built the instrument tested. This work has been performed under "Novel Magneto-Optical Biosensors for Malaria Diagnosis" of the European Commission Framework 6 Program