Logo-jcs
Journal of caring sciences. 10(4):205-209. doi: 10.34172/JCS.2021.002

Original Article

Translation, Cross-cultural Adaptation and Validation of the Neck Bournemouth Questionnaire: Persian Version

Mohammad Mehdi Salaree 1ORCID logo, Masoud Sirati Nir 2ORCID logo, Vahid Sobhani 3ORCID logo, Abbas Ali Delavari 4, *ORCID logo, Seyyed Ali Reza Mosavi 5
1Health Research Center, Lifestyle Institute, Nursing Faculty, Baqiyatallah University of Medical Sciences, Tehran, Iran
2Behavioral Sciences Research Center, Nursing Faculty, Baqiyatallah University of Medical Sciences, Tehran, Iran
3Exercise Physiology Research Center, Lifestyle Institute, Baqiyatallah University of Medical Sciences, Tehran, Iran
4Trauma Research Center, Department of Anesthesiology, Baqiyatallah University of Medical Sciences, Tehran, Iran
5Department of Medicine, Baqiyatallah University of Medical Sciences, Tehran, Iran
*Corresponding Author: Abbas Ali Delavari, Email: ad90.delavari@yahoo.com

Abstract

Introduction: The Neck Bournemouth Questionnaire (NBQ) is being used widely in various countries. This study evaluated the validity and reliability of the Persian version of NBQ.

Methods: This methodological study investigated 170 patients with chronic neck pain (NP). The psychometric properties of NBQ were evaluated in two stages. First, the standard scale was translated based on Guillemin’s guidelines for cross-cultural adaption and face validity tested in a pilot group (N=25). Second, it was conducted on a sample of 170 diverse chronic pain patients. Construct validity was determined with convergent validity by short-form McGill pain questionnaire. Then, the reliability was confirmed using Cronbach’s alpha and the intraclass correlation coefficient.

Results: The instrument demonstrated a good face validity and the participants made minor changes. A slight change was applied on content validity. In construct validity, Pearson’s correlation coefficient was 0.85, which was statistically significant and showed strong correlation. A Cronbach’s alpha of 0.87 was obtained. This confirmed the remarkable internal consistency and stability (0.92).

Conclusion: The Persian version of NBQ showed a good internal consistency and reliability and it could be considered as a valuable tool for assessing patients with cervical pain in Iranian population.

Keywords: Neck Bournemouth Questionnaire, Reliability, Validity, Persian

Copyright

© 2021 The Author(s).
This work is published by Journal of Caring Sciences as an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by-nc/4.0/). Non-commercial uses of the work are permitted, provided the original work is properly cited.


Introduction

Work-related musculoskeletal disorders are among major occupational health hazards in different countries, 1 especially developing and industrialized countries, 2 with an increasing prevalence due to sedentary and changing lifestyle. 3,4 Not only do these problems adversely affect people’s body and spirit, but they also have significantly on the quality of life and reduce their efficiency, 5 cause half of the work absenteeism 6 and double the use of health services. 1

Neck pain (NP) is one of the most common musculoskeletal disorders, 7 the lifetime prevalence of NP for adults across different countries has been reported to range from 14.2% to 71.0%, 8 but it experienced by 70% of the Iranian population at least once in their lives. 3 It is one of the four most common musculoskeletal problems reported in England, where almost one-fifth of the adults have reported NP over the last year. 9

NP is a multifactorial problem, in which, various physical, psychological, social and personal factors are involved. 10 Hence, the best way to define NP is through a biopsychosocial model, which includes pain, disability, cognitive and affective domains. 11 Self-administered questionnaires as common as used for assessing the health status or outcome of treatment in patients with NP by physicians. It is useful to quantify the level of disability, pain perception, and relevant outcomes.

The Neck Bournemouth Questionnaire (NBQ) is a global tool designed by Bolton and Humphreys 11 based on biopsychosocial model, and includes questions about pain and disability as well as questions relating to the cognitive model of pain. 12

The NBQ is a multidimensional instrument originally created in English that has been shown to be valid, reliable and responsive for use in the clinical and research settings. 11 In order to use the NBQ in a Persian speaking patient population it is not enough to just translate the items well linguistically, because that does not guarantee similar measurement properties. 13 The questionnaire also has to be adapted cross-culturally, which means employing a process that looks at both language and cultural issues relevant to the Persian speaking population in which the questionnaire will be used. 14 The NBQ is being used widely in various countries. As it is only available in English, French, Dutch, German and Italian. 11,12,15-17 Cronbach’s alpha coefficients for global item homogeneity of the NBQ in several countries were 0.87, 0.91, 0.79, 0.87 and 0.89 respectively.

The main strength of this questionnaire is an interesting and specific assessment tool for NP patients because it is the only questionnaire based on the biopsychosocial illness model. Also, this includes a one-page questionnaire that takes less than five minutes to complete; that it could be used in outpatient settings, such as clinics providing manual therapy. As such, any clinician or re-searcher who needs to succinctly evaluate NP in a context that considers the biological, psychological and social dimensions would prefer this test to other validated tools based on pain and disability evaluation. Thus, for the first time validated as a new questionnaire in Iran. The purpose of this study was to cross-culturally adaptation and validation of this questionnaire in a sample of Iranian chronic NP outpatients.


Materials and Methods

The present study is a methodological investigation that testing of the NBQ was carried out in 170 adult patients with chronic NP. The sample size was obtained by using G*Power softwareversion 3.0.10 and considering the previous studies as sample 18 with power = 0.9, β = 0.10 and α= 0.05, and r = 0.4. They were admitted to the pain clinic of Baqiyatallah teaching hospital. The NBQ includes seven independent questions, each representing a different dimension of the pain experience. Each question is scored on an 11-point numerical rating scale (0–10). The seven items include pain intensity, functional status in daily living and social activities, affective dimensions of anxiety and depression, cognitive aspects of fear-avoidance belief and pain locus of control. 15

After obtaining the required permission from developer (Professor JE Bolton), a standard translation of NBQ perceived based on the guidelines of Beaton et al. 14

The entire process is made up of 6 steps can be explainedas follows:Stage 1: (Forward translation), two official translators (T1 and T2) translated the NBQ from English into Persian. Stage 2: (Synthesis translations), then it was discussed in a committee of translators and physicians expert in pain management, including physical medicine, neurosurgery, neurology, rheumatology, orthopedics, and anesthesiology. After reaching consensus on translated words, Stage 3: (Backward translation), two other English-speaking translators (BT1 and BT2), who were totally blind to the original questionnaire, translated the Iranian version back to English. Stage 4: (Expert committee review), the divergence between the translations was discussed and resolved by the expert committee of physicians and consultants. Stage 5: (Face validity testing in 25 patients), finally, the Persian version of the scale was revised grammatically by expert translators and presented for the evaluation of psychometric properties. If we observed that some words were difficult for patients to comprehend, we provided short descriptions to help better describe the pain qualities. Stage 6: (Submission and documentation to committee for appraisal), which showed in .

jcs-10-205-g001
Figure 1. Flowchart of translation phases

We used a convenience sampling method for case selection from a diverse group of chronic NP patients who were referred to our tertiary pain and rehabilitation clinic over four months. The inclusion criteria were: having past history of chronic NP (more than six months), age over 20, gender (male and female), and ability to speak and understand Persian language, and consent to participate in the study. The exclusion criteria were: patients who had received any sort of treatment in the last 6 months, intellectual disability and dementia.

After data was gathered, the descriptive analysis, validity, and reliability were analyzed by SPSS software (version 13). The demographic data of the patients were described by the use of mean and standard deviations. The internal consistency of the NBQ, which measures the degree to which items that make up the total score are all measuring the same underlying attribute, was assessed using Cronbach alpha. 12 External construct validity shows the extent to which the NBQ’s scores concord with the scores of other instruments measuring the same theoretical hypotheses of the concepts under consideration. 12 This was done with Pearson correlation coefficient, comparing the total scores of the Persian version of NBQ with the total score of short-form McGill pain questionnaire.

The ethics committee of Baqiyatallah University of Medical Sciences has approved the proposal. This article is related to the professional medical doctoral dissertation with registration number (1168) in Baqiyatallah University of Medical Sciences. It has reviewed the study and raised no objections from an ethical point of view. Permission to carry out the study was first obtained from professor Bolton, the principle designer of the NBQ.All participants were informed about the purpose of the study and gave a written consent for participation. They had the possibility to withdraw or interrupt their participation at any time.


Results

Of the 170 neck patients who completed the study, 104 (61.4%) were male and 66 (38.6%) were female with a mean age of 47.25 (SD = 7.21) years. There was no significant age difference between the genders (P > 0.05). The mean total score for the Persian version of NBQ was 41.87 (SD = 7.7), and also for the short-form McGill questionnaire the mean total score was 45.24 (SD = 8.9). (Table 1) Results of the chi-square test showed that gender, education level and marital status had no significant relationship with NBQ’s scores.

Table 1. Demographic and clinical characteristics of patients (n = 170)
Variables No. (%)
SexFemale66 (38.6)
Male104 (61.4)
Age (y) 47.25 (7.21)a
Married statusSingle43 (25)
Married127 (75)
EducationPrimary31 (18)
Secondary103 (61)
High36 (21)
OccupationOffice worker123 (73)
Manager21 (12)
Student26 (15)
Pain duration (day)1-14 87 (51)
Over 14 83 (49)

aMean (SD).

Face validity was determined in a qualitative manner, and the NBQ was presented to 25 adult patients with chronic headache and migraine. This step was essential to ensuring the scale’s quality and obtaining appropriate feedback from patients while they answered the translated questions minor changes were agreed and the pre-final form was modified to include these changes with consensus. Content validity was qualitatively assessed by several specialists and found to be at an appropriate level. The content validity ratio (CVR)and content validity index (CVI) scores for the NBQ were 0.88 and 0.92, respectively.

Construct validity, was determined with convergent validity by short-form McGill pain questionnaire. We assessed construct validity by calculating the correlation between the Persian version of NBQ results and that of a comparative external measure, the McGill pain questionnaire. The Iranian Short-form McGill pain questionnaire has a valid and reliable Persian version (I-SF-MPQ). 19 The Pearson correlation between NBQ total scores and short-form McGill questionnaire total score was 0.85 (P = 0.001) which indicates a strong correlation between Persian version of NBQ and I-SF-MPQ.

Table 2 shows the item-corrected total correlations for the Persian version of the NBQ, with all values well above the cut-off point of 0.2, 20 indicating that all seven scales contribute to the overall score. The study revealed that the intrarater reliability of the severity scores, assessed by Cronbach’s alpha, was 0.87 (P = 0.001), in our study, the intraclass correlation coefficient was 0.92 (95% confidence interval, 0.79–0.94).

Table 2. Internal consistency of the Neck Bournemouth Questionnaire (Persian version)
Item-corrected total correlations
Variable Pearson’s r Cronbach’s alpha
Domain (item)1234567Total score
Value0.820.810.830.800.880.820.930.87

Discussion

The purpose of this study was to translate and test a Persian version of the NBQ for use Iranian clinicians and researchers working in the field of pain.The most common questionnaires used for NP in the number of studies included: The Neck Pain Disability Index (NDI), 21 The Northwick Park Neck Pain Questionnaire, 22 The Copenhagen Neck Functional Disability Scale, 23 The Neck Pain and Disability Scale (NPAD) 18 and The Bournemouth Questionnaire for Neck Pain. 11 The NBQ is form multidimensional instrument developed from the bio psychosocial model and contains as follows items: pain intensity, disability in activities of daily living in social activities, the emotional dimensions of anxiety and depression, the cognitive aspects of fear-avoidance behavior and pain locus of control. 11

The NBQ has been cross-culturally translated into several languages with good internal consistency and construct validity to evaluate low back pain and NP. 24 Recently, the version of this instrument has been translated and validated in various languages such as Arabic, 25,26 Brazilian, 27 Turkish, 28,29 French, 15 Dutch, 16 German, 12 and Italian. 17 The 6-step translation and cross cultural adaptation process after Beaton et al., 14 was used in this study and included forward and back translations, validation by an expert committee, face validity and testing in NP patients followed by statistical analysis. The cross-cultural adaptation of the NBQ in Iranian patients showed the absence of any major difficulty during the fourth and back translation processes. This finding is consistent with the results of other previous studies in other countries. 12,17 In this study, the internal consistency was strong for all 7 items of the NBQ with Cronbach alpha of 0.87. The internal consistency of NBQ was higher than the NDI. 30 This instrument compared to other instruments that used in different countries was considered coefficient alpha.

Construct validity is an important feature of questionnaires that measures the confirmation with the theoretical construct of the studied phenomenon. 31 There was an acceptable correlation was found between the NBQ and the McGill pain questionnaire in our study. The study revealed a good reliability and the strengths of the present study include gold standard translation approach and an excellent sample size. This is also in agreement with the other study conducted by Leonard et al., 32 Adelmanesh et al., 19 Geri et al., 17 and Schmitt et al. 16 The results of this study demonstrate that the psychometric properties of the NBQ Iranian translation are sufficiently adequate, thus its use with NP patients.

One main limitation of this study is the fact that all testing was done on chronic NP patients referred to the pain clinic of Baqiyatallah hospital in the city of Tehran. It is suggested that further studies be conducted in other parts of the country as comparative investigations between patients and healthy people. The results obtained from the application of this scale need to be evaluated nationwide. An additional limitation is that patients were not selected by the random sampling method and thus may not be representative of Iranian adults with acute NP. Further psychometric studies in children populations are needed.


Conclusion

According to the results of present study, the Persian version of NBQ is simple and applicable questionnaire which was developed with appropriate psychometric properties. This scale is privileged with a simple scoring system, good validity and reliability and useful instrument in screening and assessment of patients with cervical pain in Iranian population. It can be used by Iranian clinicians and researchers working in the field of pain to communicate internationally.


Acknowledgements

The present study has been funded by the Trauma Research Centre of Baqiyatallah University of Medical Sciences and conducted with the cooperation of the Baqiyatallah hospital in Tehran. The authors would like to express their gratitude to the authorities at the hospital and also to Bolton for kindly responding to all queries and giving permission to translate into the Persian.


Ethical Issues

The required permissions for this study were acquired from both patients and the research ethics committee. In addition, all subjects were informed of the nature and the purpose of study. All information was kept confidential, and the authors’ rights were recognized when using previously published texts.


Conflict of Interest

The authors declare that they have no competing interests.


Authors’ Contributions

AAD was the main investigator and supervisor, write up, and revised the final manuscript. MMS and SARM contributed to the study design and data collection. MSN and VS helped as a consultant in all parts of the study, especially proposal writing, and revising manuscript. All authors read and approved the final manuscript.


Research Highlights

What is the current knowledge?

NP is a debilitating disease with high burden in different countries. Use of appropriate tools to evaluate NP helps healthcare provider for better disease management.

What is new here?

Persian version of Neck Bournemouth -7 item was good validity and reliability as well as applicability.

-This is a good scale for assessing patients with cervical pain in Iranian population.

-This is a feasible scale for using clinicians to investigation rate of pain in patients with chronic cervicalgia.


References

  1. Taheri H, Mahdavinejad R, Bagherian Dehkordi S, Omidali Z. Comparison of forward head in persons with chronic neck pain and healthy persons (Persian). Journal of Research in Rehabilitation Sciences 2011; 7(2):162-8. doi: 10.22122/jrrs.v7i2.188 [Crossref]
  2. Taheri H, Mahdavinejad R, Minasian V, Karimi A. The effect of 8 weeks selected exercise therapy and self treatment by pamphlet programs on the strength and range of motion of the neck in patients with chronic neck pain (Persian). Journal of Research in Rehabilitation Sciences 2011; 7(1):1-10. doi: 10.22122/jrrs.v7i1.148 [Crossref]
  3. Amiri Arimi S, Abdollahi I, Mohseni-Bandpei MA. Effects of chronic mechanical neck pain on motor control of cervical muscles: a systematic review. Journal of Mazandaran University of Medical Sciences 2016; 26(136):211-24.
  4. Kerosuo E, Kerosuo H, Kanerva L. Self-reported health complaints among general dental practitioners, orthodontists, and office employees. Acta Odontol Scand 2000; 58(5):207-12. doi: 10.1080/000163500750051755 [Crossref]
  5. Salo PK, Häkkinen AH, Kautiainen H, Ylinen JJ. Effect of neck strength training on health-related quality of life in females with chronic neck pain: a randomized controlled 1-year follow-up study. Health Qual Life Outcomes 2010; 8:48. doi: 10.1186/1477-7525-8-48 [Crossref]
  6. Kovacs FM, Bagó J, Royuela A, Seco J, Giménez S, Muriel A. Psychometric characteristics of the Spanish version of instruments to measure neck pain disability. BMC Musculoskelet Disord 2008; 9:42. doi: 10.1186/1471-2474-9-42 [Crossref]
  7. Hogg-Johnson S, van der Velde G, Carroll LJ, Holm LW, Cassidy JD, Guzman J. The burden and determinants of neck pain in the general population: results of the bone and joint decade 2000-2010 task force on neck pain and its associated disorders. Spine (Phila Pa 1976) 2008; 33(4 Suppl):S39-51. doi: 10.1097/BRS.0b013e31816454c8 [Crossref]
  8. Pedisic Z, Pranic S, Jurakic D. Relationship of back and neck pain with quality of life in the Croatian general population. J Manipulative Physiol Ther 2013; 36(5):267-75. doi: 10.1016/j.jmpt.2013.05.012 [Crossref]
  9. McLean SM, May S, Moffett JK, Sharp DM, Gardiner E. Prognostic factors for progressive non-specific neck pain: a systematic review. Phys Ther Rev 2007; 12(3):207-20. doi: 10.1179/108331907X222967 [Crossref]
  10. Andersen JH, Kaergaard A, Frost P, Thomsen JF, Bonde JP, Fallentin N. Physical, psychosocial, and individual risk factors for neck/shoulder pain with pressure tenderness in the muscles among workers performing monotonous, repetitive work. Spine (Phila Pa 1976) 2002; 27(6):660-7. doi: 10.1097/00007632-200203150-00017 [Crossref]
  11. Bolton JE, Humphreys BK. The Bournemouth Questionnaire: a short-form comprehensive outcome measure II Psychometric properties in neck pain patients. J Manipulative Physiol Ther 2002; 25(3):141-8. doi: 10.1067/mmt.2002.123333 [Crossref]
  12. Soklic M, Peterson C, Humphreys BK. Translation and validation of the German version of the Bournemouth Questionnaire for neck pain. Chiropr Man Therap 2012; 20(1):2. doi: 10.1186/2045-709x-20-2 [Crossref]
  13. Schellingerhout JM, Heymans MW, Verhagen AP, de Vet HC, Koes BW, Terwee CB. Measurement properties of translated versions of neck-specific questionnaires: a systematic review. BMC Med Res Methodol 2011; 11:87. doi: 10.1186/1471-2288-11-87 [Crossref]
  14. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976) 2000; 25(24):3186-91. doi: 10.1097/00007632-200012150-00014 [Crossref]
  15. Martel J, Dugas C, Lafond D, Descarreaux M. Validation of the French version of the Bournemouth Questionnaire. J Can Chiropr Assoc 2009; 53(2):102-20.
  16. Schmitt MA, de Wijer A, van Genderen FR, van der Graaf Y, Helders PJ, van Meeteren NL. The Neck Bournemouth Questionnaire cross-cultural adaptation into Dutch and evaluation of its psychometric properties in a population with subacute and chronic whiplash associated disorders. Spine (Phila Pa 1976) 2009; 34(23):2551-61. doi: 10.1097/BRS.0b013e3181b318c4 [Crossref]
  17. Geri T, Signori A, Gianola S, Rossettini G, Grenat G, Checchia G. Cross-cultural adaptation and validation of the Neck Bournemouth Questionnaire in the Italian population. Qual Life Res 2015; 24(3):735-45. doi: 10.1007/s11136-014-0806-5 [Crossref]
  18. Wu S, Ma C, Mai M, Li G. Translation and validation study of Chinese versions of the neck disability index and the neck pain and disability scale. Spine (Phila Pa 1976) 2010; 35(16):1575-9. doi: 10.1097/BRS.0b013e3181c6ea1b [Crossref]
  19. Adelmanesh F, Arvantaj A, Rashki H, Ketabchi S, Montazeri A, Raissi G. Results from the translation and adaptation of the Iranian Short-Form McGill Pain Questionnaire (I-SF-MPQ): preliminary evidence of its reliability, construct validity and sensitivity in an Iranian pain population. Sports Med Arthrosc Rehabil Ther Technol 2011; 3(1):27. doi: 10.1186/1758-2555-3-27 [Crossref]
  20. Hartvigsen J, Lauridsen H, Ekström S, Nielsen MB, Lange F, Kofoed N. Translation and validation of the Danish version of the Bournemouth Questionnaire. J Manipulative Physiol Ther 2005; 28(6):402-7. doi: 10.1016/j.jmpt.2005.06.012 [Crossref]
  21. Vernon H. The neck disability index: state-of-the-art, 1991-2008. J Manipulative Physiol Ther 2008; 31(7):491-502. doi: 10.1016/j.jmpt.2008.08.006 [Crossref]
  22. Lee KW, Seo HD, Jung KS, Kim SH, Chung Y. Reliability and validity of Korean version Northwick Park Neck Pain Questionnaire in neck pain patients. Phys Ther Korea 2010; 17(3):68-76.
  23. Misterska E, Jankowski R, Glowacki M. Cross-cultural adaptation of the Neck Disability Index and Copenhagen Neck Functional Disability Scale for patients with neck pain due to degenerative and discopathic disorders Psychometric properties of the Polish versions. BMC Musculoskelet Disord 2011; 12:84. doi: 10.1186/1471-2474-12-84 [Crossref]
  24. Zhang ZC, Jia ZY, Cheng YJ, Wang F, Yang YL, Li M. Cross-cultural adaptation and validation of the simplified-Chinese version of Neck Bournemouth Questionnaire for patients in Mainland China. Spine (Phila Pa 1976) 2019; 44(7):E438-E44. doi: 10.1097/brs.0000000000002869 [Crossref]
  25. Elerian AE, Abdel-Aal NM, Abdelhay MI. Bournemouth Questionnaire Arabic version: cross-cultural adaptation, validity, and reliability for patients with low back pain. Physiother Res Int 2020; 25(3):e1834. doi: 10.1002/pri.1834 [Crossref]
  26. Morsi HA, Elerian AE, Abdelhay I, Salama H. Validity and reliability of Arabic version of cervical spine Bournemouth Questionnaire for neck pain. International Journal of Recent Advances in Multidisciplinary Research 2018; 5(7):3947-50.
  27. Kamonseki DH, Fonseca CL, Calixtre LB. The Brazilian version of the Bournemouth Questionnaire for low back pain: translation and cultural adaptation. Sao Paulo Med J 2019; 137(3):262-9. doi: 10.1590/1516-3180.2018.0482120419 [Crossref]
  28. Yılmaz O, Gafuroğlu Ü, Yüksel S. Translation, reliability, and validity of the Turkish version of the Neck Bournemouth Questionnaire. Turk J Phys Med Rehabil 2019; 65(1):59-66. doi: 10.5606/tftrd.2019.2693 [Crossref]
  29. Aslan Telci E, Baş Aslan Ü, Yağcı N, Cavlak U, Gür Kabul E, Kara G. The Turkish version of the Neck Bournemouth Questionnaire in patients with chronic neck pain: a cultural adaptation, reliability, and validity study. Arch Med Sci 2021; 17(3). doi: 10.5114/aoms.2019.89322 [Crossref]
  30. Gay RE, Madson TJ, Cieslak KR. Comparison of the Neck Disability Index and the Neck Bournemouth Questionnaire in a sample of patients with chronic uncomplicated neck pain. J Manipulative Physiol Ther 2007; 30(4):259-62. doi: 10.1016/j.jmpt.2007.03.009 [Crossref]
  31. Salaree MM, Zareiyan A, Ebadi A. Development and psychometric properties of the military nurses’ job burnout factors questionnaire. J Mil Med 2019; 20(6):645-54.
  32. Leonard JH, Choo CP, Manaf MR, Md Isa Z, Mohd Nordin NA, Das S. Development and evaluation of ‘neck pain and functional limitation scale’: a validation study in the Asian context. Indian J Med Sci 2009; 63(10):445-54. doi: 10.4103/0019-5359.57645 [Crossref]
Submitted: 20 Apr 2019
Accepted: 02 Feb 2021
First published online: 25 Aug 2021
EndNote EndNote

(Enw Format - Win & Mac)

BibTeX BibTeX

(Bib Format - Win & Mac)

Bookends Bookends

(Ris Format - Mac only)

EasyBib EasyBib

(Ris Format - Win & Mac)

Medlars Medlars

(Txt Format - Win & Mac)

Mendeley Web Mendeley Web
Mendeley Mendeley

(Ris Format - Win & Mac)

Papers Papers

(Ris Format - Win & Mac)

ProCite ProCite

(Ris Format - Win & Mac)

Reference Manager Reference Manager

(Ris Format - Win only)

Refworks Refworks

(Refworks Format - Win & Mac)

Zotero Zotero

(Ris Format - FireFox Plugin)

Abstract View: 1006
PDF Download: 514
Full Text View: 275