Publication rate of scientific papers presented at the largest event on breast cancer research in Latin America
Sergio Nascimento1,2,3,a, Rosemar Macedo Sousa Rahal1,2,b, Leonardo Ribeiro Soares1,2,3,c, Herik Jansen de Souza Pimentel3,d, Tágara Oliveira Kamimura3,e and Ruffo Freitas-Junior1,2,f
1Faculty of Medicine, School of Medicine, The Federal University of Goiás, Rua 235 s/nº, Setor Leste Universitário, 74605050 Goiânia, GO, Brazil
2Advanced Center for Breast Diagnosis (CORA), Teaching Hospital, Federal University of Goiás, Primeira avenida s/nº, Setor Leste Universitário, 74605020 Goiânia, GO, Brazil
3School of Medicine, Alfredo Nasser University, Av Bela Vista, nº 26, Jardim Esmeraldas, 74905020 Aparecida de Goiânia, GO, Brazil
ahttps://orcid.org/0000-0003-1294-2524
bhttps://orcid.org/0000-0003-3619-0603
chttps://orcid.org/0000-0002-9448-6114
dhttps://orcid.org/0000-0002-4411-0397
ehttps://orcid.org/0000-0002-5053-1040
fhttps://orcid.org/0000-0003-4145-8598
Abstract
Purpose: Medical congresses allow scientific production to be appropriately disseminated and discussed. However, most of the scientific papers presented at medical congresses do not go on to be published in indexed journals. The present study aimed to determine the publication rate of papers presented at the Brazilian Breast Cancer Symposium (BBCS) and trends associated with publication over that timeframe.
Methods: This was a retrospective, observational study evaluating scientific papers presented at the BBCS between 2012 and 2017. All the abstracts presented at the event within this timeframe were recorded. Next, a search for papers was made using online databases (BIREME/LILACS and MEDLINE/PubMed) and in the curricula of the authors on the Lattes Platform.
Results: Overall, 543 abstracts of papers presented at the BBCS between 2012 and 2017 were included. Of these, 112 (20.6%) had been published in an indexed journal, mostly in English (67.0%), in journals with an impact factor of 2.0–3.0 (21.4%) and ≥1 year after presentation at the event (75.9%). The factors associated with publication were: study conducted in a public institution (p = 0.01), oral or commented poster presentation (p > 0.001) and study concerning rehabilitation following breast cancer (p = 0.04). There was a downward trend in the rate of publication of articles over the years (p = 0.01). Conversely, the impact factor of the publications increased significantly between 2012 and 2017 (p = 0.04).
Conclusion: The publication rate of papers presented at the BBCS is low and remains consistent over the study period despite academic incentives and substantial awards.
Keywords: breast neoplasms, bibliometrics, research report, journal article
Correspondence to: Rosemar Macedo Sousa Rahal
Email: rosems@terra.com.br
Published: 02/07/2021
Received: 20/02/2021
Publication costs for this article were supported by ecancer (UK Charity number 1176307).
Copyright: © the authors; licensee ecancermedicalscience. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Introduction
Disseminating knowledge gained from scientific research is the first step for healthcare advancement. Safe and reliable sources of information are of vital importance, and priority must be given to scientific studies conducted with appropriate methodology [1–3]. In recent years, scientific development in the field of breast cancer has contributed to progress in the diagnosis of the disease, to consolidating new treatment strategies and to achieving more favourable oncologic outcomes [3–5].
Medical congresses allow scientific production to be appropriately disseminated and discussed. The authors of each study may present their results and discuss the study limitations as well as the practical implications of their results. Among other benefits, medical congresses promote continued education, the discussion of clinical cases, the formulation of institutional protocols and the launching of specialised bibliographic material, as well as allowing contact between individuals from different geographic regions [6]. In this respect, bibliometric studies within any given medical speciality can contribute by providing indicators related to the production and dissemination of scientific knowledge [1, 7]. These studies also allow the progress achieved in any given subject or topic within each area of interest to be evaluated [1, 2, 6].
Data published in Brazil show that most of the scientific papers presented at medical congresses do not go on to be published in indexed journals [8, 9]. At the Brazilian Congresses of Angiology and Vascular Surgery held between 2001 and 2003, the mean publication rate was 6.3% [9]. Of the papers presented at the Brazilian Congress of Mastology held in 2017, the publication rate was 5.4% [3]. However, there are no data available on the temporal evolution of the publication rate for the same congress. To the best of the authors’ knowledge, this is the first temporal study of scientific events in the field of breast cancer in Brazil.
The Brazilian Breast Cancer Symposium (BBCS) is an annual scientific event that focuses on research in breast cancer and related subjects. The venue is Goiânia, Goiás, in the country’s mid-western region. The event was created in 2010 and since then around 5,000 participants have been engaged, approximately 600 scientific papers have been presented, and approximately US$ 45,000.00 in awards has been distributed to researchers.
The objective of the present study was to evaluate the publication rate of papers presented at the BBCS between 2012 and 2017, as well as trends in the publication of these papers throughout this timeframe.
Methods
This was a retrospective, observational study, with the unit of observation being the scientific papers presented at the BBCS between 2012 and 2017. This symposium was selected because it is the largest event on breast cancer research in Brazil and Latin America. The 2012–2017 period was selected to allow an interval of 3 years after presentation, since this period is considered an appropriate time for the publication of abstracts presented at a congress [1]. In 2011, the BBCS event was not held because the city of Goiânia was the venue for the Brazilian Congress of Mastology.
Variables
The following data were collected: the title of the paper, its authors and the institution and state in which the study was conducted. The abstracts were classified according to type of presentation as: posters, commented poster presentations or oral presentations. The main topic of the study was classified into the following categories: ‘epidemiology’, ‘histology’, ‘radiology’, ‘systemic treatment’, ‘surgery’, ‘radiotherapy’, ‘rehabilitation’, ‘basic science’ and ‘other topics’. The institutions at which the studies were conducted were classified as: ‘public’, ‘private’ or ‘public-private partnership’.
To determine whether the study had been published, a search was initially made of the authors’ curricula, which are available on the Brazilian National Council for Scientific and Technological Development (CNPq)’s Lattes Platform (www.lattes.cnpq.br). Two investigators conducted the search independently, using the name of the first and last author of the paper presented at the congress. The last date for search must be given as 10 December 2020.
Next, a search was made for the papers on the online databases: BIREME/LILACS virtual health library (http://lilacs.bvsalud.org/) and PubMed (US National Library of Medicine, National Institutes of Health) (https://www.ncbi.nlm.nih.gov/pubmed). Finally, if the search using the authors’ names was unsuccessful, another search was made in the same databases using the title of the paper.
For the papers published in journals, agreement was evaluated between the article in the journal and the paper presented at the medical congress. Changes in the titles, authors, objectives, materials and methods, results and conclusions were evaluated.
The absolute number of publications was evaluated, together with the language in which the paper was published and the year and journal in which it was published (national or international), the type of study and the quality of the scientific evidence. The publication rate was obtained for each congress based on the ratio between the total number of papers published and the total number of papers presented at the congress.
The classification proposed by the Brazilian Medical Association (http://www/amb/org/br) was used to classify the degree of scientific evidence: (A) The most consistent experimental or observational studies (meta-analysis or randomised clinical trials); (B) Less consistent experimental or observational studies (other non-randomised clinical trials or observational studies or case–control studies); (C) Reports or case series (non-controlled studies) and (D) Opinion lacking critical evaluation, based on consensuses, physiological studies or animal models.
Statistical analysis
The data collected were initially entered on an Excel spreadsheet (Microsoft Corporation, Redmond, USA; version 2013), and then analysed using the SPSS statistical software program (IBM Corporation, Armonk, USA; version 23.0). The data were characterised using absolute (n) and relative (%) frequencies. Nonparametric statistical tests and techniques were used in this study as required, with the normality of distribution being defined according to the Kolmogorov–Smirnov test. The exploratory analyses of the categorical variables were performed using multiple contingency tables, with Pearson’s chi-square test being applied, followed by post-hoc analysis [10]. Comparison between the journal’s impact factor and the type of institution was performed using the Mann–Whitney test. The trend in the impact factor between 2012 and 2017 was examined using Spearman’s correlation coefficient. Poisson regression was used based on the Annual Percentage Change (APC) of publications between the periods from 2012 to 2017. Significance level was defined as p < 0.05 for the entire statistical analysis.
Ethical aspects
The data used are publicly available at the headquarters of the event’s organising committee (https://2020.bbcs.org.br/). For this type of study, formal consent is not required. All recommendations of good clinical practice were followed according to Brazilian law and the Helsinki Convention.
Results
A total of 543 abstracts of scientific papers presented at the BBCS between 2012 and 2017 were included in the study. The majority of these papers refer to work conducted in public institutions (71.1%), originating in the state of Goiás (47.3%) and being presented in poster form (72.0%) (Table 1).
Of all the abstracts presented, 112 (20.6%) were published in an indexed journal. Fifty-five (49.1%) articles were published in journals with no impact factor. The others papers were published in journals with an impact factor between 0.1 and 1.9 (14.3%), between 2.0 and 3.0 (21.4%) and greater than 3.0 (15.2%) (Figure 1). In most cases, the work was published a year or more after presentation at the event (75.9%) and published in English (67.0%) (Table 2).
The factors associated with publication of the scientific papers were: study conducted in a public institution (p = 0.01), oral or commented poster presentation (p < 0.01) and study concerning rehabilitation following breast cancer (p = 0.04) (Table 1). There was no statistically significant association between the journal’s impact factor and the type of institution in which the study was conducted (p = 0.80) (Figure 2). No statistically significant association was found between time to publication of the paper, language of publication or the degree of scientific evidence (Table 3). Table 4 shows the names of all the journals in which the publication rate of these papers was over 1%.
Table 1. Characteristics of the authors’ institution and of the presentation as a function of whether the paper was published, 2012–2017.
There was a downward trend in the rate of publication of articles over the years (p = 0.01) (Figure 3). In 2012, 17 of the 53 abstracts presented at the congress (32.1%) were published in an indexed journal, while, in 2017, 13 of the 97 papers presented were published (13.4%). Conversely, there was a significant increase in the impact factor of the publications between 2012 and 2017 (p = 0.04) (Figure 4). The distribution of the other characteristics according to the time evolution is shown in Table 5.
Discussion
The dissemination of knowledge gained from scientific research represents a crucial step in the process of improving healthcare. As a prerequisite, care must be taken to ensure that the data in question originates from safe, reliable sources that prioritise scientific papers with appropriate methodology. The present study evaluated the publication rate of papers presented at the largest event on breast cancer research in Latin America. Papers for presentation at that event are previously selected by a committee specifically formed for this purpose and composed of professionals of renowned scientific expertise. Nonetheless, the average rate of publication was as low as 20.6% (ranging from 13.4% to 32.1%).
Figure 1. Histogram showing the distribution of the impact factor of the journals in which the papers were published.
Table 2. Comparison between the type of institution and characteristics of the publication.
Figure 2. Boxplot comparing the impact factor with the type of institution in which the study was conducted.
Table 3. Comparison between time to publication and characteristics of the journal and the article.
Table 4. Names of the journals in which the papers were published as a function of the proportion of publications.
Figure 3. Line graph showing the publication rate in the periods from 2012 to 2017 and the result of the Poisson regression used from the APC.
Figure 4. Scatter plot for the correlation between the journal’s impact factor and the year evaluated between 2012 and 2017 (Spearman’s correlation coefficient).
A possible factor associated with this low rate of publication that merits particular emphasis refers to the technical and methodological limitations of the studies conducted and presented at scientific events. In a study that analysed the quality of the abstracts presented at the congress of the Brazilian Society of Infectious Diseases, results showed that in around half the papers analysed the methodology was inadequately or incompletely described [11]. Among the published abstracts from the Brazilian Congress of Plastic Surgery, 88.5% had no statistical analysis, 76% had no impact factor and 52% had no citations [8]. In the present study, 55 (49.1%) abstracts were published in journals with no impact factor and another 16 (14.3%) with an impact factor between 0.1 and 2.0. Although this information does not necessarily imply poor scientific quality, it could reflect limitations in the methodology that resulted in the papers being published in journals with a lower impact factor.
In Brazil, the current model of scientific production is focused on postgraduate programmes and is associated with government incentives, when available [12, 13]. In this model, the publication process becomes dependent on personal and motivational factors present in the respective students and faculty, who not infrequently admit defeat after their paper is refused by the first journal to which it is submitted. In the University of São Paulo, one of the most renowned universities in Latin America, less than 50% of doctoral theses presented between 1990 and 2000 were published within a 5-year period [7]. Other factors such as financial limitations, lack of institutional incentives and a lack of technical support may also discourage scientific publication of a recently concluded study [14, 15].
We observed in the analysis using Poisson regression that the publication rate has been decreasing over the years (Figure 3), although the analysis with the Chi-square test did not demonstrate this reduction (Table 5). In 2017, only 13 of the 97 papers presented were published (13.4%). During this period, the dissemination and awards of the event increased. Thus, one of the justifications for this trend is the increase in Brazilian participation in international congresses, such as the San Antonio Breast Cancer Symposium and American Society of Clinical Oncology (ASCO) Annual Meeting, which give researchers greater prestige and visibility [1, 6]. Given this information, researchers should be encouraged to present their abstracts at Brazilian events and, later, receive institutional support to publish them.
Table 5. Characteristics of the institution according to year of presentation (2012 and 2017).
The publication rate found for papers presented at the BBCS is in agreement with bibliometric studies conducted with other medical specialities in Brazil [1, 8] but lower than that found for renowned international congresses [2, 16, 17]. The differences between this event and others held in Brazil for which publication rates are below 10% [9, 18] may be due to the quality control applied by the respective scientific committees reviewing and selecting the papers submitted and to the methodological characteristics of the papers accepted for presentation at the congress [3, 19]. Nevertheless, the fact that the BBCS is an event that focuses on scientific research and that offers a range of incentives to speakers and considerable awards and prizes for the best papers presented may also have contributed to this better performance [3].
Only three of the factors capable of affecting publication rates were found to be significant. The publication rate was higher in the case of studies developed in public institutions, possibly due to the authors’ academic experience and the scientific incentives present in the majority of these institutions in Brazil [7, 12, 13]. Studies dealing with rehabilitation following breast cancer were also more likely to be published, reflecting not only the quality of these studies but also the encouragement provided for multidisciplinary participation in the BBCS [3]. Finally, the publication rate was higher for papers given as oral or commented poster presentations, reflecting the effectiveness of the event’s organising committee in selecting the studies with greatest scientific impact [16, 19]. In a study conducted in Germany, three different factors were found to affect publication: positive findings, the editorial activity of the supervisor of the study and the quality of the statistical analysis [20]. Those factors were not evaluated in the present study because the information was not available; however, they should be the focus of future studies in this same line of research.
To the best of the authors’ knowledge, this is the first bibliometric survey of events related to breast cancer in Brazil. However, this study also highlights other relevant aspects. Despite the diversity of authors and institutions of origin, there was a predominance of studies originating in Goiás. This can probably be explained by the fact that the event takes place in that state and emphasises the importance of this symposium for the scientific development of the region [3]. There was also a predominance of papers on studies conducted in public hospitals and universities, reflecting the importance of these institutions in scientific production in Brazil [13]. Of the studies that went on to be published, it should be noted that Mastology, the journal of the Brazilian Breast Society, was the publication that most benefitted from papers presented at the BBCS. This corroborates the institutional support for the dissemination of Brazil’s scientific production and confirms the importance of the medical societies in the development and dissemination of academic knowledge [21].
Some limitations to the present study that must be mentioned include those inherent to any study conducted using secondary data sources such as the retrospective design and the limited access to some variables that could have added further information to the discussion. The cut-off point of 3 years after the last event included in the study minimises the risk of a temporal bias that could have existed in relation to the publication rate, although other studies have used 4–5 years [14, 22]. Thus, the publication rates for the 2016 and 2017 events may still increase slightly, in the coming years. On the other hand, the standardisation of the methodology and the rigour applied in the search for the papers increases the robustness of the data found in this study, which constitutes the first bibliometric survey in the field of breast cancer in Brazil.
Conclusion
The publication rate of papers presented at the BBCS is low and remains consistent over the study period despite academic incentives and substantial awards. Studies conducted in public educational institutions, presented in the form of an oral presentation and addressing rehabilitation after breast cancer were associated with the highest publication rate.
Conflicts of interest
None declared.
Funding
This research did not receive any specific grant from funding agencies in the public, commercial or not-for-profit sectors.
Authors’ contributions
Nascimento S contributed to the conception of the study, the acquisition, analysis and interpretation of the data, and manuscript writing. Rahal RMS, Soares LR, Pimentel HJS, Kamimura TO and Freitas-Junior R contributed equally to the conception and design of the study and to revising the manuscript critically for important intellectual content. All authors approved the final version of the manuscript and take public responsibility for the appropriate parts of the content.
Acknowledgments
None.
References
1. Pinheiro CMA, Masson ALS, and Faingezicht AM, et al (2009) Estudos Brasileiros Apresentados nos Encontros Anuais da ASCO entre 2001 e 2007: Aumento de Produção, com Baixa Taxa de Publicação Rev Bras Cancerol 55 221–227 https://doi.org/10.32635/2176-9745.RBC.2009v55n3.1610
2. Arap MA, Reis RB, and Torricelli FC, et al (2014) Brazilian abstracts presented at the American Urological Association annual meetings: contribution, publication rates, and comparison with oncology abstracts Int Braz J Urol 40 730–737 https://doi.org/10.1590/S1677-5538.IBJU.2014.06.03
3. Rahal RMS, Nascimento S, and Soares LR, et al (2020) Publication rate of abstracts on breast cancer presented at different scientific events in Brazil Mastology 30 e20200048 https://doi.org/10.29289/2594539420202020200048
4. Simon SD, Bines J, and Werutsky G, et al (2019) Characteristics and prognosis of stage I-III breast cancer subtypes in Brazil: the AMAZONA retrospective cohort study Breast 44 113–119 https://doi.org/10.1016/j.breast.2019.01.008 PMID: 30738289
5. Freitas-Junior R, Nunes RD, and Martins E, et al (2017) Prognostic factors and overall survival of breast cancer in the city of Goiania, Brazil: a population-based study Rev Col Bras Cir 44 435–443 https://doi.org/10.1590/0100-69912017005003
6. Freitas PF, Freitas-Junior RF, and Soares LR, et al (2014) Série temporal da apresentação de trabalhos brasileiros no San Antonio Breast Cancer Symposium Rev Bras Mastologia 24 4–8 https://doi.org/10.5327/Z201400010002RBM
7. Younes RN, Deheinzelin D, and Birolini D (2005) Graduate education at the faculty of medicine of the University of Sao Paulo: quo vadis? Clinics 60 6–8 https://doi.org/10.1590/S1807-59322005000100003 PMID: 15838574
8. Denadai R, Pinho AS, and Júnior SH, et al (2017) Conversion of plastic surgery meeting abstract presentations to full manuscripts: a Brazilian perspective Rev Col Bras Cir 44 17–26 https://doi.org/10.1590/0100-69912017001008 PMID: 28489207
9. Bonetti W, Holmo NF, and Corregliano GT, et al (2008) Publicações indexadas geradas a partir de resumos de congressos de angiologia e cirurgia vascular no Brasil J Vasc Bras 7 293–297 https://doi.org/10.1590/S1677-54492008000400002
10. MacDonald PL and Gardner RC (2000) Type I error rate comparisons of post hoc procedures for I j Chi-Square tables Educ Psychol Meas 60 735–754 https://doi.org/10.1177/00131640021970871
11. Santos EF and Pereira MG (2007) Qualidade dos resumos estruturados apresentados em congresso médico Rev Assoc Med Bras 53 355–359 https://doi.org/10.1590/S0104-42302007000400023
12. Zorzetto R, Razzouk D, and Dubugras MT, et al (2006) The scientific production in health and biological sciences of the top 20 Brazilian universities Braz J Med Biol Res 39 1513–1520 https://doi.org/10.1590/S0100-879X2006001200001 PMID: 17160259
13. Cardoso SC and Gattás GJF (2009) The scientific production of full professors of the Faculdade de Medicina da Universidade de São Paulo: a view of the period of 2001–2006 Clinics 64 903–909 https://doi.org/10.1590/S1807-59322009000900012
14. Denadai R, Araujo GH, and Pinho AS, et al (2016) Discrepancies between plastic surgery meeting abstracts and subsequent full-length manuscript publications Aesthetic Plast Surg 40 778–784 https://doi.org/10.1007/s00266-016-0680-3 PMID: 27422258
15. Sarkar B, Wang YX, and Cai J (2020) The open access financial model hinders the growth of medical physics research in low- and middle-income countries Med Phys 47 5972–5975 https://doi.org/10.1002/mp.14220 PMID: 32367514
16. Ohtori S, Orita S, and Eguchi Y, et al (2018) Oral presentations have a significantly higher publication rate, but not impact factors, than poster presentations at the International Society for study of lumbar spine meeting: review of 1126 abstracts from 2010 to 2012 meetings Spine (Phila Pa 1976) 43 1347–1354 https://doi.org/10.1097/BRS.0000000000002620
17. Meral UM, Alakus U, and Urkan M, et al (2016) Publication rate of abstracts presented at the annual congress of the European Society for Surgical Research during 2008–2011 Eur Surg Res 56 132–140 https://doi.org/10.1159/000443608
18. de Andrade VA, Carpini S, and Schwingel R, et al (2011) Publication of papers presented in a Brazilian Trauma Congress Rev Col Bras Cir 38 172–176 PMID: 21789455
19. Vieira RAC, Bonetti TCS, and Marques MMC, et al (2020) Criteria for evaluating studies at scientific medical events Mastology 30 e20200031 https://doi.org/10.29289/25945394202020200031
20. Vogel U and Windeler J (2000) Factors modifying frequency of publications of clinical research results exemplified by medical dissertations Dtsch Med Wochenschr 125 110–113
21. Urban C (2019) Mastology in the open entrance of the closed palace of the king Mastology 29 1 https://doi.org/10.29289/259453942019EDIT291
22. Hackett PJ, Guirguis M, and Sakai N, et al (2014) Fate of abstracts presented at the 2004–2008 International Liver Transplantation Society meetings Liver Transpl 20 355–360 https://doi.org/10.1002/lt.23807 PMID: 24497441
