You are probably used to hearing media reports about breast cancer and its causes. For example, the media often report on research advances or studies that link particular types of food with a reduced risk of breast cancer.
In this section of the website, the Canadian Breast Cancer Foundation offers you tips for how to evaluate secondary sources of information about breast cancer research, such as media reports. We also provide you with information on how to evaluate the primary sources, the research articles themselves.
Evaluating media reports: questions to ask
Media reports about breast cancer research or the findings of a new study can often be more confusing, contradictory or sensational than informative. When breast cancer research is described by the media, their reporting may just focus on one part of a new study without explaining the findings more fully and often does not put the study into the broader context of other research findings. Media reports rarely provide all the details you need to evaluate new research.
As you read media reports about research on breast health and breast cancer, consider the following questions to help you assess the reporting:
1. What are the media report’s sources of information? Are they credible sources?
2. What does the media report tell you about the research? Does it provide information about the type of research study, what was done, when, where, how many people were studied, key findings and conclusions as well as research gaps or limitations?
3. Does the media report contain enough information for you to evaluate the merits and limitations of the research?
4. Does it give you different points of view from experts not involved in the study?
5. Does it refer to other studies in the same field of research to give you a clearer picture of the context, including debates in the field?
6. Is the subject matter sensationalized to attract attention?
7. When you look closer, is the report actually an advertisement that is trying to sell you something?
8. Does the publication or author have a particular agenda or political perspective that may bias their reporting?
9. Who is the author and what is their background? Does their expertise include science writing or health reporting?
Evaluating research: questions to ask
The best way to evaluate research is to read the primary source, the original published study that the media report was based on. Many research articles, or at least their summary or abstract, are available online. To gain a fuller understanding, the Canadian Breast Cancer Foundation encourages you to read independent, peer-reviewed articles to evaluate the research for yourself and learn about the debates within the research community.
Research studies are often published in academic journals that focus on a specific subject area. These journals are available online and in print. Before getting published in these specialized journals, articles are reviewed by other subject matter experts – this is known as “peer review.” Medical and health journals provide a place for researchers and experts to debate ideas. Usually a number of studies are published on a topic before the idea is accepted as conclusive evidence and used to inform practice.
By going to the source and reading original research articles, you will be able to access the fuller details and context beyond the media reports. This may help you to evaluate the research. As you read research articles, consider the following questions:
1. Who owns or publishes the journal? How independent is the owner of the journal? Is the journal funded by industry, the government, or an academic institution?
2. Is the journal credible and seen as a source of authority?
3. Who wrote the research article and what are their credentials?
4. Who funded the research? Does it look as though it was an independent source of funding or a commercial or industry source?
5. How current is it?
6. Was the research done on people, animals or cells?
7. How many people were studied, and for how long?
8. Does the article give you a good understanding of previous research in this area?
9. Does the article describe research findings and conclusions as well as its limitations?
Understanding common research terms
If you are new to reading research articles, it may help you to become familiar with some key research terms.
Common research methods
Quantitive research: this type of research counts things. It generates numerical data and statistics, for example by estimating how many new cases of breast cancer there will be in Canadian women in a given time period. Numbers are an important part of research, but they don’t provide the whole picture.
Qualitative research: this type of research tries to provide a picture of the context and complexity of people’s lived experiences, to get at the “how” and the “why,” in addition to the “how much” and “how many.” It focuses on the stories that people tell about their experiences. Qualitative data are gathered with interviews, focus groups, case studies or by observation.
Common types of research study
Experimental research: in an experimental study researchers apply an intervention, such as a certain type of treatment, to a group of individuals and compare the results with those of another group that does not receive it, known as the control group. The researchers manage who receives the intervention and who does not. One of the most common types of experimental studies is the clinical trial.
Observational research: in an observational study, the researchers observe groups of people engaged in their normal activities, without an intervention controlled by researchers. There are different types of observational studies.
More Information
Sources
- Cancer.net, Understanding Cancer Research Studies, Part I, Part II. Accessed July 31, 2011.
- Cancer Research UK, How to make sense of mixed cancer messages in the media. Accessed July 31, 2011.
- Centres of Excellence for Women’s Health. (2005). Just the Facts Ma’am. A Women’s Guide for Understanding Evidence about Health and Health Care. Accessed July 31, 2011.
- Womenshealthmatters.ca, Women Wading Through the Web – A Health Toolkit. No longer accessible online.
- World Cancer Research Fund/American Institute for Cancer Research. Judging the Evidence. In Food, Nutrition, Physical Activity, and the Prevention of Cancer: a Global Perspective. Washington DC: AICR, 2007. Accessed July 31, 2011.