A glossary of research and marketing terms to help you become a savvy Nag yourself:

TYPES OF RESEARCH

• Biomedical or basic research:  studies done on cells, tissue or animals, often in a laboratory. They may or may not be relevant to humans. They often only suggest directions for research.
• Epidemiological research:  studies of groups of people (populations) to look at patterns in the rates, distribution, prevention and control of disease, injuries, and other health-related events.
• Social and behavioural research: studies that look at people’s attitudes, needs and practices.
• Clinical research:  studies the diagnosis, treatment, prevention, and outcomes of diseases or conditions. They include intervention studies, such as clinical trials and community-based trials that look at whether a strategy, drug, or medical treatment is safe and works to treat or prevent a health-related event.
• Health services and operational research:  studies how health care is delivered and how people access health care.

Two general kinds of studies

• Qualitative studies ask questions like “why?” and “how?” This kind of research often uses interviews, surveys or other ways to observe people to find out how people think, feel, or act. For example, a qualitative study may ask: “Why do girls start smoking?” Qualitative studies ask questions that are tough to answer with numbers.

Levels of evidence in studies

• Systematic Reviews and Meta-Analysis:  Comprehensive and structured review of all studies on a specific topic, sometimes combines the data or statistics from the studies (meta-analysis)
• Randomized Controlled Studies:  Randomly assign study participants into two groups: those who get the treatment (case) and those who do not (control) to look for differences between the two groups. The chance of being in either group is 50/50. It does not depend on things like how much a person needs treatment. A stronger form of this type of study is the Randomized Controlled Double-Blind Study. This form has the extra step of making sure that neither the researchers nor the study participants know who is getting the treatment or the placebo until the end of the study.
• Cohort or Panel Studies:  Observe a clearly defined group of people either forward in time (prospective) or looking back in time (retrospective) at previous medical records and other information; in Observational Studies, individuals are observed or certain outcomes are measured, but no attempt is made to affect the outcome (for example, no treatment is given). Observational studies can’t prove cause and effect. They can show a strong statistical association, but cannot prove benefit or risk reduction.
• Case-Control Studies:  Compare two groups of people: people with a disease or condition (cases) to other people who have the same characteristics (such as age and sex) who do not have that condition (controls)
• Case Series:  Describe of a number of cases
• Case Reports:  Report on a single case
• Ideas, Editorials, and Opinions
• Animal Research
• In Vitro (Test Tube) Research

Funding for research

• usually comes from government departments, foundations, universities or corporations
• ask where the money comes from because some funders may have a financial interest in what the study says. For example, a drug company paying for research on their drug wants the research to show that the drug they’ve spent hundreds of millions of dollars developing is effective. Researchers are now more frequently disclosing their  ‘conflict of interest’ issues for the study right on the research paper or journal article.

The people studied

• Did the researchers study men only, women only, or both women and men (and was the sample group equally divided between genders or significantly more one-sided)?
• Were the study participants from a wide range of backgrounds and ages?
• If the researchers studied only certain types of women, their findings may not apply to all women. Ditto for men.
• Until recently, medical research has tended to study men and not recognize that there are differences between men’s and women’s health.
• Researchers are trying more to understand those differences using gender-based analysis or “GBA”.
• Was the group studied large enough? When a quantitative study looks at whether one treatment is better than another, or has dangers or side effects, researching a large population over a long period of time gives results that are more meaningful.
• Small groups are often used in qualitative studies. These studies look at an issue in-depth and can take a lot of time, so it is not always possible to have a large study group.

Statistics

• Statistics are supposed to show whether something just happens by chance or because of the treatment that is being studied.
• Saying that statistics are significant means that the research results show that there is a meaningful difference between the groups in the study and that the differences are so big that they are probably not due to chance. The difference between to two groups is then due either to the treatment that is being studied, or an error or bias in the study.
• Statistics can also be used to show whether two things occur together, how large a difference is, the combined effects of many factors, or how something changes over time.

Bias

A bias is anything that influence the results of a research study. Different sources of bias can affect the study design, the data analysis, or the interpretation of the study results.

• Medical research may focus on one disease or condition and only look at how some aspects of patients’ lives affect the condition.
• Some people feel better when they think they are receiving treatment, even if they are only getting a placebo, the so-called placebo effect.
• People’s memories are selective and volunteers can under- or overestimate answers to research questions. People sometimes give answers that they think are the ‘right’ ones or what the researchers want to hear.
• Sometimes, observations and conclusions may be influenced by stereotypes about groups of people.
• There might be problems in the way that people were chosen or volunteer for the study so that the study participants are not representative of the larger society.

Questions to ponder:

• Did the study do what it set out to do?
• Do the conclusions follow from the information presented?
• Does the study overestimate benefits or underestimate dangers?
• If the study suggests drugs or therapies for prevention, was there longterm follow-up on the effects?
• Do the results fit with older, more established evidence? Sometimes new research findings challenge established evidence.

Be suspicious of research presented at scientific meetings

• information presented in talks at scientific meetings may be incomplete
• research abstracts presented at prominent scientific meetings often receive substantial media attention before the validity of the work has been established in the scientific community
• many of the abstracts receiving media attention have weak designs, are small, or are based on animal or laboratory studies
• this work is generally not ready for public consumption: results change, fatal problems emerge, and hypotheses fail to pan out
• 25% remained unpublished more than three years after the meeting
• presentations that receive front-page coverage are no more likely to be published than abstracts receiving less prominent coverage
• results are frequently presented as scientifically sound evidence rather than as preliminary findings with still uncertain validity
• most findings have not undergone final peer review, have yet to be independently vetted, and may change
• unlike at scientific meetings, evidence strength of research published in peer-reviewed journals can be evaluated
• physicians, confronted with preliminary research findings, must be able to answer some fundamental questions such as: “What is the rush?”
• develop a healthy skepticism about the ‘breakthroughs’ you repeatedly encounter in the news

Sources include: Canadian Women’s Health Network and Health News Review

.

DEFINITIONS

• astroturfing: political, advertising, or public relations campaigns that are formally planned by an organization or company, but designed to mask their true origins to create the impression of being spontaneous, popular “grassroots” behaviour. (The term refers to AstroTurf™, a brand of synthetic carpeting designed to look like natural grass).  Astroturfing campaigns are widely considered by us PR types to be behind the growing trend towards noisy health care protests and town hall meetings in the U.S.

• conflict of interest: this happens if a research study author or team member is now receiving or has previously received money or any other benefits from the manufacturer of the drug or device being studied, or has anything to gain if the study is positive towards the manufacturer.  It’s generally suspected that you don’t bite the hand that feeds you. Some medical journals (not all) ask the authors of scientific papers being published in their journals to disclose any conflicts of interest, usually listed at the end of the article.

• data mining: happens when a research study doesn’t show what researchers or funders wanted, and so they look at subgroups to tweak the data every which way until they get something that looks more positive

• drug reps: sales employees of pharmaceutical companies who visit physicians in order to convince them to prescribe their company’s drugs, or to up the dosage of these drugs

• file drawer effect:  when negative research studies are not submitted for publication

• guest authors: the names of well-known physicians, academics or scientists added to the published list of authors in a journal article even though they did not write the article; often included as a ‘tribute’ to a department chair or the person who successfully arranged funding for the research because the ‘guest author’ gets to take credit for the title on a career list of publications even if he/she didn’t do the work.  See also: medical ghostwriting.

• medical ghostwriting: when someone makes substantial  contributions to a manuscript without being credited. “It is considered bad publication practice in the  medical sciences, and some argue it is scientific misconduct,” according to Danish researcher Dr. Peter Gøtzsche. “At its extreme, medical ghostwriting involves pharmaceutical companies hiring professional writers to produce papers promoting their products-  but hiding those contributions and instead naming academic physicians or scientists as the authors.” See also ‘guest authors’.

• placebo: looks like medicine, but isn’t; used to be called a ‘sugar pill’

• publication bias: when academic or medical journals are less likely to publish negative studies

• shills: this word originally, maybe as far back as 1914, denoted a carnival worker who pretended to be a member of the audience in an attempt to elicit interest in an attraction.  Both illegal and legal gambling industries use shills to make winning at games appear more likely than it actually is. In online forums, shills may express specific opinions in order to further the interests of an organization in which they have an interest, such as an employee, commercial vendor or special interest group. Sometimes shills may be used to downplay legitimate complaints posted by users on the internet forum.

• sock puppetry: an online scam usually seen in community forums or letters to the editors in which people sign on as one user soliciting recommendations for a specific product or service, and then sign on as a different user pretending to be a satisfied customer of a specific company. In many jurisdictions and circumstances, this type of activity may be and should be illegal.

See also:

• Sock Puppetry, Astroturfing and the Marketing Shill Game
• Dr. Harriet Hall Explains Tooth Fairy Science