Todays article is a guest post Catherine Clavering of Kiss Me Deadly.
As a psychologist, particularly one of a therapeutic bent, I never felt much like a scientist. I mean, were fluffy bunnies in the world of вЂњproperвЂќ science, no matter how much we talk about epistemological theory or Feyerabends ideas or squeeze gratuitous Greek letters and geometry style diagrams into our work.
As a lingerie professional, however, Im sometimes quite scared about how little the industry seems to know about what it means to be scientific.
At its heart, science is about argument. You ask a billion questions, come up with an idea, and everyone вЂ“ INCLUDING YOU вЂ“ throws everything they can at it to try and disprove it. Im very lucky that KMD fans seem to have learnt this in their cribs, and so will cheerfully debate you into the ground on why our survey respondents might not represent our core customer group, among other things.
Today, Im going to talk about sampling (because its either that or get a large bruise from hitting myself on the head the next time someone says something stupid about breast health research). No, not the sexy lingerie example sampling, but the choosing a bunch of people to test your idea on kind of sampling. Yes, I know this sounds terribly boring but bear with me, because if you stick with it, you too can have arguments with people on the internet about statistics! Which is everyones idea of a good time, no? Okay, well, alternatively it means youll be able to evaluate whether you really need to get worked up about whether bras cause IBS or not.
The main piece of research Im going to use as an example today was published by the Portsmouth Breast Health Research and is named The Evaluation of Professional Bra Fitting Criteria for Bra Selection and Fitting in the UK. Im using this because Im pretty sure this is the only non-commercial piece of research thats being quoted in all those вЂњ80% of women are wearing the wrong bra size!!!вЂќ things you see.
This research set out to compare two different methods of bra fitting, one was the plus 4 method, and the other is fitting by eye. I could criticise a whole heap of things about their research methods, but lets stick with the sampling. Youll notice that the title of the paper says вЂњIn the UK,вЂќ which one might reasonably assume means they want this research to be relevant to the whole of the UK.
As youve likely guessed, there are quite a few women in the UK. In fact, there are more than 32 million of us according to the 2011 census. Thats a good many to get to try on bras, so of course no research will ever include all of them, just as the census doesnt catch all the people in the country.
Fortunately, because of the Magic Of Statistics (or Gaussian Distribution, if youd like to go and look it up), we dont need to see all of the women to get a good idea of what they are like. We just need to get a really good example set of them. So here are some things to keep in mind when youre getting that example set (i.e. sample) of people.
So how does this research do?
Well, Portsmouth Breast Health Research recruited 45 women.
I bet even the least mathematical amongst you are saying, вЂњIsnt 45 an awful lot less than 32 million?вЂќ
And yes. Yes, it is.
Now, its a very long time since I had to calculate a sample size, and Im sure many of you can do it much better than me, but Im pretty certain that to get a decent sample you need at least 350 people. Furthermore, most research that covers the whole population needs at least 1000 people. So basically, 45 isnt really cutting the mustard.
This is especially true when you consider that all the study participants were from Portsmouth. Now, the UK is tiny and Portsmouth is a pretty nice place, but I can assure you that most people would not be impressed if we, say, let Portsmouth decide major government policies because it seems pretty representative of the rest of the country. Even worse, all the study participants were recruited from university staff and students, who are all likely to be fitted in the same place (and therefore run into the same fit issues).
Moving on, participants were recruited via poster and email. If you wanted to get very picky, its important to know what the emails and posters said, as youll get wildly different samples in response to вЂњNot sure what bra size you are? Help us with our research!вЂќ vs. вЂњWe are looking for women to help test fitting methods for bras.вЂќ Although, you may be wondering, surely if you mention bra fit at all, youre likely to get people who arent happy with their fit? If that was your first thought, give yourself several brownie points because one of the major problems in social science research is that volunteers are atypical! The good news though, is that at least they werent paid to do it.
The researchers managed to recruit women aged from 19 to 58 (average age 32). They also have some means and standard deviations for weight and height, but nothing for socioeconomic status (class and/or income) or ethnicity. They also didnt include anyone who had breast fed or been pregnant in the last year, and Id be interested to know if you thinks thats wise or not!
On the basis of sample size and geographic distribution alone, you cant really use this study to demonstrate much about the UK as a whole in terms of bra fitting, and you certainly cant use it to demonstrate anything about women all over the world. Its also worth noting that theres another study, done by a plastic surgeon on more than 100 women, that found a similar percentage of bra fit issues but in a completely different direction!
Ill stop here, but hopefully, in the future, when you hear someone spout off a statistic in bra marketing, youll think, Where did that number come from and how many people did they use to get it?
Author: Cora Harrington