Forum Settings
       
« Previous 1 2
Reply To Thread

Bad Science?Follow

#1 Apr 29 2014 at 3:21 PM Rating: Excellent
Meat Popsicle
*****
13,666 posts
Well I don't usually post 2 topics in a day, but I felt obligated to question bad data. Well long story made short, I started here: Linky and the topic sounded interesting, especially as a father of two daughters:

Quote:
Simply being called 'fat' makes young girls more likely to become obese: Trying to be thin is like trying to be tall.


Okay, I'll buy that, now why are they saying it. So we read along, link to the summary page, the download the eventual article. Firstly it's a page and a half long letter, with a single table, which is worrisome in itself. Below is the table in which they display their results.

	Source of Labeling, OR (95% CI)	 
	 
Predictor          	Model 1: Anyone  	Model 2: Family	       Model 3: Nonfamily 
Baseline BMI           	1.70 (1.61-1.80)	1.70 (1.61-1.80)	1.72 (1.62-1.82) 
Race                   	1.31 (0.93-1.84)	1.30 (0.93-1.82)	1.32 (0.94-1.86) 
Parental education   	0.73 (0.58-0.93)	0.73 (0.58-0.93)	0.75 (0.59-0.95) 
Household income   	0.76 (0.64-0.89)	0.76 (0.64-0.89)	0.74 (0.63-0.88) 
Age at menarche   	1.01 (0.91-1.12)	1.00 (0.90-1.11)	1.01 (0.91-1.13) 
Baseline labeling   	1.66 (1.20-2.30)	1.62 (1.18-2.22)	1.40 (1.01-1.94) 


Important notes:

1) Higher numbers mean a better correlation
2) The 95% confidence interval is range of values possible given the sampling size, scatter, etc.

The couple of things that irked me are that firstly there is probably a better correlation between baseline BMI (age 10), and final BMI (age 19) than being labelled as fat prior to the study. So first off it's completely within the data to conclude, the better correlation between being fat at 19 is being fat at 10, rather than someone calling you fat. You could even conclude that because the correlation value is lower calling someone "fat" might help lessen their chances of being overweight. Of course all the uncertainty leads me to point number 2 below.

Secondly, the error range is so broad you can't really conclude anything from the data. Seriously, if your confidence intervals overlap, you're supposed to assume you can't tell the difference. Baseline labeling and Baseline BMI should be considered indistinguishable as to which is a better predictor of BMI at the end of the study. This is like community college statistics here people! Smiley: mad

Finally there's no division of the data on Baseline BMI, so there's way to know if people are calling a person "fat" because they're overweight initially, or because they're being evil jerks Not that those are mutually exclusive mind you. Every experiment needs a proper control, how this one didn't have one worked into the data is beyond me. You need to control for known causes in your analysis, and childhood BMI is known to be well correlated with adult BMI.

I'm mean it's like some grad student threw a bunch of data at a SPSS and it didn't pan out. So they had to dream up something to publish because otherwise there was nothing worthwhile to show for a 9-year study. It's not that this isn't real, or isn't a problem, but doing a poor study doesn't help advance anyone's understanding of the issue. All you're really showing with the data is that people call heavier people "fat," and we already knew that.

Seriously, do a proper experiment or GTFO. Smiley: motz

So what do you think?
I think someone pissed in your cheerios or something.:3 (27.3%)
It's obviously a poorly designed study.:4 (36.4%)
No, you're reading the data wrong stupid. Here let me show you how this works...:3 (27.3%)
I have no idea WTF you're talking out.:1 (9.1%)
Total:11


Edit: Okay I feel better now... Smiley: lol

Edited, Apr 29th 2014 2:54pm by someproteinguy
____________________________
That monster in the mirror, he just might be you. -Grover
#2 Apr 29 2014 at 3:47 PM Rating: Excellent
Liberal Conspiracy
*******
TILT
I only glanced over your stuff but I have no problem believing that a poorly done study was picked up because it made for good click-bait. I tend to take singular studies with a grain of salt. Give me some more studies showing the same and we can talk.
____________________________
Belkira wrote:
Wow. Regular ol' Joph fan club in here.
#3 Apr 29 2014 at 3:50 PM Rating: Good
Worst. Title. Ever!
*****
17,302 posts
tl:dr, but

Quote:
Trying to be thin is like trying to be tall.


That's laughable...
____________________________
Can't sleep, clown will eat me.
#4 Apr 29 2014 at 4:23 PM Rating: Excellent
Meat Popsicle
*****
13,666 posts
Jophiel wrote:
I only glanced over your stuff but I have no problem believing that a poorly done study was picked up because it made for good click-bait. I tend to take singular studies with a grain of salt. Give me some more studies showing the same and we can talk.
I think as scientists we have an obligation to repeatedly rant about any potential flaws we find in someone else's work to as many people as possible, regardless of whether or not they care. In many ways it's the best part of the job.

Usually it's something along the lines of "How to heck did this get published when my work wasn't?" Smiley: lol
____________________________
That monster in the mirror, he just might be you. -Grover
#5 Apr 29 2014 at 5:38 PM Rating: Excellent
Avatar
******
29,919 posts
They probably shouldn't have studied a bunch of families of models anyways. Models tend to be ridiculously skinny on account of not eating proper amounts of sandwiches.
____________________________
Arch Duke Kaolian Drachensborn, lvl 95 Ranger, Unrest Server
Tech support forum | FAQ (Support) | Mobile Zam: http://m.zam.com (Premium only)
Forum Rules
#6 Apr 29 2014 at 6:40 PM Rating: Good
They definitely need to employ a more rigorous methodology with a large sample size, but...

When I was a kid, I was called slow and fat. Not just by the other kids, but by the teachers. I was actually pretty average, speed-wise. But I absorbed this idea that I was slow and fat, the turtle of the group. That led to the idea that I was always going to be terrible at sports so I shouldn't even bother trying.

In hindsight, I should have said @#%^ THE HATERS and taken up track or softball anyway. But it's hard to have that kind of attitude when you're a little kid. My parents were totally okay with me being a bookworm instead since the library was free.

Maybe, just maybe, if a coach or one of my parents had said "Wow, you're actually pretty fast/strong/flexible, you should consider pursuing this further" I wouldn't be the person I am today. It's way easier to lose weight as a little kid just starting to get fat than it is to lose as an obese adult.

Edited, Apr 29th 2014 8:40pm by Catwho
#7 Apr 29 2014 at 6:53 PM Rating: Good
******
27,272 posts
I don't give a rat's *** about the topic but it's entertaining to see you all worked up about this Protein, so carry on.
#8 Apr 29 2014 at 11:42 PM Rating: Good
Avatar
*****
13,240 posts
Quote:
The couple of things that irked me are that firstly there is probably a better correlation between baseline BMI (age 10), and final BMI (age 19) than being labelled as fat prior to the study. So first off it's completely within the data to conclude, the better correlation between being fat at 19 is being fat at 10, rather than someone calling you fat. You could even conclude that because the correlation value is lower calling someone "fat" might help lessen their chances of being overweight. Of course all the uncertainty leads me to point number 2 below.


Being previously fat is already a well known indicator of being fat. Same thing with being a previous smoker.

The other thing is, you don't call a skinny person fat.

Edited, Apr 30th 2014 1:43am by Timelordwho
____________________________
Just as Planned.
#9 Apr 30 2014 at 12:47 AM Rating: Excellent
Sage
**
670 posts
Catwho wrote:
They definitely need to employ a more rigorous methodology with a large sample size, but...

When I was a kid, I was called slow and fat. Not just by the other kids, but by the teachers. I was actually pretty average, speed-wise. But I absorbed this idea that I was slow and fat, the turtle of the group. That led to the idea that I was always going to be terrible at sports so I shouldn't even bother trying.

In hindsight, I should have said @#%^ THE HATERS and taken up track or softball anyway. But it's hard to have that kind of attitude when you're a little kid. My parents were totally okay with me being a bookworm instead since the library was free.

Maybe, just maybe, if a coach or one of my parents had said "Wow, you're actually pretty fast/strong/flexible, you should consider pursuing this further" I wouldn't be the person I am today. It's way easier to lose weight as a little kid just starting to get fat than it is to lose as an obese adult.

Edited, Apr 29th 2014 8:40pm by Catwho

I remember wanting to play football at the park district with the rest of my friends when I was maybe 8. The coach basically told me I was too fat to play with the rest of the kids. I said F that and haven't cared about sports in the 30 years since.
#10 Apr 30 2014 at 6:33 AM Rating: Good
Skelly Poker Since 2008
*****
16,781 posts
I don't have enough information.

Also work sucks today. Calgon ...take me awaaayyyyyyyyy.
____________________________
Alma wrote:
I lost my post
#11 Apr 30 2014 at 7:27 AM Rating: Good
*******
50,767 posts
someproteinguy wrote:
Quote:
Simply being called 'fat' makes young girls more likely to become obese: Trying to be thin is like trying to be tall.
That while some people are predisposed to being tall, that some if not most people can be tall through exercise and diet?
____________________________
George Carlin wrote:
I think it’s the duty of the comedian to find out where the line is drawn and cross it deliberately.
#12 Apr 30 2014 at 7:41 AM Rating: Good
Skelly Poker Since 2008
*****
16,781 posts
I always thought I was kind of small due to genetics, but I did get called 'little' a lot as kid.

Losers.....
____________________________
Alma wrote:
I lost my post
#13 Apr 30 2014 at 9:55 AM Rating: Excellent
Meat Popsicle
*****
13,666 posts
His Excellency Aethien wrote:
I don't give a rat's *** about the topic but it's entertaining to see you all worked up about this Protein, so carry on.
It's because they were wrong! Smiley: motz

Timelordwho wrote:
Being previously fat is already a well known indicator of being fat. Same thing with being a previous smoker.

The other thing is, you don't call a skinny person fat.
Yeah, basically that. They didn't make any effort to separate out people who were overweight before they were called fat from those who weren't. You can't make the claims they were making without that data.

lolgaxe wrote:
someproteinguy wrote:
Quote:
Simply being called 'fat' makes young girls more likely to become obese: Trying to be thin is like trying to be tall.
That while some people are predisposed to being tall, that some if not most people can be tall through exercise and diet?
Exactly, if you want to be tall use those neck ring things that one tribe uses in Africa or wherever. Then throw on a pair of high heels and hang out with shorter people.

Kids these days, they don't even try... Smiley: disappointed
____________________________
That monster in the mirror, he just might be you. -Grover
#14 Apr 30 2014 at 2:31 PM Rating: Decent
Encyclopedia
******
35,568 posts
Is this where I point out what field of study this falls under? Color me not surprised.
____________________________
King Nobby wrote:
More words please
#15 Apr 30 2014 at 2:33 PM Rating: Good
*******
50,767 posts
gbaji wrote:
Is this where I point out what field of study this falls under?
Didn't realize it was being-wrong-o-clock.
____________________________
George Carlin wrote:
I think it’s the duty of the comedian to find out where the line is drawn and cross it deliberately.
#16 Apr 30 2014 at 3:30 PM Rating: Excellent
Will swallow your soul
******
29,360 posts
Psychology, according to the article.
____________________________
In a time of universal deceit, telling the truth is a revolutionary act.

#17 Apr 30 2014 at 3:38 PM Rating: Excellent
Meat Popsicle
*****
13,666 posts
It was an "online first" publication from the American Medical Association's Pediatrics Journal. Or, you know, kids these days... Smiley: clown

Clearly gbaji is biased against pediatric medicine. Smiley: disappointed
____________________________
That monster in the mirror, he just might be you. -Grover
#18 Apr 30 2014 at 5:10 PM Rating: Decent
Encyclopedia
******
35,568 posts
someproteinguy wrote:
It was an "online first" publication from the American Medical Association's Pediatrics Journal. Or, you know, kids these days... Smiley: clown

Clearly gbaji is biased against pediatric medicine. Smiley: disappointed


I'm biased against poor interpretation of data (which is precisely what you were complaining about) and have noticed a trend with regards to which fields tend to do this more than others.
____________________________
King Nobby wrote:
More words please
#19 Apr 30 2014 at 5:14 PM Rating: Good
Ghost in the Machine
Avatar
******
36,443 posts
Poll option wrote:
No, you're reading the data wrong stupid. Here let me show you how this works...


This is real science!

                             ,|      
                             //|                              ,| 
                           //,/                             -~ | 
                         // / |                         _-~   /  , 
                       /'/ / /                       _-~   _/_-~ | 
                      ( ( / /'                   _ -~     _-~ ,/' 
                       \~\/'/|             __--~~__--\ _-~  _/, 
               ,,)))))));, \/~-_     __--~~  --~~  __/~  _-~ / 
            __))))))))))))));,>/\   /        __--~~  \-~~ _-~ 
           -\(((((''''(((((((( >~\/     --~~   __--~' _-~ ~| 
  --==//////((''  .     `)))))), /     ___---~~  ~~\~~__--~  
          ))| @    ;-.     (((((/           __--~~~'~~/ 
          ( `|    /  )      )))/      ~~~~~__\__---~~__--~~--_ 
             |   |   |       (/      ---~~~/__-----~~  ,;::'  \         , 
             o_);   ;        /      ----~~/           \,-~~~\  |       /| 
                   ;        (      ---~~/         `:::|      |;|      < > 
                  |   _      `----~~~~'      /      `:|       \;\_____//  
            ______/\/~    |                 /        /         ~------~ 
          /~;;.____/;;'  /          ___----(   `;;;/                
         / //  _;______;'------~~~~~    |;;/\    /           
        //  | |                        /  |  \;;,\               
       (<_  | ;                      /',/-----'  _> 
        \_| ||_                     //~;~~~~~~~~~  
            `\_|                   (,~~  
                                    \~\  
                                     ~~ 


Edited, May 1st 2014 1:15am by Mazra
____________________________
Please "talk up" if your comprehension white-shifts. I will use simple-happy language-words to help you understand.
#20 Apr 30 2014 at 5:56 PM Rating: Excellent
Meat Popsicle
*****
13,666 posts
gbaji wrote:
someproteinguy wrote:
It was an "online first" publication from the American Medical Association's Pediatrics Journal. Or, you know, kids these days... Smiley: clown

Clearly gbaji is biased against pediatric medicine. Smiley: disappointed


I'm biased against poor interpretation of data (which is precisely what you were complaining about) and have noticed a trend with regards to which fields tend to do this more than others.
LIES. Smiley: mad
____________________________
That monster in the mirror, he just might be you. -Grover
#21 Apr 30 2014 at 6:30 PM Rating: Decent
Encyclopedia
******
35,568 posts
someproteinguy wrote:
gbaji wrote:
someproteinguy wrote:
It was an "online first" publication from the American Medical Association's Pediatrics Journal. Or, you know, kids these days... Smiley: clown

Clearly gbaji is biased against pediatric medicine. Smiley: disappointed


I'm biased against poor interpretation of data (which is precisely what you were complaining about) and have noticed a trend with regards to which fields tend to do this more than others.
LIES. Smiley: mad


So your field does this just as frequently as the fields of psychology and sociology? I mean, if you want to put yourself and your peers down like that, go ahead. But I'd think you'd have at least some pride in working in a more hard science as opposed to that pseudo-science stuff they do. I mean, c'mon, they don't even like put stuff in beakers or anything!
____________________________
King Nobby wrote:
More words please
#22 Apr 30 2014 at 6:31 PM Rating: Excellent
*******
50,767 posts
gbaji wrote:
I'm biased against poor interpretation of data
The ****, you're literally the poster child of bias data interpretation.
____________________________
George Carlin wrote:
I think it’s the duty of the comedian to find out where the line is drawn and cross it deliberately.
#23 Apr 30 2014 at 6:39 PM Rating: Excellent
Liberal Conspiracy
*******
TILT
I've been told that if you just unskew these numbers they'll say exactly what I desperately wish they'd say -- I'm data driven!!
____________________________
Belkira wrote:
Wow. Regular ol' Joph fan club in here.
#24 Apr 30 2014 at 7:47 PM Rating: Decent
Encyclopedia
******
35,568 posts
lolgaxe wrote:
gbaji wrote:
I'm biased against poor interpretation of data
The @#%^, you're literally the poster child of bias data interpretation.


Literally.
____________________________
King Nobby wrote:
More words please
#25 Apr 30 2014 at 8:52 PM Rating: Good
GBATE!! Never saw it coming
Avatar
****
9,957 posts
gbaji wrote:
lolgaxe wrote:
gbaji wrote:
I'm biased against poor interpretation of data
The @#%^, you're literally the poster child of bias data interpretation.
Literally.
It is pretty obvious.
____________________________
remorajunbao wrote:
One day I'm going to fly to Canada and open the curtains in your office.

#26 Apr 30 2014 at 9:46 PM Rating: Excellent
Meat Popsicle
*****
13,666 posts
gbaji wrote:
someproteinguy wrote:
gbaji wrote:
someproteinguy wrote:
It was an "online first" publication from the American Medical Association's Pediatrics Journal. Or, you know, kids these days... Smiley: clown

Clearly gbaji is biased against pediatric medicine. Smiley: disappointed


I'm biased against poor interpretation of data (which is precisely what you were complaining about) and have noticed a trend with regards to which fields tend to do this more than others.
LIES. Smiley: mad


So your field does this just as frequently as the fields of psychology and sociology? I mean, if you want to put yourself and your peers down like that, go ahead. But I'd think you'd have at least some pride in working in a more hard science as opposed to that pseudo-science stuff they do. I mean, c'mon, they don't even like put stuff in beakers or anything!
Well, it's not particle physics, that much is sure. That coming from the one member of our lab who spent some 30 years working for the physics dept. at UC Berkley of course. There's a different threshold for discovery, and work isn't nearly as well vetted in medical research as in other fields. Which is a scary thought.

I don't know, thresholds for discovery is are one thing, but if you're really onto something it doesn't really matter what statistical test you throw at it. For my two cents there's more people and money in the field than good ideas. You got probably 90% of the good quality work done by 10% of the labs, and most of the rest mainly second tier (or worse) scientists chasing the leftover ideas. I'd take money out of thing like cancer and drug research and put it into more basic science funding. Applied research only functions properly when there's a big pool of basic knowledge to pull ideas from, and that pool feels mighty shallow sometimes. We'd benefit from a broader base when trying to build that ivory tower so high.

For what it's worth though, it'll never happen. People want to donate their money to fighting the big name diseases, not cataloging rocks in some random corner of the world. Would be nice if they were getting more bang for their buck, but who am I to judge. After all they're helping fund my position. Smiley: rolleyes
____________________________
That monster in the mirror, he just might be you. -Grover
« Previous 1 2
Reply To Thread

Colors Smileys Quote OriginalQuote Checked Help

 

Recent Visitors: 399 All times are in CST
Anonymous Guests (399)