[slim_seo_breadcrumbs display_current=false]

Understanding Statistics & Reading Studies

Introduction & Relevance to Fitness Goals

In the vast realm of health and fitness, there’s an overwhelming abundance of information. Much of this comes in the form of tips, tricks, trends, and miracle cures, often with little to no scientific backing. This can lead to a confusing and, at times, dangerous landscape for individuals seeking to improve their health and fitness. Evidence-based, scientifically sound information should be the cornerstone of any fitness plan. It’s not just about the effectiveness of your workout routine or diet plan, it’s also about your long-term health and well-being. Relying on unverified claims or poorly understood statistics can result in suboptimal outcomes or even harm. It’s vital to equip ourselves with the right understanding and skills to discern the truth amidst the noise. Hence, the need for this page – a guide to understanding scientific studies and statistical interpretation in the context of health and fitness

I vividly recall my initial excitement as a fresh psychology student at university, eager to explore the captivating world of social psychology. However, my expectations took an unexpected turn on the first day when we plunged into the world of statistics instead. My initial disappointment quickly surfaced, but our lecturer explained something vital: without the ability to discern the legitimacy of studies and truly understand their findings, there would be little point in examining research in psychology, and even less in trying to apply methodology unless we knew what it was rooted in.

Initially, I struggled to reconcile the heavy mathematical focus in what I assumed would be a largely qualitative field, it all seemed a little mundane. However, over time, I grew to appreciate this unexpected journey into the intricate world of statistics. The skills I cultivated in reading and interpreting studies proved invaluable, empowering me to make well-informed decisions that have shaped both my personal and professional life

This appreciation and understanding of statistics play a vital role in the health and fitness industry as well. In a world where new studies and data are continuously presented to us, and usually not by researchers, but by media outlets that are forced to deliver brief and compelling headlines and snippers. This makes being able to decipher and critique this information a powerful tool. Understanding the “why” and “how” behind studies can drastically influence how we apply their findings to our lives. It empowers us to make informed decisions about our health, exercise routines, and nutrition.

In this pursuit of empowering knowledge, three resources stand out. Peter Attia’s “Studying Studies” series demystifies the complex world of research papers, helping laypersons understand how studies are conducted, and more importantly, how to interpret them. “Bad Science” by Ben Goldacre delves into the misuse of science and statistics by various industries, teaching us to be skeptical and thoughtful consumers of information. Finally, “How to Lie with Statistics” by Darrell Huff provides an illuminating exploration of how statistics can be manipulated, showcasing the importance of a discerning eye. These resources guide the discourse throughout this page, as we dive deeper into the relevance of understanding statistics for effective health and fitness decisions.

The Importance of Evidence-Based Information

In our quest for better health and fitness, we often encounter an overwhelming amount of information. Every day, new workout routines, diet trends, and health products for example nutritional supplements promise us rapid transformations and unparalleled benefits. However, it’s crucial to recognise the importance of basing our health choices on credible, evidence-based information, not just aggressive marketing.

In our pursuit of health and fitness, the myriad of diet options available to us can seem overwhelming. Studies abound endorsing various diets – one research might indicate remarkable weight loss success with a ketogenic diet, while another espouses the benefits of a plant-based diet. This, however, does not imply that one diet is universally superior or that a specific nutrient, such as carbohydrates, should be entirely excluded from a weight loss program by definition.

It’s crucial to understand that the context and individual differences matter significantly when it comes to diet. What works excellently for one person may not yield the same results for another due to genetic, metabolic, and lifestyle differences. Furthermore, not all carbohydrates impact our bodies in the same way. Different types of carbs can vary greatly in their effects, especially when considering factors like the glycemic index.

Hence, it is not about finding a one-size-fits-all diet but about discovering what works best for you as an individual. This discovery process involves understanding your body, examining reliable studies, and perhaps even a bit of trial and error. Being equipped with an understanding of scientific studies and statistics can empower you to make the best decisions for your health. 

I’d like to share a personal experience that highlights the importance of understanding individual health needs. A member of my family has a gene mutation that leads to a condition where his body absorbs too much iron, potentially affecting several organs. Fortunately, he can manage it effectively by donating blood regularly.

One day, my relative decided to boost his health and came across an article that suggested Vitamin C could enhance immunity. While this is may be generally true, the piece didn’t mention that Vitamin C also boosts iron absorption. So, for someone like my dad, who needs to limit iron intake, taking Vitamin C could inadvertently worsen his condition while trying to improve another aspect of his health.

Further down the line, my relative decided to adopt a largely plant-based diet. The idea was to avoid heme-iron, a form of iron found only in animal products and more readily absorbed by the body than non-heme iron which is found in plant-based foods. This dietary shift turned out to be beneficial for him not curing the condition but effectively cutting off the source of the nutrient that would exacerbate it.

Now, consider another individual with a history of anemia due to genetic factors or heavy menstrual cycles. Let’s say they hear about my relative’s improved sense of health with a plant-based diet and decide to try it out. Now, the very same absence of heme-iron in their new diet that benefited my relative could actually worsen their anemia, leading to symptoms like severe fatigue. 

So in this scenario, despite following what’s generally considered a ‘healthy’ diet, they might find themselves feeling worse.

The takeaway here is that health is highly individual, and there’s no universal ‘best’ diet or health regimen. The more you can learn about your own body and its unique needs, the better you can tailor your lifestyle to support your health.

Scientific studies also provide insight into the safety and efficacy of various exercise routines and health products. Through rigorous, controlled experiments, they offer us objective measurements and outcomes, allowing us to evaluate the pros and cons. A carefully designed research study can unveil the nuances of how certain workouts might be beneficial for some but not others, based on factors such as age, sex, or pre-existing health conditions. This allows for tailored, effective fitness regimens.

Moreover, misinformation and pseudoscience can be harmful, leading to wasted time, resources, and potentially adverse health consequences. Consider, for example, the countless “miracle cures” or “quick fixes” that flood the market. These products often lack robust scientific backing, instead, they rely on anecdotal evidence, personal testimonials, or manipulated data. They promise spectacular results with minimal effort, capitalising on our desire for easy solutions. But in reality, they often underdeliver, and in some cases, can even be harmful.

Take, for instance, the case of weight loss supplements, in the form of diet pills. Many such products promise rapid weight loss without the need for dieting or exercising. Yet, not only do most of these supplements fail to deliver on their promises, but they can also have dangerous side effects. Misleading marketing, manipulated statistics, and a lack of proper scientific validation can lead to these harmful outcomes. From my view, there is also a huge opportunity cost in seeking to achieve body composition changes through mechanisms that basically can’t be surmised as hard work and dedication, I say that because part of the challenge particularly in weight loss, is not just about getting results, but also developing the habits and personal development to maintain your results, so if that entire process is circumvented with a pill it’s easy to see why results would be temporary at best.

In essence, a strong understanding of science-backed information empowers us to navigate the complex world of health and fitness more effectively. It allows us to differentiate between valid, beneficial health advice and misleading, potentially harmful misinformation. In the following sections, we will delve deeper into the tools and knowledge you need to make this distinction, providing a solid foundation for better health and fitness decisions.

Understanding & Interpreting Statistics

Statistics form the backbone of scientific studies, allowing us to quantify, analyze, and interpret data. They act as the bridge between raw data and informed decisions, turning abstract numbers into meaningful insights. Consequently, understanding and accurately interpreting statistical data is crucial when considering health and fitness advice based on scientific studies.

When we talk about statistics in scientific studies, there are a few key terms and concepts that often come up. The term ‘variable’ refers to any characteristic or attribute that can be measured, such as weight, heart rate, or dietary intake. In health and fitness studies, the variables are often the specific aspects of our health or fitness that the study is looking to explore.

‘Samples’ are a subset of a larger population that is used in the study. For instance, if a study wanted to explore the impact of a new diet on weight loss, the sample might be a group of individuals following that diet.

The ‘mean’ or average is a measure of central tendency, which gives us a general sense of the ‘typical’ value in a set of data. Other measures of central tendency include the median (the middle value in a sorted list of data) and the mode (the most frequently occurring value).

Understanding these terms is the first step toward interpreting statistical data. However, it’s equally crucial to be aware of common errors that can occur in this process. Darrell Huff’s “How to Lie with Statistics” provides excellent examples of these.

For instance, one might be misled by a study if they overlook the sample size. A small sample size can skew results and make them less reliable, how, where, and why that sample was collected may also play significant factors. Similarly, correlation does not imply causation – just because two variables appear to be linked, it doesn’t mean one caused the other.

To illustrate, let’s consider a hypothetical example: a headline claims that “People who drink four cups of coffee a day live longer.” Upon reading the study, you might find that the sample size was very small, or that the researchers did not account for other lifestyle factors such as exercise, diet, or smoking. In this case, the statistical data might be misleading, as it oversimplifies the complex relationship between coffee consumption and longevity.

To play with the idea a little bit, let’s say you represent a coffee company and want to make the case that more coffee leads to a healthier, longer life. Among the populations that might drink a lot of coffee, you could look for regions of the world where it’s culturally reinforced to sit, talk and relax with loved ones over a coffee, Italy for example. Or you could seek out long-distance lorry drivers traversing the United States who may use coffee more to relieve boredom and fight fatigue on long grueling drives. Knowing what we know about the role community plays in health, and the potential benefits of the Mediterranean diet, plus what we know about the detrimental effects of a sedentary lifestyle, night shifts, and eating and drinking outside of the body’s natural circadian rhythms, which group would you include in your study? This is why understanding the intricacies of a study is so crucial. 

To better understand and interpret statistical data, it can be beneficial to practice with interactive examples or simple exercises. Try reading a health or fitness study and pay attention to the variables, the sample size, and the measures of central tendency. Look for potential biases, confounding variables, or other issues that might affect the study’s validity. With practice, you’ll become more adept at discerning reliable, evidence-based information from potentially misleading data. As I highlighted with my coffee example, a great place to start is by asking the question, “Who paid for the study?”

Accuracy is also important. Let’s take an example from my own work as an online personal trainer. I often suggest that my clients do their light activity at a heart rate of between 100-120 beats per minute as it’s likely to be better for burning fat as a fuel source. Often I am told on my clients’ accountability calls that “I’m doing what you asked my average heart rate was 120BPM (for example).  However, to arrive at an average heart rate of 120, a significant amount of time would necessarily have been spent training outside of the range I suggested. Whilst it on the surface this doesn’t seem like a big deal, training at the higher heart range could mean less time spent using fat as a primary fuel source and accumulating more fatigue than I had planned for in how I created the program, expand this over 3,6We  or 12 months and it’s a major deviation from what was intended.

Remember, the aim here is not to turn you into a statistician, but rather to equip you with the tools and understanding necessary to interpret health and fitness information critically and accurately. The better we understand statistics, the better we can use them to guide our health and fitness choices.

Reading and Understanding Scientific Studies

The importance of being able to critically analyse and understand scientific studies cannot be understated. It’s crucial to realise that not all studies are created equal. The quality, depth, and validity of research can vary significantly, making discerning analysis indispensable for informed decision-making.

When engaging with a scientific study, several key components warrant your attention. An understanding of these sections will form a roadmap, helping you navigate and interpret the research.

First, the ‘abstract’ provides a brief overview of the study, including the purpose, methodology, key findings, and conclusions. Reading the abstract can help you decide whether the study is relevant and worth your time. However, it’s also the section most likely to contain embellished claims or oversimplifications to make the study seem more impactful, so it’s crucial not to base your understanding solely on the abstract.

Next, the ‘methodology’ or ‘methods’ section outlines how the study was conducted. This section is vital as it gives you an idea of the study’s reliability. It provides details about the sample size, the process of data collection, and how the variables were controlled or measured. A well-conducted study will have a clear and detailed methodology that can be replicated by other researchers.

The ‘results’ section presents the study’s findings, often accompanied by statistical analyses. This section requires careful reading and an understanding of the statistical concepts we previously discussed. Remember, correlation does not imply causation, and not all statistically significant results are practically significant. 

Finally, the ‘conclusion’ or ‘discussion’ section interprets the results in the context of the research question or hypothesis. It often includes the study’s limitations, suggestions for future research, and the potential implications of the findings. Be cautious of studies that make broad generalisations or extrapolate their findings beyond what the data support.

Understanding the peer-review process is another essential aspect of interpreting scientific research. Peer review is a quality control measure wherein other experts in the field review a study before publication. It ensures that the methodology is sound, the results are interpreted correctly, and the conclusions are justified. However, it’s not infallible; flawed studies can and do slip through.

A critical examination of scientific studies must also acknowledge common issues that can affect a study’s validity, such as small sample sizes, biased sampling, and confounding factors. Ben Goldacre’s “Bad Science” offers numerous examples of these problems. For instance, a study might overlook a crucial confounding factor, giving the illusion of causation when there is none.

Developing the skill to read and interpret scientific studies is not an overnight process. It requires patience, practice, and a discerning mind. However, the ability to critically analyse research gives you control over your health and fitness decisions, allowing you to separate fact from fiction and make choices grounded in reliable, evidence-backed science. Remember, true empowerment comes from understanding, and understanding stems from education. As you continue on with your health and fitness 

journey, this understanding will serve as your compass, guiding you toward informed and effective choices.

Petter Attia: Studying Studies

In the realm of health and wellness, Dr. Peter Attia is a recognised authority. He’s particularly known for his ability to distill complex scientific studies into understandable, actionable insights. His approach to evaluating scientific studies, as presented in his “Studying Studies” series, provides a robust framework that anyone can use to comprehend and interpret research.

Attia’s methodical process emphasises a few crucial points. First, he insists on considering the study type. Not all studies hold equal weight, and understanding the inherent strengths and limitations of each type — from randomised controlled trials to observational studies — is vital.

Next, Attia highlights the importance of scrutinising a study’s methodology. He pays careful attention to the sample size, controls, blinding, and statistical analyses used. He emphasises looking out for sources of bias, such as selection bias or funding bias. He scrutinises the outcome measures used in the study, cautioning against surrogate markers that may not represent meaningful, real-world outcomes.

Attia also underscores the need for careful interpretation of study results. He’s quick to point out that statistical significance does not always mean clinical or practical significance. Moreover, he warns against the common error of confusing correlation with causation. He consistently encourages looking at the totality of the evidence, understanding that one study is just a single piece in a larger puzzle. This is particularly pertinent to the world of health & fitness, where health-oriented changes usually come in clusters, i.e an individual let’s say in January for obvious reasons might start exercising, change their diet, meaning they stop eating some things they have been and introduce new things they haven’t been and perhaps also start taking a number of supplements. It would be an easy mistake to make to draw the conclusion that a resulting health benefit was from any one of the new factors when it was likely a product of the composite. 


Let’s take a hypothetical situation. Imagine you’re someone who’s been relying on microwave dinners every night – the roast turkey meal being your favorite. Regular exercise is not part of your routine. But then, you stumble upon some intriguing information about the benefits of a pescatarian diet.

You’re at a stage in your life where you’re tired of sidelining your health. So you decide to embrace change. You start to practice evening meditation for stress management, cook your own seafood meals each night, enjoy daily walks in the sunshine, and even begin regular workouts with a personal trainer. After six weeks, you find yourself 10 lbs lighter, with added muscle, and you’re feeling fantastic.

Now, was it the lack of turkey that led to these positive changes? It’s highly unlikely. Statistically, there might be a correlation between your ditching the turkey dinners and your health improvements. This could potentially be an appealing fact for a seafood restaurant to highlight. However, the reality is that you could have introduced all these healthy habits and still enjoyed an occasional homemade turkey roast without hindering your progress. The turkey wasn’t necessarily the problem; it was the context – the unhealthy lifestyle in which the turkey dinners were just one factor.

This is why really sitting and thinking dietary changes through before making them is essential, especially if they are going to be rigid enough to rule out a number of foods and ingredients moving forward.

Lastly, Attia’s approach is imbued with humility and curiosity. He recognises that science is a process of learning and unlearning, and he is open to changing his mind when faced with compelling new evidence. He also emphasises the importance of asking good questions, recognising that the process of inquiry is just as important as the answers obtained.

Attia’s approach is highly applicable in real-world scenarios. For instance, when faced with a sensationalised news headline about the latest health study, you can use his framework to assess the research’s validity. Or when making decisions about your personal health and fitness, you can apply his principles to evaluate the evidence supporting different approaches.

In conclusion, Peter Attia’s “Studying Studies” is an invaluable guide for anyone who wants to interpret scientific studies with greater accuracy and confidence. His methodical, skeptical, and curious approach empowers us to navigate the complex world of scientific research, enabling us to make health and fitness decisions that are grounded in evidence and personal context. It’s not merely about accepting or rejecting studies outright, but rather about developing a nuanced understanding of the evidence, asking insightful questions, and maintaining an open yet critical mind.

The Power of Discernment

In a world filled with information at our fingertips, discernment becomes an essential skill. It’s particularly important when interpreting and applying scientific information related to health and fitness. The ability to discern between high-quality, evidence-based information and misinformation, anecdotal claims, or commercial interests can make a world of difference in how you approach your wellness journey.

Discernment involves a critical examination of sources, rigorous fact-checking, and a readiness to question any health claim before accepting it as valid. Remember, just because a piece of information is popular or widely shared does not mean it’s correct. Learn to verify the sources of your information. Is the claim backed by peer-reviewed research? Is the source reputable and reliable? Is there any potential conflict of interest?

Consider this real-world example. The Internet is rife with articles and influencers claiming that specific superfoods can “boost” your immune system. However, a discerning reader would recognise that the immune system is complex and can’t simply be “boosted” by one food item, as if in a computer game. This understanding can save one from costly, ineffective purchases based on misleading health claims.

Another instance where discernment proves vital is in the context of dietary trends. Every few years, a new diet becomes a trend, promising quick weight loss or health benefits. However, long-term studies often reveal a different story, highlighting potential health risks or sustainability issues. Understanding the difference between a dietary trend and a balanced, sustainable eating habit can safeguard your health. Personally, I like to consider a program effective only after results can be maintained, if the route to ‘effective’ is unsustainable it’s not really fit for the purpose of year-round results, which is how I work.

Again, this is where discernment comes into play. There is a big difference between getting in the kind of shape you can reasonably maintain year round with a degree of flexibility and the kind of routines and restriction it takes to ‘peak’ for a bodybuilding competition or photoshoot. This means if you are being sold that kind of short-term methodology as a long-term solution you will soon find yourself in no man’s land without any real sustainable habits shortly after the program. To be clear, it’s not that those practices don’t work, it’s that they were developed for specific circumstances and never meant to be sustained beyond the ‘peak’ event, so if you are being sold them as a new year-round lifestyle, that’s a huge disconnect and simply isn’t going to work. Always remember if you are seeking a permanent solution via impermanent means, you can only fail. 

It’s crucial to remember that health and wellness are not one-size-fits-all. What works well for one person may not work for another. Therefore, discernment also involves understanding your unique body, needs, and context. It’s about being able to apply scientific information in a personalised way that respects your individual health status, preferences, and goals.

Consider this scenario: If you asked me to identify the most effective muscle-building program, I’d likely suggest German Volume Training with its ten sets of ten, often paired in supersets. However, even if it’s technically the “best” program, it’s not a one-size-fits-all solution. Why? Because it’s a rigorous and mentally challenging regimen. For many, it could be overwhelming, difficult to recover from, or simply too repetitive to stick with causing psychological fatigue. In this situation, the “best” muscle-building program becomes ineffective in the wrong context, and most people would benefit more from a slightly less intense, but more sustainable, program.

Let’s draw a similar parallel with fat loss. Hill sprints can be incredibly effective for burning fat, but even seasoned athletes approach them with a degree of caution. Imagine giving this exercise to someone who has taken a lengthy break from working out. The daunting nature of hill sprints could be demotivating, rendering their effectiveness moot. It would be better to start with a less intense, but more manageable routine to promote consistent engagement.

An analogy outside the realm of fitness would be teaching a seventeen-year-old to drive. If we want them to be the best driver, it doesn’t mean we should start their lessons in a Formula 1 car. Even though it’s one of the “best” vehicles, it’s not appropriate for a beginner. The message here is that the most powerful tools can become obstacles if they are not suited to the individual’s current abilities or circumstances. It all comes down to context.

In conclusion, the power of discernment is a tool that allows us to navigate the ocean of information with a discerning eye, separating fact from fiction, and empowering us to make informed decisions about our health and wellness. Being able to analyse and critically evaluate the information we encounter daily is a vital skill for anyone interested in taking control of their health. This discernment, coupled with a solid understanding of scientific studies, will form a formidable foundation for your health and wellness journey.

Conclusion

We embarked on this journey to shed light on the importance of understanding statistics and embracing accurate, science-backed information in the realm of health and fitness. We’ve delved into why evidence-based information is essential in debunking health myths and making informed health decisions. We’ve explored the crucial role of statistics in scientific studies and learned how to critically interpret these data. We’ve learned about the structure and analysis of scientific studies and even delved deep into Peter Attia’s “Studying Studies” series. Finally, we’ve highlighted the power of discernment in evaluating and applying scientific information.

Being equipped with the knowledge and understanding to interpret and apply scientific studies empowers us in a way few things can. It allows us to sift through the vast array of information out there, discern what is useful and relevant to our personal health journeys, and make informed decisions that align with our individual health and wellness goals.

Remember, your health is your responsibility, and arming yourself with the right knowledge and understanding is one of the best ways to take charge. It’s not always easy; it requires effort, time, and a willingness to delve deep into the science behind health claims. But the payoff is worth it: a more informed, empowered, and healthy you.

Here at scottlaidler.com our mission remains steadfast in promoting accurate, science-backed health information, and we hope this page has given you the tools to discern, analyse, and apply health and fitness data effectively. 

We invite you to continue this journey of learning and empowerment by exploring other resources on our website. Knowledge is power, and in the realm of health and fitness, it’s a power that can profoundly impact your quality of life. Let’s continue on this path of informed health and fitness together.

Online Resources

If you want to dig into some studies that may inform your health & fitness decisions or simply want to practice coming to terms with the structure of studies and practice the newfound tools of discernment this article may have given you. 

  • Google Scholar (scholar.google.com): A freely accessible web search engine that indexes the full text of scholarly literature across an array of publishing formats and disciplines.
  • PubMed (pubmed.ncbi.nlm.nih.gov): A free search engine accessing primarily the MEDLINE database of references and abstracts on life sciences and biomedical topics.
  • PLOS ONE (journals.plos.org/plosone/): An inclusive journal community working together to advance science for the benefit of society, now and in the future.
  • Cochrane Library (cochranelibrary.com): A collection of high-quality, independent evidence to inform healthcare decision-making.
  • BioRxiv (www.biorxiv.org): A free online archive and distribution service for unpublished preprints in the life sciences.
  • Khan Academy (www.khanacademy.org): Offers practice exercises, instructional videos, and a personalized learning dashboard for many subjects including statistics.
  • Gapminder (www.gapminder.org): Promotes a fact-based worldview everyone can understand. They turn complicated data and statistics into clear, understandable graphs.
  • Explorable (explorable.com): Provides numerous articles explaining various aspects of scientific studies, including statistical analysis.
  • Towards Data Science (towardsdatascience.com): A Medium publication sharing concepts, ideas, and codes in the field of data science.
  • StatsDirect (www.statsdirect.com): Although it’s a paid service, it provides an understandable statistics guide for non-statisticians.

About the author

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Ut elit tellus, luctus nec ullamcorper mattis, pulvinar dapibus leo.

Get a personalized workout plan in minutes.

Let’s get rid of what’s bothering you the most about your body once and for all. Whatever it is, after 12+ years of bespoke fitness coaching I simply know what works. I promise.