{"id":76,"date":"2020-04-29T13:56:33","date_gmt":"2020-04-29T13:56:33","guid":{"rendered":"https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/?post_type=chapter&#038;p=76"},"modified":"2022-04-20T14:59:35","modified_gmt":"2022-04-20T14:59:35","slug":"analyzing-findings","status":"publish","type":"chapter","link":"https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/chapter\/analyzing-findings\/","title":{"raw":"Analyzing Findings","rendered":"Analyzing Findings"},"content":{"raw":"<div class=\"PageContent-ny9bj0-0 iapMdy\">\r\n<div id=\"main-content\" class=\"MainContent__HideOutline-sc-6yy1if-0 bdVAq\">\r\n<div id=\"44e86fdd-1b17-4e86-8c8b-945230d8133a\">\r\n<div id=\"47813\" class=\"ui-has-child-title\"><header>\r\n<div class=\"textbox textbox--learning-objectives\"><header class=\"textbox__header\">\r\n<p class=\"textbox__title\"><span style=\"color: #ffffff\">Learning Objectives<\/span><\/p>\r\n\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\nBy the end of this section, you will be able to:\r\n<ul>\r\n \t<li>Explain what a correlation coefficient tells us about the relationship between variables<\/li>\r\n \t<li>Recognize that correlation does not indicate a cause-and-effect relationship between variables<\/li>\r\n \t<li>Discuss our tendency to look for relationships between variables that do not really exist<\/li>\r\n \t<li>Explain random sampling and assignment of participants into experimental and control groups<\/li>\r\n \t<li>Discuss how experimenter or participant bias could affect the results of an experiment<\/li>\r\n \t<li>Identify independent and dependent variables<\/li>\r\n<\/ul>\r\n<\/div>\r\n<\/div>\r\n<p id=\"fs-idm9597360\" class=\"indent no-indent\">Did you know that as sales in ice cream increase, so does the overall rate of crime? Is it possible that indulging in your favourite flavour of ice cream could send you on a crime spree? Or, after committing crime do you think you might decide to treat yourself to a cone? There is no question that a relationship exists between ice cream and crime (e.g., Harper, 2013), but it would be pretty foolish to decide that one thing actually caused the other to occur.<\/p>\r\n<p id=\"fs-idm8747152\">It is much more likely that both ice cream sales and crime rates are related to the temperature outside. When the temperature is warm, there are lots of people out of their houses, interacting with each other, getting annoyed with one another, and sometimes committing crimes. Also, when it is warm outside, we are more likely to seek a cool treat like ice cream. How do we determine if there is indeed a relationship between two things? And when there is a relationship, how can we discern whether it is attributable to coincidence or causation?<\/p>\r\n\r\n<section id=\"fs-idm28272816\">\r\n<h3>Correlational Research<\/h3>\r\n<strong><a id=\"TTcorrelational\"><\/a>TRICKY TOPIC: CORRELATIONAL RESEARCH\r\n<\/strong>\r\n\r\n[embed]https:\/\/youtu.be\/9YTYuQa8p-U[\/embed]\r\n\r\n<span id=\"term70\"><em>If the video above does not load, click here: <a href=\"https:\/\/www.youtube.com\/watch?v=9YTYuQa8p-U&amp;feature=youtu.be\">https:\/\/www.youtube.com\/watch?v=9YTYuQa8p-U&amp;feature=youtu.be<\/a><\/em>\r\n<em>For a full transcript of this video, click <\/em><a href=\"\/intropsychneuro\/back-matter\/appendix\/#correlational\"><em>here<\/em><\/a><\/span>\r\n\r\n<span id=\"term70\">Correlation<\/span>\u00a0means that there is a relationship between two or more variables (such as ice cream consumption and crime), but this relationship does not necessarily imply cause and effect. When two variables are correlated, it simply means that as one variable changes, so does the other. We can measure correlation by calculating a statistic known as a correlation coefficient. A<strong>\u00a0<span id=\"term71\">correlation coefficient<\/span>\u00a0<\/strong>is a number from -1 to +1 that indicates the strength and direction of the relationship between variables. The correlation coefficient is usually represented by the letter\u00a0<em>r<\/em>.\r\n<p id=\"fs-idp46664736\">The number portion of the correlation coefficient indicates the strength of the relationship. The closer the number is to 1 (be it negative or positive), the more strongly related the variables are, and the more predictable changes in one variable will be as the other variable changes. The closer the number is to zero, the weaker the relationship, and the less predictable the relationships between the variables becomes. For instance, a correlation coefficient of 0.9 indicates a far stronger relationship than a correlation coefficient of 0.3. If the variables are not related to one another at all, the correlation coefficient is 0. The example above about ice cream and crime is an example of two variables that we might expect to have no relationship to each other.<\/p>\r\nThe sign\u2014positive or negative\u2014of the correlation coefficient indicates the direction of the relationship (<a class=\"autogenerated-content\" href=\"https:\/\/openstax.org\/books\/psychology-2e\/pages\/2-3-analyzing-findings#CNX_Psych_02_04_scatter\">Figure PR.11<\/a>). A\u00a0<strong><span id=\"term72\">positive correlation<\/span><\/strong>\u00a0means that the variables move in the same direction. Put another way, it means that as one variable increases so does the other, and conversely, when one variable decreases so does the other. A <strong>negative correlation <\/strong><i><\/i>means that the variables move in opposite directions. If two variables are negatively correlated, a decrease in one variable is associated with an increase in the other and vice versa.\r\n<p id=\"fs-idm12626416\">The example of ice cream and crime rates is a positive correlation because both variables increase when temperatures are warmer. Other examples of positive correlations are the relationship between an individual\u2019s height and weight or the relationship between a person\u2019s age and number of wrinkles. One might expect a negative correlation to exist between someone\u2019s tiredness during the day and the number of hours they slept the previous night: the amount of sleep decreases as the feelings of tiredness increase. In a real-world example of negative correlation, student researchers at the University of Minnesota found a weak negative correlation (<em>r<\/em>\u00a0= -0.29) between the average number of days per week that students got fewer than 5 hours of sleep and their GPA (Lowry, Dean, &amp; Manders, 2010). Keep in mind that a negative correlation is not the same as no correlation. For example, we would probably find no correlation between hours of sleep and shoe size.<\/p>\r\n<p id=\"fs-idm4271152\">As mentioned earlier, correlations have predictive value. Imagine that you are on the admissions committee of a major university. You are faced with a huge number of applications, but you are able to accommodate only a small percentage of the applicant pool. How might you decide who should be admitted? You might try to correlate your current students\u2019 college GPA with their scores on standardized tests like the SAT or ACT. By observing which correlations were strongest for your current students, you could use this information to predict relative success of those students who have applied for admission into the university.<\/p>\r\n\r\n<div id=\"CNX_Psych_02_04_scatter\" class=\"os-figure\">\r\n<figure>\r\n\r\n[caption id=\"\" align=\"aligncenter\" width=\"975\"]<img id=\"91904\" src=\"https:\/\/openstax.org\/resources\/97caa41a4392d7220b4c21871bb6c94c0a0a3412\" alt=\"Three scatterplots are shown. Scatterplot (a) is labeled \u201cpositive correlation\u201d and shows scattered dots forming a rough line from the bottom left to the top right; the x-axis is labeled \u201cweight\u201d and the y-axis is labeled \u201cheight.\u201d Scatterplot (b) is labeled \u201cnegative correlation\u201d and shows scattered dots forming a rough line from the top left to the bottom right; the x-axis is labeled \u201ctiredness\u201d and the y-axis is labeled \u201chours of sleep.\u201d Scatterplot (c) is labeled \u201cno correlation\u201d and shows scattered dots having no pattern; the x-axis is labeled \u201cshoe size\u201d and the y-axis is labeled \u201chours of sleep.\u201d\" width=\"975\" height=\"300\" \/> Figure PR.11 Scatterplots are a graphical view of the strength and direction of correlations. The stronger the correlation, the closer the data points are to a straight line. In these examples, we see that there is (a) a positive correlation between weight and height, (b) a negative correlation between tiredness and hours of sleep, and (c) no correlation between shoe size and hours of sleep.[\/caption]<\/figure>\r\n<div class=\"textbox textbox--key-takeaways\"><header class=\"textbox__header\">\r\n<p class=\"textbox__title\"><span style=\"color: #ffffff\">LINK TO LEARNING<\/span><\/p>\r\n\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\nManipulate this\u00a0<a style=\"text-align: initial;font-family: Lora, serif;font-size: 1em;font-weight: normal\" href=\"https:\/\/rpsychologist.com\/correlation\/\" target=\"_blank\" rel=\"noopener nofollow\">interactive scatterplot<\/a><span style=\"text-align: initial;font-family: Lora, serif;font-size: 1em;font-weight: normal\">\u00a0to practice your understanding of positive and negative correlation.<\/span>\r\n\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<section id=\"fs-idm84043200\">\r\n<h4>Correlation Does Not Indicate Causation<\/h4>\r\n<p id=\"fs-idp46775888\" class=\"indent no-indent\">Correlational research is useful because it allows us to discover the strength and direction of relationships that exist between two variables. However, correlation is limited because establishing the existence of a relationship tells us little about\u00a0<strong><span id=\"term74\">cause and effect<\/span><\/strong>. While variables are sometimes correlated because one does cause the other, it could also be that some other factor, a\u00a0<strong><span id=\"term75\">confounding variable<\/span><\/strong>, is actually causing the systematic movement in our variables of interest. In the ice cream\/crime rate example mentioned earlier, temperature is a confounding variable that could account for the relationship between the two variables.<\/p>\r\n<p id=\"fs-idm12088928\">Even when we cannot point to clear confounding variables, we should not assume that a correlation between two variables implies that one variable causes changes in another. This can be frustrating when a cause-and-effect relationship seems clear and intuitive. Think back to our discussion of the research done by the American Cancer Society and how their research projects were some of the first demonstrations of the link between smoking and cancer. It seems reasonable to assume that smoking causes cancer, but if we were limited to\u00a0<span id=\"term76\" class=\"no-emphasis\">correlational research<\/span>, we would be overstepping our bounds by making this assumption.<\/p>\r\n<p id=\"fs-idm37888912\">Unfortunately, people mistakenly make claims of causation as a function of correlations all the time. Such claims are especially common in advertisements and news stories. For example, recent research found that people who eat cereal on a regular basis achieve healthier weights than those who rarely eat cereal (Frantzen, Trevi\u00f1o, Echon, Garcia-Dominic, &amp; DiMarco, 2013; Barton et al., 2005). Guess how the cereal companies report this finding. Does eating cereal really cause an individual to maintain a healthy weight, or are there other possible explanations, such as, someone at a healthy weight is more likely to regularly eat a healthy breakfast than someone who is obese or someone who avoids meals in an attempt to diet (<a class=\"autogenerated-content\" href=\"https:\/\/openstax.org\/books\/psychology-2e\/pages\/2-3-analyzing-findings#CNX_Psych_02_04_cereal\">Figure PR.12<\/a>)? While correlational research is invaluable in identifying relationships among variables, a major limitation is the inability to establish causality. Psychologists want to make statements about cause and effect, but the only way to do that is to conduct an experiment to answer a research question. The next section describes how scientific experiments incorporate methods that eliminate, or control for, alternative explanations, which allow researchers to explore how changes in one variable cause changes in another variable.<\/p>\r\n\r\n<div id=\"CNX_Psych_02_04_cereal\" class=\"os-figure\">\r\n<figure>\r\n\r\n[caption id=\"\" align=\"aligncenter\" width=\"325\"]<img id=\"98487\" src=\"https:\/\/openstax.org\/resources\/8b9f7edcdb1d52de91dc6a890d91d06cdf18ddb0\" alt=\"A photograph shows a bowl of cereal.\" width=\"325\" height=\"244\" \/> Figure PR.12 Does eating cereal really cause someone to be a healthy weight? (credit: Tim Skillern)[\/caption]<\/figure>\r\n<\/div>\r\n<\/section><section id=\"fs-idm54837568\">\r\n<h4>Illusory Correlations<\/h4>\r\n<p id=\"fs-idp9589232\" class=\"indent no-indent\">The temptation to make erroneous cause-and-effect statements based on correlational research is not the only way we tend to misinterpret data. We also tend to make the mistake of<strong> illusory correlations<\/strong>, especially with unsystematic observations.\u00a0<span id=\"term77\">Illusory correlations<\/span>, or false correlations, occur when people believe that relationships exist between two things when no such relationship exists. One well-known illusory correlation is the supposed effect that the moon\u2019s phases have on human behaviour. Many people passionately assert that human behaviour is affected by the phase of the moon, and specifically, that people act strangely when the moon is full (<a class=\"autogenerated-content\" href=\"https:\/\/openstax.org\/books\/psychology-2e\/pages\/2-3-analyzing-findings#CNX_Psych_02_04_moon\">Figure PR.13<\/a>).<\/p>\r\n\r\n<div id=\"CNX_Psych_02_04_moon\" class=\"os-figure\">\r\n<figure>\r\n\r\n[caption id=\"\" align=\"aligncenter\" width=\"325\"]<img id=\"82889\" src=\"https:\/\/openstax.org\/resources\/27d9385e8ab8ba755aad482bd8ecad4859be14bb\" alt=\"A photograph shows the moon.\" width=\"325\" height=\"216\" \/> Figure PR.13 Many people believe that a full moon makes people behave oddly. (credit: Cory Zanker)[\/caption]<\/figure>\r\n<p class=\"os-caption-container indent no-indent\"><span style=\"text-align: initial;font-size: 1em\">There is no denying that the moon exerts a powerful influence on our planet. The ebb and flow of the ocean\u2019s tides are tightly tied to the gravitational forces of the moon. Many people believe, therefore, that it is logical that we are affected by the moon as well. After all, our bodies are largely made up of water. A meta-analysis of nearly 40 studies consistently demonstrated, however, that the relationship between the moon and our behaviour does not exist (Rotton &amp; Kelly, 1985). While we may pay more attention to odd behaviour during the full phase of the moon, the rates of odd behaviour remain constant throughout the lunar cycle.<\/span><\/p>\r\n\r\n<\/div>\r\n<p id=\"fs-idm46730704\" class=\"indent no-indent\">Why are we so apt to believe in illusory correlations like this? Often we read or hear about them and simply accept the information as valid. Or, we have a hunch about how something works and then look for evidence to support that hunch, ignoring evidence that would tell us our hunch is false; this is known as\u00a0<span id=\"term78\">confirmation bias<\/span>. Other times, we find illusory correlations based on the information that comes most easily to mind, even if that information is severely limited. And while we may feel confident that we can use these relationships to better understand and predict the world around us, illusory correlations can have significant drawbacks. For example, research suggests that illusory correlations\u2014in which certain behaviours are inaccurately attributed to certain groups\u2014are involved in the formation of prejudicial attitudes that can ultimately lead to discriminatory behaviour (Fiedler, 2004).<\/p>\r\n\r\n<\/section><\/section><section id=\"fs-idp9975072\">\r\n<h3>Causality: Conducting Experiments and Using the Data<\/h3>\r\n<p id=\"fs-idm22387104\" class=\"indent no-indent\">As you\u2019ve learned, the only way to establish that there is a cause-and-effect relationship between two variables is to conduct a scientific\u00a0<span id=\"term79\" class=\"no-emphasis\">experiment<\/span>. Experiment has a different meaning in the scientific context than in everyday life. In everyday conversation, we often use it to describe trying something for the first time, such as experimenting with a new hair style or a new food. However, in the scientific context, an experiment has precise requirements for design and implementation.<\/p>\r\n\r\n<\/section><strong><a id=\"TTexperimental\"><\/a>TRICKY TOPIC: EXPERIMENTAL RESEARCH\r\n<\/strong>\r\n\r\n[embed]https:\/\/youtu.be\/iXT7zY5uKnE[\/embed]\r\n\r\n<em><span id=\"term70\">If the video above does not load, click here:\u00a0<a href=\"https:\/\/www.youtube.com\/watch?v=iXT7zY5uKnE&amp;feature=youtu.be\"> https:\/\/www.youtube.com\/watch?v=9YTYuQa8p-U&amp;feature=youtu.be<\/a>\r\nFor a full transcript of this video, click <a href=\"\/intropsychneuro\/back-matter\/appendix\/#experimental\">here<\/a><\/span><\/em>\r\n<p class=\"no-indent\"><span style=\"font-family: 'Cormorant Garamond', serif;font-size: 1em;font-style: italic;font-weight: bold\">The Experimental Hypothesis<\/span><\/p>\r\n<span style=\"text-align: initial;text-indent: 2em;font-size: 1em\">In order to conduct an experiment, a researcher must have a specific\u00a0<\/span><span id=\"term80\" class=\"no-emphasis\" style=\"text-align: initial;text-indent: 2em;font-size: 1em\">hypothesis<\/span><span style=\"text-align: initial;text-indent: 2em;font-size: 1em\">\u00a0to be tested. As you\u2019ve learned, hypotheses can be formulated either through direct observation of the real world or after careful review of previous research.\u00a0<span class=\"TextRun SCXW240248436 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW240248436 BCX9\">If you\u2019ve ever spent time with a<\/span><span class=\"NormalTextRun SCXW240248436 BCX9\"> young child in a car you may have seen them mimicking the actions of the adult driving, pretending to turn the steering wheel or honk the horn. You may have also seen this kind of imitation in less neutral contexts, like a child repeating offensive language that they clearly don\u2019t understand. Based on this observation, it would be reasonable to think that children have a tendency to imitate <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW240248436 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW240248436 BCX9\"> they observe from others. You might make further observations from here, for example you might notice that children more often imitate <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW240248436 BCX9\">behaviours<\/span><span class=\"NormalTextRun SCXW240248436 BCX9\"> performed by adults rather than other children, or that this tendency for imitation could facilitate the development of aggressive <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW240248436 BCX9\">behaviours<\/span><span class=\"NormalTextRun SCXW240248436 BCX9\"> in children.<\/span><\/span><span class=\"EOP SCXW240248436 BCX9\">\u00a0<\/span><\/span>\r\n\r\n<section id=\"fs-idp9975072\"><section id=\"fs-idm57740512\">\r\n<div id=\"CNX_Psych_02_05_toygun\" class=\"os-figure\">\r\n\r\n[caption id=\"attachment_2235\" align=\"aligncenter\" width=\"500\"]<img class=\"wp-image-2235 \" src=\"https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-content\/uploads\/sites\/21\/2020\/04\/sai-de-silva-cykFL7IQCTk-unsplash-1024x683.jpg\" alt=\"A parent sits on a motorcycle with their young child, both look into the rearview mirror, sticking out their tongues. \" width=\"500\" height=\"333\" \/> Figure PR.14 Do children imitate the adults they observe? (credit: Unsplash)[\/caption]\r\n\r\n<\/div>\r\n<p id=\"fs-idp4153712\" class=\"indent no-indent\"><span class=\"TextRun SCXW57143820 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW57143820 BCX9\">These sorts of personal observations are what often lead us to formulate a specific hypothesis, but <\/span><span class=\"NormalTextRun SCXW57143820 BCX9\">we cannot use limited personal observations and anecdotal evidence to rigorously test our hypothesis. <\/span><span class=\"NormalTextRun SCXW57143820 BCX9\">Instead, to find out if real-world data supports our hypothesis, we have to conduct an experiment.<\/span><\/span><span class=\"EOP SCXW57143820 BCX9\">\u00a0<\/span><\/p>\r\n\r\n<\/section><section id=\"fs-idp3024240\">\r\n<h4>Designing an Experiment<\/h4>\r\n<p id=\"fs-idp4610192\" class=\"indent no-indent\">The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference\u2014 experimental manipulation. The\u00a0<strong><span id=\"term81\">experimental group<\/span><\/strong>\u00a0gets the experimental manipulation\u2014that is, the treatment or variable being tested (in this case, the use of technology)\u2014and the\u00a0<strong><span id=\"term82\">control group<\/span><\/strong>\u00a0does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between the two are due to experimental manipulation rather than chance.<\/p>\r\n<p id=\"fs-idm22193024\"><span class=\"TextRun SCXW114149343 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW114149343 BCX9\">T<\/span><span class=\"NormalTextRun SCXW114149343 BCX9\">o investigate the relationship between observed aggression and imitated aggressive <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW114149343 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW114149343 BCX9\"> in children, our experimental manipulation will be to allow children to observe an adult modeling aggressive <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW114149343 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW114149343 BCX9\">. We might have the children in our experimental group play in a room where they are able to observe adults playing aggressively with toys, hitting, pushing and yelling at them. The study we are describing here is actually a simplified version of the famous 1961 Bobo doll study performed by <\/span><\/span><span class=\"TextRun MacChromeBold SCXW114149343 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW114149343 BCX9\">Albert Bandura, Dorothea Ross, and Sheila A. Ross, <\/span><\/span><span class=\"TextRun SCXW114149343 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW114149343 BCX9\">named as such because the toy used to demonstrate aggression was an inflatable clown doll called Bobo. We will touch more on work done by Bandura in greater detail in section 57 on observational learning.<\/span><\/span><span class=\"EOP SCXW114149343 BCX9\">\u00a0<\/span><\/p>\r\n\r\n\r\n[caption id=\"attachment_2242\" align=\"aligncenter\" width=\"538\"]<img class=\" wp-image-2242\" src=\"https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-content\/uploads\/sites\/21\/2020\/04\/Bobo-textbook-1024x819.jpg\" alt=\"\" width=\"538\" height=\"430\" \/> Figure PR. 15 The Bobo doll, a bowling pin shaped inflatable toy with a clown printed on it. The toy is heavier at the base than it is at the top, so it rocks back and forth without falling over when pushed or struck.[\/caption]\r\n\r\n<span class=\"TextRun SCXW194619472 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW194619472 BCX9\">We\u2019ve decided our <\/span><span class=\"NormalTextRun SCXW194619472 BCX9\">experimental condition will involve allowing children to observe adults modelling aggressive <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW194619472 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW194619472 BCX9\">, we now need to design a control group that differs only by a lack of exposure to aggressive adult models. <\/span><span class=\"NormalTextRun SCXW194619472 BCX9\">The original version of the Bobo doll study had a control group that did not observe any <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW194619472 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW194619472 BCX9\"> at all. Knowing what you now know about experimental design, would you design your control group in the same way? If a control group is meant to differ from an experimental group only in terms of the experimental manipulation, you might argue that a group exposed to nothing differs in several ways. For example, the experience of being made to sit in a room with a strange adult could theoretically provoke acts of aggression in young children. It might seem far-fetched, but we cannot infer that observation of aggression was the cause of our participant\u2019s <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW194619472 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW194619472 BCX9\"> if we don\u2019t rule out the possibility that other features of our manipulation could have contributed. The researchers used a second experimental group to rule out this possibility, but for the purposes of our hypothetical replication we have an experimental group who observe adults behaving aggressively with toys, and a control group who observe adults behaving non-aggressively with the same toys.<\/span><\/span><span class=\"EOP SCXW194619472 BCX9\">\u00a0<\/span>\r\n\r\n<span class=\"TextRun Highlight SCXW253445310 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW253445310 BCX9\">One of the most important parts of a scientific study is having a clear description of how each variable is measured, known as an <\/span><\/span><strong><span class=\"TextRun Highlight MacChromeBold SCXW253445310 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW253445310 BCX9\">operational definition<\/span><\/span><\/strong><span class=\"TextRun Highlight SCXW253445310 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW253445310 BCX9\">.<\/span><\/span><span class=\"TextRun Highlight SCXW253445310 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW253445310 BCX9\"> Some variables, like age and height, are easy to define, but psychologists are often interested in measuring abstract variables like thought, emotion, and <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW253445310 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW253445310 BCX9\"> which can be challenging. For example, can you operationally define helpfulness? People vary in how helpful they are, so there must be some way to measure this. This could be measured by looking at charitable donations on annual tax returns, but that\u2019s only one type of helpfulness and is biased towards wealthier individuals. What about number of hours per week volunteering? This operational definition also has its limitations in capturing helping <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW253445310 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW253445310 BCX9\">.<\/span><\/span><span class=\"TextRun Highlight SCXW253445310 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW253445310 BCX9\"> In our Bobo doll study, we will have to define aggression, which could be described in a variety of ways. For example, one might define aggression as <\/span><span class=\"NormalTextRun SCXW253445310 BCX9\">hostile, injurious, or destructive behaviour caused by frustration. However, this definition would require us to also measure frustration, as this feature is not externally observable. <\/span><\/span><span class=\"TextRun Highlight SCXW253445310 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW253445310 BCX9\">Researchers often create different operational definitions of the same variable, so providing a clear, <\/span><\/span><span class=\"TextRun Highlight SCXW253445310 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW253445310 BCX9\">measurable <\/span><\/span><span class=\"TextRun Highlight SCXW253445310 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW253445310 BCX9\">description is important in interpreting research findings.\u00a0<\/span><\/span><span class=\"EOP SCXW253445310 BCX9\">\u00a0<\/span>\r\n<div style=\"font-weight: 400\">\r\n\r\nWhile it is possible to measure frustration through self-report, our study is interested in imitative aggression, and we do not know that imitative aggression is caused by frustration. So for the purposes of our hypothetical experiment, we could define aggressive behaviour as physical or verbal acts that have the potential to cause harm to an object or another human.\u00a0 We could then describe specific, observable aggressive behaviours like kicking the doll, throwing it, or saying things like \u201cstupid doll\u201d. Our adult models could perform these specific behaviours, and we could measure the rate at which participants imitate those acts when given an opportunity to play with the same doll later. The imitation of those previously described acts would be considered imitative aggression. Having defined our variables like this, we are able to communicate specifically what we have measured, which makes it easier for other researchers to replicate our experiment and check our results.\r\n\r\n<\/div>\r\n<div style=\"font-weight: 400\">\r\n\r\nWe\u2019ve operationalized our variables, so now we can decide how our experiment will run. In this case, we could allow our participants to play in a room with an adult model who would perform a set of specifically defined behaviours (either aggressive or non-aggressive) to a doll. We could then move our participants to a different room with the same set of toys and count how many of those specifically defined behaviours they reproduce.\r\n\r\n<\/div>\r\n<p id=\"fs-idm43450704\">Ideally, the people who count imitated behaviours are unaware of who was assigned to the experimental or control group, in order to control for experimenter bias.\u00a0<strong><span id=\"term84\">Experimenter bias<\/span>\u00a0<\/strong>refers to the possibility that a researcher\u2019s expectations might skew the results of the study. Remember, conducting an experiment requires a lot of planning, and the people involved in the research project have a vested interest in supporting their hypotheses. If the observers knew which child was in which group, it might influence how they interpret ambiguous responses, such as squeezing the doll. By being blind to which child is in which group, we protect against those biases. This situation is a<strong>\u00a0<span id=\"term85\">single-blind study<\/span><\/strong>, meaning that one of the groups (participants) are unaware as to which group they are in (experiment or control group) while the researcher who developed the experiment knows which participants are in each group.<\/p>\r\n<p id=\"fs-idm30047504\">In a<strong>\u00a0<span id=\"term86\">double-blind study<\/span><\/strong>, both the researchers and the participants are blind to group assignments,\u00a0<span class=\"TextRun SCXW127479651 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW127479651 BCX9\">which allows us to control for both experimenter and participant expectations. A well-known example of this is the <\/span><\/span><span class=\"TextRun MacChromeBold SCXW127479651 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW127479651 BCX9\"><strong>placebo effect<\/strong>,\u00a0which\u00a0<\/span><\/span>occurs when people's expectations or beliefs influence or determine their experience in a given situation. In other words, simply expecting something to happen can actually make it happen.<\/p>\r\n\r\n<div style=\"font-weight: 400\">\r\n\r\nTo illustrate, imagine that you have bad allergies and are taking part in a study testing a new allergy medication. You go to a university or hospital setting to take part in the experiment, speaking to people in lab coats with medical authority who do a number of tests on you and then give you a pill. Whether the pill contains actual medication or not, the experience of taking part and receiving the pill may give the treatment a sense of legitimacy. You may feel hopeful and proactive about your bad allergies, and as a result you may notice an actual improvement in symptoms even if you only took a sugar pill.\r\n\r\n<\/div>\r\n<div style=\"font-weight: 400\">\r\n\r\nAs we know, we can only say that our experimental manipulation (in this case the medication) is the cause of our results if it is the only difference between the experimental and control groups. As a result, we might use a placebo control, where the only difference between the two groups would be the contents of the pill- medicine or something inert. To ensure that all other conditions are the same, participants must not know whether they have received the drug- if they knew, we wouldn\u2019t be able to tell whether the effects were due to expectations about drug efficacy or to the actual drug. Similarly, if the researchers know which drug participants are receiving they might treat participants differently, which could alter the way participants respond\u00a0<span style=\"text-align: initial;font-size: 1em\">(<\/span><a class=\"autogenerated-content\" style=\"text-align: initial;font-size: 1em\" href=\"https:\/\/openstax.org\/books\/psychology-2e\/pages\/2-3-analyzing-findings#CNX_Psych_02_05_placebo\">Figure PR.15<\/a><span style=\"text-align: initial;font-size: 1em\">).<\/span>\r\n\r\n<\/div>\r\n<div id=\"CNX_Psych_02_05_placebo\" class=\"os-figure\">\r\n<figure>\r\n\r\n[caption id=\"\" align=\"aligncenter\" width=\"488\"]<img id=\"31885\" src=\"https:\/\/openstax.org\/resources\/6a44cc88807b4da187e437b2c86cf4ea3e269db5\" alt=\"Three pill bottles are displayed. The labels on the bottles read \u2018Cebocap No. 1 placebo\u2019, \u2018Cebocap No. 2 placebo\u2019, and \u2018Cebocap No. 3 Placebo\u2019 respectively. \" width=\"488\" height=\"368\" \/> Figure PR.15 Providing the control group with a placebo treatment protects against bias caused by expectancy. (credit: Elaine and Arthur Shapiro)[\/caption]<\/figure>\r\n<div class=\"os-caption-container\"><span style=\"font-family: 'Cormorant Garamond', serif;font-size: 1em;font-style: italic;font-weight: bold\">Independent and Dependent Variables<\/span><\/div>\r\n<div><\/div>\r\n<\/div>\r\n<\/section><section id=\"fs-idm4342688\">\r\n<p id=\"fs-idp4642816\" class=\"indent no-indent\">In a research experiment, we strive to study whether changes in one thing cause changes in another. To achieve this, we must pay attention to two important variables, or things that can be changed, in any experimental study: the independent variable and the dependent variable. An<strong><span id=\"term88\">independent variable<\/span><\/strong>\u00a0is manipulated or controlled by the experimenter. In a well-designed experimental study, the independent variable is the only important difference between the experimental and control groups.\u00a0<span class=\"TextRun SCXW252625613 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW252625613 BCX9\">In our example of how the observation of aggressive <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW252625613 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW252625613 BCX9\"> affects later <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW252625613 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW252625613 BCX9\">, the independent variable is the type of <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW252625613 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW252625613 BCX9\"> observed by the participants.<\/span><\/span> (<a class=\"autogenerated-content\" href=\"https:\/\/openstax.org\/books\/psychology-2e\/pages\/2-3-analyzing-findings#CNX_Psych_02_05_variables\">Figure PR.16<\/a>). A\u00a0<strong><span id=\"term89\">dependent variable<\/span><\/strong>\u00a0is what the researcher measures to see how much effect the independent variable had.<span class=\"TextRun SCXW203181323 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW203181323 BCX9\">In our example, the dependent variable is the number of modelled aggressive <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW203181323 BCX9\">behaviours<\/span><span class=\"NormalTextRun SCXW203181323 BCX9\"> our participants imitate.<\/span><\/span><\/p>\r\n\r\n\r\n[caption id=\"attachment_2237\" align=\"aligncenter\" width=\"538\"]<img class=\" wp-image-2237\" src=\"https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-content\/uploads\/sites\/21\/2020\/04\/Bandura_Bobo_doll_experiments_video_stills.jpg\" alt=\"The image displays three rows of four photos each. In the first row from left to right, an adult is seen sitting on a bobo doll, throwing a bobo doll, punching a bobo doll, and kicking a bobo doll. In the second and third rows, two different children are seen imitating the same actions. \" width=\"538\" height=\"314\" \/> Figure PR.16 In an experiment, manipulations of the independent variable are expected to result in changes in the dependent variable. (source: wikimedia commons)[\/caption]\r\n\r\n&nbsp;\r\n<p class=\"indent no-indent\"><span style=\"text-align: initial;font-size: 1em\">We expect that the dependent variable will change as a function of the independent variable. In other words, the dependent variable\u00a0<\/span><em style=\"text-align: initial;font-size: 1em\">depends<\/em><span style=\"text-align: initial;font-size: 1em\">\u00a0on the independent variable. A good way to think about the relationship between the independent and dependent variables is with this question: What effect does the independent variable have on the dependent variable?<span class=\"TextRun SCXW225656347 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW225656347 BCX9\">In our example of how the observation of aggressive <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW225656347 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW225656347 BCX9\"> affects later <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW225656347 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW225656347 BCX9\">, the independent variable is the type of <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW225656347 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW225656347 BCX9\"> observed by the participants.<\/span><\/span><span class=\"EOP SCXW225656347 BCX9\">\u00a0<\/span><\/span><\/p>\r\n\r\n<\/section><section id=\"fs-idm13736208\">\r\n<h4>Selecting and Assigning Experimental Participants<\/h4>\r\n<p id=\"fs-idm35111680\" class=\"indent no-indent\">Now that our study is designed, we need to obtain a sample of individuals to include in our experiment. Our study involves human participants so we need to determine who to include.\u00a0<strong><span id=\"term90\">Participants<\/span>\u00a0<\/strong>are the subjects of psychological research, and as the name implies, individuals who are involved in psychological research actively participate in the process. Often, psychological research projects rely on college students to serve as participants. In fact, the vast majority of research in psychology subfields has historically involved students as research participants (Sears, 1986; Arnett, 2008). But are college students truly representative of the general population? College students tend to be younger, more educated, more liberal, and less diverse than the general population. Although using students as test subjects is an accepted practice, relying on such a limited pool of research participants can be problematic because it is difficult to generalize findings to the larger population.<\/p>\r\n<p id=\"fs-idm53871616\">Our hypothetical experiment involves\u00a0<span class=\"TextRun SCXW199198023 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW199198023 BCX9\">preschool aged children, so we need to generate a sample from that population.\u00a0<\/span><\/span>Samples are used because populations are usually too large to reasonably involve every member in our particular experiment (<a class=\"autogenerated-content\" href=\"https:\/\/openstax.org\/books\/psychology-2e\/pages\/2-3-analyzing-findings#CNX_Psych_02_05_sample\">Figure PR.17<\/a>).\u00a0<span class=\"TextRun SCXW126176439 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW126176439 BCX9\">If possible, we should use a random sample (there are other types of samples, but for the purposes of this chapter, we will focus on random samples). A <\/span><\/span><strong><span class=\"TextRun MacChromeBold SCXW126176439 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW126176439 BCX9\">random sample<\/span><\/span><\/strong><span class=\"TextRun SCXW126176439 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW126176439 BCX9\"> is a subset of a larger population in which every member of the population has an equal chance of being selected. Random samples are preferred because if the sample is large enough we can be reasonably sure that the participating individuals are representative of the larger population. This means that the percentages of characteristics in the sample\u2014sex, ethnicity, socioeconomic level, and any other characteristics that might affect the results\u2014are close to those percentages in the larger population. Additionally, random sampling ensures that differences in characteristics are relatively balanced between groups.<\/span><\/span><span class=\"EOP SCXW126176439 BCX9\">\u00a0<\/span><\/p>\r\n<p id=\"fs-idm59772960\">In our example,\u00a0<span class=\"TextRun SCXW106477386 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW106477386 BCX9\">w<\/span><span class=\"NormalTextRun SCXW106477386 BCX9\">e\u2019re interested in pre-school aged children, but we can\u2019t possibly include all pre-school aged children in our study so we need to be more specific; instead we might say our population of interest is all pre-school aged children in a particular city. We should include children from various income brackets, family situations, races, ethnicities, religions, and geographic areas of town. With this more manageable population, we can work with local preschools to select a random sample of around 200 children who we want to participate in our experiment.<\/span><\/span><span class=\"EOP SCXW106477386 BCX9\">\u00a0<\/span><\/p>\r\n<p id=\"fs-idm43561728\">In summary, because we cannot test all of the pre-school aged children in a city, we want to find a group of about 200 that reflects the composition of that city. With a representative group, we can generalize our findings to the larger population without fear of our sample being biased in some way.\u00a0<span class=\"TextRun SCXW129861775 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW129861775 BCX9\">In the original version of this study, the sample was composed of 72 children from the Stanford University Nursery School. Can you think of some ways in which a sample drawn exclusively from a wealthy universities\u2019 nursery school might be biased?<\/span><\/span><span class=\"EOP SCXW129861775 BCX9\">\u00a0<\/span><\/p>\r\n\r\n<div id=\"CNX_Psych_02_05_sample\" class=\"os-figure\">\r\n<figure>\r\n\r\n[caption id=\"\" align=\"aligncenter\" width=\"649\"]<img id=\"18921\" src=\"https:\/\/openstax.org\/resources\/070dfd277b2ebc6bb0e6a4e7abd433e1a72c7043\" alt=\"(a) A photograph shows an aerial view of crowds on a street. (b) A photograph shows s small group of children.\" width=\"649\" height=\"248\" \/> Figure PR.17 Researchers may work with (a) a large population or (b) a sample group that is a subset of the larger population. (credit \u201ccrowd\u201d: modification of work by James Cridland; credit \u201cstudents\u201d: modification of work by Laurie Sullivan)[\/caption]<\/figure>\r\n<\/div>\r\n<p id=\"fs-idm58025968\" class=\"indent no-indent\">Now that we have a sample, the next step of the experimental process is to split the participants into experimental and control groups through<strong> random assignment<\/strong>. With\u00a0<span id=\"term92\">random assignment<\/span>, all participants have an equal chance of being assigned to either group. There is statistical software that will randomly assign each of the children in the sample to either the experimental or the control group.<\/p>\r\n<p id=\"fs-idm22541664\">Random assignment is critical for sound\u00a0<span id=\"term93\" class=\"no-emphasis\">experimental design<\/span>. With sufficiently large samples, random assignment makes it unlikely that there are systematic differences between the groups. So, for instance, it would be very unlikely that we would get one group composed entirely of males, a given ethnic identity, or a given religious ideology. This is important because if the groups were systematically different before the experiment began, we would not know the origin of any differences we find between the groups: Were the differences preexisting, or were they caused by manipulation of the independent variable?\u00a0<span class=\"TextRun SCXW252141257 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW252141257 BCX9\">Even using random assignment it is possible to have groups that differ significantly from each other, so it is important to monitor any variable we think might impact our results. If we do find that a variable of interest differs significantly between groups, we can <\/span><span class=\"NormalTextRun SCXW252141257 BCX9\">match them on that variable<\/span><\/span><span class=\"TextRun MacChromeBold SCXW252141257 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW252141257 BCX9\">. <strong>Matching<\/strong><\/span><\/span><span class=\"TextRun SCXW252141257 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW252141257 BCX9\"> is a practice where participants in the experimental group are paired with participants in the control group that have similar scores on a variable of interest.<\/span><span class=\"NormalTextRun SCXW252141257 BCX9\"> For example, In the Bobo doll study participants were scored on their baseline levels of aggression. If their experimental group was found to be significantly more aggressive than their control group prior to any experimental manipulation, then they would not have been able to infer that the results were due to their manipulation. To avoid this outcome the researchers matched children in different groups with similar levels of baseline aggression, so that the groups would be roughly equivalent on that variable.<\/span> <\/span>Random assignment, monitoring variables, and matching allow us to assume that any differences observed between experimental and control groups result from the manipulation of the independent variable.<\/p>\r\n\r\n<div id=\"fs-idm46705312\" class=\"psychology link-to-learning ui-has-child-title\"><section>\r\n<div class=\"os-note-body\">\r\n<div class=\"textbox textbox--key-takeaways\"><header class=\"textbox__header\">\r\n<p class=\"textbox__title\"><span style=\"color: #ffffff\">LINK TO LEARNING<\/span><\/p>\r\n\r\n<\/header>\r\n<div class=\"textbox__content\">Use this\u00a0<a href=\"https:\/\/www.randomizer.org\/\" target=\"_blank\" rel=\"noopener nofollow\">online random number generator<\/a>\u00a0to learn more about random sampling and assignments.<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/section><\/div>\r\n<\/section><section id=\"fs-idm26660352\">\r\n<h4>Issues to Consider<\/h4>\r\n<p id=\"fs-idm84373440\" class=\"indent no-indent\">While experiments allow scientists to make cause-and-effect claims, they are not without problems. True experiments require the experimenter to manipulate an independent variable, and that can complicate many questions that psychologists might want to address. For instance, imagine that you want to know what effect sex (the independent variable) has on spatial memory (the dependent variable). Although you can certainly look for differences between people with different biological sexes on a task that taps into spatial memory, you cannot directly control a person\u2019s sex. We categorize this type of research approach as quasi-experimental and recognize that we cannot make cause-and-effect claims in these circumstances.<\/p>\r\n<p id=\"fs-idm110237888\">Experimenters are also limited by ethical constraints. For instance, you would not be able to conduct an experiment designed to determine if experiencing abuse as a child leads to lower levels of self-esteem among adults. To conduct such an experiment, you would need to randomly assign some experimental participants to a group that receives abuse, and that experiment would be unethical.<\/p>\r\n\r\n<\/section><section id=\"fs-idp16962688\">\r\n<h4>Interpreting Experimental Findings<\/h4>\r\n<p id=\"fs-idp27164832\" class=\"indent no-indent\">Once data is collected from both the experimental and the control groups, a\u00a0<strong><span id=\"term94\">statistical analysis<\/span><\/strong>\u00a0is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). For example, if an experiment is done on the effectiveness of a nutritional supplement, and those taking a placebo pill (and not the supplement) have the same result as those taking the supplement, then the experiment has shown that the nutritional supplement is not effective. Generally, psychologists consider differences to be statistically significant if there is less than a five percent chance of observing them if the groups did not actually differ from one another. Stated another way, psychologists want to limit the chances of making \u201cfalse positive\u201d claims to five percent or less.<\/p>\r\nThe greatest strength of experiments is the ability to assert that any significant differences in the findings are caused by the independent variable. This occurs because random selection, random assignment, and a design that limits the effects of both experimenter bias and participant expectancy should create groups that are similar in composition and treatment. Therefore, any difference between the groups is attributable to the independent variable, and now we can finally make a causal statement.\u00a0<span class=\"TextRun SCXW145964823 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW145964823 BCX9\">If we find that observing aggressive <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW145964823 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW145964823 BCX9\"> results in more imitated aggression than observing non-aggressive <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW145964823 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW145964823 BCX9\">, we can safely say that exposure to aggressive <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW145964823 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW145964823 BCX9\"> causes an increase in imitated aggression.<\/span><\/span><span class=\"EOP SCXW145964823 BCX9\">\u00a0<\/span>\r\n\r\n&nbsp;\r\n\r\n<strong><a id=\"TTstatmeasures\"><\/a>TRICKY TOPIC: STATISTICAL MEASURES<\/strong>\r\n\r\n[embed]https:\/\/youtu.be\/uV87qt1iRkA[\/embed]\r\n\r\n<\/section><section id=\"fs-idm35834672\"><em><span id=\"term70\">If the video above does not load, click here: <a href=\"https:\/\/youtu.be\/uV87qt1iRkA\">https:\/\/youtu.be\/uV87qt1iRkA<\/a>\r\nFor a full transcript of this video, click <a href=\"\/intropsychneuro\/back-matter\/appendix\/#statmeasures\">here<\/a><\/span><\/em><\/section>\r\n<h3 class=\"no-indent\"><em>Reporting Research<\/em><\/h3>\r\n<p id=\"fs-idm40325120\" class=\"indent no-indent\">When psychologists complete a research project, they generally want to share their findings with other scientists. The American Psychological Association (APA) publishes a manual detailing how to write a paper for submission to scientific journals. Unlike an article that might be published in a magazine like\u00a0<em>Psychology Today,\u00a0<\/em>which targets a general audience with an interest in psychology, scientific journals generally publish\u00a0<span id=\"term95\"><strong>peer-reviewed journal articles<\/strong><\/span><strong>\u00a0<\/strong>aimed at an audience of professionals and scholars who are actively involved in research themselves.<\/p>\r\n\r\n<div id=\"fs-idm22108992\" class=\"psychology link-to-learning ui-has-child-title\"><header><\/header><section>\r\n<div class=\"os-note-body\">\r\n<div class=\"textbox textbox--key-takeaways\"><header class=\"textbox__header\">\r\n<p class=\"textbox__title\"><span style=\"color: #ffffff\">LINK TO LEARNING<\/span><\/p>\r\n\r\n<\/header>\r\n<div class=\"textbox__content\">The\u00a0<a href=\"https:\/\/owl.purdue.edu\/\" target=\"_blank\" rel=\"noopener nofollow\">Online Writing Lab (OWL)<\/a>\u00a0at Purdue University can walk you through the APA writing guidelines.<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/section><\/div>\r\n<p id=\"fs-idm62557504\" class=\"indent no-indent\">A peer-reviewed journal article is read by several other scientists (generally anonymously) with expertise in the subject matter. These peer reviewers provide feedback\u2014to both the author and the journal editor\u2014regarding the quality of the draft. Peer reviewers look for a strong rationale for the research being described, a clear description of how the research was conducted, and evidence that the research was conducted in an ethical manner. They also look for flaws in the study's design, methods, and statistical analyses. They check that the conclusions drawn by the authors seem reasonable given the observations made during the research. Peer reviewers also comment on how valuable the research is in advancing the discipline\u2019s knowledge. This helps prevent unnecessary duplication of research findings in the scientific literature and, to some extent, ensures that each research article provides new information. Ultimately, the journal editor will compile all of the peer reviewer feedback and determine whether the article will be published in its current state (a rare occurrence), published with revisions, or not accepted for publication.<\/p>\r\n<p id=\"fs-idm25798976\">Peer review provides some degree of quality control for psychological research.\u00a0<span class=\"TextRun SCXW225408219 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW225408219 BCX9\">Poorly conceived or executed studies can be weeded out, well-designed research can be improved, and ideally, studies can be described clearly enough to allow other scientists to <\/span><\/span><strong><span class=\"TextRun MacChromeBold SCXW225408219 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW225408219 BCX9\">replicate<\/span><\/span><\/strong><span class=\"TextRun SCXW225408219 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW225408219 BCX9\"> them, which helps to determine reliability.<\/span><\/span><span class=\"EOP SCXW225408219 BCX9\">\u00a0<\/span><\/p>\r\n<span class=\"TextRun SCXW44549156 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW44549156 BCX9\">So why would we want to replicate a study? Imagine that our version of the Bobo doll study is done exactly the same as the original, only using a different set of participants and researchers. We use the same operational definitions, manipulations, measurements, and procedures, and our groups are equivalent in terms of their baseline levels of aggression. In our replication however, we receive completely different results and the children do not imitate aggressive <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW44549156 BCX9\">behaviours<\/span><span class=\"NormalTextRun SCXW44549156 BCX9\"> any more than they would at the level of chance. If our experimental manipulation is exactly the same, then the difference in results must be attributable to something else that is different between our study and the original, which might include the researchers, participants, and location. If on the other hand, we were able to replicate the results of the original experiment using different researchers and participants at a different location, then this would provide support for the idea that the results were due to the manipulation and not to any of these other variables. The more we can replicate a result with different samples, the more reliable it is.<\/span><\/span><span class=\"EOP SCXW44549156 BCX9\">\u00a0<\/span>\r\n<p id=\"zip-idm382014320\">In recent years, there has been increasing concern about a \u201creplication crisis\u201d that has affected a number of scientific fields, including psychology.\u00a0<span class=\"NormalTextRun SCXW51075474 BCX9\">One study found that only about 62% of social science studies reviewed were replicable, and even then their effect sizes were reduced by half (<\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW51075474 BCX9\">Cramerer<\/span><span class=\"NormalTextRun SCXW51075474 BCX9\"> et. al, 2018).<\/span> In fact, even a famous Nobel Prize-winning scientist has recently retracted a published paper because she had difficulty replicating her results (Nobel Prize-winning scientist Frances Arnold retracts paper, 2020 January 3). These kinds of outcomes have prompted some scientists to begin to work together and more openly, and some would argue that the current \u201ccrisis\u201d is actually improving the ways in which science is conducted and in how its results are shared with others (Aschwanden, 2018).\u00a0<span class=\"TextRun SCXW44318343 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW44318343 BCX9\">One example of this more collaborative approach is the <\/span><\/span><span class=\"TextRun MacChromeBold SCXW44318343 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW44318343 BCX9\">Psychological Science Accelerator<\/span><\/span><span class=\"TextRun SCXW44318343 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW44318343 BCX9\">, a network of over 500 laboratories, representing 82 countries. This network allows researchers to pre-register their study designs, which minimizes any cherry-picking that might happen along the way to boost results. The network also facilitates data collection across multiple labs, allowing for the use of large, diverse samples and more wide-spread sharing of results. Hopefully with a more collaborative approach, we can develop a better process for replicating and quality checking research.\u00a0<\/span><\/span><span class=\"EOP SCXW44318343 BCX9\">\u00a0<\/span><\/p>\r\n&nbsp;\r\n<div id=\"fs-idm22108992\" class=\"psychology link-to-learning ui-has-child-title\"><header><\/header><section>\r\n<div class=\"os-note-body\">\r\n<div class=\"textbox textbox--key-takeaways\"><header class=\"textbox__header\">\r\n<p class=\"textbox__title\"><span style=\"color: #ffffff\">LINK TO LEARNING<\/span><\/p>\r\n\r\n<\/header>\r\n<div class=\"textbox__content\">If you'd like to learn more about the Psychological Sciences Accelerator, you can check out their website here:\u00a0<a href=\"https:\/\/psysciacc.org\/\">https:\/\/psysciacc.org\/<\/a><\/div>\r\n<\/div>\r\n<\/div>\r\n<\/section><\/div>\r\n<div id=\"fs-idp8756544\" class=\"psychology dig-deeper ui-has-child-title\"><header>\r\n<div class=\"textbox textbox--exercises\"><header class=\"textbox__header\">\r\n<p class=\"textbox__title\"><span style=\"color: #ffffff\">DIG DEEPER<\/span><\/p>\r\n\r\n<\/header>\r\n<div class=\"textbox__content\"><section id=\"fs-idp9975072\">\r\n<div id=\"fs-idp8756544\" class=\"psychology dig-deeper ui-has-child-title\"><section>\r\n<div class=\"os-note-body\">\r\n<h4 id=\"11452\" class=\"os-subtitle\"><span class=\"os-subtitle-label\">The Vaccine-Autism Myth and Retraction of Published Studies<\/span><\/h4>\r\n<p id=\"fs-idm6414480\" class=\"indent no-indent\">Some scientists have claimed that routine childhood vaccines cause some children to develop autism, and, in fact, several peer-reviewed publications published research making these claims. Since the initial reports, large-scale epidemiological research has suggested that vaccinations are not responsible for causing autism and that it is much safer to have your child vaccinated than not. Furthermore, several of the original studies making this claim have since been retracted.<\/p>\r\n<p id=\"fs-idm28915072\">A published piece of work can be rescinded when data is called into question because of falsification, fabrication, or serious research design problems. Once rescinded, the scientific community is informed that there are serious problems with the original publication. Retractions can be initiated by the researcher who led the study, by research collaborators, by the institution that employed the researcher, or by the editorial board of the journal in which the article was originally published. In the vaccine-autism case, the retraction was made because of a significant conflict of interest in which the leading researcher had a financial interest in establishing a link between childhood vaccines and autism (Offit, 2008). Unfortunately, the initial studies received so much media attention that many parents around the world became hesitant to have their children vaccinated (<a class=\"autogenerated-content\" href=\"https:\/\/openstax.org\/books\/psychology-2e\/pages\/2-3-analyzing-findings#CNX_Psych_02_05_vaccine\">Figure PR.18<\/a>). Continued reliance on such debunked studies has significant consequences. For instance, between January and October of 2019, there were 22 measles outbreaks across the United States and more than a thousand cases of individuals contracting measles (Patel et al., 2019). This is likely due to the anti-vaccination movements that have risen from the debunked research. For more information about how the vaccine\/autism story unfolded, as well as the repercussions of this story, take a look at Paul Offit\u2019s book,\u00a0<em>Autism\u2019s False Prophets: Bad Science, Risky Medicine, and the Search for a Cure.<\/em><\/p>\r\n\r\n<div id=\"CNX_Psych_02_05_vaccine\" class=\"os-figure\">\r\n<figure>\r\n\r\n[caption id=\"\" align=\"aligncenter\" width=\"325\"]<img id=\"65709\" src=\"https:\/\/openstax.org\/resources\/d9f818637982cfda00fd5059461a4c8cdf73f608\" alt=\"A photograph shows a child being given an oral vaccine.\" width=\"325\" height=\"487\" \/> Figure PR.18\u00a0Some people still think vaccinations cause autism. (credit: modification of work by UNICEF Sverige)[\/caption]<\/figure>\r\n<\/div>\r\n<\/div>\r\n<\/section><\/div>\r\n<\/section><\/div>\r\n<\/div>\r\n<h3 class=\"os-title\"><span style=\"font-size: 1em\">Reliability and Validity<\/span><\/h3>\r\n<\/header><\/div>\r\n<\/section><section id=\"fs-idp8428288\">\r\n<p id=\"fs-idm12719232\" class=\"indent no-indent\">Reliability and validity are two important considerations that must be made with any type of data collection.\u00a0<strong><span id=\"term97\">Reliability<\/span><\/strong>\u00a0refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways. There are a number of different types of reliability. Some of these include <em>inter-rater reliability<\/em> (the degree to which two or more different observers agree on what has been observed), <em>internal consistency<\/em> (the degree to which different items on a survey that measure the same thing correlate with one another), and <em>test-retest reliability<\/em> (the degree to which the outcomes of a particular measure remain consistent over multiple administrations).<\/p>\r\n<p id=\"fs-idm47286192\">Unfortunately, being consistent in measurement does not necessarily mean that you have measured something correctly. To illustrate this concept, consider a kitchen scale that would be used to measure the weight of cereal that you eat in the morning. If the scale is not properly calibrated, it may consistently under- or overestimate the amount of cereal that\u2019s being measured. While the scale is highly reliable in producing consistent results (e.g., the same amount of cereal poured onto the scale produces the same reading each time), those results are incorrect. This is where validity comes into play.\u00a0<strong><span id=\"term98\">Validity<\/span><\/strong>\u00a0refers to the extent to which a given instrument or tool accurately measures what it\u2019s supposed to measure, and once again, there are a number of ways in which validity can be expressed. <em>Ecological validity<\/em> (the degree to which research results generalize to real-world applications), <em>construct validity<\/em> (the degree to which a given variable actually captures or measures what it is intended to measure), and <em>face validity<\/em> (the degree to which a given variable seems valid on the surface) are just a few types that researchers consider. While any valid measure is by necessity reliable, the reverse is not necessarily true. Researchers strive to use instruments that are both highly reliable and valid.<\/p>\r\n\r\n<div style=\"font-weight: 400\">\r\n\r\nTo illustrate how complicated it can be to determine the validity of a measure, let\u2019s look again at the original Bobo doll study. Bandura and colleagues were not only interested in whether children would imitate aggressive behaviours, they also wanted to know if observing same-sex adults would have a greater impact on children's behaviour than observing adults of a different sex. So how did they define sex? The children involved in the study were nursery school aged, so it\u2019s likely that the researchers simply did a visual assessment or asked their parents. Generally we now use \u2018sex\u2019 to refer to the different biological categories people might fit into, while \u2018gender\u2019 refers to the socially constructed characteristics we assign to those categories, and is something an individual must define for themselves. In this case, the researchers were really categorizing their participants based on assumed sex, rather than actual biological sex.\r\n\r\n<\/div>\r\n<div style=\"font-weight: 400\">\r\n\r\nA visual assessment of biological sex might seem to have clear face validity to many people, but as a measurement it is low in construct validity. That is, while it is often assumed that sex can be determined by looking at an individual\u2019s appearance, that approach has little ability to accurately measure biological sex. The assumption that biological sex is both binary and visually obvious results in a lack of research in populations of people who exist outside of those assumptions. This in turn means that the measure has little ecological validity, as these people do exist in real-world populations. To illustrate further, let\u2019s consider some of the ways biological sex has been traditionally assessed:\r\n<ul>\r\n \t<li>Visual assessment: In this approach, researchers would record \u2018sex\u2019 based on their visual assessment of the clothed participant. This might work for many individuals, but it\u2019s based on an assumption about the individual\u2019s reproductive biology, which is not reliably assessed by external appearance. There are female humans with beards, male humans without Adam\u2019s apples, and of course, transgender, non-binary, and intersex people whose bodies may not fit these assumed categories<\/li>\r\n \t<li>Medical records or birth certificates: In medical research, data is routinely collected about patient\u2019s demographics, so sex may be assessed simply by looking at a participants\u2019 medical record. However, given that biological sex assignment of infants at birth is based a visual assessment of the infant\u2019s external genitalia, which is used to categorize the infant as \u201cmale\u201d or \u201cfemale.\u201d While visually assessing the genitals of an individual may appear to be enough to determine their biological sex, this is unreliable for the reasons outlined above (visual assessment). A larger problem is this method of sex assignment at birth has been incredibly harmful to intersex people.<\/li>\r\n \t<li>Self-report: To avoid the issues described above, it may seem reasonable to ask participants to self-identify. This can present two issues: (1) most people\u2019s understanding of their own biological sex is based on their medical record or birth certificate, and not further testing (thus their beliefs about their biological sex may not be congruent with their actual biology). This may seem unlikely but remember birth certificates and the determination of biological sex of an infant at birth is not a foolproof way of getting this information. And, (2) as with all self-report measures, it\u2019s reliant upon the researchers providing appropriate categories (i.e., has intersex been included as an option) and the participant being truthful. Participants may not readily volunteer this information for reasons of privacy, safety, or simply because it makes navigating the world easier for them.<\/li>\r\n<\/ul>\r\n<div style=\"font-weight: 400\">\r\n\r\nWhile it may seem like something that ought to be easy, truly determining the biological sex of an individual can be difficult. The biological sex of an individual is determined by more than their external genitals, or whether they have a penis\/vagina. Some other determinants of biological sex include the internal gonads (ovaries or testes), predominant hormones (testosterone or estrogen), and chromosomal DNA (e.g., XX, XY). It is often assumed that the chromosomal DNA of a person is the truest indicator of their biological sex, however this does not always \u201cmatch\u201d gonadal, hormonal, or genital sex. Intersex is a general term applied to a variety of conditions which result in a person being born with anatomy that defies traditional male-female categorization. This could result in a person having atypical external genitalia, genitals that don\u2019t align with internal reproductive organs, or atypical chromosomal structures (despite typical anatomy). For instance, a person could be born with mosaic genetics, with both XX and XY chromosomes. These conditions may be present at birth, but often a person has no reason to suspect they are intersex until they reach puberty. In some cases, the condition may not even be discovered until post-mortem during a medical autopsy.\r\n\r\n<\/div>\r\n<div style=\"font-weight: 400\">\r\n\r\nIt\u2019s not impossible to determine an individual\u2019s biological sex, but sex should be operationally defined and data should be collected accordingly. As you go learn more about the scientific process and research, it\u2019s important to critically evaluate methods and findings. Participants are frequently divided into male-female categories and it\u2019s worth exploring the details of the methods to understand how scientists have actually measured biological sex and whether their approach may impact the validity of their conclusions.\r\n<div id=\"fs-idm46705312\" class=\"psychology link-to-learning ui-has-child-title\"><section>\r\n<div class=\"os-note-body\">\r\n<div class=\"textbox textbox--key-takeaways\"><header class=\"textbox__header\">\r\n<p class=\"textbox__title\"><span style=\"color: #ffffff\">LINK TO LEARNING<\/span><\/p>\r\n\r\n<\/header>\r\n<div class=\"textbox__content\">For more information on intersex conditions, check out the FAQ for interACT, an advocacy group for intersex youth:\u00a0<a href=\"https:\/\/interactadvocates.org\/faq\/\">https:\/\/interactadvocates.org\/faq\/<\/a><\/div>\r\n<\/div>\r\n<\/div>\r\n<\/section><\/div>\r\nNow that we understand the complexity of measuring biological sex, let\u2019s consider how it was it was assessed in the original Bobo doll study. There is no mention of biological measures being taken so we can assume that sex categorization was based on visual assessment or by report from the children\u2019s parents. We know now that this is not an accurate way to measure biological sex, so we should consider why sex was included in the experiment. Given that children were found to perceive their parents as having preferences for them to behave in \u2018sex appropriate\u2019 ways (eg. Girls playing with dolls and boys playing with trucks), the researchers hypothesized their participants would be more likely to imitate the behaviour of a same-sex model than a model of a different sex. They were interested in the effect that socially reinforced gender roles would have on imitated behaviour so the assumed sex of the children was all that mattered, as this would determine what behaviours would be discouraged or reinforced by adults. It\u2019s ok that no biological measures were taken for this study because biological sex wasn\u2019t actually relevant, but terms like sex and gender have often used interchangeably in research so it\u2019s important to think critically about how constructs are being operationally defined and measured. If Bandura and colleagues were to replicate this study today, we should hope that they would be more accurate and specific with their terminology and use something like \u2018assumed sex\/gender\u2019 rather than \u2018sex\u2019 to refer to the variable they were interested in. After all, this kind of specificity in language allows for more accurate understanding and replication, which can increase our confidence in their original conclusion. As you move forward in your degree and engage in research more directly, consider carefully what variables you are interested in, and do your best to choose language that is both specific and accurate.\r\n\r\n<\/div>\r\n<\/div>\r\n<\/section><\/header><\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>","rendered":"<div class=\"PageContent-ny9bj0-0 iapMdy\">\n<div id=\"main-content\" class=\"MainContent__HideOutline-sc-6yy1if-0 bdVAq\">\n<div id=\"44e86fdd-1b17-4e86-8c8b-945230d8133a\">\n<div id=\"47813\" class=\"ui-has-child-title\">\n<header>\n<div class=\"textbox textbox--learning-objectives\"><\/div>\n<\/header>\n<header class=\"textbox__header\">\n<p class=\"textbox__title\"><span style=\"color: #ffffff\">Learning Objectives<\/span><\/p>\n<\/header>\n<div class=\"textbox__content\">\n<p>By the end of this section, you will be able to:<\/p>\n<ul>\n<li>Explain what a correlation coefficient tells us about the relationship between variables<\/li>\n<li>Recognize that correlation does not indicate a cause-and-effect relationship between variables<\/li>\n<li>Discuss our tendency to look for relationships between variables that do not really exist<\/li>\n<li>Explain random sampling and assignment of participants into experimental and control groups<\/li>\n<li>Discuss how experimenter or participant bias could affect the results of an experiment<\/li>\n<li>Identify independent and dependent variables<\/li>\n<\/ul>\n<\/div>\n<\/div>\n<p id=\"fs-idm9597360\" class=\"indent no-indent\">Did you know that as sales in ice cream increase, so does the overall rate of crime? Is it possible that indulging in your favourite flavour of ice cream could send you on a crime spree? Or, after committing crime do you think you might decide to treat yourself to a cone? There is no question that a relationship exists between ice cream and crime (e.g., Harper, 2013), but it would be pretty foolish to decide that one thing actually caused the other to occur.<\/p>\n<p id=\"fs-idm8747152\">It is much more likely that both ice cream sales and crime rates are related to the temperature outside. When the temperature is warm, there are lots of people out of their houses, interacting with each other, getting annoyed with one another, and sometimes committing crimes. Also, when it is warm outside, we are more likely to seek a cool treat like ice cream. How do we determine if there is indeed a relationship between two things? And when there is a relationship, how can we discern whether it is attributable to coincidence or causation?<\/p>\n<section id=\"fs-idm28272816\">\n<h3>Correlational Research<\/h3>\n<p><strong><a id=\"TTcorrelational\"><\/a>TRICKY TOPIC: CORRELATIONAL RESEARCH<br \/>\n<\/strong><\/p>\n<p><iframe loading=\"lazy\" id=\"oembed-1\" title=\"Tricky Topics: Correlational Research Design in Psychology &amp; Neuroscience\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/9YTYuQa8p-U?feature=oembed&#38;rel=0\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p><span id=\"term70\"><em>If the video above does not load, click here: <a href=\"https:\/\/www.youtube.com\/watch?v=9YTYuQa8p-U&amp;feature=youtu.be\">https:\/\/www.youtube.com\/watch?v=9YTYuQa8p-U&amp;feature=youtu.be<\/a><\/em><br \/>\n<em>For a full transcript of this video, click <\/em><a href=\"\/intropsychneuro\/back-matter\/appendix\/#correlational\"><em>here<\/em><\/a><\/span><\/p>\n<p><span>Correlation<\/span>\u00a0means that there is a relationship between two or more variables (such as ice cream consumption and crime), but this relationship does not necessarily imply cause and effect. When two variables are correlated, it simply means that as one variable changes, so does the other. We can measure correlation by calculating a statistic known as a correlation coefficient. A<strong>\u00a0<span id=\"term71\">correlation coefficient<\/span>\u00a0<\/strong>is a number from -1 to +1 that indicates the strength and direction of the relationship between variables. The correlation coefficient is usually represented by the letter\u00a0<em>r<\/em>.<\/p>\n<p id=\"fs-idp46664736\">The number portion of the correlation coefficient indicates the strength of the relationship. The closer the number is to 1 (be it negative or positive), the more strongly related the variables are, and the more predictable changes in one variable will be as the other variable changes. The closer the number is to zero, the weaker the relationship, and the less predictable the relationships between the variables becomes. For instance, a correlation coefficient of 0.9 indicates a far stronger relationship than a correlation coefficient of 0.3. If the variables are not related to one another at all, the correlation coefficient is 0. The example above about ice cream and crime is an example of two variables that we might expect to have no relationship to each other.<\/p>\n<p>The sign\u2014positive or negative\u2014of the correlation coefficient indicates the direction of the relationship (<a class=\"autogenerated-content\" href=\"https:\/\/openstax.org\/books\/psychology-2e\/pages\/2-3-analyzing-findings#CNX_Psych_02_04_scatter\">Figure PR.11<\/a>). A\u00a0<strong><span id=\"term72\">positive correlation<\/span><\/strong>\u00a0means that the variables move in the same direction. Put another way, it means that as one variable increases so does the other, and conversely, when one variable decreases so does the other. A <strong>negative correlation <\/strong><i><\/i>means that the variables move in opposite directions. If two variables are negatively correlated, a decrease in one variable is associated with an increase in the other and vice versa.<\/p>\n<p id=\"fs-idm12626416\">The example of ice cream and crime rates is a positive correlation because both variables increase when temperatures are warmer. Other examples of positive correlations are the relationship between an individual\u2019s height and weight or the relationship between a person\u2019s age and number of wrinkles. One might expect a negative correlation to exist between someone\u2019s tiredness during the day and the number of hours they slept the previous night: the amount of sleep decreases as the feelings of tiredness increase. In a real-world example of negative correlation, student researchers at the University of Minnesota found a weak negative correlation (<em>r<\/em>\u00a0= -0.29) between the average number of days per week that students got fewer than 5 hours of sleep and their GPA (Lowry, Dean, &amp; Manders, 2010). Keep in mind that a negative correlation is not the same as no correlation. For example, we would probably find no correlation between hours of sleep and shoe size.<\/p>\n<p id=\"fs-idm4271152\">As mentioned earlier, correlations have predictive value. Imagine that you are on the admissions committee of a major university. You are faced with a huge number of applications, but you are able to accommodate only a small percentage of the applicant pool. How might you decide who should be admitted? You might try to correlate your current students\u2019 college GPA with their scores on standardized tests like the SAT or ACT. By observing which correlations were strongest for your current students, you could use this information to predict relative success of those students who have applied for admission into the university.<\/p>\n<div id=\"CNX_Psych_02_04_scatter\" class=\"os-figure\">\n<figure>\n<figure style=\"width: 975px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" id=\"91904\" src=\"https:\/\/openstax.org\/resources\/97caa41a4392d7220b4c21871bb6c94c0a0a3412\" alt=\"Three scatterplots are shown. Scatterplot (a) is labeled \u201cpositive correlation\u201d and shows scattered dots forming a rough line from the bottom left to the top right; the x-axis is labeled \u201cweight\u201d and the y-axis is labeled \u201cheight.\u201d Scatterplot (b) is labeled \u201cnegative correlation\u201d and shows scattered dots forming a rough line from the top left to the bottom right; the x-axis is labeled \u201ctiredness\u201d and the y-axis is labeled \u201chours of sleep.\u201d Scatterplot (c) is labeled \u201cno correlation\u201d and shows scattered dots having no pattern; the x-axis is labeled \u201cshoe size\u201d and the y-axis is labeled \u201chours of sleep.\u201d\" width=\"975\" height=\"300\" \/><figcaption class=\"wp-caption-text\">Figure PR.11 Scatterplots are a graphical view of the strength and direction of correlations. The stronger the correlation, the closer the data points are to a straight line. In these examples, we see that there is (a) a positive correlation between weight and height, (b) a negative correlation between tiredness and hours of sleep, and (c) no correlation between shoe size and hours of sleep.<\/figcaption><\/figure>\n<\/figure>\n<div class=\"textbox textbox--key-takeaways\">\n<header class=\"textbox__header\">\n<p class=\"textbox__title\"><span style=\"color: #ffffff\">LINK TO LEARNING<\/span><\/p>\n<\/header>\n<div class=\"textbox__content\">\n<p>Manipulate this\u00a0<a style=\"text-align: initial;font-family: Lora, serif;font-size: 1em;font-weight: normal\" href=\"https:\/\/rpsychologist.com\/correlation\/\" target=\"_blank\" rel=\"noopener nofollow\">interactive scatterplot<\/a><span style=\"text-align: initial;font-family: Lora, serif;font-size: 1em;font-weight: normal\">\u00a0to practice your understanding of positive and negative correlation.<\/span><\/p>\n<\/div>\n<\/div>\n<\/div>\n<section id=\"fs-idm84043200\">\n<h4>Correlation Does Not Indicate Causation<\/h4>\n<p id=\"fs-idp46775888\" class=\"indent no-indent\">Correlational research is useful because it allows us to discover the strength and direction of relationships that exist between two variables. However, correlation is limited because establishing the existence of a relationship tells us little about\u00a0<strong><span id=\"term74\">cause and effect<\/span><\/strong>. While variables are sometimes correlated because one does cause the other, it could also be that some other factor, a\u00a0<strong><span id=\"term75\">confounding variable<\/span><\/strong>, is actually causing the systematic movement in our variables of interest. In the ice cream\/crime rate example mentioned earlier, temperature is a confounding variable that could account for the relationship between the two variables.<\/p>\n<p id=\"fs-idm12088928\">Even when we cannot point to clear confounding variables, we should not assume that a correlation between two variables implies that one variable causes changes in another. This can be frustrating when a cause-and-effect relationship seems clear and intuitive. Think back to our discussion of the research done by the American Cancer Society and how their research projects were some of the first demonstrations of the link between smoking and cancer. It seems reasonable to assume that smoking causes cancer, but if we were limited to\u00a0<span id=\"term76\" class=\"no-emphasis\">correlational research<\/span>, we would be overstepping our bounds by making this assumption.<\/p>\n<p id=\"fs-idm37888912\">Unfortunately, people mistakenly make claims of causation as a function of correlations all the time. Such claims are especially common in advertisements and news stories. For example, recent research found that people who eat cereal on a regular basis achieve healthier weights than those who rarely eat cereal (Frantzen, Trevi\u00f1o, Echon, Garcia-Dominic, &amp; DiMarco, 2013; Barton et al., 2005). Guess how the cereal companies report this finding. Does eating cereal really cause an individual to maintain a healthy weight, or are there other possible explanations, such as, someone at a healthy weight is more likely to regularly eat a healthy breakfast than someone who is obese or someone who avoids meals in an attempt to diet (<a class=\"autogenerated-content\" href=\"https:\/\/openstax.org\/books\/psychology-2e\/pages\/2-3-analyzing-findings#CNX_Psych_02_04_cereal\">Figure PR.12<\/a>)? While correlational research is invaluable in identifying relationships among variables, a major limitation is the inability to establish causality. Psychologists want to make statements about cause and effect, but the only way to do that is to conduct an experiment to answer a research question. The next section describes how scientific experiments incorporate methods that eliminate, or control for, alternative explanations, which allow researchers to explore how changes in one variable cause changes in another variable.<\/p>\n<div id=\"CNX_Psych_02_04_cereal\" class=\"os-figure\">\n<figure>\n<figure style=\"width: 325px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" id=\"98487\" src=\"https:\/\/openstax.org\/resources\/8b9f7edcdb1d52de91dc6a890d91d06cdf18ddb0\" alt=\"A photograph shows a bowl of cereal.\" width=\"325\" height=\"244\" \/><figcaption class=\"wp-caption-text\">Figure PR.12 Does eating cereal really cause someone to be a healthy weight? (credit: Tim Skillern)<\/figcaption><\/figure>\n<\/figure>\n<\/div>\n<\/section>\n<section id=\"fs-idm54837568\">\n<h4>Illusory Correlations<\/h4>\n<p id=\"fs-idp9589232\" class=\"indent no-indent\">The temptation to make erroneous cause-and-effect statements based on correlational research is not the only way we tend to misinterpret data. We also tend to make the mistake of<strong> illusory correlations<\/strong>, especially with unsystematic observations.\u00a0<span id=\"term77\">Illusory correlations<\/span>, or false correlations, occur when people believe that relationships exist between two things when no such relationship exists. One well-known illusory correlation is the supposed effect that the moon\u2019s phases have on human behaviour. Many people passionately assert that human behaviour is affected by the phase of the moon, and specifically, that people act strangely when the moon is full (<a class=\"autogenerated-content\" href=\"https:\/\/openstax.org\/books\/psychology-2e\/pages\/2-3-analyzing-findings#CNX_Psych_02_04_moon\">Figure PR.13<\/a>).<\/p>\n<div id=\"CNX_Psych_02_04_moon\" class=\"os-figure\">\n<figure>\n<figure style=\"width: 325px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" id=\"82889\" src=\"https:\/\/openstax.org\/resources\/27d9385e8ab8ba755aad482bd8ecad4859be14bb\" alt=\"A photograph shows the moon.\" width=\"325\" height=\"216\" \/><figcaption class=\"wp-caption-text\">Figure PR.13 Many people believe that a full moon makes people behave oddly. (credit: Cory Zanker)<\/figcaption><\/figure>\n<\/figure>\n<p class=\"os-caption-container indent no-indent\"><span style=\"text-align: initial;font-size: 1em\">There is no denying that the moon exerts a powerful influence on our planet. The ebb and flow of the ocean\u2019s tides are tightly tied to the gravitational forces of the moon. Many people believe, therefore, that it is logical that we are affected by the moon as well. After all, our bodies are largely made up of water. A meta-analysis of nearly 40 studies consistently demonstrated, however, that the relationship between the moon and our behaviour does not exist (Rotton &amp; Kelly, 1985). While we may pay more attention to odd behaviour during the full phase of the moon, the rates of odd behaviour remain constant throughout the lunar cycle.<\/span><\/p>\n<\/div>\n<p id=\"fs-idm46730704\" class=\"indent no-indent\">Why are we so apt to believe in illusory correlations like this? Often we read or hear about them and simply accept the information as valid. Or, we have a hunch about how something works and then look for evidence to support that hunch, ignoring evidence that would tell us our hunch is false; this is known as\u00a0<span id=\"term78\">confirmation bias<\/span>. Other times, we find illusory correlations based on the information that comes most easily to mind, even if that information is severely limited. And while we may feel confident that we can use these relationships to better understand and predict the world around us, illusory correlations can have significant drawbacks. For example, research suggests that illusory correlations\u2014in which certain behaviours are inaccurately attributed to certain groups\u2014are involved in the formation of prejudicial attitudes that can ultimately lead to discriminatory behaviour (Fiedler, 2004).<\/p>\n<\/section>\n<\/section>\n<section id=\"fs-idp9975072\">\n<h3>Causality: Conducting Experiments and Using the Data<\/h3>\n<p id=\"fs-idm22387104\" class=\"indent no-indent\">As you\u2019ve learned, the only way to establish that there is a cause-and-effect relationship between two variables is to conduct a scientific\u00a0<span id=\"term79\" class=\"no-emphasis\">experiment<\/span>. Experiment has a different meaning in the scientific context than in everyday life. In everyday conversation, we often use it to describe trying something for the first time, such as experimenting with a new hair style or a new food. However, in the scientific context, an experiment has precise requirements for design and implementation.<\/p>\n<\/section>\n<p><strong><a id=\"TTexperimental\"><\/a>TRICKY TOPIC: EXPERIMENTAL RESEARCH<br \/>\n<\/strong><\/p>\n<p><iframe loading=\"lazy\" id=\"oembed-2\" title=\"Tricky Topics: Experimental Research Design in Psychology &amp; Neuroscience\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/iXT7zY5uKnE?feature=oembed&#38;rel=0\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p><em><span>If the video above does not load, click here:\u00a0<a href=\"https:\/\/www.youtube.com\/watch?v=iXT7zY5uKnE&amp;feature=youtu.be\"> https:\/\/www.youtube.com\/watch?v=9YTYuQa8p-U&amp;feature=youtu.be<\/a><br \/>\nFor a full transcript of this video, click <a href=\"\/intropsychneuro\/back-matter\/appendix\/#experimental\">here<\/a><\/span><\/em><\/p>\n<p class=\"no-indent\"><span style=\"font-family: 'Cormorant Garamond', serif;font-size: 1em;font-style: italic;font-weight: bold\">The Experimental Hypothesis<\/span><\/p>\n<p><span style=\"text-align: initial;text-indent: 2em;font-size: 1em\">In order to conduct an experiment, a researcher must have a specific\u00a0<\/span><span id=\"term80\" class=\"no-emphasis\" style=\"text-align: initial;text-indent: 2em;font-size: 1em\">hypothesis<\/span><span style=\"text-align: initial;text-indent: 2em;font-size: 1em\">\u00a0to be tested. As you\u2019ve learned, hypotheses can be formulated either through direct observation of the real world or after careful review of previous research.\u00a0<span class=\"TextRun SCXW240248436 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW240248436 BCX9\">If you\u2019ve ever spent time with a<\/span><span class=\"NormalTextRun SCXW240248436 BCX9\"> young child in a car you may have seen them mimicking the actions of the adult driving, pretending to turn the steering wheel or honk the horn. You may have also seen this kind of imitation in less neutral contexts, like a child repeating offensive language that they clearly don\u2019t understand. Based on this observation, it would be reasonable to think that children have a tendency to imitate <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW240248436 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW240248436 BCX9\"> they observe from others. You might make further observations from here, for example you might notice that children more often imitate <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW240248436 BCX9\">behaviours<\/span><span class=\"NormalTextRun SCXW240248436 BCX9\"> performed by adults rather than other children, or that this tendency for imitation could facilitate the development of aggressive <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW240248436 BCX9\">behaviours<\/span><span class=\"NormalTextRun SCXW240248436 BCX9\"> in children.<\/span><\/span><span class=\"EOP SCXW240248436 BCX9\">\u00a0<\/span><\/span><\/p>\n<section>\n<section id=\"fs-idm57740512\">\n<div id=\"CNX_Psych_02_05_toygun\" class=\"os-figure\">\n<figure id=\"attachment_2235\" aria-describedby=\"caption-attachment-2235\" style=\"width: 500px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-2235\" src=\"https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-content\/uploads\/sites\/21\/2020\/04\/sai-de-silva-cykFL7IQCTk-unsplash-1024x683.jpg\" alt=\"A parent sits on a motorcycle with their young child, both look into the rearview mirror, sticking out their tongues.\" width=\"500\" height=\"333\" srcset=\"https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-content\/uploads\/sites\/21\/2020\/04\/sai-de-silva-cykFL7IQCTk-unsplash-1024x683.jpg 1024w, https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-content\/uploads\/sites\/21\/2020\/04\/sai-de-silva-cykFL7IQCTk-unsplash-300x200.jpg 300w, https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-content\/uploads\/sites\/21\/2020\/04\/sai-de-silva-cykFL7IQCTk-unsplash-768x512.jpg 768w, https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-content\/uploads\/sites\/21\/2020\/04\/sai-de-silva-cykFL7IQCTk-unsplash-65x43.jpg 65w, https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-content\/uploads\/sites\/21\/2020\/04\/sai-de-silva-cykFL7IQCTk-unsplash-225x150.jpg 225w, https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-content\/uploads\/sites\/21\/2020\/04\/sai-de-silva-cykFL7IQCTk-unsplash-350x233.jpg 350w\" sizes=\"(max-width: 500px) 100vw, 500px\" \/><figcaption id=\"caption-attachment-2235\" class=\"wp-caption-text\">Figure PR.14 Do children imitate the adults they observe? (credit: Unsplash)<\/figcaption><\/figure>\n<\/div>\n<p id=\"fs-idp4153712\" class=\"indent no-indent\"><span class=\"TextRun SCXW57143820 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW57143820 BCX9\">These sorts of personal observations are what often lead us to formulate a specific hypothesis, but <\/span><span class=\"NormalTextRun SCXW57143820 BCX9\">we cannot use limited personal observations and anecdotal evidence to rigorously test our hypothesis. <\/span><span class=\"NormalTextRun SCXW57143820 BCX9\">Instead, to find out if real-world data supports our hypothesis, we have to conduct an experiment.<\/span><\/span><span class=\"EOP SCXW57143820 BCX9\">\u00a0<\/span><\/p>\n<\/section>\n<section id=\"fs-idp3024240\">\n<h4>Designing an Experiment<\/h4>\n<p id=\"fs-idp4610192\" class=\"indent no-indent\">The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference\u2014 experimental manipulation. The\u00a0<strong><span id=\"term81\">experimental group<\/span><\/strong>\u00a0gets the experimental manipulation\u2014that is, the treatment or variable being tested (in this case, the use of technology)\u2014and the\u00a0<strong><span id=\"term82\">control group<\/span><\/strong>\u00a0does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between the two are due to experimental manipulation rather than chance.<\/p>\n<p id=\"fs-idm22193024\"><span class=\"TextRun SCXW114149343 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW114149343 BCX9\">T<\/span><span class=\"NormalTextRun SCXW114149343 BCX9\">o investigate the relationship between observed aggression and imitated aggressive <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW114149343 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW114149343 BCX9\"> in children, our experimental manipulation will be to allow children to observe an adult modeling aggressive <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW114149343 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW114149343 BCX9\">. We might have the children in our experimental group play in a room where they are able to observe adults playing aggressively with toys, hitting, pushing and yelling at them. The study we are describing here is actually a simplified version of the famous 1961 Bobo doll study performed by <\/span><\/span><span class=\"TextRun MacChromeBold SCXW114149343 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW114149343 BCX9\">Albert Bandura, Dorothea Ross, and Sheila A. Ross, <\/span><\/span><span class=\"TextRun SCXW114149343 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW114149343 BCX9\">named as such because the toy used to demonstrate aggression was an inflatable clown doll called Bobo. We will touch more on work done by Bandura in greater detail in section 57 on observational learning.<\/span><\/span><span class=\"EOP SCXW114149343 BCX9\">\u00a0<\/span><\/p>\n<figure id=\"attachment_2242\" aria-describedby=\"caption-attachment-2242\" style=\"width: 538px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-2242\" src=\"https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-content\/uploads\/sites\/21\/2020\/04\/Bobo-textbook-1024x819.jpg\" alt=\"\" width=\"538\" height=\"430\" srcset=\"https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-content\/uploads\/sites\/21\/2020\/04\/Bobo-textbook-1024x819.jpg 1024w, https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-content\/uploads\/sites\/21\/2020\/04\/Bobo-textbook-300x240.jpg 300w, https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-content\/uploads\/sites\/21\/2020\/04\/Bobo-textbook-768x614.jpg 768w, https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-content\/uploads\/sites\/21\/2020\/04\/Bobo-textbook-65x52.jpg 65w, https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-content\/uploads\/sites\/21\/2020\/04\/Bobo-textbook-225x180.jpg 225w, https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-content\/uploads\/sites\/21\/2020\/04\/Bobo-textbook-350x280.jpg 350w\" sizes=\"(max-width: 538px) 100vw, 538px\" \/><figcaption id=\"caption-attachment-2242\" class=\"wp-caption-text\">Figure PR. 15 The Bobo doll, a bowling pin shaped inflatable toy with a clown printed on it. The toy is heavier at the base than it is at the top, so it rocks back and forth without falling over when pushed or struck.<\/figcaption><\/figure>\n<p><span class=\"TextRun SCXW194619472 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW194619472 BCX9\">We\u2019ve decided our <\/span><span class=\"NormalTextRun SCXW194619472 BCX9\">experimental condition will involve allowing children to observe adults modelling aggressive <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW194619472 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW194619472 BCX9\">, we now need to design a control group that differs only by a lack of exposure to aggressive adult models. <\/span><span class=\"NormalTextRun SCXW194619472 BCX9\">The original version of the Bobo doll study had a control group that did not observe any <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW194619472 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW194619472 BCX9\"> at all. Knowing what you now know about experimental design, would you design your control group in the same way? If a control group is meant to differ from an experimental group only in terms of the experimental manipulation, you might argue that a group exposed to nothing differs in several ways. For example, the experience of being made to sit in a room with a strange adult could theoretically provoke acts of aggression in young children. It might seem far-fetched, but we cannot infer that observation of aggression was the cause of our participant\u2019s <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW194619472 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW194619472 BCX9\"> if we don\u2019t rule out the possibility that other features of our manipulation could have contributed. The researchers used a second experimental group to rule out this possibility, but for the purposes of our hypothetical replication we have an experimental group who observe adults behaving aggressively with toys, and a control group who observe adults behaving non-aggressively with the same toys.<\/span><\/span><span class=\"EOP SCXW194619472 BCX9\">\u00a0<\/span><\/p>\n<p><span class=\"TextRun Highlight SCXW253445310 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW253445310 BCX9\">One of the most important parts of a scientific study is having a clear description of how each variable is measured, known as an <\/span><\/span><strong><span class=\"TextRun Highlight MacChromeBold SCXW253445310 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW253445310 BCX9\">operational definition<\/span><\/span><\/strong><span class=\"TextRun Highlight SCXW253445310 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW253445310 BCX9\">.<\/span><\/span><span class=\"TextRun Highlight SCXW253445310 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW253445310 BCX9\"> Some variables, like age and height, are easy to define, but psychologists are often interested in measuring abstract variables like thought, emotion, and <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW253445310 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW253445310 BCX9\"> which can be challenging. For example, can you operationally define helpfulness? People vary in how helpful they are, so there must be some way to measure this. This could be measured by looking at charitable donations on annual tax returns, but that\u2019s only one type of helpfulness and is biased towards wealthier individuals. What about number of hours per week volunteering? This operational definition also has its limitations in capturing helping <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW253445310 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW253445310 BCX9\">.<\/span><\/span><span class=\"TextRun Highlight SCXW253445310 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW253445310 BCX9\"> In our Bobo doll study, we will have to define aggression, which could be described in a variety of ways. For example, one might define aggression as <\/span><span class=\"NormalTextRun SCXW253445310 BCX9\">hostile, injurious, or destructive behaviour caused by frustration. However, this definition would require us to also measure frustration, as this feature is not externally observable. <\/span><\/span><span class=\"TextRun Highlight SCXW253445310 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW253445310 BCX9\">Researchers often create different operational definitions of the same variable, so providing a clear, <\/span><\/span><span class=\"TextRun Highlight SCXW253445310 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW253445310 BCX9\">measurable <\/span><\/span><span class=\"TextRun Highlight SCXW253445310 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW253445310 BCX9\">description is important in interpreting research findings.\u00a0<\/span><\/span><span class=\"EOP SCXW253445310 BCX9\">\u00a0<\/span><\/p>\n<div style=\"font-weight: 400\">\n<p>While it is possible to measure frustration through self-report, our study is interested in imitative aggression, and we do not know that imitative aggression is caused by frustration. So for the purposes of our hypothetical experiment, we could define aggressive behaviour as physical or verbal acts that have the potential to cause harm to an object or another human.\u00a0 We could then describe specific, observable aggressive behaviours like kicking the doll, throwing it, or saying things like \u201cstupid doll\u201d. Our adult models could perform these specific behaviours, and we could measure the rate at which participants imitate those acts when given an opportunity to play with the same doll later. The imitation of those previously described acts would be considered imitative aggression. Having defined our variables like this, we are able to communicate specifically what we have measured, which makes it easier for other researchers to replicate our experiment and check our results.<\/p>\n<\/div>\n<div style=\"font-weight: 400\">\n<p>We\u2019ve operationalized our variables, so now we can decide how our experiment will run. In this case, we could allow our participants to play in a room with an adult model who would perform a set of specifically defined behaviours (either aggressive or non-aggressive) to a doll. We could then move our participants to a different room with the same set of toys and count how many of those specifically defined behaviours they reproduce.<\/p>\n<\/div>\n<p id=\"fs-idm43450704\">Ideally, the people who count imitated behaviours are unaware of who was assigned to the experimental or control group, in order to control for experimenter bias.\u00a0<strong><span id=\"term84\">Experimenter bias<\/span>\u00a0<\/strong>refers to the possibility that a researcher\u2019s expectations might skew the results of the study. Remember, conducting an experiment requires a lot of planning, and the people involved in the research project have a vested interest in supporting their hypotheses. If the observers knew which child was in which group, it might influence how they interpret ambiguous responses, such as squeezing the doll. By being blind to which child is in which group, we protect against those biases. This situation is a<strong>\u00a0<span id=\"term85\">single-blind study<\/span><\/strong>, meaning that one of the groups (participants) are unaware as to which group they are in (experiment or control group) while the researcher who developed the experiment knows which participants are in each group.<\/p>\n<p id=\"fs-idm30047504\">In a<strong>\u00a0<span id=\"term86\">double-blind study<\/span><\/strong>, both the researchers and the participants are blind to group assignments,\u00a0<span class=\"TextRun SCXW127479651 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW127479651 BCX9\">which allows us to control for both experimenter and participant expectations. A well-known example of this is the <\/span><\/span><span class=\"TextRun MacChromeBold SCXW127479651 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW127479651 BCX9\"><strong>placebo effect<\/strong>,\u00a0which\u00a0<\/span><\/span>occurs when people&#8217;s expectations or beliefs influence or determine their experience in a given situation. In other words, simply expecting something to happen can actually make it happen.<\/p>\n<div style=\"font-weight: 400\">\n<p>To illustrate, imagine that you have bad allergies and are taking part in a study testing a new allergy medication. You go to a university or hospital setting to take part in the experiment, speaking to people in lab coats with medical authority who do a number of tests on you and then give you a pill. Whether the pill contains actual medication or not, the experience of taking part and receiving the pill may give the treatment a sense of legitimacy. You may feel hopeful and proactive about your bad allergies, and as a result you may notice an actual improvement in symptoms even if you only took a sugar pill.<\/p>\n<\/div>\n<div style=\"font-weight: 400\">\n<p>As we know, we can only say that our experimental manipulation (in this case the medication) is the cause of our results if it is the only difference between the experimental and control groups. As a result, we might use a placebo control, where the only difference between the two groups would be the contents of the pill- medicine or something inert. To ensure that all other conditions are the same, participants must not know whether they have received the drug- if they knew, we wouldn\u2019t be able to tell whether the effects were due to expectations about drug efficacy or to the actual drug. Similarly, if the researchers know which drug participants are receiving they might treat participants differently, which could alter the way participants respond\u00a0<span style=\"text-align: initial;font-size: 1em\">(<\/span><a class=\"autogenerated-content\" style=\"text-align: initial;font-size: 1em\" href=\"https:\/\/openstax.org\/books\/psychology-2e\/pages\/2-3-analyzing-findings#CNX_Psych_02_05_placebo\">Figure PR.15<\/a><span style=\"text-align: initial;font-size: 1em\">).<\/span><\/p>\n<\/div>\n<div id=\"CNX_Psych_02_05_placebo\" class=\"os-figure\">\n<figure>\n<figure style=\"width: 488px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" id=\"31885\" src=\"https:\/\/openstax.org\/resources\/6a44cc88807b4da187e437b2c86cf4ea3e269db5\" alt=\"Three pill bottles are displayed. The labels on the bottles read \u2018Cebocap No. 1 placebo\u2019, \u2018Cebocap No. 2 placebo\u2019, and \u2018Cebocap No. 3 Placebo\u2019 respectively.\" width=\"488\" height=\"368\" \/><figcaption class=\"wp-caption-text\">Figure PR.15 Providing the control group with a placebo treatment protects against bias caused by expectancy. (credit: Elaine and Arthur Shapiro)<\/figcaption><\/figure>\n<\/figure>\n<div class=\"os-caption-container\"><span style=\"font-family: 'Cormorant Garamond', serif;font-size: 1em;font-style: italic;font-weight: bold\">Independent and Dependent Variables<\/span><\/div>\n<div><\/div>\n<\/div>\n<\/section>\n<section id=\"fs-idm4342688\">\n<p id=\"fs-idp4642816\" class=\"indent no-indent\">In a research experiment, we strive to study whether changes in one thing cause changes in another. To achieve this, we must pay attention to two important variables, or things that can be changed, in any experimental study: the independent variable and the dependent variable. An<strong><span id=\"term88\">independent variable<\/span><\/strong>\u00a0is manipulated or controlled by the experimenter. In a well-designed experimental study, the independent variable is the only important difference between the experimental and control groups.\u00a0<span class=\"TextRun SCXW252625613 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW252625613 BCX9\">In our example of how the observation of aggressive <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW252625613 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW252625613 BCX9\"> affects later <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW252625613 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW252625613 BCX9\">, the independent variable is the type of <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW252625613 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW252625613 BCX9\"> observed by the participants.<\/span><\/span> (<a class=\"autogenerated-content\" href=\"https:\/\/openstax.org\/books\/psychology-2e\/pages\/2-3-analyzing-findings#CNX_Psych_02_05_variables\">Figure PR.16<\/a>). A\u00a0<strong><span id=\"term89\">dependent variable<\/span><\/strong>\u00a0is what the researcher measures to see how much effect the independent variable had.<span class=\"TextRun SCXW203181323 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW203181323 BCX9\">In our example, the dependent variable is the number of modelled aggressive <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW203181323 BCX9\">behaviours<\/span><span class=\"NormalTextRun SCXW203181323 BCX9\"> our participants imitate.<\/span><\/span><\/p>\n<figure id=\"attachment_2237\" aria-describedby=\"caption-attachment-2237\" style=\"width: 538px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-2237\" src=\"https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-content\/uploads\/sites\/21\/2020\/04\/Bandura_Bobo_doll_experiments_video_stills.jpg\" alt=\"The image displays three rows of four photos each. In the first row from left to right, an adult is seen sitting on a bobo doll, throwing a bobo doll, punching a bobo doll, and kicking a bobo doll. In the second and third rows, two different children are seen imitating the same actions.\" width=\"538\" height=\"314\" srcset=\"https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-content\/uploads\/sites\/21\/2020\/04\/Bandura_Bobo_doll_experiments_video_stills.jpg 412w, https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-content\/uploads\/sites\/21\/2020\/04\/Bandura_Bobo_doll_experiments_video_stills-300x175.jpg 300w, https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-content\/uploads\/sites\/21\/2020\/04\/Bandura_Bobo_doll_experiments_video_stills-65x38.jpg 65w, https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-content\/uploads\/sites\/21\/2020\/04\/Bandura_Bobo_doll_experiments_video_stills-225x132.jpg 225w, https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-content\/uploads\/sites\/21\/2020\/04\/Bandura_Bobo_doll_experiments_video_stills-350x205.jpg 350w\" sizes=\"(max-width: 538px) 100vw, 538px\" \/><figcaption id=\"caption-attachment-2237\" class=\"wp-caption-text\">Figure PR.16 In an experiment, manipulations of the independent variable are expected to result in changes in the dependent variable. (source: wikimedia commons)<\/figcaption><\/figure>\n<p>&nbsp;<\/p>\n<p class=\"indent no-indent\"><span style=\"text-align: initial;font-size: 1em\">We expect that the dependent variable will change as a function of the independent variable. In other words, the dependent variable\u00a0<\/span><em style=\"text-align: initial;font-size: 1em\">depends<\/em><span style=\"text-align: initial;font-size: 1em\">\u00a0on the independent variable. A good way to think about the relationship between the independent and dependent variables is with this question: What effect does the independent variable have on the dependent variable?<span class=\"TextRun SCXW225656347 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW225656347 BCX9\">In our example of how the observation of aggressive <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW225656347 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW225656347 BCX9\"> affects later <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW225656347 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW225656347 BCX9\">, the independent variable is the type of <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW225656347 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW225656347 BCX9\"> observed by the participants.<\/span><\/span><span class=\"EOP SCXW225656347 BCX9\">\u00a0<\/span><\/span><\/p>\n<\/section>\n<section id=\"fs-idm13736208\">\n<h4>Selecting and Assigning Experimental Participants<\/h4>\n<p id=\"fs-idm35111680\" class=\"indent no-indent\">Now that our study is designed, we need to obtain a sample of individuals to include in our experiment. Our study involves human participants so we need to determine who to include.\u00a0<strong><span id=\"term90\">Participants<\/span>\u00a0<\/strong>are the subjects of psychological research, and as the name implies, individuals who are involved in psychological research actively participate in the process. Often, psychological research projects rely on college students to serve as participants. In fact, the vast majority of research in psychology subfields has historically involved students as research participants (Sears, 1986; Arnett, 2008). But are college students truly representative of the general population? College students tend to be younger, more educated, more liberal, and less diverse than the general population. Although using students as test subjects is an accepted practice, relying on such a limited pool of research participants can be problematic because it is difficult to generalize findings to the larger population.<\/p>\n<p id=\"fs-idm53871616\">Our hypothetical experiment involves\u00a0<span class=\"TextRun SCXW199198023 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW199198023 BCX9\">preschool aged children, so we need to generate a sample from that population.\u00a0<\/span><\/span>Samples are used because populations are usually too large to reasonably involve every member in our particular experiment (<a class=\"autogenerated-content\" href=\"https:\/\/openstax.org\/books\/psychology-2e\/pages\/2-3-analyzing-findings#CNX_Psych_02_05_sample\">Figure PR.17<\/a>).\u00a0<span class=\"TextRun SCXW126176439 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW126176439 BCX9\">If possible, we should use a random sample (there are other types of samples, but for the purposes of this chapter, we will focus on random samples). A <\/span><\/span><strong><span class=\"TextRun MacChromeBold SCXW126176439 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW126176439 BCX9\">random sample<\/span><\/span><\/strong><span class=\"TextRun SCXW126176439 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW126176439 BCX9\"> is a subset of a larger population in which every member of the population has an equal chance of being selected. Random samples are preferred because if the sample is large enough we can be reasonably sure that the participating individuals are representative of the larger population. This means that the percentages of characteristics in the sample\u2014sex, ethnicity, socioeconomic level, and any other characteristics that might affect the results\u2014are close to those percentages in the larger population. Additionally, random sampling ensures that differences in characteristics are relatively balanced between groups.<\/span><\/span><span class=\"EOP SCXW126176439 BCX9\">\u00a0<\/span><\/p>\n<p id=\"fs-idm59772960\">In our example,\u00a0<span class=\"TextRun SCXW106477386 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW106477386 BCX9\">w<\/span><span class=\"NormalTextRun SCXW106477386 BCX9\">e\u2019re interested in pre-school aged children, but we can\u2019t possibly include all pre-school aged children in our study so we need to be more specific; instead we might say our population of interest is all pre-school aged children in a particular city. We should include children from various income brackets, family situations, races, ethnicities, religions, and geographic areas of town. With this more manageable population, we can work with local preschools to select a random sample of around 200 children who we want to participate in our experiment.<\/span><\/span><span class=\"EOP SCXW106477386 BCX9\">\u00a0<\/span><\/p>\n<p id=\"fs-idm43561728\">In summary, because we cannot test all of the pre-school aged children in a city, we want to find a group of about 200 that reflects the composition of that city. With a representative group, we can generalize our findings to the larger population without fear of our sample being biased in some way.\u00a0<span class=\"TextRun SCXW129861775 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW129861775 BCX9\">In the original version of this study, the sample was composed of 72 children from the Stanford University Nursery School. Can you think of some ways in which a sample drawn exclusively from a wealthy universities\u2019 nursery school might be biased?<\/span><\/span><span class=\"EOP SCXW129861775 BCX9\">\u00a0<\/span><\/p>\n<div id=\"CNX_Psych_02_05_sample\" class=\"os-figure\">\n<figure>\n<figure style=\"width: 649px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" id=\"18921\" src=\"https:\/\/openstax.org\/resources\/070dfd277b2ebc6bb0e6a4e7abd433e1a72c7043\" alt=\"(a) A photograph shows an aerial view of crowds on a street. (b) A photograph shows s small group of children.\" width=\"649\" height=\"248\" \/><figcaption class=\"wp-caption-text\">Figure PR.17 Researchers may work with (a) a large population or (b) a sample group that is a subset of the larger population. (credit \u201ccrowd\u201d: modification of work by James Cridland; credit \u201cstudents\u201d: modification of work by Laurie Sullivan)<\/figcaption><\/figure>\n<\/figure>\n<\/div>\n<p id=\"fs-idm58025968\" class=\"indent no-indent\">Now that we have a sample, the next step of the experimental process is to split the participants into experimental and control groups through<strong> random assignment<\/strong>. With\u00a0<span id=\"term92\">random assignment<\/span>, all participants have an equal chance of being assigned to either group. There is statistical software that will randomly assign each of the children in the sample to either the experimental or the control group.<\/p>\n<p id=\"fs-idm22541664\">Random assignment is critical for sound\u00a0<span id=\"term93\" class=\"no-emphasis\">experimental design<\/span>. With sufficiently large samples, random assignment makes it unlikely that there are systematic differences between the groups. So, for instance, it would be very unlikely that we would get one group composed entirely of males, a given ethnic identity, or a given religious ideology. This is important because if the groups were systematically different before the experiment began, we would not know the origin of any differences we find between the groups: Were the differences preexisting, or were they caused by manipulation of the independent variable?\u00a0<span class=\"TextRun SCXW252141257 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW252141257 BCX9\">Even using random assignment it is possible to have groups that differ significantly from each other, so it is important to monitor any variable we think might impact our results. If we do find that a variable of interest differs significantly between groups, we can <\/span><span class=\"NormalTextRun SCXW252141257 BCX9\">match them on that variable<\/span><\/span><span class=\"TextRun MacChromeBold SCXW252141257 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW252141257 BCX9\">. <strong>Matching<\/strong><\/span><\/span><span class=\"TextRun SCXW252141257 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW252141257 BCX9\"> is a practice where participants in the experimental group are paired with participants in the control group that have similar scores on a variable of interest.<\/span><span class=\"NormalTextRun SCXW252141257 BCX9\"> For example, In the Bobo doll study participants were scored on their baseline levels of aggression. If their experimental group was found to be significantly more aggressive than their control group prior to any experimental manipulation, then they would not have been able to infer that the results were due to their manipulation. To avoid this outcome the researchers matched children in different groups with similar levels of baseline aggression, so that the groups would be roughly equivalent on that variable.<\/span> <\/span>Random assignment, monitoring variables, and matching allow us to assume that any differences observed between experimental and control groups result from the manipulation of the independent variable.<\/p>\n<div id=\"fs-idm46705312\" class=\"psychology link-to-learning ui-has-child-title\">\n<section>\n<div class=\"os-note-body\">\n<div class=\"textbox textbox--key-takeaways\">\n<header class=\"textbox__header\">\n<p class=\"textbox__title\"><span style=\"color: #ffffff\">LINK TO LEARNING<\/span><\/p>\n<\/header>\n<div class=\"textbox__content\">Use this\u00a0<a href=\"https:\/\/www.randomizer.org\/\" target=\"_blank\" rel=\"noopener nofollow\">online random number generator<\/a>\u00a0to learn more about random sampling and assignments.<\/div>\n<\/div>\n<\/div>\n<\/section>\n<\/div>\n<\/section>\n<section id=\"fs-idm26660352\">\n<h4>Issues to Consider<\/h4>\n<p id=\"fs-idm84373440\" class=\"indent no-indent\">While experiments allow scientists to make cause-and-effect claims, they are not without problems. True experiments require the experimenter to manipulate an independent variable, and that can complicate many questions that psychologists might want to address. For instance, imagine that you want to know what effect sex (the independent variable) has on spatial memory (the dependent variable). Although you can certainly look for differences between people with different biological sexes on a task that taps into spatial memory, you cannot directly control a person\u2019s sex. We categorize this type of research approach as quasi-experimental and recognize that we cannot make cause-and-effect claims in these circumstances.<\/p>\n<p id=\"fs-idm110237888\">Experimenters are also limited by ethical constraints. For instance, you would not be able to conduct an experiment designed to determine if experiencing abuse as a child leads to lower levels of self-esteem among adults. To conduct such an experiment, you would need to randomly assign some experimental participants to a group that receives abuse, and that experiment would be unethical.<\/p>\n<\/section>\n<section id=\"fs-idp16962688\">\n<h4>Interpreting Experimental Findings<\/h4>\n<p id=\"fs-idp27164832\" class=\"indent no-indent\">Once data is collected from both the experimental and the control groups, a\u00a0<strong><span id=\"term94\">statistical analysis<\/span><\/strong>\u00a0is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). For example, if an experiment is done on the effectiveness of a nutritional supplement, and those taking a placebo pill (and not the supplement) have the same result as those taking the supplement, then the experiment has shown that the nutritional supplement is not effective. Generally, psychologists consider differences to be statistically significant if there is less than a five percent chance of observing them if the groups did not actually differ from one another. Stated another way, psychologists want to limit the chances of making \u201cfalse positive\u201d claims to five percent or less.<\/p>\n<p>The greatest strength of experiments is the ability to assert that any significant differences in the findings are caused by the independent variable. This occurs because random selection, random assignment, and a design that limits the effects of both experimenter bias and participant expectancy should create groups that are similar in composition and treatment. Therefore, any difference between the groups is attributable to the independent variable, and now we can finally make a causal statement.\u00a0<span class=\"TextRun SCXW145964823 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW145964823 BCX9\">If we find that observing aggressive <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW145964823 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW145964823 BCX9\"> results in more imitated aggression than observing non-aggressive <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW145964823 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW145964823 BCX9\">, we can safely say that exposure to aggressive <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW145964823 BCX9\">behaviour<\/span><span class=\"NormalTextRun SCXW145964823 BCX9\"> causes an increase in imitated aggression.<\/span><\/span><span class=\"EOP SCXW145964823 BCX9\">\u00a0<\/span><\/p>\n<p>&nbsp;<\/p>\n<p><strong><a id=\"TTstatmeasures\"><\/a>TRICKY TOPIC: STATISTICAL MEASURES<\/strong><\/p>\n<p><iframe loading=\"lazy\" id=\"oembed-3\" title=\"Tricky Topics: Statistical Measures\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/uV87qt1iRkA?feature=oembed&#38;rel=0\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<\/section>\n<section id=\"fs-idm35834672\"><em><span>If the video above does not load, click here: <a href=\"https:\/\/youtu.be\/uV87qt1iRkA\">https:\/\/youtu.be\/uV87qt1iRkA<\/a><br \/>\nFor a full transcript of this video, click <a href=\"\/intropsychneuro\/back-matter\/appendix\/#statmeasures\">here<\/a><\/span><\/em><\/section>\n<h3 class=\"no-indent\"><em>Reporting Research<\/em><\/h3>\n<p id=\"fs-idm40325120\" class=\"indent no-indent\">When psychologists complete a research project, they generally want to share their findings with other scientists. The American Psychological Association (APA) publishes a manual detailing how to write a paper for submission to scientific journals. Unlike an article that might be published in a magazine like\u00a0<em>Psychology Today,\u00a0<\/em>which targets a general audience with an interest in psychology, scientific journals generally publish\u00a0<span id=\"term95\"><strong>peer-reviewed journal articles<\/strong><\/span><strong>\u00a0<\/strong>aimed at an audience of professionals and scholars who are actively involved in research themselves.<\/p>\n<div id=\"fs-idm22108992\" class=\"psychology link-to-learning ui-has-child-title\">\n<header><\/header>\n<section>\n<div class=\"os-note-body\">\n<div class=\"textbox textbox--key-takeaways\">\n<header class=\"textbox__header\">\n<p class=\"textbox__title\"><span style=\"color: #ffffff\">LINK TO LEARNING<\/span><\/p>\n<\/header>\n<div class=\"textbox__content\">The\u00a0<a href=\"https:\/\/owl.purdue.edu\/\" target=\"_blank\" rel=\"noopener nofollow\">Online Writing Lab (OWL)<\/a>\u00a0at Purdue University can walk you through the APA writing guidelines.<\/div>\n<\/div>\n<\/div>\n<\/section>\n<\/div>\n<p id=\"fs-idm62557504\" class=\"indent no-indent\">A peer-reviewed journal article is read by several other scientists (generally anonymously) with expertise in the subject matter. These peer reviewers provide feedback\u2014to both the author and the journal editor\u2014regarding the quality of the draft. Peer reviewers look for a strong rationale for the research being described, a clear description of how the research was conducted, and evidence that the research was conducted in an ethical manner. They also look for flaws in the study&#8217;s design, methods, and statistical analyses. They check that the conclusions drawn by the authors seem reasonable given the observations made during the research. Peer reviewers also comment on how valuable the research is in advancing the discipline\u2019s knowledge. This helps prevent unnecessary duplication of research findings in the scientific literature and, to some extent, ensures that each research article provides new information. Ultimately, the journal editor will compile all of the peer reviewer feedback and determine whether the article will be published in its current state (a rare occurrence), published with revisions, or not accepted for publication.<\/p>\n<p id=\"fs-idm25798976\">Peer review provides some degree of quality control for psychological research.\u00a0<span class=\"TextRun SCXW225408219 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW225408219 BCX9\">Poorly conceived or executed studies can be weeded out, well-designed research can be improved, and ideally, studies can be described clearly enough to allow other scientists to <\/span><\/span><strong><span class=\"TextRun MacChromeBold SCXW225408219 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW225408219 BCX9\">replicate<\/span><\/span><\/strong><span class=\"TextRun SCXW225408219 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW225408219 BCX9\"> them, which helps to determine reliability.<\/span><\/span><span class=\"EOP SCXW225408219 BCX9\">\u00a0<\/span><\/p>\n<p><span class=\"TextRun SCXW44549156 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW44549156 BCX9\">So why would we want to replicate a study? Imagine that our version of the Bobo doll study is done exactly the same as the original, only using a different set of participants and researchers. We use the same operational definitions, manipulations, measurements, and procedures, and our groups are equivalent in terms of their baseline levels of aggression. In our replication however, we receive completely different results and the children do not imitate aggressive <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW44549156 BCX9\">behaviours<\/span><span class=\"NormalTextRun SCXW44549156 BCX9\"> any more than they would at the level of chance. If our experimental manipulation is exactly the same, then the difference in results must be attributable to something else that is different between our study and the original, which might include the researchers, participants, and location. If on the other hand, we were able to replicate the results of the original experiment using different researchers and participants at a different location, then this would provide support for the idea that the results were due to the manipulation and not to any of these other variables. The more we can replicate a result with different samples, the more reliable it is.<\/span><\/span><span class=\"EOP SCXW44549156 BCX9\">\u00a0<\/span><\/p>\n<p id=\"zip-idm382014320\">In recent years, there has been increasing concern about a \u201creplication crisis\u201d that has affected a number of scientific fields, including psychology.\u00a0<span class=\"NormalTextRun SCXW51075474 BCX9\">One study found that only about 62% of social science studies reviewed were replicable, and even then their effect sizes were reduced by half (<\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW51075474 BCX9\">Cramerer<\/span><span class=\"NormalTextRun SCXW51075474 BCX9\"> et. al, 2018).<\/span> In fact, even a famous Nobel Prize-winning scientist has recently retracted a published paper because she had difficulty replicating her results (Nobel Prize-winning scientist Frances Arnold retracts paper, 2020 January 3). These kinds of outcomes have prompted some scientists to begin to work together and more openly, and some would argue that the current \u201ccrisis\u201d is actually improving the ways in which science is conducted and in how its results are shared with others (Aschwanden, 2018).\u00a0<span class=\"TextRun SCXW44318343 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW44318343 BCX9\">One example of this more collaborative approach is the <\/span><\/span><span class=\"TextRun MacChromeBold SCXW44318343 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW44318343 BCX9\">Psychological Science Accelerator<\/span><\/span><span class=\"TextRun SCXW44318343 BCX9\" lang=\"EN\" xml:lang=\"EN\"><span class=\"NormalTextRun SCXW44318343 BCX9\">, a network of over 500 laboratories, representing 82 countries. This network allows researchers to pre-register their study designs, which minimizes any cherry-picking that might happen along the way to boost results. The network also facilitates data collection across multiple labs, allowing for the use of large, diverse samples and more wide-spread sharing of results. Hopefully with a more collaborative approach, we can develop a better process for replicating and quality checking research.\u00a0<\/span><\/span><span class=\"EOP SCXW44318343 BCX9\">\u00a0<\/span><\/p>\n<p>&nbsp;<\/p>\n<div class=\"psychology link-to-learning ui-has-child-title\">\n<header><\/header>\n<section>\n<div class=\"os-note-body\">\n<div class=\"textbox textbox--key-takeaways\">\n<header class=\"textbox__header\">\n<p class=\"textbox__title\"><span style=\"color: #ffffff\">LINK TO LEARNING<\/span><\/p>\n<\/header>\n<div class=\"textbox__content\">If you&#8217;d like to learn more about the Psychological Sciences Accelerator, you can check out their website here:\u00a0<a href=\"https:\/\/psysciacc.org\/\">https:\/\/psysciacc.org\/<\/a><\/div>\n<\/div>\n<\/div>\n<\/section>\n<\/div>\n<div id=\"fs-idp8756544\" class=\"psychology dig-deeper ui-has-child-title\">\n<header>\n<div class=\"textbox textbox--exercises\"><\/div>\n<\/header>\n<header class=\"textbox__header\">\n<p class=\"textbox__title\"><span style=\"color: #ffffff\">DIG DEEPER<\/span><\/p>\n<\/header>\n<div class=\"textbox__content\">\n<section>\n<div class=\"psychology dig-deeper ui-has-child-title\">\n<section>\n<div class=\"os-note-body\">\n<h4 id=\"11452\" class=\"os-subtitle\"><span class=\"os-subtitle-label\">The Vaccine-Autism Myth and Retraction of Published Studies<\/span><\/h4>\n<p id=\"fs-idm6414480\" class=\"indent no-indent\">Some scientists have claimed that routine childhood vaccines cause some children to develop autism, and, in fact, several peer-reviewed publications published research making these claims. Since the initial reports, large-scale epidemiological research has suggested that vaccinations are not responsible for causing autism and that it is much safer to have your child vaccinated than not. Furthermore, several of the original studies making this claim have since been retracted.<\/p>\n<p id=\"fs-idm28915072\">A published piece of work can be rescinded when data is called into question because of falsification, fabrication, or serious research design problems. Once rescinded, the scientific community is informed that there are serious problems with the original publication. Retractions can be initiated by the researcher who led the study, by research collaborators, by the institution that employed the researcher, or by the editorial board of the journal in which the article was originally published. In the vaccine-autism case, the retraction was made because of a significant conflict of interest in which the leading researcher had a financial interest in establishing a link between childhood vaccines and autism (Offit, 2008). Unfortunately, the initial studies received so much media attention that many parents around the world became hesitant to have their children vaccinated (<a class=\"autogenerated-content\" href=\"https:\/\/openstax.org\/books\/psychology-2e\/pages\/2-3-analyzing-findings#CNX_Psych_02_05_vaccine\">Figure PR.18<\/a>). Continued reliance on such debunked studies has significant consequences. For instance, between January and October of 2019, there were 22 measles outbreaks across the United States and more than a thousand cases of individuals contracting measles (Patel et al., 2019). This is likely due to the anti-vaccination movements that have risen from the debunked research. For more information about how the vaccine\/autism story unfolded, as well as the repercussions of this story, take a look at Paul Offit\u2019s book,\u00a0<em>Autism\u2019s False Prophets: Bad Science, Risky Medicine, and the Search for a Cure.<\/em><\/p>\n<div id=\"CNX_Psych_02_05_vaccine\" class=\"os-figure\">\n<figure>\n<figure style=\"width: 325px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" id=\"65709\" src=\"https:\/\/openstax.org\/resources\/d9f818637982cfda00fd5059461a4c8cdf73f608\" alt=\"A photograph shows a child being given an oral vaccine.\" width=\"325\" height=\"487\" \/><figcaption class=\"wp-caption-text\">Figure PR.18\u00a0Some people still think vaccinations cause autism. (credit: modification of work by UNICEF Sverige)<\/figcaption><\/figure>\n<\/figure>\n<\/div>\n<\/div>\n<\/section>\n<\/div>\n<\/section>\n<\/div>\n<\/div>\n<h3 class=\"os-title\"><span style=\"font-size: 1em\">Reliability and Validity<\/span><\/h3>\n<\/section>\n<\/div>\n<section id=\"fs-idp8428288\">\n<p id=\"fs-idm12719232\" class=\"indent no-indent\">Reliability and validity are two important considerations that must be made with any type of data collection.\u00a0<strong><span id=\"term97\">Reliability<\/span><\/strong>\u00a0refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways. There are a number of different types of reliability. Some of these include <em>inter-rater reliability<\/em> (the degree to which two or more different observers agree on what has been observed), <em>internal consistency<\/em> (the degree to which different items on a survey that measure the same thing correlate with one another), and <em>test-retest reliability<\/em> (the degree to which the outcomes of a particular measure remain consistent over multiple administrations).<\/p>\n<p id=\"fs-idm47286192\">Unfortunately, being consistent in measurement does not necessarily mean that you have measured something correctly. To illustrate this concept, consider a kitchen scale that would be used to measure the weight of cereal that you eat in the morning. If the scale is not properly calibrated, it may consistently under- or overestimate the amount of cereal that\u2019s being measured. While the scale is highly reliable in producing consistent results (e.g., the same amount of cereal poured onto the scale produces the same reading each time), those results are incorrect. This is where validity comes into play.\u00a0<strong><span id=\"term98\">Validity<\/span><\/strong>\u00a0refers to the extent to which a given instrument or tool accurately measures what it\u2019s supposed to measure, and once again, there are a number of ways in which validity can be expressed. <em>Ecological validity<\/em> (the degree to which research results generalize to real-world applications), <em>construct validity<\/em> (the degree to which a given variable actually captures or measures what it is intended to measure), and <em>face validity<\/em> (the degree to which a given variable seems valid on the surface) are just a few types that researchers consider. While any valid measure is by necessity reliable, the reverse is not necessarily true. Researchers strive to use instruments that are both highly reliable and valid.<\/p>\n<div style=\"font-weight: 400\">\n<p>To illustrate how complicated it can be to determine the validity of a measure, let\u2019s look again at the original Bobo doll study. Bandura and colleagues were not only interested in whether children would imitate aggressive behaviours, they also wanted to know if observing same-sex adults would have a greater impact on children&#8217;s behaviour than observing adults of a different sex. So how did they define sex? The children involved in the study were nursery school aged, so it\u2019s likely that the researchers simply did a visual assessment or asked their parents. Generally we now use \u2018sex\u2019 to refer to the different biological categories people might fit into, while \u2018gender\u2019 refers to the socially constructed characteristics we assign to those categories, and is something an individual must define for themselves. In this case, the researchers were really categorizing their participants based on assumed sex, rather than actual biological sex.<\/p>\n<\/div>\n<div style=\"font-weight: 400\">\n<p>A visual assessment of biological sex might seem to have clear face validity to many people, but as a measurement it is low in construct validity. That is, while it is often assumed that sex can be determined by looking at an individual\u2019s appearance, that approach has little ability to accurately measure biological sex. The assumption that biological sex is both binary and visually obvious results in a lack of research in populations of people who exist outside of those assumptions. This in turn means that the measure has little ecological validity, as these people do exist in real-world populations. To illustrate further, let\u2019s consider some of the ways biological sex has been traditionally assessed:<\/p>\n<ul>\n<li>Visual assessment: In this approach, researchers would record \u2018sex\u2019 based on their visual assessment of the clothed participant. This might work for many individuals, but it\u2019s based on an assumption about the individual\u2019s reproductive biology, which is not reliably assessed by external appearance. There are female humans with beards, male humans without Adam\u2019s apples, and of course, transgender, non-binary, and intersex people whose bodies may not fit these assumed categories<\/li>\n<li>Medical records or birth certificates: In medical research, data is routinely collected about patient\u2019s demographics, so sex may be assessed simply by looking at a participants\u2019 medical record. However, given that biological sex assignment of infants at birth is based a visual assessment of the infant\u2019s external genitalia, which is used to categorize the infant as \u201cmale\u201d or \u201cfemale.\u201d While visually assessing the genitals of an individual may appear to be enough to determine their biological sex, this is unreliable for the reasons outlined above (visual assessment). A larger problem is this method of sex assignment at birth has been incredibly harmful to intersex people.<\/li>\n<li>Self-report: To avoid the issues described above, it may seem reasonable to ask participants to self-identify. This can present two issues: (1) most people\u2019s understanding of their own biological sex is based on their medical record or birth certificate, and not further testing (thus their beliefs about their biological sex may not be congruent with their actual biology). This may seem unlikely but remember birth certificates and the determination of biological sex of an infant at birth is not a foolproof way of getting this information. And, (2) as with all self-report measures, it\u2019s reliant upon the researchers providing appropriate categories (i.e., has intersex been included as an option) and the participant being truthful. Participants may not readily volunteer this information for reasons of privacy, safety, or simply because it makes navigating the world easier for them.<\/li>\n<\/ul>\n<div style=\"font-weight: 400\">\n<p>While it may seem like something that ought to be easy, truly determining the biological sex of an individual can be difficult. The biological sex of an individual is determined by more than their external genitals, or whether they have a penis\/vagina. Some other determinants of biological sex include the internal gonads (ovaries or testes), predominant hormones (testosterone or estrogen), and chromosomal DNA (e.g., XX, XY). It is often assumed that the chromosomal DNA of a person is the truest indicator of their biological sex, however this does not always \u201cmatch\u201d gonadal, hormonal, or genital sex. Intersex is a general term applied to a variety of conditions which result in a person being born with anatomy that defies traditional male-female categorization. This could result in a person having atypical external genitalia, genitals that don\u2019t align with internal reproductive organs, or atypical chromosomal structures (despite typical anatomy). For instance, a person could be born with mosaic genetics, with both XX and XY chromosomes. These conditions may be present at birth, but often a person has no reason to suspect they are intersex until they reach puberty. In some cases, the condition may not even be discovered until post-mortem during a medical autopsy.<\/p>\n<\/div>\n<div style=\"font-weight: 400\">\n<p>It\u2019s not impossible to determine an individual\u2019s biological sex, but sex should be operationally defined and data should be collected accordingly. As you go learn more about the scientific process and research, it\u2019s important to critically evaluate methods and findings. Participants are frequently divided into male-female categories and it\u2019s worth exploring the details of the methods to understand how scientists have actually measured biological sex and whether their approach may impact the validity of their conclusions.<\/p>\n<div class=\"psychology link-to-learning ui-has-child-title\">\n<section>\n<div class=\"os-note-body\">\n<div class=\"textbox textbox--key-takeaways\">\n<header class=\"textbox__header\">\n<p class=\"textbox__title\"><span style=\"color: #ffffff\">LINK TO LEARNING<\/span><\/p>\n<\/header>\n<div class=\"textbox__content\">For more information on intersex conditions, check out the FAQ for interACT, an advocacy group for intersex youth:\u00a0<a href=\"https:\/\/interactadvocates.org\/faq\/\">https:\/\/interactadvocates.org\/faq\/<\/a><\/div>\n<\/div>\n<\/div>\n<\/section>\n<\/div>\n<p>Now that we understand the complexity of measuring biological sex, let\u2019s consider how it was it was assessed in the original Bobo doll study. There is no mention of biological measures being taken so we can assume that sex categorization was based on visual assessment or by report from the children\u2019s parents. We know now that this is not an accurate way to measure biological sex, so we should consider why sex was included in the experiment. Given that children were found to perceive their parents as having preferences for them to behave in \u2018sex appropriate\u2019 ways (eg. Girls playing with dolls and boys playing with trucks), the researchers hypothesized their participants would be more likely to imitate the behaviour of a same-sex model than a model of a different sex. They were interested in the effect that socially reinforced gender roles would have on imitated behaviour so the assumed sex of the children was all that mattered, as this would determine what behaviours would be discouraged or reinforced by adults. It\u2019s ok that no biological measures were taken for this study because biological sex wasn\u2019t actually relevant, but terms like sex and gender have often used interchangeably in research so it\u2019s important to think critically about how constructs are being operationally defined and measured. If Bandura and colleagues were to replicate this study today, we should hope that they would be more accurate and specific with their terminology and use something like \u2018assumed sex\/gender\u2019 rather than \u2018sex\u2019 to refer to the variable they were interested in. After all, this kind of specificity in language allows for more accurate understanding and replication, which can increase our confidence in their original conclusion. As you move forward in your degree and engage in research more directly, consider carefully what variables you are interested in, and do your best to choose language that is both specific and accurate.<\/p>\n<\/div>\n<\/div>\n<\/section>\n<\/div>\n<\/div>\n","protected":false},"author":13,"menu_order":4,"template":"","meta":{"pb_show_title":"on","pb_short_title":"","pb_subtitle":"","pb_authors":[],"pb_section_license":""},"chapter-type":[],"contributor":[],"license":[],"part":21,"_links":{"self":[{"href":"https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-json\/pressbooks\/v2\/chapters\/76"}],"collection":[{"href":"https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-json\/pressbooks\/v2\/chapters"}],"about":[{"href":"https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-json\/wp\/v2\/types\/chapter"}],"author":[{"embeddable":true,"href":"https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-json\/wp\/v2\/users\/13"}],"version-history":[{"count":27,"href":"https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-json\/pressbooks\/v2\/chapters\/76\/revisions"}],"predecessor-version":[{"id":2243,"href":"https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-json\/pressbooks\/v2\/chapters\/76\/revisions\/2243"}],"part":[{"href":"https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-json\/pressbooks\/v2\/parts\/21"}],"metadata":[{"href":"https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-json\/pressbooks\/v2\/chapters\/76\/metadata\/"}],"wp:attachment":[{"href":"https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-json\/wp\/v2\/media?parent=76"}],"wp:term":[{"taxonomy":"chapter-type","embeddable":true,"href":"https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-json\/pressbooks\/v2\/chapter-type?post=76"},{"taxonomy":"contributor","embeddable":true,"href":"https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-json\/wp\/v2\/contributor?post=76"},{"taxonomy":"license","embeddable":true,"href":"https:\/\/digitaleditions.library.dal.ca\/intropsychneuro\/wp-json\/wp\/v2\/license?post=76"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}