<?xml version="1.0" encoding="UTF-8"?>
<rss  xmlns:atom="http://www.w3.org/2005/Atom" 
      xmlns:media="http://search.yahoo.com/mrss/" 
      xmlns:content="http://purl.org/rss/1.0/modules/content/" 
      xmlns:dc="http://purl.org/dc/elements/1.1/" 
      version="2.0">
<channel>
<title>Matthew E. Vanaman</title>
<link>https://www.matthewvanaman.com/</link>
<atom:link href="https://www.matthewvanaman.com/index.xml" rel="self" type="application/rss+xml"/>
<description>Personal Website of Dr. Matthew E. Vanaman, Psychologist, Applied Quantitative Methodologist</description>
<generator>quarto-1.5.56</generator>
<lastBuildDate>Fri, 27 Sep 2024 05:00:00 GMT</lastBuildDate>
<item>
  <title>Visualization Tip: Never Be Random</title>
  <dc:creator>Matthew E. Vanaman</dc:creator>
  <link>https://www.matthewvanaman.com/posts/never-be-random/</link>
  <description><![CDATA[ 





<figure class="figure">

<img src="https://www.matthewvanaman.com/_site/imgs/random.png" alt="Random legs." style="text-align:center; border-radius: 2%; opacity:0.9; width:100%; filter:grayscale(25%);" class="figure-img">

<figcaption style="text-align:center;">

Random legs.

</figcaption>

</figure>
<p>Analyzing data is hard. Analyzing another person’s data analysis is even harder. Almost as hard as saying that last sentence out loud.</p>
<p>One way to make life easier for your audience — whether it be a reader of your article, someone watching your presentation, or anyone consuming your analysis — is to show your data and results visually.</p>
<p>I often come across visualizations that stop short of being maximally useful because some aspect of the plot is random. By random, I don’t mean random variability, which you <a href="https://simplystatistics.org/posts/2019-02-21-dynamite-plots-must-die/" target="_blank"><em>do</em> want to see in a plot</a>. By “random”, I mean <em>unplanned</em>. Meaning some part of the plot could have been formatted with intent but was instead left to the devices of the plotting software defaults or the idiosyncrasies of the dataset.</p>
<p>With these examples, I hope to persuade you, kind visitor to my blog, that no part of a plot should be random.</p>
<section id="example-1-average-heights-of-star-wars-species" class="level2">
<h2 class="anchored" data-anchor-id="example-1-average-heights-of-star-wars-species">Example 1: Average Heights of Star Wars Species</h2>
<p>Say I wanted to explore the average heights (in centimeters) of the different species seen in the Star Wars films (using the <code>starwars</code> dataset from the <em>dplyr</em> R package). I decide to visualize the mean heights for each species.</p>
<p>Behold my plot below! See if you can spot the randomness:</p>
<div class="cell">
<details class="code-fold">
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb1" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb1-1">starwars <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb1-2">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">filter</span>(<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">!</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">is.na</span>(species), <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">!</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">is.na</span>(height)) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb1-3">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">ggplot</span>(<span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">aes</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">x =</span> species, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">y =</span> height)) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb1-4">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">geom_point</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">stat =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"summary"</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb1-5">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">labs</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">x =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Species"</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">y =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Height in Centimeters"</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb1-6">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">coord_flip</span>() <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb1-7">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">theme_minimal</span>() <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb1-8">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">theme</span>(</span>
<span id="cb1-9">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">panel.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb1-10">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">plot.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb1-11">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">legend.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb1-12">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">legend.box.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>)</span>
<span id="cb1-13">  )</span></code></pre></div>
</details>
<div class="cell-output-display">
<div>
<figure class="figure">
<p><img src="https://www.matthewvanaman.com/posts/never-be-random/index_files/figure-html/unnamed-chunk-2-1.png" class="img-fluid figure-img" width="4200"></p>
</figure>
</div>
</div>
</div>
<p>The randomness is in the <em>y</em>-axis, which arranges the species alphabetically (this is the default of the <code>ggplot()</code> function). This kind of randomness is tricky to spot because alphabetical ordering is a pattern and therefore seems rational. But as the eye moves from the top to the bottom of the plot, it encounters randomness in the species heights — no fun indeed for our pattern-seeking eyeballs.</p>
<p>Behold: my plot again! This one orders the <em>y</em>-axis by height:</p>
<div class="cell">
<details class="code-fold">
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb2" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb2-1">starwars <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb2-2">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">filter</span>(<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">!</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">is.na</span>(species), <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">!</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">is.na</span>(height)) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb2-3">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">ggplot</span>(<span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">aes</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">x =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">reorder</span>(species, height), <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">y =</span> height)) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb2-4">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">geom_point</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">stat =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"summary"</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb2-5">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">labs</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">x =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Species"</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">y =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Height in Centimeters"</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb2-6">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">coord_flip</span>() <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb2-7">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">theme_minimal</span>() <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb2-8">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">theme</span>(</span>
<span id="cb2-9">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">panel.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb2-10">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">plot.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb2-11">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">legend.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb2-12">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">legend.box.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>)</span>
<span id="cb2-13">  )</span></code></pre></div>
</details>
<div class="cell-output-display">
<div>
<figure class="figure">
<p><img src="https://www.matthewvanaman.com/posts/never-be-random/index_files/figure-html/unnamed-chunk-3-1.png" class="img-fluid figure-img" width="4200"></p>
</figure>
</div>
</div>
</div>
<p>Isn’t this much easier to understand? The tallest species is at the top and the shortest is at the bottom — much more intuitive! 😎</p>
</section>
<section id="example-2-gender-bias-in-college-admissions" class="level2">
<h2 class="anchored" data-anchor-id="example-2-gender-bias-in-college-admissions">Example 2: Gender Bias In College Admissions</h2>
<p>Say I am analyzing data that some have claimed contains evidence of gender bias in college admissions (using the <code>UCBAdmissions</code> dataset, which has admission rates by gender and department at the University of California — Berkeley in 1973).</p>
<p>The first step in providing evidence of bias is to show that the rates of admission are indeed different for women compared to men. If the rates are the same, bias is ruled out. If there are differences, bias is possible.</p>
<p>At this stage, the audience just wants to know which departments have different rates of admission for men and women. Behold: my plot again! Can you spot the randomness?</p>
<div class="cell">
<details class="code-fold">
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb3" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb3-1">plot_data <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> UCBAdmissions <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span></span>
<span id="cb3-2">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">as_tibble</span>() <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span></span>
<span id="cb3-3">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">pivot_wider</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">names_from =</span> Admit, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">values_from =</span> n) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb3-4">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">mutate</span>(</span>
<span id="cb3-5">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">Total =</span> Admitted <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span> Rejected,</span>
<span id="cb3-6">    <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Percent Admitted"</span> <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">=</span> Admitted <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">/</span> Total <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">*</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">100</span></span>
<span id="cb3-7">    ) </span>
<span id="cb3-8"></span>
<span id="cb3-9"><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">ggplot</span>(plot_data, <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">aes</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">x =</span> Dept, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">y =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">`</span><span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">Percent Admitted</span><span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">`</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> Gender)) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb3-10">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">geom_col</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">position =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"dodge"</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb3-11">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">scale_y_continuous</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">labels =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">percent_format</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">scale =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">1</span>)) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb3-12">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">scale_fill_manual</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">values =</span> colors[<span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">1</span><span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">:</span><span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">2</span>]) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb3-13">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">theme_minimal</span>() <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb3-14">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">theme</span>(</span>
<span id="cb3-15">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">panel.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb3-16">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">plot.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb3-17">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">legend.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb3-18">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">legend.box.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>)</span>
<span id="cb3-19">  )</span></code></pre></div>
</details>
<div class="cell-output-display">
<div>
<figure class="figure">
<p><img src="https://www.matthewvanaman.com/posts/never-be-random/index_files/figure-html/unnamed-chunk-4-1.png" class="img-fluid figure-img" width="4200"></p>
</figure>
</div>
</div>
</div>
<p>There are two sources of randomness:</p>
<ol type="1">
<li>The <em>y</em>-axis truncates at 80% instead of 100% admission rate (this value is automatically chosen by <code>ggplot()</code> based on the characteristics of the data); and</li>
<li>This one’s tricky: the order of the departments on the <em>x</em>-axis.</li>
</ol>
<p>As for (1), why should the axis be truncated at 80% and not 90% or 99% or 100%? Conventional wisdom tells us to truncate the axis based on “what looks nice”. But is our research question, “what looks nice?” Nope! It’s, “are any gender differences in admission rates big enough to make us worried admissions are biased?”</p>
<p>If the axis is truncated, the differences will be visually inflated, and the audience will be more likely to falsely conclude that a trivial difference in admissions rate is actually worrisome. If, on the other hand, the difference in admission rates looks huge even with the full axis, then Berkeley’s lawyers will feel spontaneous neck pain.</p>
<p>Here’s the plot with the full <em>y</em>-axis:</p>
<div class="cell">
<details class="code-fold">
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb4" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb4-1"><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">ggplot</span>(</span>
<span id="cb4-2">  plot_data, </span>
<span id="cb4-3">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">aes</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">x =</span> Dept,</span>
<span id="cb4-4">      <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">y =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">`</span><span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">Percent Admitted</span><span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">`</span>, </span>
<span id="cb4-5">      <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> Gender)</span>
<span id="cb4-6">  ) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb4-7">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">geom_col</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">position =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"dodge"</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb4-8">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">scale_y_continuous</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">labels =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">percent_format</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">scale =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">1</span>), <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">limits =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">c</span>(<span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">0</span>, <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">100</span>)) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb4-9">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">scale_fill_manual</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">values =</span> colors[<span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">1</span><span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">:</span><span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">2</span>]) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb4-10">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">theme_minimal</span>() <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb4-11">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">theme</span>(</span>
<span id="cb4-12">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">panel.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb4-13">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">plot.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb4-14">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">legend.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb4-15">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">legend.box.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>)</span>
<span id="cb4-16">  )</span></code></pre></div>
</details>
<div class="cell-output-display">
<div>
<figure class="figure">
<p><img src="https://www.matthewvanaman.com/posts/never-be-random/index_files/figure-html/unnamed-chunk-5-1.png" class="img-fluid figure-img" width="4200"></p>
</figure>
</div>
</div>
</div>
<p>Notice the difference between men and women is still present, but they appear smaller when considered against the full range of the possible percentages. Some will disagree, but I strongly recommend against truncated axes for any bounded variables (like percents, which range from 0 to 100 in this case) except in rare, extreme cases where you can — and hopefully <em>do</em> — provide an explicit rationale for why the axis is truncated<sup>1</sup>.</p>
<p>Now let’s consider randomness part (2), namely the order of the departments on the <em>x</em>-axis. The departments are again ordered alphabetically as per <code>ggplot()</code> defaults. The issue is that nothing about our question of gender bias has anything to do with the alphabetical ordering of the departments. This axis lacks intent, dammit! It can’t keep getting away with it!</p>
<p>Remember, the whole point of plotting gender by department is to help the audience see which departments are admitting men at higher rates than women (as opposed to the other way around — I’ll tackle that in a moment). This is easier to see if the <em>x</em>-axis is arranged so that the first department admits the most men relative to women, followed by the department that admits the second-most men relative to women, and so on. That’s a pattern the audience will probably look for, and they will like you more if you serve it up to them on a silver platter.</p>
<p>Here’s a second attempt:</p>
<div class="cell">
<details class="code-fold">
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb6" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb6-1"><span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># Do some data wrangling magic</span></span>
<span id="cb6-2">plot_data <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> plot_data <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb6-3">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">select</span>(Gender, <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">`</span><span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">Percent Admitted</span><span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">`</span>, Dept) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb6-4">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">pivot_wider</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">names_from =</span> Gender, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">values_from =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">`</span><span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">Percent Admitted</span><span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">`</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb6-5">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">mutate</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">Gender_Difference =</span> Female <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">-</span> Male) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb6-6">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">pivot_longer</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">cols =</span> Male<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">:</span>Female, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">names_to =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Gender"</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">values_to =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Percent Admitted"</span>) </span>
<span id="cb6-7"></span>
<span id="cb6-8"><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">ggplot</span>(</span>
<span id="cb6-9">  plot_data, </span>
<span id="cb6-10">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">aes</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">x =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">reorder</span>(Dept, Gender_Difference), <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># order the x axis by the Gender_Difference variable</span></span>
<span id="cb6-11">      <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">y =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">`</span><span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">Percent Admitted</span><span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">`</span>, </span>
<span id="cb6-12">      <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> Gender)</span>
<span id="cb6-13">  ) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb6-14">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">geom_col</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">position =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"dodge"</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb6-15">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">scale_y_continuous</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">labels =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">percent_format</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">scale =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">1</span>), <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">limits =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">c</span>(<span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">0</span>, <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">100</span>)) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb6-16">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">scale_fill_manual</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">values =</span> colors[<span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">1</span><span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">:</span><span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">2</span>]) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb6-17">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">labs</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">x =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Dept"</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb6-18">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">theme_minimal</span>() <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb6-19">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">theme</span>(</span>
<span id="cb6-20">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">panel.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb6-21">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">plot.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb6-22">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">legend.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb6-23">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">legend.box.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>)</span>
<span id="cb6-24">  )</span></code></pre></div>
</details>
<div class="cell-output-display">
<div>
<figure class="figure">
<p><img src="https://www.matthewvanaman.com/posts/never-be-random/index_files/figure-html/unnamed-chunk-7-1.png" class="img-fluid figure-img" width="4200"></p>
</figure>
</div>
</div>
</div>
<p>In this new plot, Department E now stands out clearly as having the largest disparity between men and women (favoring men). The disparity gets smaller as you move from left to right, until the pattern reverses. For example, Department A admits women at a much higher rate than men.</p>
<p>What if we tweaked the research question from “which departments admit men at higher rates than women?” to “which departments admit <em>either</em> gender at a higher rate than the other?” In that case, I’ll order the departments by the size of the difference in the rates regardless of which gender was admitted more often:</p>
<div class="cell">
<details class="code-fold">
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb7" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb7-1"><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">ggplot</span>(plot_data, </span>
<span id="cb7-2">       <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">aes</span>(</span>
<span id="cb7-3">         <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">x =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">reorder</span>(Dept, <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">desc</span>(<span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">abs</span>(Gender_Difference))), <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># change the order to the absolute value of gender difference, use descending order to put largest difference on the left</span></span>
<span id="cb7-4">         <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">y =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">`</span><span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">Percent Admitted</span><span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">`</span>, </span>
<span id="cb7-5">         <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> Gender)</span>
<span id="cb7-6">       ) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb7-7">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">geom_col</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">position =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"dodge"</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb7-8">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">scale_y_continuous</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">labels =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">percent_format</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">scale =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">1</span>), <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">limits =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">c</span>(<span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">0</span>, <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">100</span>)) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb7-9">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">scale_fill_manual</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">values =</span> colors[<span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">1</span><span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">:</span><span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">2</span>]) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb7-10">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">labs</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">x =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Dept"</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb7-11">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">theme_minimal</span>() <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb7-12">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">theme</span>(</span>
<span id="cb7-13">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">panel.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb7-14">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">plot.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb7-15">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">legend.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb7-16">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">legend.box.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>)</span>
<span id="cb7-17">  )</span></code></pre></div>
</details>
<div class="cell-output-display">
<div>
<figure class="figure">
<p><img src="https://www.matthewvanaman.com/posts/never-be-random/index_files/figure-html/unnamed-chunk-8-1.png" class="img-fluid figure-img" width="4200"></p>
</figure>
</div>
</div>
</div>
<p>Now, we can see that Department A has the largest difference in rates between genders (in favor of women) while Department B has the second largest difference (in favor of men). The further right you move, the more parity there is between genders. Department F has the most gender parity.</p>
<section id="digression-never-use-bar-charts" class="level3">
<h3 class="anchored" data-anchor-id="digression-never-use-bar-charts">Digression: Never Use Bar Charts</h3>
<p>Surprise! There was a third random thing about this plot: the choice to use a bar chart! Bamboozled again! Won’t you ever learn?!</p>
<p>It’s not a popular idea, but bar charts are terrible. They misleadingly show plot graphics (bars) where there is no data — in our case, the data is the department and the admission rate, the latter of which is a single value for each department for men and women.</p>
<p>But the bar covers all rates from 0 to the actual rate. This violates one of the few hard and fast rules of visualization: never visualize data that don’t exist!</p>
<p>Here’s one possible alternative you could use that more accurately draws the eye to the differences in rates by genders:</p>
<div class="cell">
<details class="code-fold">
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb8" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb8-1"><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">ggplot</span>(plot_data, </span>
<span id="cb8-2">       <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">aes</span>(</span>
<span id="cb8-3">         <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">x =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">reorder</span>(Dept, <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">100</span> <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">-</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">abs</span>(Gender_Difference)), <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># change the order to the absolute value of gender difference (subtract from 100 so that largest differences are first)</span></span>
<span id="cb8-4">         <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">y =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">`</span><span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">Percent Admitted</span><span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">`</span>, </span>
<span id="cb8-5">         <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> Gender,</span>
<span id="cb8-6">         <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">shape =</span> Gender,</span>
<span id="cb8-7">         <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">group =</span> Gender_Difference)</span>
<span id="cb8-8">       ) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb8-9">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">geom_line</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"black"</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">linetype =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"dotted"</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb8-10">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">geom_point</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">size =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">3</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb8-11">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">scale_y_continuous</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">labels =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">percent_format</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">scale =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">1</span>), <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">limits =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">c</span>(<span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">0</span>, <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">100</span>)) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb8-12">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">scale_color_manual</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">values =</span> colors[<span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">1</span><span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">:</span><span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">2</span>]) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb8-13">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">labs</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">x =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Dept"</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span> </span>
<span id="cb8-14">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">coord_flip</span>() <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb8-15">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">theme_minimal</span>() <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb8-16">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">theme</span>(</span>
<span id="cb8-17">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">panel.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb8-18">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">plot.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb8-19">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">legend.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb8-20">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">legend.box.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>)</span>
<span id="cb8-21">  )</span></code></pre></div>
</details>
<div class="cell-output-display">
<div>
<figure class="figure">
<p><img src="https://www.matthewvanaman.com/posts/never-be-random/index_files/figure-html/unnamed-chunk-9-1.png" class="img-fluid figure-img" width="4200"></p>
</figure>
</div>
</div>
</div>
<p>See the dotted black lines? The longer they are, the larger the difference in admission rates for that department. If viewing the above plot elicits a pleasant massaging feeling in your occipital lobe, that’s normal!</p>
<p>Here’s another alternative:</p>
<div class="cell">
<details class="code-fold">
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb9" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb9-1"><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">set.seed</span>(<span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">350</span>)</span>
<span id="cb9-2">plot_data <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb9-3">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">mutate</span>(</span>
<span id="cb9-4">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">label =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">round</span>(<span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">`</span><span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">Percent Admitted</span><span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">`</span>, <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">1</span>),</span>
<span id="cb9-5">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">label =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">format</span>(label, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">nsmall =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">1</span>),</span>
<span id="cb9-6">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">label =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">paste</span>(label, <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"%"</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">sep =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">""</span>)</span>
<span id="cb9-7">         ) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb9-8">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">ggplot</span>(<span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">aes</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">x =</span> Gender, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">y =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">`</span><span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">Percent Admitted</span><span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">`</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> Dept)) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb9-9">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">geom_point</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">size =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">3</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">shape =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"circle"</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">show.legend =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">FALSE</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb9-10">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">geom_line</span>(<span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">aes</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">group =</span> Gender_Difference)) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb9-11">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">geom_label_repel</span>(<span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">aes</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">label =</span> label), <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">label.size =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">0</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">show.legend =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">FALSE</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb9-12">    <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">scale_y_continuous</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">labels =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">percent_format</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">scale =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">1</span>), <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">limits =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">c</span>(<span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">0</span>, <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">100</span>)) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb9-13">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">scale_color_manual</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">values =</span> colors) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb9-14">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">labs</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Dept"</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb9-15">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">theme_minimal</span>() <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span></span>
<span id="cb9-16">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">theme</span>(</span>
<span id="cb9-17">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">panel.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb9-18">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">plot.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb9-19">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">legend.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb9-20">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">legend.box.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>)</span>
<span id="cb9-21">  )</span></code></pre></div>
</details>
<div class="cell-output-display">
<div>
<figure class="figure">
<p><img src="https://www.matthewvanaman.com/posts/never-be-random/index_files/figure-html/unnamed-chunk-10-1.png" class="img-fluid figure-img" width="4200"></p>
</figure>
</div>
</div>
</div>
<p>This one is nice because you don’t have to order the departments to see where the biggest differences are — they are biggest when the slopes are steepest. Credit to <a href="https://rebeccabarter.com/blog/2018-05-29_getting_fancy_ggplot2" target="_blank">this post</a> by Dr.&nbsp;Rebecca Barter for the idea!</p>
</section>
</section>
<section id="conclusion" class="level2">
<h2 class="anchored" data-anchor-id="conclusion">Conclusion</h2>
<p>Don’t be random! Plot your data with intent. Give yourself credit for taking pity on your audience by using a visualization, but don’t rest on your laurels. Look at your plot, think about what you want your audience to learn from it, and interrogate the defaults of your plotting software for randomness. Replace it with intent, and <a href="https://en.wikipedia.org/wiki/Basking_in_reflected_glory" target="_blank">bask in the reflected glory</a> of being an effective data visualizer.</p>


</section>


<div id="quarto-appendix" class="default"><section id="footnotes" class="footnotes footnotes-end-of-document"><h2 class="anchored quarto-appendix-heading">Footnotes</h2>

<ol>
<li id="fn1"><p>Note that truncation doesn’t apply to <em>unbounded</em> variables where the minimum and/or maximum values are determined by the data. Sometimes you do want to truncate — the rule is not “never truncate”, it’s just “always format your axes with intent”. As an example, let’s turn back to the starwars dataset. The heaviest species (Hutt) has an average weight of 1,500 kilograms while the next heaviest species (Kaleesh) is less than 250 kilograms. In this case, including Hutts might mislead the viewer into thinking that differences among other species are smaller than they actually are given Hutts are so unusually massive. In this case, we actually <em>should</em> truncate the axis — or better yet, exclude Hutts from the plot altogether:</p>
<div class="cell">
<details class="code-fold">
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb5" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb5-1">untruncated <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> starwars <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb5-2">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">filter</span>(<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">!</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">is.na</span>(species), <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">!</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">is.na</span>(mass)) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb5-3">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">ggplot</span>(<span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">aes</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">x =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">reorder</span>(species, mass), <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">y =</span> mass)) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span> </span>
<span id="cb5-4">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">geom_point</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">stat =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"summary"</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span> </span>
<span id="cb5-5">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">labs</span>(</span>
<span id="cb5-6">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">x =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Species"</span>, ,</span>
<span id="cb5-7">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">y =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Weight in Kilograms"</span>,</span>
<span id="cb5-8">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">title =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Untruncated X-Axis"</span></span>
<span id="cb5-9">    ) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span> </span>
<span id="cb5-10">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">coord_flip</span>() <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span> <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># flip x and y axes</span></span>
<span id="cb5-11">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">theme_minimal</span>() <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span> </span>
<span id="cb5-12">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">theme</span>(</span>
<span id="cb5-13">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">panel.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb5-14">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">plot.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb5-15">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">legend.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb5-16">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">legend.box.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb5-17">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">plot.title =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_text</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">hjust =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">0</span>)</span>
<span id="cb5-18">  )</span>
<span id="cb5-19">truncated <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> starwars <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb5-20">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">filter</span>(</span>
<span id="cb5-21">    <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">!</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">is.na</span>(species), </span>
<span id="cb5-22">    <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">!</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">is.na</span>(mass), </span>
<span id="cb5-23">    species <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">!=</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Hutt"</span> <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># exclude hutts</span></span>
<span id="cb5-24">    ) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb5-25">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">ggplot</span>(<span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">aes</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">x =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">reorder</span>(species, mass), <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">y =</span> mass)) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span> </span>
<span id="cb5-26">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">geom_point</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">stat =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"summary"</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span> </span>
<span id="cb5-27">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">labs</span>(</span>
<span id="cb5-28">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">x =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Species"</span>, ,</span>
<span id="cb5-29">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">y =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Weight in Kilograms"</span>,</span>
<span id="cb5-30">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">title =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Axis Truncated By Excluding Hutts"</span>,</span>
<span id="cb5-31">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">caption =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Note: Hutt species was much heavier than</span><span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">\n</span><span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">all other species at 1,500 kg. To make </span><span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">\n</span><span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">differences among other species clearer, </span><span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">\n</span><span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">Hutts are excluded from the plot."</span></span>
<span id="cb5-32">    ) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span> </span>
<span id="cb5-33">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">coord_flip</span>() <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span> <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># flip x and y axes</span></span>
<span id="cb5-34">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">theme_minimal</span>() <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span> </span>
<span id="cb5-35">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">theme</span>(</span>
<span id="cb5-36">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">panel.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb5-37">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">plot.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb5-38">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">legend.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb5-39">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">legend.box.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb5-40">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">plot.caption =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_text</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">hjust =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">0</span>),</span>
<span id="cb5-41">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">plot.title =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_text</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">hjust =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">1</span>)</span>
<span id="cb5-42">  )</span>
<span id="cb5-43">untruncated <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">+</span> truncated <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">&amp;</span>  </span>
<span id="cb5-44">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">plot_annotation</span>(</span>
<span id="cb5-45">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">theme =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">theme</span>(</span>
<span id="cb5-46">      <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">panel.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>),</span>
<span id="cb5-47">      <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">plot.background =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">element_rect</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fill =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">color =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>)</span>
<span id="cb5-48">    ))</span></code></pre></div>
</details>
<div class="cell-output-display">
<div>
<figure class="figure">
<p><img src="https://www.matthewvanaman.com/posts/never-be-random/index_files/figure-html/unnamed-chunk-6-1.png" class="img-fluid figure-img" width="4200"></p>
</figure>
</div>
</div>
</div>
↩︎</li>
</ol>
</section><section class="quarto-appendix-contents" id="quarto-citation"><h2 class="anchored quarto-appendix-heading">Citation</h2><div><div class="quarto-appendix-secondary-label">BibTeX citation:</div><pre class="sourceCode code-with-copy quarto-appendix-bibtex"><code class="sourceCode bibtex">@online{e._vanaman2024,
  author = {E. Vanaman, Matthew},
  title = {Visualization {Tip:} {Never} {Be} {Random}},
  date = {2024-09-27},
  url = {https://www.matthewvanaman.com/posts/never-be-random/},
  langid = {en}
}
</code></pre><div class="quarto-appendix-secondary-label">For attribution, please cite this work as:</div><div id="ref-e._vanaman2024" class="csl-entry quarto-appendix-citeas">
E. Vanaman, M. (2024, September 27). <em><a href="https://www.matthewvanaman.com/posts/never-be-random/">Visualization
Tip: Never Be Random</a></em>.
</div></div></section></div> ]]></description>
  <category>data-visualization</category>
  <category>transparency</category>
  <category>tips-and-tricks</category>
  <guid>https://www.matthewvanaman.com/posts/never-be-random/</guid>
  <pubDate>Fri, 27 Sep 2024 05:00:00 GMT</pubDate>
  <media:content url="https://www.matthewvanaman.com/_site/imgs/random.png" medium="image" type="image/png" height="96" width="144"/>
</item>
<item>
  <title>Applying to PhD Programs in Psychology: A Thorough and Honest Guide</title>
  <dc:creator>Matthew E. Vanaman</dc:creator>
  <link>https://www.matthewvanaman.com/posts/2021-05-18-crash-course-to-getting-into-a-phd-program-in-psychology/crash_course_PhD.html</link>
  <description><![CDATA[ 





<p>So you want to be a psychologist. Where do you start? Generally speaking, those seeking a career in psychology have two broad career tracks. The first is the social work or family counseling track. This track requires master’s degrees in social work or counseling, which in turn qualify you for those professions. Those are honorable professions that do important work, and frankly they should get paid more.</p>
<p>This guide assumes that you are probably interested in the other career track. This one involves advanced training in the scientific method, the teaching of college level courses, and depending on your specialty, becoming licensed to administer advanced clinical interventions that far exceed the training in master’s level counseling and social work degrees. This track could result in a career in academia as a researcher and teacher, or as a data scientist at a Fortune 500 tech company. You might found your own behavioral science consulting company, or start your own private therapy practice. You would qualify to work as a survey statistician at the CDC, as a statistical analyst at a political think tank, or as a social scientist at an NGO.</p>
<p>This second track is the PhD in psychology. If a PhD in psychology is what you want, then you have come to the <a href="https://www.matthewvanaman.com/imgs/serenity.gif" target="_blank">right place</a>. It can be fulfilling, and I personally find it very rewarding (so far). But it is a task. To see what you are in for, dedicate 45 minutes to a serious read of this guide. As the comedian Jerry <a href="https://en.wikipedia.org/wiki/List_of_Seinfeld_episodes" target="_blank">Seinfeld</a> once remarked, “sometimes the road less traveled is less traveled for a reason.”</p>
<section id="the-real-talk" class="level1">
<h1>The Real Talk</h1>
<p>Understand one important thing: getting into a PhD in Psychology is harder than you think it is. It will take more work than you think it will. It may require you to be more assertive than you are comfortable being. It will definitely require you to do many, many hours of work, over the course of years, to acquire the qualifications needed for a compelling application.</p>
<p>Before you implement this guide in real life, you will need to decide whether getting into a PhD program matters enough to you to be worth the effort (and time, and money). For some, it will be more trouble than it’s worth. For others, it will seem worth the effort, but they will doubt their capabilities. Internalize this fact: if you are thinking of applying, and you are taking it seriously, you are most likely qualified, or you are capable of becoming qualified. In fact, the vast majority of people who apply are qualified. The vast majority who apply are also rejected - about 95% actually. Internalize the contradiction. Be prepared to try as hard as you can, and face rejection nonetheless. Prepare for the best, but expect the worst.</p>
<p>With that said, I am of the belief that, uncontrollable barriers notwithstanding, the only thing between you and acceptance into a PhD program in psychology is the tolerance you personally have for the prerequisite time and effort required to make that happen. When I decided to apply, I was flat broke; I had a thoroughly average GPA; I was scared of math; I had zero social capital; I had no PhD-in-psychology-relevant qualifications <em>whatsoever</em>; and to top it all off, I started barely a year and a half before the first application was due - in other words, way later than most successful applicants start. Why do I mention this? Because if I can pull this off, then you surely can. The question you will have to answer first is, “how badly do I want it?”</p>
</section>
<section id="the-philosophy" class="level1">
<h1>The Philosophy</h1>
<div id="phil">

</div>
<p>So you’ve decided to move forward. Let me now disabuse you of some common folktales about PhD applications:</p>
<ul>
<li><p>Folktale 1: getting into a PhD program is <em>entirely</em> about merit, and you will be judged purely by your qualifications.</p></li>
<li><p>Folktale 2: getting into a PhD program is <em>entirely</em> about structural this, unfairness that, and you will be judged purely on the basis of anything <em>but</em> your qualifications.</p></li>
</ul>
<p>The uncomfortable truth is, reality is more complicated than the tidy folktales above suggest. Folktale 1 is false because your application absolutely <em>is</em> affected by factors that are <a href="https://onlinelibrary.wiley.com/doi/abs/10.1002/oby.20171" target="_blank">unfair</a> and have <a href="https://en.wikipedia.org/wiki/Halo_effect" target="_blank">nothing to do with merit</a>. Folktale 2 is false because under the right circumstances, your applications <em>will</em> be judged by your qualifications and the hard work you did to get them. To make sense of this, you could think of the different kinds of factors that could influence your application as a table:</p>
<div class="cell">
<div class="cell-output-display">
<table class="huxtable" data-quarto-disable-processing="true" style="border-collapse: collapse; border: 0px; margin-bottom: 2em; margin-top: 2em; ; margin-left: auto; margin-right: auto;  " id="tab:unnamed-chunk-2">
<caption style="caption-side: top; text-align: center;">Factors That Will Influence Your Application</caption><colgroup><col><col></colgroup><tbody><tr>
<th style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0.4pt 0.4pt;    padding: 6pt 6pt 6pt 6pt; font-weight: bold;">Controllable?</th><th style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0.4pt 0.4pt 0pt;    padding: 6pt 6pt 6pt 6pt; font-weight: bold;">Relevant to Your Qualifications?</th></tr>
<tr>
<td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0pt 0.4pt;    padding: 6pt 6pt 6pt 6pt; background-color: rgb(242, 242, 242); font-weight: normal;">Yes</td><td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0.4pt 0pt 0pt;    padding: 6pt 6pt 6pt 6pt; background-color: rgb(242, 242, 242); font-weight: normal;">Yes</td></tr>
<tr>
<td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0pt 0.4pt;    padding: 6pt 6pt 6pt 6pt; font-weight: normal;">Yes</td><td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0.4pt 0pt 0pt;    padding: 6pt 6pt 6pt 6pt; font-weight: normal;">No</td></tr>
<tr>
<td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.4pt 0.4pt;    padding: 6pt 6pt 6pt 6pt; background-color: rgb(242, 242, 242); font-weight: normal;">No</td><td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0.4pt 0.4pt 0pt;    padding: 6pt 6pt 6pt 6pt; background-color: rgb(242, 242, 242); font-weight: normal;">No</td></tr>
</tbody></table>

</div>
</div>
<p>Ignore the last row - there’s nothing you can do about those factors! The factors in the middle row have nothing to do with how well you meet the program requirements. Nevertheless, these factors do influence your applications. With that said, they are affected by your choices and behavior (or lack thereof), and can be addressed with some effort and forethought. You can decide for yourself how to morally judge the factors in this category; in an ideal world, you would be judged solely on your objective potential. But this is not the world we live in. Therefore, the <a href="https://www.matthewvanaman.com/imgs/trick.gif" target="_blank">trick</a> is to <em>get</em> the qualifications, and to make sure you don’t <em>get in the way</em> of having your qualifications recognized. This guide is designed to help you get the recognition you deserve. But to do that, we must have a realistic understanding of what we can and cannot control. For a brief introduction, I highly recommend reading about the graduate school kisses of death.</p>
<section id="focus-only-on-what-you-can-control" class="level2">
<h2 class="anchored" data-anchor-id="focus-only-on-what-you-can-control">Focus Only On What You Can Control</h2>
<p><strong>The goal of this guide is to help you focus on what you can control.</strong> As I’ve said at the outset, you are probably qualified. The <em>most</em> unfair outcome for you, at least in my opinion, is that your application is disqualified for bullshit that has nothing to do with your actual qualifications. Let’s minimize the bullshit.</p>
<p>Consistent with this philosophy, any therapist <a href="https://www.psychologytoday.com/us/blog/what-mentally-strong-people-dont-do/201705/how-stop-worrying-about-things-you-cant-change" target="_blank">will tell you</a> that the key to maintaining well-being during stressful times is to focus <em>only</em> what you can control, and to let go of what you can’t. One common suggestion is to draw a circle, think of some factors that could influence your application outcome, and ask yourself “what could I do about that?” If you can think of a reasonable answer, write that factor inside the circle. If your answer is “I can’t imagine being able to do a damn thing about that”, then write that factor outside the circle.</p>
<p>To help you let go of what you can’t control - even the unjust and ugly factors - I’ve gone ahead and drawn the circles for you. Feel free to explore the graph below by clicking on the circles to preview some of the factors:</p>
<div class="cell">
<div class="cell-output-display">
<div class="circlepackeR html-widget html-fill-item-overflow-hidden html-fill-item" id="htmlwidget-c2e06c4fce0827808feb" style="width:100%;height:742px;"></div>
<script type="application/json" data-for="htmlwidget-c2e06c4fce0827808feb">{"x":{"data":{"name":"factor","children":[{"name":"Factors Out of Your Control","children":[{"name":"Qualifications: Irrelevant","children":[{"name":"PA: Accepting Students","controllable":"Factors Out of Your Control","factor":"PA: Accepting Students","importance":6,"qualifications":"Qualifications: Irrelevant"},{"name":"PA: Funding Availability","controllable":"Factors Out of Your Control","factor":"PA: Funding Availability","importance":4,"qualifications":"Qualifications: Irrelevant"},{"name":"Program Funding","controllable":"Factors Out of Your Control","factor":"Program Funding","importance":3.5,"qualifications":"Qualifications: Irrelevant"},{"name":"PA: Lab Priorities","controllable":"Factors Out of Your Control","factor":"PA: Lab Priorities","importance":3,"qualifications":"Qualifications: Irrelevant"},{"name":"PA: Funding Priorities","controllable":"Factors Out of Your Control","factor":"PA: Funding Priorities","importance":3,"qualifications":"Qualifications: Irrelevant"},{"name":"Competition","controllable":"Factors Out of Your Control","factor":"Competition","importance":2,"qualifications":"Qualifications: Irrelevant"},{"name":"PA: On Sabatical","controllable":"Factors Out of Your Control","factor":"PA: On Sabatical","importance":2,"qualifications":"Qualifications: Irrelevant"},{"name":"PA: Personality","controllable":"Factors Out of Your Control","factor":"PA: Personality","importance":1.5,"qualifications":"Qualifications: Irrelevant"},{"name":"Attractiveness","controllable":"Factors Out of Your Control","factor":"Attractiveness","importance":1,"qualifications":"Qualifications: Irrelevant"},{"name":"Demographics","controllable":"Factors Out of Your Control","factor":"Demographics","importance":1,"qualifications":"Qualifications: Irrelevant"}]}]},{"name":"Factors In Your Control","children":[{"name":"Qualifications: Relevant","children":[{"name":"CV: Research","controllable":"Factors In Your Control","factor":"CV: Research","importance":4.5,"qualifications":"Qualifications: Relevant"},{"name":"Letters of Recommendation","controllable":"Factors In Your Control","factor":"Letters of Recommendation","importance":4.5,"qualifications":"Qualifications: Relevant"},{"name":"CV: Research Products","controllable":"Factors In Your Control","factor":"CV: Research Products","importance":4.5,"qualifications":"Qualifications: Relevant"},{"name":"Statement: Content","controllable":"Factors In Your Control","factor":"Statement: Content","importance":3.5,"qualifications":"Qualifications: Relevant"},{"name":"Clear Research Interests","controllable":"Factors In Your Control","factor":"Clear Research Interests","importance":2.5,"qualifications":"Qualifications: Relevant"},{"name":"GRE Scores","controllable":"Factors In Your Control","factor":"GRE Scores","importance":2.5,"qualifications":"Qualifications: Relevant"},{"name":"Awards and Honors","controllable":"Factors In Your Control","factor":"Awards and Honors","importance":1.5,"qualifications":"Qualifications: Relevant"},{"name":"CV: GPA","controllable":"Factors In Your Control","factor":"CV: GPA","importance":2.5,"qualifications":"Qualifications: Relevant"},{"name":"CV: Teaching","controllable":"Factors In Your Control","factor":"CV: Teaching","importance":2.5,"qualifications":"Qualifications: Relevant"}]},{"name":"Qualifications: Irrelevant","children":[{"name":"Statement: Quality of Prose","controllable":"Factors In Your Control","factor":"Statement: Quality of Prose","importance":3,"qualifications":"Qualifications: Irrelevant"},{"name":"Interview Performance","controllable":"Factors In Your Control","factor":"Interview Performance","importance":3,"qualifications":"Qualifications: Irrelevant"},{"name":"Likability","controllable":"Factors In Your Control","factor":"Likability","importance":3,"qualifications":"Qualifications: Irrelevant"},{"name":"Diversity Statement","controllable":"Factors In Your Control","factor":"Diversity Statement","importance":2,"qualifications":"Qualifications: Irrelevant"},{"name":"Self-Promotion","controllable":"Factors In Your Control","factor":"Self-Promotion","importance":3,"qualifications":"Qualifications: Irrelevant"},{"name":"CV: Formatting","controllable":"Factors In Your Control","factor":"CV: Formatting","importance":2,"qualifications":"Qualifications: Irrelevant"},{"name":"\"Elevator Pitch\"","controllable":"Factors In Your Control","factor":"\"Elevator Pitch\"","importance":1,"qualifications":"Qualifications: Irrelevant"},{"name":"Submit On Time","controllable":"Factors In Your Control","factor":"Submit On Time","importance":6,"qualifications":"Qualifications: Irrelevant"}]}]}]},"options":{"size":"importance","color_min":"hsl(56,80%,80%)","color_max":"hsl(341,30%,40%)"}},"evals":[],"jsHooks":[]}</script>
</div>
</div>
</section>
</section>
<section id="the-timeline" class="level1">
<h1>The Timeline</h1>
<p>First thing’s first: you should start preparing as early as you can. My recommended minimum is that you start this guide <strong>at least two years</strong> before you plan to submit your applications. If you plan to submit applications in Fall 2025, you should consult this guide starting in Fall 2023, at the latest. For some it’s too late, but if you are currently putting it off, stop putting it off.</p>
<p>Generally, the application process for psychology is as follows:</p>
<ul>
<li><p>Figure out <strong>what you want to research</strong>. This is purely interest-driven, so I assume that you already have a subject-area that you find intrinsically interesting and can imagine yourself dedicating uncountable hours to reading about and understanding.</p></li>
<li><p>Establish a <strong>longlist</strong>: identify about 25 or so potential advisors, or PAs, who share your research interests.</p></li>
<li><p>Narrow that down to a <strong>shortlist</strong>: identify those PAs who are a) accepting applications in your target application semester, b) will have funding available to pay you, either through grants or through the psychology department. Your longlist will shorten after narrowing down based on these criteria.</p></li>
<li><p>Make sure your have one or more of the following:</p>
<ul>
<li><p>Above-average scores on the <strong>GRE</strong>, aka the Graduate Record Examination; or</p></li>
<li><p>Above-average college <strong>GPA</strong> (especially major GPA).</p></li>
</ul></li>
<li><p>Compose <strong>statements of purpose</strong>, one for each PA (yes: you will have a unique statement for each PA).</p></li>
<li><p>Finely-tune your <strong>CV</strong>, including qualifications <em>and</em> formatting and prose. This will take time.</p></li>
<li><p>Submit your <strong>applications</strong>. Deadlines are usually late November or early December.</p></li>
<li><p>If your application is successful, you will be invited to a <strong>remote interview</strong> (phone or video chat). Usually, this happens in mid- to late-January.</p></li>
<li><p>If your remote interview is successful, you will be invited to an <strong>in-person interview</strong>. This usually happens in February or March. At this point, your chances of acceptance are greater than your chances of rejection.</p></li>
<li><p>If your in-person interview is successful, you will get an <strong>offer letter</strong>. You will usually know by the first of May, one way or the other.</p></li>
<li><p>The vast majority of your application experience, if not the entirety (at least the first attempt), will be <strong>rejection</strong>. Prepare yourself for this. Seriously, it hurts. Hope for the best, prepare for the worst, as they say.</p></li>
</ul>
<p>Here is an example timeline (feel free to download this template):</p>
<div class="cell">
<div class="cell-output-display">
<table class="huxtable" data-quarto-disable-processing="true" style="border-collapse: collapse; border: 0px; margin-bottom: 2em; margin-top: 2em; width: 100%; margin-left: auto; margin-right: auto;  " id="tab:unnamed-chunk-4">
<colgroup><col><col></colgroup><tbody><tr>
<th style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0.4pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: bold;">Task</th><th style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0.4pt 0.4pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: bold;">Recommended Deadline</th></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; background-color: rgb(242, 242, 242); font-weight: normal;">Find a mentor</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; background-color: rgb(242, 242, 242); font-weight: normal;">Immediately</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">CV: Start researching</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">Immediately</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; background-color: rgb(242, 242, 242); font-weight: normal;">Start saving money</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; background-color: rgb(242, 242, 242); font-weight: normal;">Immediately</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">CV: GPA (start getting A's)</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">Immediately</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; background-color: rgb(242, 242, 242); font-weight: normal;">Schedule GRE (if required)</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; background-color: rgb(242, 242, 242); font-weight: normal;">End of Spring semester, 2022</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">Start studying for GRE (if required)</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">Beginning of Summer, 2022</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; background-color: rgb(242, 242, 242); font-weight: normal;">Take the GRE</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; background-color: rgb(242, 242, 242); font-weight: normal;">August, 2022</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">Identify 4 (3 + 1 backup) professors to write letters of recommendation, and begin building rapport with them</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">Beginning of Fall semester, 2022</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; background-color: rgb(242, 242, 242); font-weight: normal;">Begin teaching, tutoring, or mentoring</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; background-color: rgb(242, 242, 242); font-weight: normal;">Beginning of Fall semester, 2022</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">Assemble the Long List</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">End of Summer, 2023</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; background-color: rgb(242, 242, 242); font-weight: normal;">Write a rough draft of your CV</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; background-color: rgb(242, 242, 242); font-weight: normal;">End of Summer, 2023</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">Write a rough, generic draft of your Statement of Purpose</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">End of Summer, 2023</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; background-color: rgb(242, 242, 242); font-weight: normal;">Confirm that everyone on Long List is accepting applications for funded positions</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; background-color: rgb(242, 242, 242); font-weight: normal;">Last week of August, 2023</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">Gather and complete forms for letters of recommendation</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">Last week of August, 2023</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; background-color: rgb(242, 242, 242); font-weight: normal;">Finalize your Short List</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; background-color: rgb(242, 242, 242); font-weight: normal;">First week of September, 2023</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">Fill out Short List spreadsheet</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">First week of September, 2023</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; background-color: rgb(242, 242, 242); font-weight: normal;">Begin applications</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; background-color: rgb(242, 242, 242); font-weight: normal;">First week of September, 2023</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">Request letters of recommendation from professors</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">First week of September, 2023</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; background-color: rgb(242, 242, 242); font-weight: normal;">Email everyone on your Short List to inquire about a video or phone call</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; background-color: rgb(242, 242, 242); font-weight: normal;">Last week of September, 2023</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">Request official transcripts and send to all programs</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">First week of October, 2023</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; background-color: rgb(242, 242, 242); font-weight: normal;">Send GRE scores to all programs</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; background-color: rgb(242, 242, 242); font-weight: normal;">First week of October, 2023</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">Start filling out applications</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">First week of October, 2023</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; background-color: rgb(242, 242, 242); font-weight: normal;">Finalize and upload all statements of purpose</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; background-color: rgb(242, 242, 242); font-weight: normal;">Last week of October, 2023</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">Finalize and upload CV</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">Last week of October, 2023</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; background-color: rgb(242, 242, 242); font-weight: normal;">Finalize and upload diversity statement (if required)</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; background-color: rgb(242, 242, 242); font-weight: normal;">First week of November, 2023</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">Confirm and submit your applications</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">Second week of November, 2023</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; background-color: rgb(242, 242, 242); font-weight: normal;">Confirm successful processing of applications</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; background-color: rgb(242, 242, 242); font-weight: normal;">Third week of November, 2023</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.4pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">Email everyone on your Short List to inform them that you submitted</td><td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.4pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">Third week of November, 2023</td></tr>
</tbody></table>

</div>
</div>
</section>
<section id="the-budget" class="level1">
<h1>The Budget</h1>
<p>Applying to PhD programs in psychology is not free. In fact, it’s very expensive. Application fees will range from about $80 to $120 each. Your school will probably charge a fee to send your transcripts to the schools on your list. Mine charged $7.25. If you are lucky enough to be invited to an in-person interview, you will most likely be unlucky enough to have to pay to get there. Most of the time, you will be able to stay with a current student, but plan on saving enough money for a hotel just in case. The GRE is expensive, and although you can study for free, I personally had the best luck using Magoosh. Importantly, you can almost always catch Magoosh on a sale, and their customer service is accommodating.</p>
<p>Here’s a breakdown of what you can expect to pay, assuming you are applying to 10 schools:</p>
<div class="cell">
<div class="cell-output-display">
<table class="huxtable" data-quarto-disable-processing="true" style="border-collapse: collapse; border: 0px; margin-bottom: 2em; margin-top: 2em; width: 100%; margin-left: auto; margin-right: auto;  " id="tab:unnamed-chunk-5">
<colgroup><col><col></colgroup><tbody><tr>
<td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">Application fees ($100 x 10)</td><td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">$1,000</td></tr>
<tr>
<td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; background-color: rgb(242, 242, 242); font-weight: normal;">Transcript requests ($7.25 x 10)</td><td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; background-color: rgb(242, 242, 242); font-weight: normal;">$72.50</td></tr>
<tr>
<td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">Flights to interviews ($250 x 3)</td><td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">$750</td></tr>
<tr>
<td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; background-color: rgb(242, 242, 242); font-weight: normal;">Hotels ($100 x 2 interviews x 2 stays each)</td><td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; background-color: rgb(242, 242, 242); font-weight: normal;">$400</td></tr>
<tr>
<td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">GRE (if university requires it)</td><td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">$205</td></tr>
<tr>
<td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; background-color: rgb(242, 242, 242); font-weight: normal;">6 GRE practice tests (optional)</td><td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; background-color: rgb(242, 242, 242); font-weight: normal;">$50</td></tr>
<tr>
<td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">6 month Magoosh GRE subscription (optional)</td><td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">$180</td></tr>
<tr>
<td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; background-color: rgb(242, 242, 242); font-weight: bold;">Total (conservative estimate)</td><td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; background-color: rgb(242, 242, 242); font-weight: bold;">$2,658</td></tr>
<tr>
<td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.4pt 0.4pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: bold;">Total (minimum estimate)</td><td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.4pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: bold;">$1,823</td></tr>
</tbody></table>

</div>
</div>
<p>What does this mean for you? First, it means you should start saving the exact moment you realize that you want to get a PhD in psychology. Second, it means that you should immediately start asking your professors, your department, your school career center, and your school financial aid office for help in finding financial assistance for applying to graduate school. Also check your prospective programs for application and GRE fee waivers. Lastly, look for school or association interview travel support that can get you to and from interviews. They’re rare, but they are out there.</p>
<p>After you have exhausted every option, consider a personal loan instead of racking up credit card debt. Personal loans are easy to get, the payments are reasonable, and the interest is usually lower than credit cards. However, an even better option would be to apply to a <em>new</em> credit card and take advantage of the usual 12-month interest-free period. Be careful though, you can easily get yourself into trouble with these options. I amassed thousands of dollars of credit card debt during the application process…but I wanted it bad enough to warrant that. Is that healthy or wise? I don’t really care. But I will stop short of recommending it for you.</p>
<p>The takeaway: exhaust every possible option before you take on debt - remember, it is highly likely that you will not receive an offer letter.</p>
</section>
<section id="the-mentor" class="level1">
<h1>The Mentor</h1>
<p>I benefited strongly from having someone “show me the ropes” of the application process. This person also gave me an honest picture of what life would look like as a PhD student in psychology. As early as you can, identify a professor and the professor know that you intend to apply to PhD programs in psychology. Preferably, this will be someone you already have rapport with, such as a teacher or the person who runs the research lab you are working in. Frankly ask if this person would be willing to guide you through the process. Professors are busy, so don’t be afraid to be assertive, but also don’t be afraid to move on if this professor does not give you a fair and reasonable amount of guidance. Just make sure that before you ask, you are committed to the process and the hard work it will take to heed your mentor’s advice. Advising a prospective PhD student is work for them, so make sure you are serious about it. They will be proud if you get in.</p>
<p>Most importantly, demand that this person be honest with you about the downsides of PhD study in psychology, including the <a href="https://www.nature.com/articles/d41586-019-03459-7" target="_blank">tortuous nature</a> of graduate school life, and the scant job <a href="https://forum.effectivealtruism.org/posts/3TQTec6FKcMSRBT2T/estimation-of-probabilities-to-get-tenure-track-in-academia" target="_blank">prospects</a> for psychology professors. And most importantly, do not think of this guide as a replacement for a mentor. I’d like to think I wrote a useful guide, but nothing beats a real life person who can tune their advice to your unique circumstances and interests.</p>
</section>
<section id="the-curriculum-vitae" class="level1">
<h1>The Curriculum Vitae</h1>
<p>The CV should be all research, all the time. I have broken up the CV section into factors that are relevant to your qualifications and factors irrelevant to your qualifications, both of which are within your control.</p>
<p>To compare content, feel free to use my CV as an example. I received positive feedback from PAs during the application process; one used the word “impressed”. Some will disagree, but it’s a good starting point.</p>
<section id="cv-factors-relevant-to-qualifications" class="level2">
<h2 class="anchored" data-anchor-id="cv-factors-relevant-to-qualifications">CV Factors Relevant to Qualifications</h2>
<ul>
<li><div id="research">

</div>
<p><strong>Research experience</strong>: As early as humanly possible, get yourself involved in a research lab. Target the subfield that you want to eventually research as a graduate student. The earlier you start, the more opportunity you will have to rule out subfields you don’t like, as is often the case. Although there are other (and perhaps better) <a href="https://www.apa.org/ed/precollege/psn/2014/01/research-undergraduate" target="_blank">guides</a> out <a href="https://www.nature.com/articles/d41586-019-00871-x" target="_blank">there</a>, here are the most common ways to get involved in research:</p>
<ul>
<li><p><strong>Become a research assistant.</strong> Find a professor who runs a lab at your school, and inquire about becoming their research assistant. Preferably, this professor will do research in an area you are interested in pursuing, though beggars cannot always be choosers.</p>
<ul>
<li><p>Sometimes, you can get <a href="https://www.google.com/search?q=research+assistant+positions+paid&amp;client=safari&amp;rls=en&amp;ei=T_e4YM6gJMLH_QbAr4r4Cg&amp;oq=research+assistant+positions+paid&amp;gs_lcp=Cgdnd3Mtd2l6EAMyBwgAEEcQsAMyBwgAEEcQsAMyBwgAEEcQsAMyBwgAEEcQsAMyBwgAEEcQsAMyBwgAEEcQsAMyBwgAEEcQsAMyBwgAEEcQsANQAFgAYLwCaABwA3gAgAFyiAFykgEDMC4xmAEAqgEHZ3dzLXdpesgBCMABAQ&amp;sclient=gws-wiz&amp;ved=0ahUKEwiOhKnd5fvwAhXCY98KHcCXAq8Q4dUDCA0&amp;uact=5" target="_blank">paid</a> as a research assistant. Try for those first!</p></li>
<li><p>Usually, you can count your research assistantship for course credit. Try that next!</p></li>
<li><p>Always, you can volunteer as a research assistant. Only do this if you have ruled out getting paid or taking it for course credit. You are not made of money, you poor undergraduate!</p></li>
<li><p>Regardless, expect to dedicate between 5 to 15 hours per week to your research assistantship.</p></li>
</ul></li>
<li><p><strong>Apply for student research grants</strong>. Usually your school will offer grant competitions for undergraduates to fund their own research opportunities. I applied to <a href="https://www.stetson.edu/other/research/sure.php" target="_blank">this one</a> and <a href="https://www.stetson.edu/other/research/sure-grant-recipients.php" target="_blank">got it</a> (yes, I used to shave my head, it feels cool and saved me poor undergraduate self $20 a month, I regret nothing!). It was a great experience!</p>
<ul>
<li>The <a href="http://www.psychwiki.com/wiki/Undergraduate_grants/awards" target="_blank">psychwiki</a> has a good resource for finding undergraduate research grants.</li>
</ul></li>
<li><p><strong>Carry out a senior research thesis</strong>. Sometimes undergraduate programs require this anyway. Good, do it and make sure to get an A. Sometimes senior research theses are optional, or part of an honors course. Opt in if possible.</p></li>
<li><p><strong>Take an independent research course</strong>. Propose your own study and carry it out. Do this <em>in addition to</em> a senior thesis or honors thesis. Usually, this is a bit different from getting research credit as a research assistantship, as you are leading your own research rather than assisting on someone else’s project. More work, but more in-depth experience.</p></li>
<li><p><strong>Work at research outside of your school</strong>. Summer research internships or camps hosted at other schools or through associations, research at hospitals or government agencies, research institutes or think tanks, non-profit or community organizations (I conducted demography research at a homelessness agency for a time), and research internships in the private sector, to name a few examples.</p></li>
</ul></li>
<li><p><strong>Research Products</strong>: Experience is one thing; outcomes are another. Wherever you can, try to make your hard work count for more than cool stories. Here are some ways to do that:</p>
<ul>
<li><p><strong>Publish</strong>. Before you embark on any of your research, be it a research grant, senior project, honors thesis, or independent research course, ask your professor if they’d be willing to supervise the project through to publication in a peer-reviewed journal. If you are a research assistant, ask if your lab supervisor would let you take enough responsibility to take on a coauthorship. Be <em>explicit</em> on the front end that you expect coauthorship for doing any above-and-beyond work. Also it be known that undergraduate students can get publications in top-tier peer-reviewed journals; I did, and so did the professor I published with, when he was an undergraduate. There are also undergraduate journals, and believe it or not, those count too!</p></li>
<li><p><strong>Present at conferences</strong>. Same as the above; but research conferences don’t always have as high of a bar for acceptance. There are undergraduate research conferences as well, <a href="https://www.cur.org/what/events/students/ncur/" target="_blank">some of which</a> are well-known and respectable in their own right. If you are a research assistant, ask to help with the poster in exchange coauthorship. Also be on the lookout for research showcases at home. I presented at my school’s <a href="https://www.stetson.edu/other/research/showcase.php" target="_blank">research showcase</a> twice.</p></li>
<li><p><strong>Present your research at lab meetings</strong>. No matter what capacity you are doing research in, there are usually opportunities to present at lab meetings, be they the meetings held by your professors, lab supervisors, other labs at the school who do similar research, and so on. Sometimes you can present on your contributions to others’ work, such as data analysis you did as a research assistant.</p></li>
</ul></li>
<li><p><strong>Awards and Honors</strong>: It’s time to become an award hound. I’ll leave you to decide whether actively seeking awards for yourself is virtuous or vicious, but awards can have a big impact, especially if they are related to research.</p>
<ul>
<li><p><strong>University or departmental awards</strong>. If your school or department has research award competitions, apply. These are very often self-nominated; for those awards that aren’t, ask your mentor if they’d be willing to nominate you, or what you might need to do to earn a nomination (if necessary).</p></li>
<li><p><strong>Association awards</strong>. These are offered through professional organizations, like the Association for Psychological Science or Psi Chi undergraduate honors soceity. Actively seek out awards and apply for them. Same advice applies for these as school or departmental awards.</p>
<ul>
<li>The <a href="http://www.psychwiki.com/wiki/Undergraduate_grants/awards" target="_blank">psychwiki</a> has a good resource for finding undergraduate research awards.</li>
</ul></li>
<li><p><strong>Dean’s list, “top student” awards, and the like</strong>. These don’t hurt either, but don’t break your back over them. Getting into Psi Chi can be good, but it’s not very impressive on its own. But, it is very useful for getting undergraduate research grants and awards.</p></li>
</ul></li>
<li><p><strong>Teaching or Tutoring</strong>: You will mostly likely be teaching undergraduate students as a PhD student. Although you should prioritize your research, having other experience that demonstrates your competence can go a long way, and showing that you’re an expert among your peers is a great way to do that. Consider, for at least a semester, doing one or more of the following:</p>
<ul>
<li><p><strong>Teaching assistantship</strong>. Are you a stats wiz? Has your professor complimented you on your Research Methods paper? Consider becoming a teaching assistant or apprentice. Often, you can get course credit for teaching assistantships, which usually consist of you working with a professor to carry out class activities, grade (sometimes), implement changes to the curriculum, provide tutoring hours to students outside of class, or lead labs, depending on the needs of you professor.</p></li>
<li><p><strong>Tutoring</strong>. Schools usually have <a href="https://www.stetson.edu/administration/academic-success/tutoring-spi.php" target="_blank">tutoring centers</a>, which you can volunteer at or, occasionally, acquire a part-time job at (i.e., money!). Sometimes work-study programs can include tutoring too. Try to tutor for statistics or research methods rather than content areas like personality or clinical psychology. Furthermore, <a href="https://www.psichi.org" target="_blank">Psi Chi</a> will often offer tutoring programs in departments where they hold chapters. My undergraduate program did, and <a href="https://www.stetson.edu/artsci/psychology/psi-chi.php" target="_blank">still does</a>.</p></li>
</ul></li>
<li><p><strong>Professional Experience</strong>: This one is a mixed bag, so make sure to take this into consideration before you start spending time adding this to your CV.</p>
<ul>
<li><p><strong>Counseling or Clinical Experience</strong>. <em>Do not do this, for two reasons.</em></p>
<ul>
<li><p>One, if you are not going for a clinical PhD, no one will care. Spend the time on research instead.</p></li>
<li><p>If you <em>are</em> going for a PhD in clinical, no will care - but worse, they may care but not in a good way. While it’s tempting to think that clinical programs or your potential PA would like to see clinical experience. After all, wouldn’t this minimize how much time and effort needed to train you? The truth is, your previous experience will be ignored at best. At worst, the program will have to <em>untrain</em> you in order to instill their own training philosophy. A blank slate is actually preferable to previous experience, because it is less work to train to puppy to do new tricks than an old dog who was taught tricks the old way. Focus on your research instead - you can <em>always</em> be on being expected to hit the ground running on the research front.</p></li>
</ul></li>
</ul></li>
<li><p><strong>Other Qualifications</strong>: Be creative and re-frame non-academic or non-psychology experiences to be relevant to PhD work. Include anything and everything that you could reasonable construe as highlighting a skill or experience that makes you prepared for the work you’ll do as a PhD student. You’ll be surprised at how much of your experience could be presented in this way, without lying. It’s just a matter of thinking in terms of skills, rather than rigid superstitions about which positions “count” and which don’t. Here are some examples:</p>
<ul>
<li><p><strong>Project management</strong>. Have you been in charge of recruiting team members, leading the team, setting agendas, etc? Highlight it. Why? Because you will be in charge leading teams as a PhD student, like your army research assistants, or your coauthors who have designated you the lead author.</p></li>
<li><p><strong>Software skills</strong>. Have you had a job that required database management? Did you recently take a summer crash course on C++? Highlight it, because PhD life will require you to learn new statistical software, and possibly others. I learned python, and fellow PhD students of mine have learned javascript during their studies.</p></li>
<li><p><strong>Non-academic teaching or training</strong>. Have experience teaching or training people? Highlight it. Why? Because you will be teaching, and training, many students and mentees as a PhD student.</p></li>
<li><p><strong>Other stuff - be creative</strong>. I talked to a prospective PhD student who had an M.A.&nbsp;in Film, where he taught acting classes and graded screenplays. He talked about the strategies he learned for managing actors’ egos, and for finessing his feedback on their screenplays. After all, actors are vulnerable when they are on stage, and creative writing is often near and dear to writers’ hearts, and it was important to maximize their receptivity to constructive criticism. He was surprised when I recommended he put this experience on his CV. As a PhD student, you may have to train research assistants to “act”, such as training them as a confederate, or “pretend co-participant”. You will almost certainly be grading papers, or providing feedback on the writing of your research assistants, or editing drafts written by coauthors. For academics and students, writing is near and dear to <em>their</em> hearts too, and it takes finesse to offer constructive criticism in an actually-helpful way. This student’s skills working with actors would make him an above-average teacher and mentor, as he will not have to waste time learning how to provide constructive feedback.</p>
<ul>
<li>Too long/didn’t read: think about your previous experience in terms of how it might translate to you being prepared for life as a PhD student.</li>
</ul></li>
</ul></li>
</ul>
</section>
<section id="cv-factors-irrelevant-to-qualifications" class="level2">
<h2 class="anchored" data-anchor-id="cv-factors-irrelevant-to-qualifications">CV Factors Irrelevant to Qualifications</h2>
<p>Feel free to use my CV as an example format. There are no rules for CV formatting really, but there are definite principles to follow. If I had to do it over again, I would have written a bit less turgidly, gotten rid of the passive voice, moved to a bullet-point format over the paragraph format, and perhaps overall written a bit less or trimmed things down a bit. Most academic CVs will not include descriptions of what was done; for student CVs, I recommend that describe the projects and experiences as long as the content is easy to access (i.e., formatted well). <strong>Make sure that your CV is not redundant with your Personal Statement!</strong> For example, if you discuss a project at length in your statement, don’t recap it on your CV.</p>
<ul>
<li><p><strong>Formatting</strong>. Shouldn’t PAs only consider the content on your CV? Yes, but that is not what is going to happen in real life. In real life, your PA and everyone else reviewing your CV will likely not have time to read every detail. You will therefore want to make your CV as easy to read as possible, and arrange the information in such a way that minimizes the amount of work it takes to see your qualifications clearly. This is the order I recommend:</p>
<ul>
<li><p><strong>Education section</strong>: Include the usual stuff, with the name of your senior or honors research thesis if you have one, and your major GPA followed by overall GPA.</p></li>
<li><p><strong>Awards/Grants</strong>: Don’t be humble, put everything ya got here. If you have more than, say, 4 or 5 grants and 4 or 5 honors, break those up into separate sections (Grants and Scholarships, and Honors and Awards, for example). For any grants or scholarships, list the dollar amount.</p></li>
<li><p><strong>Publications and Presentations</strong>: This is where you’ll list your “research products”. Did you present the same poster at two conferences? List both of them. Have a manuscript under review at a journal? List it, along with the journal name it’s being reviewed at. Have a manuscript in preparation? <em>If</em> you have a copy that you could, hypothetically, provide to someone who might ask for it, then list it, otherwise leave it off. List everything, use APA style. Include links to your work where applicable. Break up sections - “publications and manuscripts”, and “presentations” is a good start.</p>
<ul>
<li>Note: If you have research products in the works, but have not been realized by the <em>time of application</em>, you can still list them if you <u>fully and confidently</u> expect to have them ready <em>by the time you interview</em> (late January is a safe deadline). Have a manuscript that is not ready to be read on the deadline of November 30th, but you are <em>sure</em> that you will have a readable draft by late January? List it.</li>
</ul></li>
<li><p><strong>Research Experience, or Research and Related Experience</strong>. List your positions in reverse chronological order, and draw attention to your tangible accomplishments and skills. This is where you can do some describing.</p></li>
<li><p><strong>Teaching Experience, or Teaching and Related Experience</strong>. List any positions, along with what you did. Straightforward.</p></li>
</ul></li>
<li><p><strong>Prose</strong>.</p>
<ul>
<li><p><strong>When writing, be exhaustive, but brief</strong>. A contradiction, you say. There is an art to writing efficiently; I revised my CV about ten times, and trimmed it down from eight pages to three-and-a-half pages. With CVs, the traditional advice is “longer is better”, but this is only true if every bit of writing is content and very little, if any, is inefficient or empty fluff.</p></li>
<li><p><strong>Adopt a classic style</strong>. Now is not the time to overwhelm with jargon, or show off your poetry skills. Some professors will insist that you write in an abstruse, pseudo-sophisticated, jargon-laden manner, as if you were writing an academic manuscript — or at least you might be tempted to think they expect that from you. Regardless of the real or imagined directive to write like an academic, just say “no”: instad, make your content as readable and comprehensible as you can. In fact, make it <em>a pleasure to read</em>. Those reviewing your application sometimes have to read hundreds of applications, meaning you will make make yourself memorable by being one of the few that actually <em>avoided</em> being a drain on their mental (and emotional) energy.</p></li>
</ul></li>
<li><p><strong><em>Maybe</em></strong> <strong>leave off signs political or religious affiliation?</strong></p>
<ul>
<li><p>This one’s controversial. Research shows that, in general, it can <a href="https://link.springer.com/article/10.1007/s11109-014-9286-0" target="_blank">hurt</a> your job application if it reveals that you would be in the political minority at that job, regardless of industry or what the political majority happens to be. Academia is no exception; one <a href="https://journals.sagepub.com/doi/full/10.1177/1745691612448792?casa_token=sM3kBtNtgNoAAAAA%3AyK9qzBqkH0nvbBkz27NBG0XAZ2xDv5svaRwben9e8GdAVns662pifI1G5HTTVi08sy7Hp7r5a7MYDw" target="_blank">study</a> found that 38% of social psychologists were at least somewhat inclined to choose a liberal over conservative job candidate, even if the candidates were equally qualified. <a href="https://journals.sagepub.com/doi/full/10.1177/1948550616667617?casa_token=rdAe-son_dkAAAAA%3AFXMLIahWRspFpScrMvmUwA4lZJ6NuMbhOllZBz2pKNdbqgHCYomvXnAZ3vmG9Negbb_uZiyi5lLrhA" target="_blank">Another study</a> found a similar percentage, included numerous academic disciplines in their sample, and found that even though 32% of conservatives gave the same rating, all disciplines except one (agriculture, if you would like to know) were overwhelmingly liberal. We also know that there is a sizable <a href="https://academic.oup.com/socrel/article-abstract/76/3/315/1723124" target="_blank">body</a> of research showing that academics have prejudices against conservative Christians.</p></li>
<li><p>Does this mean you should leave off experience working at a church or conservative think tank? <strong>I do not have the answer.</strong> Would hiding them increase your odds of getting an offer letter? Probably. Is it right that people will judge you based on where you worked rather than on your qualifications alone? No, it’s not right. Would I list my experience working at a church again on my CV if I had to do things over again? No, I would not. Personally, I would prefer to ruthlessly maximize my chances of getting the offer letter. But for some, personal integrity is more important, and that is understandable too.</p></li>
</ul></li>
</ul>
</section>
</section>
<section id="the-letters-of-recommendation" class="level1">
<h1>The Letters of Recommendation</h1>
<p>In general, you’ll need to submit at least two, and as many as four, letters of recommendation as part of your PhD applications. The fourth letter is usually optional. I would ask for letters from three professors, and identify one backup in case one of the professors leaves you in the lurch (it does happen!).</p>
<p>You’ll want to start thinking about who will write letters of recommendation very early. This is because the better a professor or mentor knows you, and the longer they have worked with you, the more convincing and persuasive their letters will be. I have broken up the Letters of Recommendation section into factors that are relevant to your qualifications and factors irrelevant to your qualifications, both of which are within your control.</p>
<section id="lor-factors-relevant-to-qualifications" class="level2">
<h2 class="anchored" data-anchor-id="lor-factors-relevant-to-qualifications">LOR: Factors Relevant to Qualifications</h2>
<ul>
<li><p><strong>Identify writers who can speak to your potential</strong>. Early on, you’ll want to identify a few professors that you could work long-term with, in some capacity. If that is not possible, identify professors whom you had good relationships during class with. Cultivate relationships early on so that you can be given opportunities to demonstrate your talents, as well as opportunities to demonstrate your “mentorability”, or extent to which you’re willing to take good advice and apply what you learn. Remember, I had zero social capital, and had to seek it out from scratch. Generally, professors <em>enjoy</em> mentoring highly motivated students - I’m speaking from experience on both ends of that!</p></li>
<li><p><strong>Ask for LORs</strong>. Don’t be shy - you have the qualifications, you the potential, you just need to someone to vouch for you!</p></li>
<li><p><strong>Request that letters to touch on important points</strong>. If your PhD programs give descriptions of what they like to see in their candidates, make sure your writers have everything they need to speak directly to those qualities. Or if there’s an accomplishment that you are particularly proud of, but your writer doesn’t know about it, ask the writer to mention it in the letter if it seems relevant. Always provide everything your authors need to write a good letter for you, including your CV, additional information about previous research experience or accomplishments, etc.</p>
<ul>
<li><p>Occasionally, writers will ask you to review the letter for grammar or content. It’s awkward, I know. But do not be afraid to edit their letter! Advocate for yourself!</p></li>
<li><p>More rarely, writers will ask you to write the letter for them, which they will then sign. More common than you think. Write yourself a damn good letter - they <em>will</em> read it, and make it their job to tone <em>down</em> the bragging! The worst that could happen is they’ll walk it back to a more appropriate level. They’re the expert judge for that, not you, so write the best letter you can and let the experts place the gutter rails where they need to be.</p></li>
</ul></li>
</ul>
</section>
<section id="lor-factors-irrelevant-to-qualifications" class="level2">
<h2 class="anchored" data-anchor-id="lor-factors-irrelevant-to-qualifications">LOR: Factors Irrelevant to Qualifications</h2>
<p>There is a lot of leg work the needs to be done before you even ask your professors to write them. If you are not on top of these things, your professors could be irritated, you could get behind, your <em>professors</em> could get behind, and many other unnecessary obstacles, all of which will leave you with an avoidable headache.</p>
<ul>
<li><p><strong>Ask for one more letter than the highest number required among your programs.</strong> Meaning that if the highest number of letters any school on your short list asks for is 3, then ask 4 professors to author your letter. The 4th is a backup; see below.</p></li>
<li><p><strong>Turn your LORs in on time</strong>. To do so, you’ll need start way earlier than you probably think. Start these steps at the beginning of the Fall semester of your applications, and have them completed before you ask you professors to write and/or submit your letters:</p>
<ul>
<li><p><strong>Ask your current department what paperwork you need for LORs</strong>. When I was an undergraduate, my institution required me to request and complete FERPA forms (Family Educational Rights and Privacy Act) from the Psychology Department in order to get a letter of recommendation. These were needed in order for my writers to legally disclose information about me as a student to other institutions. I don’t know where this applies, but definitely find out and provide these materials with your requests if they turn out to be required.</p></li>
<li><p><strong>Ask your writers how they would like institutional info: steady stream, or all at once.</strong></p></li>
<li><p><strong>Provide these to your writers in an organized, bullet-pointed Word doc</strong> (or several, depending on writers’ answers to the last bullet point). Alternatively, you can share a Google Sheets spreadsheet:</p>
<ul>
<li><p>A full list of the names of the programs you will be applying to, with links to the labs or program pages.</p></li>
<li><p>The addresses, and contact info, of the relevant departments.</p></li>
<li><p>The names of the individuals to whom to address the letter, where applicable.</p></li>
<li><p>The names of the PAs on your short list (which I’ll review soon).</p></li>
<li><p>Deadlines for when letters are due for each institution.</p></li>
<li><p>Instructions for submitting the letters (e.g., if they should look for an invite link from application).</p></li>
<li><p>The specialization of the program you are applying to (e.g., “social psychology”)</p></li>
</ul></li>
</ul></li>
<li><p><strong>Waive your right to view the letters</strong>. Application portals will ask if you want to waive your right to view the letters. Do it, or else your letters risk losing credibility.</p></li>
<li><p><strong>Send your formal requests for letters to your authors.</strong></p>
<ul>
<li><p>Usually, you will invite professors through the school application portals, so make sure to have your professors’ preferred email addresses.</p></li>
<li><p>Send these by the end of September, at the latest, and give your authors a heads-up that you are about to do so.</p></li>
<li><p>Note that you can usually skip through the application portal to the part that asks you to submit letters of recommendation. In other words, you can send the invites whenever you want, and they can submit the letters whenever they want, regardless of the status of the rest of your application.</p></li>
</ul></li>
<li><p><strong>Periodically confirm that letters have been submitted</strong>. Check you application portals to see if they’ve been processed. DO NOT submit your application unless the letters have been processed, if the program has a different indicator. To use my own experience as an example: I submitted an application where the status of one of my letters said “submitted”. But two days later after the deadline had passed, the status changed to “processed”. The fine print of the application read “all materials must be processed by the deadline”. Did my materials get thrown out because they were late? I will never know. Don’t put yourself in that position.<br>
<br>
One thing you’ll need to plan for is that it takes authors time to write and submit the letters <em>and</em> to confirm that the letter has been received and processed. If for some reason you find yourself in a situation where one author cannot write your letter, and this puts you short a letter, and you find out say, 3 weeks before the deadline, you now have 3 weeks to ask some other extremely-busy professor to set aside time to write and submit your letters for the <em>n</em> number of schools you are applying to.<br>
<br>
I for some reason you do not already know whether your authors have successfully written and submitted your letters by about one month before the deadline, get a “yes or no” confirmation from them that your letters will be submitted no later than one week before the deadlines. If a writer has not submitted the letter by four weeks prior to the application deadline, simple ask:</p>
<ul>
<li>“Thank you again for agreeing to write my letter of recommendation. I don’t know if you realized, but the deadline to submit the letter is one month from now. Based on your schedule, can you confirm that you would be able to submit my letter by [date of one week before the deadline]?”</li>
</ul>
<p>If you do not get a response, or fail to get a clear confirmation, then provide a gentle, but firm, ultimatum:</p>
<ul>
<li>“Although I would prefer a letter from you, I would fully understand if this timeline is not compatible with your schedule; if that is the case, will you let me know now so that I may plan accordingly?”</li>
</ul></li>
<li><p>Granted, this is a rare situation and in most cases and things probably won’t come to this, especially because you already asked for a backup letter. But it’s common enough to talk about here. If you don’t hear back, or the author is being wishy-washy, ask your backup professor if they would be able to write a letter. Apologize for the late request, you can mention that another professor left you in the lurch if you want if you want, and that this is why you are asking at the last minute. But <u>do not mention the other professor by name</u>.</p></li>
</ul>
</section>
</section>
<section id="the-graduate-record-examination-gre" class="level1">
<h1>The Graduate Record Examination (GRE)</h1>
<p>At the time of this writing, a lot of schools are waiving the requirement for the GRE, due it either to the COVID-19 pandemic, concerns about racial or gender equity, or that the GRE doesn’t actually predict performance in graduate school. For the purpose of this guide, I’ll let you decide what value judgment to make about the GRE. But if you need to take it, I highly recommend following this guide.</p>
<p>A quick note: a lot of schools will claim to evaluate applications “holistically”. I’m sorry, this is just not true as long as the GRE is required. Imagine you are staring down the barrel of reviewing 100 applications, or perhaps 1,000, each of which has a three-page statement of purpose, a several-page CV, a diversity statement, transcripts that need to reviewing, and three letters of recommendation… any rational person is going to rely on an arbitrary cutoff to cull the herd. Even if the cutoff is not applied automatically but the computer, the people reviewing the applications will rely on cutoffs intuitively.</p>
<p>The good news is that, usually, you only need one of either your GPA or GRE scores to be above the cutoff. So if your GPA is a 4.0, just get an average score on the GRE (but no lower). If your GPA is a 3.4, then make sure to knock the GRE out of the park. Remember, you don’t want to get disqualified for something that has nothing to do with your actual qualifications, and by “actual qualifications”, I mean your research experience!</p>
<section id="schedule-your-exam" class="level2">
<h2 class="anchored" data-anchor-id="schedule-your-exam">Schedule Your Exam</h2>
<p><strong>I highly recommend taking the GRE one year in advance</strong>, preferably in say, August of the summer before the summer of your fall application. This way, you spread out your workload. Studying for the GRE is no joke, as you are about to see, and you can’t reasonably do that <em>and</em> write and revise several statements of purpose <em>and</em> write and revise your CV <em>and</em> fill our your applications <em>and</em>…etc. all at the same time!</p>
<div class="cell">
<div class="cell-output-display">
<table class="huxtable" data-quarto-disable-processing="true" style="border-collapse: collapse; border: 0px; margin-bottom: 2em; margin-top: 2em; ; margin-left: auto; margin-right: auto;  " id="tab:unnamed-chunk-6">
<colgroup><col><col></colgroup><tbody><tr>
<td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0pt 0pt;    padding: 6pt 6pt 6pt 6pt; font-weight: normal;">How long do I need to study?</td><td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0pt 0pt;    padding: 6pt 6pt 6pt 6pt; font-weight: normal;">Usually a little over 2 months</td></tr>
<tr>
<td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0pt 0pt;    padding: 6pt 6pt 6pt 6pt; font-weight: normal;">How long does it take to get my scores?</td><td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0pt 0pt;    padding: 6pt 6pt 6pt 6pt; font-weight: normal;">Immediately (unofficial preview); 2-3 weeks (official scores)</td></tr>
<tr>
<td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0pt 0pt;    padding: 6pt 6pt 6pt 6pt; font-weight: normal;">How long does it take for schools to receive my scores?</td><td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0pt 0pt;    padding: 6pt 6pt 6pt 6pt; font-weight: normal;">You can order them to be sent the day of the test; in that case, 2-3 weeks. Otherwise, it will take 2-3 weeks to get official GRE scores sent to the schools.</td></tr>
<tr>
<td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0pt 0pt;    padding: 6pt 6pt 6pt 6pt; font-weight: normal;">How many times can I take the GRE?</td><td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0pt 0pt;    padding: 6pt 6pt 6pt 6pt; font-weight: normal;">As many as you want</td></tr>
</tbody></table>

</div>
</div>
</section>
<section id="before-you-start-some-encouragement" class="level2">
<h2 class="anchored" data-anchor-id="before-you-start-some-encouragement">Before You Start: Some Encouragement</h2>
<div class="cell">
<div class="cell-output-display">
<div>
<figure class="figure">
<p><img src="https://www.matthewvanaman.com/posts/2021-05-18-crash-course-to-getting-into-a-phd-program-in-psychology/crash_course_PhD_files/figure-html/unnamed-chunk-7-1.png" class="img-fluid figure-img" width="672"></p>
</figure>
</div>
</div>
</div>
<p>Take a look at the plot above. At the time that I took the GRE, the population average for test-takers for the quantitative section was 152.3, with a standard deviation of 9.12. You’ll see that my first score on the GRE as almost an entire standard deviation less than the average test-taker. On my actual application, I turned in the results from my second test: a 153, just above the average.</p>
<p>Let this serve as empirical evidence that the GRE is <a href="https://jamesbierly.medium.com/does-iq-impact-gre-scores-632c24cbd5ea" target="_blank">not an IQ test</a>, but is a <a href="https://www.prepscholar.com/gre/blog/gre-to-iq-scores/" target="_blank">preparation test</a>. In fact, the revised GRE, which has been used since 2011, was purposely designed to have a lower correlation with IQ than the old version. In fact, by my experience, as well as the advice I received from my study preparation materials, the biggest impact on your score is time management during the test. Who knew?</p>
</section>
<section id="my-strategy-for-an-improved-score" class="level2">
<h2 class="anchored" data-anchor-id="my-strategy-for-an-improved-score">My Strategy for an Improved Score</h2>
<p>It is a common misconception that you need a lot of money to do well on the GRE. <a href="https://www.kaptest.com/gre" target="_blank">Kaplan</a> prep courses are about $1,000, which as far as I understand, actually do not make that much of a difference. This is not to say that people who use private prep courses like Kaplan do not score higher on the GRE; they do. But they also have an instructor hounding them with assignments, which makes sure that they study consistently. They also might be so committed to getting a good score that they would spend $1,000 of their hard earned money on a GRE course. These people would probably have gotten high scores anyway, given their apparent obsession. You could pay for a course like that, but…</p>
<p>…I’m calling bullshit on those courses. Your study habits will affect your score, not the course or some teacher. You can do that for very little money, or for free if you’re crafty with the interwebs. Your school library probably has GRE practice materials, or may even offer courses for free or at a reduced price.</p>
<p>You can also buy loads of lessons and practice problems pretty cheaply. At the time of this writing, Manhattan Prep section-based strategy guides are going for $5 a piece on <a href="https://www.ebay.com/sch/i.html?_from=R40&amp;_trksid=p2380057.m570.l1313&amp;_nkw=manhattan+prep+stragegy+guides&amp;_sacat=0" target="_blank">ebay</a>, as is the “<a href="https://www.ebay.com/sch/i.html?_from=R40&amp;_trksid=p2380057.m570.l1313&amp;_nkw=5+pound+book+of+GRE+practice+problems&amp;_sacat=0" target="_blank">5 pound</a> book of GRE practice questions”. Regardless of when you apply, be it the year before or the year of, I recommend dedicating a summer to the GRE. Not an entire summer; think of it as a small part-time job you have that you show up for during a scheduled time five days out of the week.</p>
<section id="a-recommended-study-strategy" class="level3">
<h3 class="anchored" data-anchor-id="a-recommended-study-strategy">A Recommended Study Strategy:</h3>
<p>Personally, I tried the free methods, and it took too much discipline and internal motivation to make it useful. It was worth it to me to pay an extra couple hundred dollars for materials that would help keep me on track. That’s where the Manhattan Prep practice tests and Magoosh come in. Here is what I recommend:</p>
<ol type="1">
<li><p>Schedule your test for mid-August, and do so by the end of the Spring semester.</p></li>
<li><p>At the end of your Spring semester, take two weeks off. Do not start studying for the GRE right away.</p></li>
<li><p>After your two weeks, take your first Manhattan Prep practice test. Take this test on the same day of the week, and at the same time, of your actual GRE test , in order to capitalize on <a href="https://en.wikipedia.org/wiki/State-dependent_memory" target="_blank">state</a>- and <a href="https://en.wikipedia.org/wiki/Context-dependent_memory" target="_blank">context</a>-dependent learning.</p>
<ol type="1">
<li><p>Inspect the results to identify your strong and weak areas. You should get percentile rankings for each section; use a spreadsheet that looks something like this (feel free to download the full template):</p>
<div class="cell">
<div class="cell-output-display">
<table class="huxtable" data-quarto-disable-processing="true" style="border-collapse: collapse; border: 0px; margin-bottom: 2em; margin-top: 2em; ; margin-left: auto; margin-right: auto;  " id="tab:unnamed-chunk-8">
<colgroup><col><col><col></colgroup><tbody><tr>
<th style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.4pt 0pt;    padding: 6pt 6pt 6pt 2pt; font-weight: bold;">Area</th><th style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.4pt 0pt;    padding: 6pt 6pt 6pt 6pt; font-weight: bold;">Subject</th><th style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.4pt 0pt;    padding: 6pt 2pt 6pt 6pt; font-weight: bold;">Percentile</th></tr>
<tr>
<td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0pt 0pt;    padding: 6pt 6pt 6pt 2pt; font-weight: normal;">Quantitative</td><td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0pt 0pt;    padding: 6pt 6pt 6pt 6pt; font-weight: normal;">Algebra</td><td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0pt 0pt;    padding: 6pt 2pt 6pt 6pt; font-weight: normal;"></td></tr>
<tr>
<td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0pt 0pt;    padding: 6pt 6pt 6pt 2pt; font-weight: normal;">Quantitative</td><td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0pt 0pt;    padding: 6pt 6pt 6pt 6pt; font-weight: normal;">Fractions, Decimals, and Percents</td><td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0pt 0pt;    padding: 6pt 2pt 6pt 6pt; font-weight: normal;"></td></tr>
<tr>
<td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0pt 0pt;    padding: 6pt 6pt 6pt 2pt; font-weight: normal;">Quantitative</td><td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0pt 0pt;    padding: 6pt 6pt 6pt 6pt; font-weight: normal;">Geometry</td><td style="vertical-align: top; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0pt 0pt;    padding: 6pt 2pt 6pt 6pt; font-weight: normal;"></td></tr>
</tbody></table>

</div>
</div></li>
</ol></li>
<li><p>Every week, you are going to follow this schedule:</p>
<ol type="1">
<li><p>Five days out of the week (pick the days yourself):</p>
<ol type="1">
<li><p>30 minutes of Magoosh quantitative flash cards</p></li>
<li><p>5 minute break</p></li>
<li><p>30 minutes of Magoosh verbal flash cards</p></li>
<li><p>10 minute break</p></li>
<li><p>30 minutes of quantitative practice problems</p></li>
<li><p>5 minute break</p></li>
<li><p>30 minutes of verbal practice problems</p></li>
<li><p>Total: 120 minutes study time, 20 minutes of breaks, 140 minutes total.</p></li>
</ol></li>
</ol></li>
<li><p>For the sixth day of the week, starting exactly twelve weeks before the date of your actual test:</p>
<ol type="1">
<li><p>Take one half of a Manhattan Prep test. I would alternate; verbal one week, quant the next.</p></li>
<li><p>Once you have finished the first four tests, you should have three full tests left and four weeks before the actual test.</p></li>
<li><p>Take each remaining test in full. Take your last test one week before the actual test. Do not look at your scores for the last test, for your own psychological well-being. You are just practicing.</p></li>
</ol></li>
<li><p>Seventh day: take this day off.</p></li>
</ol>
</section>
<section id="hot-to-get-the-most-out-of-your-study-sessions" class="level3">
<h3 class="anchored" data-anchor-id="hot-to-get-the-most-out-of-your-study-sessions">Hot to Get the Most Out of Your Study Sessions</h3>
<ul>
<li><p>Those flashcards and practice problems - adjust those based on your percentiles from your first practice test. If algebra was by far your lowest percentile, consider spending half of your quant time on algebra flashcards and algebra practice problems (Magoosh lets you filter by problem type). Do this until the predicted algebra score catches up to the others, then even back out.</p></li>
<li><p>For verbal, spend the least amount of your study time on long-form comprehension (reading long paragraphs of text and answering questions about it). ALL questions are worth the same amount of points, but the long-form comprehension questions take way longer to complete than the other questions. They are also the most difficult to study. Using the score tracker, the biggest boost to my verbal score came from practicing vocabulary and text completion.</p></li>
<li><p>Magoosh lets you do timed practice sessions. As you get closer to the test date, begin practicing under test conditions. About three weeks before the test, all of your practice sessions should be timed.</p></li>
<li><p>You’ll probably finish all of the flash cards. Repeat them. And repeat them again.</p></li>
<li><p>When you get a practice problem wrong, especially before you begin timed sessions, really take time to understand why you got the question wrong. Do it again, and get the right answer before you move on to the next one.</p></li>
<li><p>Don’t waste time watching the video lecture series. I spent one month watching all the quantitative videos, and very carefully at that, which amounted to an increase of just two points on my predicted score. After ditching those for the flash cards and practice problems exclusively, and only looking at videos when I got questions wrong, my score shot up. Flash cards have pretty much all the concepts in the videos, but are of course much faster to memorize.</p></li>
<li><p>Time management is by far the most important factor in doing well on GRE, do not neglect! Guess as little as possible. This means occasionally walking away from questions you know you could solve eventually (I know, it hurts). Leave yourself time to get to easier problems that you could solve quickly, then go back for those others that you on the verge of solving during your remaining time. The biggest harm to my score during the actual test was poor use of guessing. Learn from my mistake!</p></li>
<li><p>If you are struggling with confidence, like I was, then I recommend filtering out all but the easy-level practice problems. Do these until you run out, then move to medium, then hard, etc.</p></li>
<li><p>There are 700 quantitative and 700 verbal practice questions. If you stick to this guide, you should get through all or most of them. Seriously, pretend to be curious, and try to enjoy the process of improving. It can really be enjoyable if you are open minded about it, and that will motivate you to study.</p></li>
</ul>
<div class="cell">
<div class="cell-output-display">
<div>
<figure class="figure">
<p><img src="https://www.matthewvanaman.com/posts/2021-05-18-crash-course-to-getting-into-a-phd-program-in-psychology/crash_course_PhD_files/figure-html/unnamed-chunk-9-1.png" class="img-fluid figure-img" width="672"></p>
</figure>
</div>
</div>
</div>
</section>
</section>
</section>
<section id="the-long-list" class="level1">
<h1>The Long List</h1>
<p>First, put together a spreadsheet that looks like this (feel free to download this template):</p>
<div class="cell">
<div class="cell-output-display">
<table class="huxtable" data-quarto-disable-processing="true" style="border-collapse: collapse; border: 0px; margin-bottom: 2em; margin-top: 2em; width: 400%; margin-left: auto; margin-right: auto;  " id="tab:unnamed-chunk-10">
<colgroup><col><col><col><col><col><col><col><col><col><col><col><col><col><col><col><col><col><col><col><col><col><col></colgroup><tbody><tr>
<th style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.4pt 0pt;    padding: 1pt 1pt 1pt 0pt; font-weight: bold;">Potential Advisor</th><th style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.4pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: bold;">School</th><th style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.4pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: bold;">My Rank</th><th style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.4pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: bold;">Advisor Email</th><th style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.4pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: bold;">Accepting?</th><th style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.4pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: bold;">Deadline</th><th style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.4pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: bold;">PA Research Interests</th><th style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.4pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: bold;">Secondary Faculty</th><th style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.4pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: bold;">Program</th><th style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.4pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: bold;">Fee</th><th style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.4pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: bold;">Number of Letters Required?</th><th style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.4pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: bold;">ETS Code</th><th style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.4pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: bold;">GRE status</th><th style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.4pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: bold;">Status: LOR 1</th><th style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.4pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: bold;">Status: LOR 2</th><th style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.4pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: bold;">Status: LOR 3</th><th style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.4pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: bold;">Application portal link</th><th style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.4pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: bold;">Application Login</th><th style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.4pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: bold;">Application Password</th><th style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.4pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: bold;">Transcripts: Hard Copy or Digital?</th><th style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.4pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: bold;">Correspondence Status</th><th style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.4pt 0pt;    padding: 1pt 0pt 1pt 1pt; font-weight: bold;">Application Status</th></tr>
<tr>
<td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0pt 0pt;    padding: 1pt 1pt 1pt 0pt; font-weight: normal;">Dr. Cool Beans</td><td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: normal;">University of Want</td><td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: normal;">1</td><td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: normal;">cbeans@want.edu</td><td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: normal;">yes</td><td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: normal;">November 30th</td><td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: normal;">Studies things I like, topics I enjoy, research areas I want to research.</td><td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: normal;">Dr. Cool Cat</td><td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: normal;">Social Psychology</td><td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: normal;">110</td><td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: normal;">3</td><td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: normal;">5555</td><td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: normal;">Waiting to receive scores</td><td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: normal;">submitted</td><td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: normal;">program processed</td><td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: normal;">invite sent</td><td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: normal;">www.u-want.com/apply</td><td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: normal;">myEmail@gradtobe.com</td><td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: normal;">mysecurepassword</td><td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: normal;">hard copy</td><td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0pt 0pt;    padding: 1pt 1pt 1pt 1pt; font-weight: normal;">Confirmed accepting students</td><td style="vertical-align: top; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 0pt 0pt;    padding: 1pt 0pt 1pt 1pt; font-weight: normal;">In Progress</td></tr>
</tbody></table>

</div>
</div>
<p>Starting at the beginning of the summer before your application deadlines:</p>
<ul>
<li><p>Add about 25 or so PAs to your spreadsheet, but just their name, interests, and email. Find them by looking up the authors in journal articles you’ve enjoyed reading, people whom your professors have worked with, authors of books you’ve read, etc.</p></li>
<li><p>Starting the first week of August, go to each PAs lab or personal website and check to see if they are accepting applications for the next year. If it is August 2023, see if they are accepting applications for a Fall 2024 position, as the application season is a year ahead of the start date.</p></li>
<li><div id="initial">

</div>
<p>Next, send brief and professional emails to each PA, and confirm that they are taking students <em>and</em> that their positions are <strong>funded</strong> positions. Make it clear that you checked their website already. If they do not reply to your email after two weeks, send a gentle reminder. Your initial email can be something along the lines of:</p>
<blockquote class="blockquote">
<p>“Hello Dr.&nbsp;Beans,</p>
<p>My name is Billy Bob, and I am considering applying to PhD programs in [PA’s field] this Fall. I read your recent paper on [brief, concise, and for the love of God, <em>accurate</em>, sentence describing the paper’s finding]. I found that this work was not only interesting to me, but also that it overlaps closely with my interests in [brief, concise summary of your research interests]. I checked your website and saw that you are accepting applications. May I ask whether the position would be funded?</p>
<p>Thank you for your time,</p>
<p>B. Bob”</p>
</blockquote>
<ul>
<li><p>Do not - I repeat, DO NOT - work for free. If a PA says “sure, I’d love your application! But no funding at the moment”, then thank the person for getting back to you and remove that person from your list. You <em>cannot</em> work a part time job to fund your apartment during a PhD and expect to be in a position to get a job once you’re done. Do not be arrogant - you seriously cannot do it. Any extra time you get during your studies need to go to publishing. Do not accept an offer if it does not come with funding.</p></li>
<li><p>Hey, did I mention the importance of funding? Getting a PhD is already <a href="https://www.nature.com/articles/d41586-019-03489-1" target="_blank">hard enough</a> without worrying about funding. Funding is the number <a href="https://eric.ed.gov/?id=EJ1188721" target="_blank">one</a> reason students do not finish graduate school.</p></li>
</ul></li>
</ul>
</section>
<section id="the-short-list" class="level1">
<h1>The Short List</h1>
<p>At this point, it should be about late August, and you should have about 10 PAs left, each of which you know to be accepting applications for funded positions. If you still have more than 10 after the steps above, I recommend cutting out the remaining few until you have about 10. You want to apply to a lot of schools, because this is ultimately a numbers game; but you also don’t want to spread yourself too thin. Importantly, you want to ignore the school name and apply purely with the intention of working with the PAs on your list. You’d like to score a big name mentor <em>in your subfield</em>, not necessarily a big name school.</p>
<p>OK, now you have your shortlist. These are the people you’re going to apply to work with. The next step is to identify one secondary PA from the department of each primary PA. The reason is, usually, there is a “primary advisor” and a “secondary advisor”, and you will sometimes be required to specify a secondary advisor in your application. Fill out the rest of your spreadsheet, then move to the next section.</p>
</section>
<section id="the-statements-of-purpose" class="level1">
<h1>The Statements of Purpose</h1>
<section id="statement-factors-relevant-to-qualifications" class="level2">
<h2 class="anchored" data-anchor-id="statement-factors-relevant-to-qualifications">Statement Factors Relevant to Qualifications</h2>
<p>I have broken up the Statements of Purpose section into factors that are relevant to your qualifications and factors irrelevant to your qualifications, both of which are within your control.</p>
<p>You need one two-to-three-page statement of purpose <em>per PA</em>. This statement should have a cohesive narrative, or story, to tell about the development of your research interests and how they might be realized in the lab of the PA to whom it is addressed. In terms of the goals that your statement should accomplish, it should illustrate (through example, not through telling!):</p>
<ol type="1">
<li><p>Your work ethic.</p></li>
<li><p>Your curiosity.</p></li>
<li><p>Your ability to generate, and follow through on, your research ideas.</p></li>
<li><p>Your interests, and how they tie in with the PA’s.</p></li>
<li><p>Your ability to write good prose.</p></li>
</ol>
<p>Write a rough draft during summer, but leave out point 4 above. The moment you have your short list finalized, make as many copies of this draft as there are PAs on your short list. Adapt each copy to demonstrate how your research interests tie in specifically with each PA’s. Read their recent papers (within last 3 years) and cite them. In my statement, I dedicated the last few lines, or last paragraph in some cases, to tying in my interests to my PAs’. I would recommend making it about a 40/60 split, where 60% of the statement is just you, and 40% is a deliberate effort to sell yourself as a good fit for your PA.</p>
</section>
<section id="statement-factors-irrelevant-to-qualifications" class="level2">
<h2 class="anchored" data-anchor-id="statement-factors-irrelevant-to-qualifications">Statement Factors Irrelevant to Qualifications</h2>
<ul>
<li><strong>Prose.</strong> Some will recommend more formal approach; others will recommend more of a “catchy” or story-telling approach. Some people call this “the detective approach”. Ultimately, the approach is less important than the content, and it’s not even close. Success is frequently found both ways. If you do go with the catchy approach, which is admittedly more difficult to pull off (though will go further when pulled off well), only commit to it if you can back it up with a compelling narrative that <u>effectively</u> illustrates the content in the last section. Based on the positive feedback I received from multiple PAs, you might use my statement as an example of the catchy approach. Either way, adopt a classic style, and for the love of god, follow the advice of avoiding <a href="https://grad.ncsu.edu/wp-content/uploads/2016/06/Why-Academics-Stink-at-Writing-1-2.pdf" target="_blank">bad academic writing</a>.</li>
</ul>
<ol type="1">
<li><p>Perhaps include <em>some</em> personal background, but only if it helps to tell your story. Do not overshare. DO NOT OVERSHARE.</p>
<ol type="1">
<li>Now is NOT the time for “my time spent counseling on the suicide hotline was inspired was inspired by own experience struggling to find meaning in life”. You would not believe how common this is. Do not write like that. If you share anything personal, it should only be done with the explicit purpose of demonstrating points 1 through 5 above, and should be incorporated very carefully and with much professionalism.</li>
</ol></li>
<li><p>Perhaps some diversity/advocacy/altruistic type stuff/etc., but only if it helps to illustrate points 1 through 5 above. Even in today’s day and age where everyone wants to hear about diversity, this will still be true. Never be weepy, sentimental, attempt to inspire, or attempt to display moral virtue. You are auditioning to be a competent scientist, even if you would like to help people with your research or see patients eventually. Focus on illustrating points 1 through 5 above and nothing else, and remember that you have the opportunity to address those other aspects in the diversity statement.</p></li>
</ol>
<p>Importantly, you will want to write, and revise, and revise, and revise some more until your prose is tight, flowing, logical, and moving. Have your mentor go back and forth on some drafts with you. If they won’t, find another professor who will. Run your draft by the your school’s writing center, but keep in mind that they will not know what to look for in a statement of purpose. Use writing centers for grammar and syntax checks only.</p>
</section>
</section>
<section id="the-self-promotion" class="level1">
<h1>The Self-Promotion</h1>
<p>The self-promotional phase begins. This is where the pressure ramps up, and where you will have to overcome your shyness. Before we get started, let me reassure you with some lovely responses I received from my own advisor:</p>
<p>Me:</p>
<blockquote class="blockquote">
<p>Hi Dr.&nbsp;Chapman,</p>
<p><br></p>
<p>I see that you study neuro/cognitive psychology and social psychology with a focus on morality. I find that intersection of disciplines compelling, especially because I want to study morality and how it relates to cognition. With that said, you are definitely someone I would like to work with. Is most of your lab working on disgust as well?&nbsp;</p>
<p><br></p>
<p>Currently, I am working on a couple of projects dealing with morality under the supervision of some professors here at Stetson University. One is the development of a scale to see if there are measurable individual differences in the need to analyze moral issues (we’re treating it as subdomain of the Need for Cognition). The other is a series of experiments testing the way that knowledge of psychological processes affects thoughts and behaviors (known as the Enlightenment Effect), one for the Fundamental Attribution Error, the other for moral licensing as a result of high moral self-image.&nbsp;</p>
<p><br></p>
<p>Lastly, are you in need of research assistants this summer?</p>
<p><br></p>
<p>At any rate, thank you for taking the time to talk and I hope this finds you well!</p>
<p><br></p>
<p>Matthew</p>
</blockquote>
<p>My eventual advisor (<a href="http://www.emotionmoralitylab.com/principalinvestigator" target="_blank">this was us</a>, weren’t we cool?!):</p>
<blockquote class="blockquote">
<p>Hi Matthew, nice to hear from you!&nbsp;</p>
<p><br></p>
<p>It sounds like we might have a good fit in terms of research interests – sounds like you’re involved with some interesting projects. I am indeed recruiting doctoral students for the 2016/2017 application cycle. My lab is a mix of research on morality and research on other aspects of emotion, such as how we can best regulate our feelings, how emotion affects cognition etc. In terms of morality my focus has been on disgust but that’s not exclusive, I’m open to other areas in moral psych as well.&nbsp;</p>
<p><br></p>
<p>Happy to answer any further questions you might have about me, the research in the lab, our doctoral program etc. I’m associated with the Basic and Applied Social Psychology program at CUNY: you can check us out at <a href="http://cunybasp.org/" target="_blank">cunybasp.org</a>. Unfortunately I don’t have any research assistant openings this summer though.&nbsp;</p>
<p><br></p>
<p>Cheers,</p>
<p><br></p>
<p>Hanah</p>
</blockquote>
<p>My email probably could have been a little tighter. But not a bad response, right?</p>
<p>OK, so what is the self-promotion phase, exactly? Basically, you want to accomplish these goals:</p>
<ul>
<li><p><strong>Achieve name recognition with PAs.</strong> If, for example, your application made it to that PA’s own long list, that PA <em>might</em> see your application and think to themselves “well, this is the only person that had the motivation to email me, so I’ll move this one to my short list”.</p></li>
<li><p><strong>Determine what the PAs are looking for.</strong> The PA may want a student who will bring new ideas to the lab. Or, they will want someone who will fit right in with what is already being worked on. This <em>might</em> affect how you revise your statement of purpose.</p>
<ul>
<li>For example, one PA gave me feedback on my statement, and requested that I include a bit more conversation about why I would be a good fit for her lab specifically. This was because she wanted her new student to fit in with what she was already working on. Alternatively, you might find out that a PA is looking for a new student to bring some new ideas. In those cases, focus your statements relatively more on your ability to generate novel research ideas, and less about how you want to research exactly what the PA does.</li>
</ul></li>
<li><p><strong>Give the PA a chance to see your qualifications.</strong> PAs often do not view all applications themselves, especially when they are at bigger schools. In these cases, applications are screened by someone else according to program-imposed criteria, and the PA chooses from what’s left. If the PA saw your qualifications ahead of time, they <em>might</em> request that your application be pushed set aside.</p></li>
<li><p><strong>Possibly land a research assistantship.</strong> If you can land a research assistantship the summer prior to applications, <em>maybe</em> that PA will decide the hell with it - why recruit a new student when I have a perfectly good one right here?</p></li>
</ul>
<p>Why do I keep putting “might” in italics? Because none of these are in your control. Why am I recommending you to worry about them, given the philosophy of this guide? The answer is because I am a statistician at heart, and it is my belief that we cannot <em>really</em> control anything. Rather than saying “some things are within/outside of your control”, it is more accurate to say “the <em>probability</em> <em>for some things happening</em> can be influenced by us, the probability for some other things happening cannot”. You can’t control any of those bullets, but you can definitely maximize the probability of any one of them happening.</p>
<p>Let me say this: if you can manage to get a phone call chat - or, if you are in town, a lunch - with a PA, that will help your chances <em>immensely</em>. “But professors are so busy!”, you proclaim, suspecting that you have no right to pester them with such requests. Oh yes they are! Way busier than you, my poor, young undergraduate, could possibly even imagine. But if PAs are accepting students, that means they <em>need</em> students, and a five-to-six year investment is a lot for them to take on. They want to minimize risk. Also, if you do make meaningful contact with PA, and they review your application, and they invite you to a preliminary phone interview, the PA will end up with more familiarity with you than with any other applicant. <a href="https://en.wikipedia.org/wiki/Mere-exposure_effect" target="_blank">Familiarity</a> is good!</p>
<p><strong>So how should you actually accomplish self-promotion?</strong> I’ll leave out the particulars, and instead say to see the email exchange above. That’s a good example of how to follow up from your initial emails. I followed it the email above up with a (polite) request for a video chat or phone call, and provided two or three suggested times. I mentioned that I had attached my CV and statement of purpose (addressed to that person of course!) in case they would like to learn more about my work. Hanah said she was impressed by my CV, and we had a lovely video chat, and I ended up getting accepted into that program where I study (at the time of this writing).</p>
<p>Another thing could do is network at professional conferences. That is actually where I meant my adviser. That is also where I approached potential PAs after their talks to tell them how much I enjoyed what they had to say. I also asked them if they expected to have research assistantship positions opening up for that summer (this would have been the summer before applications). As a result, I was actually given an opportunity to work at the lab of a leading theorist, but turned it down because I had my own <a href="https://www.matthewvanaman.com/PDFs/nfmc.pdf" target="_blank">plans</a>.</p>
<p>Something you might want to hear at this point: I had apologized to this theorist for being so bold as to ask for work right after he presented his work. He said, “no worries, you have to be. Let me put you in touch with my lab manager.” See? Good things can happen when you put yourself out there. Have some faith in humanity.</p>
<p>Here are some of my other experiences:</p>
<ul>
<li><p>Another PA responded to my email inquiry and said that she liked my statement of purpose. She even suggested a few edits. I made the edits in a timely fashion and sent them back, to her approval. I received a Skype interview, and an in-person interview with that PA.</p></li>
<li><p>Another PA agreed to a phone call, and we had one. I kinda screwed that phone call up, so that’s on me.</p></li>
<li><p>Three other PAs asked me more about my work through email, and we had nice conversations. One of these PAs was a high-profile Ivy League leader in the field.</p></li>
<li><p>Two or three others provided polite responses, usually along the lines of “that sounds like interesting work, I would look forward to your application!”</p></li>
<li><p>Only one person was rude, saying something along the lines of “I am too busy and cannot be expected to have a phone interview with you before you even submit your application” or something like that. Ironically, this person was only an OK name in the field…</p></li>
<li><p>Only one or two did not respond.</p></li>
</ul>
<p>Importantly, two out of the three people who took the time to read my materials and/or schedule a time to chat eventually invited me to in-person interviews. Would they have invited me if they hadn’t remembered me from our conversations? Would my GRE and GPA made it past their program cutoffs if they hadn’t requested my application be set aside? I will never know. But I take comfort knowing that I did everything within my control to make sure that when they were looking through the application, that they would not be seeing “Matthew E. Vanaman” for the first time, and that is all you can do.</p>
</section>
<section id="the-diversity-statements" class="level1">
<h1>The Diversity Statements</h1>
<p>Diversity matters in higher education. It <a href="https://www.usnews.com/education/best-colleges/articles/diversity-in-college-and-why-it-matters" target="_blank">does</a>.</p>
<p>But the diversity <em>statement</em> probably does not weigh heavily in your application in the grand scheme of things. Often times it is not even required, though more schools are requiring it nowadays. And in the post-George Floyd era, you never know. But as far as I know, the diversity statement is highly unlikely to make or break the application.</p>
<p>With that said, I would not botch the diversity statement either. If it is optional, submit one anyway. Make sure you have a well-written and compelling narrative that clearly addresses what the application asks for. The narrative can be about yourself, the issue on a broad scale, or a bit of both. Most importantly, tune your approach to the application instructions: if it asks for personal experience, give personal experience. If it asks for your knowledge of the issue, show your knowledge of the issue. As long as you meet the requirements and have decent prose, it’ll pass.</p>
</section>
<section id="the-miscellany" class="level1">
<h1>The Miscellany</h1>
<section id="writing" class="level2">
<h2 class="anchored" data-anchor-id="writing">Writing</h2>
<div id="classic">

</div>
<p>In all of your writing, I personal prefer and recommend using a <a href="https://englishcomposition.org/advanced-writing/classic-prose-style/" target="_blank">classic style</a>. The basic idea with classic style is that you treat the reader as an equal, and present truth to them like an equal, as if engaged in a conversation with a colleague. You write <em>as if</em> you have something you want to show your reader; you are sure it is true and independently verifiable; your reader is just as competent as you are; your writing must get out of the way so that your reader can see the truth. With this mentality, you are trying to get out of the way so that your reader can appreciate your ideas directly rather than going through you to get them.</p>
<p>The best metaphor I’ve heard is this: imagine you and your friend are hiking. You are 20 meters ahead, have reached the top of the hill, and can see down into the valley. Your friend asks, “what do you see down there?” You respond, “There is a small cluster of houses at the base on the mountain at the far side. There is a highway that runs through the middle, which exits from the valley about three miles Northwest. People are riding their bikes and strolling around together, and some are picnicking”.</p>
<p>The response you gave your friend here is classic style. Your friend would see the same thing if she were to catch up and stand next to your side. Had she arrived first, she would have given an identical description to you (pragmatically speaking). You and your friend are equals; you just have a vantage point that she cannot appreciate because she is not standing where you are. Furthermore, the truth is not exclusive to you and your friend; <em>anyone</em> who walks up will see what you see in the valley. Pretty much any nature documentary is written or spoken in classic style.</p>
<p>Tell me, which of these passages do you find more compelling and informative to read?</p>
<blockquote class="blockquote">
<p>In the contemporary discourse surrounding epistemological frameworks, it becomes increasingly pertinent to delineate the multifaceted interactions between ontological presuppositions and methodological approaches. The dialectic of constructivist theories vis-à-vis positivist paradigms necessitates a nuanced examination of the interstitial dynamics that underpin theoretical synthesis. Consequently, scholars must engage in rigorous hermeneutic analysis to unravel the complex interplay of these divergent yet interrelated conceptual paradigms.</p>
</blockquote>
<blockquote class="blockquote">
<p>To understand where knowledge comes from, we need to look at the basic ideas behind different theories of knowledge. Some theories, like constructivism, suggest that knowledge is shaped by our experiences. Others, like positivism, argue that knowledge comes from observable facts. By comparing these ideas against each other, we can better understand how they influence each other and how they help us make sense of the world.</p>
</blockquote>
<p>Can you guess which passage is written in classic style? Can you guess which statement of purpose would be more likely to be memorable, enjoyable, and thus more likely to be set aside for consideration? Did it seem like any meaningful information was lost in the second example? (I apologize for typos, and I also want to make clear that I completely made up these examples on the fly. So don’t quote me!).</p>
<p>I’m not expert enough to advise on writing beyond advocating for this general attitude toward writing (so definitely check out this <a href="https://grad.ncsu.edu/wp-content/uploads/2016/06/Why-Academics-Stink-at-Writing-1-2.pdf" target="_blank">great advice</a>). Just start each attempt at writing by saying it out loud at first. Imagine that the thing you are describing is over the hill, and you are orating to the audience what lies on the other side. Have a conversation with your reader, not a lecture or litmus test.</p>
</section>
<section id="completing-your-application" class="level2">
<h2 class="anchored" data-anchor-id="completing-your-application">Completing Your Application</h2>
<p>The amount of time it takes to complete an application is longer than you think. One application takes, on average, at least an entire 9-5 day to complete. Filling out these applications, along with writing and revising your statements of purpose, CV, and diversity statements, will basically be a part-time job during your Fall semester, and you should absolutely treat it that way. Every day, schedule a block of time to work on your applications and their materials. Seriously. Start earl, and plan to submit your application two weeks before the deadline to give yourself plenty of time.</p>
<p>Also note that submitting your application is not the end of matters. It takes a few days to process, so <strong>do not submit the night of the deadline</strong>. Also, after you submit each application, be sure to email each PA you applied to and let them know that you submitted your application, that you thank them for your time and assistance during the application process (regardless of how much they <em>actually</em> helped), and let them know that you look forward to the chance to hear more about their work during an interview.</p>
</section>
<section id="interview-conduct" class="level2">
<h2 class="anchored" data-anchor-id="interview-conduct">Interview Conduct</h2>
<p>Note that I am shy, so this perspective is written with a bias toward people who will tend to not speak up for themselves.</p>
<p>First, have a 20-30 second “elevator pitch” that cleanly and simply summarizes your research in a way your grandmother could understand. When someone asks, “what are you interested in?”, this is what you will tell them. And believe you me, you will be asked this like a million times so <em>write it</em> and <em>practice it</em> ahead of time. And believe me, if someone wants to hear more about it, they will ask you for details. If they don’t, then you just spared them from hearing a bunch of crap they don’t want to hear but hey, now they know what you’re into.</p>
<p>The interview is not rocket science. You’ll want to overthink it - don’t! Be curious, and speak up when you have a thought you think is interesting and that you’d like to see what people think about it. When people ask you a question about yourself, just tell them! Academics are nerds, and many are awkward, so do not necessarily expect that they will always be good at interviewing you. This no doubt hurts some people’s pride but academia definitely has its own niche culture and anyone who says otherwise is probably up to something.</p>
<p>Importantly, you will want to use the interview as an opportunity to make sure that you and the PA are a good fit, temperamentally speaking. If you be yourself, you will get a more accurate picture of what your interactions with the PA will generally be like - and same for them. It’s useful for <em>both</em> of you to just be honest and yourselves - but professional too!</p>
<p>With that said, let me be clear about what I mean by “be yourself”. What I don’t mean is “be unprofessional”. You <em>definitely</em> want to have a professional persona of sorts, which is somewhat an extension of your elevator pitch. This does not mean “be fake”. I personally believe that people have multiple genuine sides to them, and your professional persona - which you will partly discover over time - will probably become a favorite aspect of yourself if you do this whole academia thing right. But <em>practice</em> developing a poise and response to the professional atmosphere - even though career centers usually emphasize the private sector, sign up for some practice interviews. You’ll learn about yourself.</p>
<p>In general, let me give you an important piece of advice that, for some reason, is controversial (?): <strong>be likable.</strong> Remember, this PA will have to spend five to six years with you, and believe it or not, PhD students can be insufferable to work with - that road goes <em>both</em> ways. Even if it has nothing to do with your qualifications, fair or unfair, PAs will judge you based on abstract intuitions about intellectual fit, personality, lab culture, and general simpatico-ness. So no posturing, no trying to outsmart the next person, no preaching at people, or whatever. You know the drill, but it’s worth reminding about.</p>
<p>Lastly, your competition will be fierce, and will be hanging out with you while you all try to pretend like the situation is not what it is. This will make you nervous. Do not let that tempt you into feeling like you need to be posturing all the time to prove how smart you are. Seriously, nobody likes it, and you will not want to work for 5-6 years alongside those who do. Your PA is <em>already</em> impressed with you - that’s why you are there. The interview is <em>only</em> about assessing fit - not skill, qualifications, but <em>fit</em>.</p>
<p>In general, follow this advice:</p>
<ul>
<li><p>Be confident in sharing your ideas.</p></li>
<li><p>When you do share your ideas, it should come from a place of:</p>
<ul>
<li><p>genuine passion for the subject</p></li>
<li><p>eagerness to share with others</p></li>
<li><p>an enthusiasm for hearing what other people have to say about your ideas, even if they might disagree.</p></li>
</ul></li>
<li><p>Ask questions when you are curious.</p></li>
<li><p>Listen to other people, and try to show genuine curiosity about what they are saying.</p></li>
<li><p>Be familiar with a few recent papers of each interviewee, least of not which you primary and secondary PAs.</p>
<ul>
<li><p>Ask questions about their work - where you going next? What do you make of this other paper?</p></li>
<li><p>But don’t try too hard to feign interest. It’s OK if you’re not interested - just provide your platitudes and get on with your life.</p></li>
</ul></li>
<li><p>Usually, there will be a round an interviewing, often taking the form of a speed-dating like thing. At the end of these interviews, have an interesting question planned before you enter.</p>
<ul>
<li><p>It should not be “will I have to teach” “Will I get health insurance” “how much will I get paid” etc. Don’t do that during the interview, do that during the off times or during your time talking to e.g., the students.</p></li>
<li><p>One good question to end with is: “is there a question that you think I should have asked, but did not ask?” Every person I’ve asked this has given a thoughtful response, and I usually learned a lot from. It’s a hit!</p></li>
</ul></li>
</ul>
</section>
<section id="vetting-your-pas" class="level2">
<h2 class="anchored" data-anchor-id="vetting-your-pas">Vetting Your PAs</h2>
<p>The first thing I’ll say is that if your potential PA seems to tolerate, encourage, or god-forbid <em>enjoy</em> it when students do that posturing crap, let that be a red flag. This is a very real thing and a sign of a toxic environment. You want a supportive environment that encourages curiosity, professionalism, rigor, and an appreciation toward the competitiveness of the field (i.e., job market), but not one that supports competition <em>among students</em> or <em>between students and advisors</em>. That is a real thing indeed, more common than you think, and something you will want to keep an eye out for. Some other advice:</p>
<ul>
<li><p>Check the PA’s CV: does it consist of all first-authored papers? If so, consider removing those PAs from your short list. You want your PA to be a good mentor that helps you develop ideas, not someone who is going to use you as free labor on their own work while taking all of the credit. Job applications will want evidence of first-authored papers, so make sure you will be allowed to get them.</p></li>
<li><p>Ask good questions:</p>
<ul>
<li><p><strong>What direction is their research heading in?</strong> Do they want to expand the scope of their lab? Or are they doubling down on their current research agenda? Do they want students who will bring fresh ideas or contribute something new? Or do they want someone to fall in line and facilitate what everyone is already working on? What is there funding situation - did they just get a 5-year, multi-million dollar grant to study X? If you are not interested in X, that could be a problem for you!</p></li>
<li><p><strong>What is their mentoring philosophy?</strong> Or more precisely, what do they expect in their graduate students? Consider whether those expectations align with your personality, expectations, and goals.</p></li>
<li><p><strong>Where are the previous students now?</strong> This will tell you two things: one, if students are getting good jobs, and two, if the students are actually finishing their PhD. You cannot ask the second one directly, because that will be like asking “are you a good mentor?” They are not going to volunteer the fact that none of their students ever tolerate them long enough to finish, but you can find out in other ways.</p></li>
<li><p><strong>What is the lab culture like?</strong> Do people tend to collaborate? Do they have shared offices? Do they socialize outside of work together? These would be good signs. Be on the lookout for cutthroat type atmospheres, a high tolerance and responsiveness to pretentious posturing, or argumentative or defensive attitude.</p></li>
</ul></li>
</ul>
<p>Asking these same questions to the PA’s students. They will be more honest with you, but probably not completely honest seeings how they are often recruited to help judge you. They even rate you on forms! Rest assured, the students hate doing it. But you can get more accurate indicators from them about the PA’s work habits, personality, mentoring style and expectations, and ethics (yes, be on the lookout for ethical concerns! They are more common than you think).</p>
</section>
</section>
<section id="the-materials" class="level1">
<h1>The Materials</h1>
<div id="materials">
<ul>
<li><p>View the I turned in with my applications: <a href="https://www.matthewvanaman.com/PDFs/Vanaman_CV_example.pdf" target="_blank">My CV</a></p></li>
<li><p>View the statement of purpose I submitted to my eventual advisor: <a href="https://www.matthewvanaman.com/PDFs/vanaman_statement_example.pdf" target="_blank">My statement</a></p></li>
<li><p>Download the example timeline: <a href="../../data/timeline.csv" download="data/timeline.csv">example timeline</a></p></li>
<li><p>Download the example GRE strength and weakness template: <a href="../../data/GRE_template.csv" download="/data/GRE_template.csv">GRE template</a></p></li>
<li><p>Download the example short list spreadsheet: <a href="../../data/grad_school_list.csv" download="data/grad_school_list.csv">short list template</a></p></li>
<li><p>View a advice for writing diversity statements: <a href="https://www.koodooslearning.com/blog-list/5-ways-to-write-an-effective-diversity-statement" target="_blank">diversity advice</a></p></li>
<li><div id="kisses">
<p>A MUST READ: the graduate school application <a href="https://www.matthewvanaman.com/PDFs/kisses.pdf" target="_blank">kisses of death</a></p>
</div></li>
</ul>
<section id="the-good-luck" class="level1">
<h1>The Good Luck</h1>
<p>Few who apply to PhD programs get in. But most did not do everything they could have. They are naive and think that they will be judged only on the pure information of their stellar qualifications contained in their CV. Or they think that they will be written off or something, and so do not advocate for themselves. Or maybe it just does not occur to them to attend to some of the non-obvious aspects of the application process, like engaging in explicit self-promotion. But hopefully, you have an idea about how to start managing that stuff.</p>
<p>It is most likely that you will get rejected, so temper your expectations. Prepare for the best, expect the worst, as they say. With that said, remember one very important thing: if you want to get a PhD and are taking the steps to apply, you almost certainly ARE qualified to be in a PhD program. Be confident, believe in yourself. Put yourself in a position to be able to say, “if I don’t get in, it was because of random chance, not my lack of accomplishments”. That’s all you can do. Good luck!</p>


</section>
</div>
</section>

<div id="quarto-appendix" class="default"><section class="quarto-appendix-contents" id="quarto-citation"><h2 class="anchored quarto-appendix-heading">Citation</h2><div><div class="quarto-appendix-secondary-label">BibTeX citation:</div><pre class="sourceCode code-with-copy quarto-appendix-bibtex"><code class="sourceCode bibtex">@online{e._vanaman2021,
  author = {E. Vanaman, Matthew},
  title = {Applying to {PhD} {Programs} in {Psychology:} {A} {Thorough}
    and {Honest} {Guide}},
  date = {2021-05-18},
  url = {https://matthewvanaman.com/posts/2021-05-18-crash-course-to-getting-into-a-phd-program-in-psychology/},
  langid = {en}
}
</code></pre><div class="quarto-appendix-secondary-label">For attribution, please cite this work as:</div><div id="ref-e._vanaman2021" class="csl-entry quarto-appendix-citeas">
E. Vanaman, M. (2021, May 18). <em><a href="https://matthewvanaman.com/posts/2021-05-18-crash-course-to-getting-into-a-phd-program-in-psychology/">Applying
to PhD Programs in Psychology: A Thorough and Honest Guide</a></em>.
</div></div></section></div> ]]></description>
  <category>professional-development</category>
  <guid>https://www.matthewvanaman.com/posts/2021-05-18-crash-course-to-getting-into-a-phd-program-in-psychology/crash_course_PhD.html</guid>
  <pubDate>Tue, 18 May 2021 05:00:00 GMT</pubDate>
  <media:content url="https://www.matthewvanaman.com/_site/imgs/jack_4.png" medium="image" type="image/png" height="192" width="144"/>
</item>
<item>
  <title>Collaborative Writing With R and Google Docs: Easier Than You Think</title>
  <dc:creator>Matthew E. Vanaman</dc:creator>
  <link>https://www.matthewvanaman.com/posts/2021-03-17-extremely-simple-guide-to-collaborative-writing-between-r-markdown-and-google-docs-users/collab_writing.html</link>
  <description><![CDATA[ 





<!--more-->
<p>Feel free to skip my preamble and get right to it.</p>
<p>Get this guide as <a href="https://matthewevanaman.netlify.app/PDFs/Collab_With_Google.pdf" target="_blank">a PDF</a>.</p>
<p>We scientists write a lot. We format a lot too, because our journals have scrupulous formatting requirements. If indeed you are a scientist who writes, you have probably been as frustrated as I have with how tedious that stuff can be, especially formatting tables.</p>
<p>At the time of this particular writing, it’s been two years since I felt the euphoria of discovering that you can write manuscripts in R using R Markdown. With the <code>papaja</code> (Preparing APA Journal Articles) <a href="http://frederikaust.com/papaja_man/introduction.html" target="_blank">package</a>, for example, all formatting is automated, including in-text statistics, tables, and references. You simply plug in your info (author names, title, abstract, etc.) and baddo-boom badda-bing you got yourself an APA manuscript ready for submission.</p>
<p>To sweeten the pot even more, R Markdown just received <a href="https://rstudio.github.io/visual-markdown-editing/#/" target="_blank">a new upgrade</a> adding point-and-click functionality to most of the core features writers need, including inserting comments, formatting text, creating headings, and inserting cross-references, effectively removing the need to know any coding to get access to R Markdown’s flexibility, transparency, and reproducibility. It even has an as-you-write pop-up window that pulls references from <a href="https://www.zotero.org" target="_blank">Zotero</a> - even the Wordiest Word Users That Ever Worded have to admit how bad ass of a feature that is.</p>
<p>Given that R provides a process for streamlining your analysis and writing from front to back, and can even be used to create <a href="https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0232424" target="_blank">online surveys</a>, why do scientists use anything <em>but</em> R? The answer can be summarized in two words: Old Guard. Or, less prejudicially: Learning Curve. In other words, it’s easy for someone like me, a graduate student, to pick up new habits, because being the squalidly grad student I am, I could be said to have established few of my own. The same cannot be said for those who have a routine that has worked just fine for them for years.</p>
<p>Many younger scientists, including myself, have oriented their habits around the efficiency, transparency, and reproducibility of consolidating analysis and writing into an R Markdown workflow. Some have tried it and turned back; some have been considering it, and some have just heard about it on Twitter and made a note to look into it more closely when they have time. Everyone in the <a href="https://lindeloev.net/spss-is-dying/" target="_blank">small-but-rapidly-growing</a> niche I have just described either has or will become frustrated by the fact that you lose many of the time-saving features of writing in R when collaborators will not accommodate your (would-be) workflow. Many don’t believe that making the switch could save them time in the long run, and frankly why should they? All they have are your anecdotes. To be clear: they are wrong. But to be clearer, I don’t hold anything against them, and neither should you, because it <em>is</em> a big leap of faith on their part to <del>trade in Microsoft Word</del> take our word for it.</p>
<p>But this doesn’t really help you, R aficionado. You need to find a solution, or else you’ll have to give up on writing in R Markdown. Luckily, you don’t have to, because people far smarter and skilled than I have solved this problem for us. Here is an easier-than-you-thought guide to salvaging your workflow of writing in R Markdown while collaborating with an ever-more popular writing tool: Google Docs.</p>
<p>Note: I focus on Google Docs here because, although there are several ways to collaborate with Word users, I have never found one as simple as this workflow for collaborating with Google Docs users. And Google Docs is on the rise.</p>
<section id="assumptions-of-this-guide" class="level1">
<h1>Assumptions of This Guide</h1>
<p>I assume the following of users of this guide:</p>
<ul>
<li><p>You are the lead author, or are otherwise in charge of formatting and analysis, which is to say you are overseeing the rendering of the final manuscript in R Markdown.</p></li>
<li><p>You are slightly competent in R (seriously, you only need to be slightly competent to adopt an “All R, All the Time” analysis and writing workflow, contrary to what you may have heard).</p></li>
<li><p>Your collaborators prefer writing in a Google Doc, or are willing to (Google Docs has track changes, comments, and document version history, if you need to sell it. It sucks at formatting, but in this scenario, you are in charge of that with R Markdown).</p></li>
</ul>
</section>
<section id="workflow" class="level1">
<h1>Workflow</h1>
<p>The workflow is super simple. At each stage of revision, you, Stewardperson of R, will have written the initial draft within R Markdown. Once the draft is ready for revisions from collaborators, you will use R to upload the contents of your R Markdown document to a Google Doc on your Google Drive. From there, you and your collaborators use Google Docs to revise. Once everyone is satisfied with the content, you will download the Google Doc content back to your R Markdown file, which will rewrite the contents of the file to include any changes that were made.</p>
<p>The pros of this workflow:</p>
<ul>
<li><p>Best of both worlds; I won’t rehash the benefits of writing in R Markdown or Google Docs, the point is you get access to both.</p></li>
<li><p>Collaborators are happy, having avoided the inevitable for a bit longer, though the creep toward having to learn R to escape the limitations of Google Docs and Word will march forward.</p></li>
<li><p>The workflow is efficient - there is little added cost to you, R Stewardperson, of adopting this workflow. Collaborators will barely notice.</p></li>
<li><p>The workflow works nicely with version control, if you use it (you absolutely should use version control, you won’t go back after learning it).</p></li>
</ul>
<p>The cons:</p>
<ul>
<li><p><em>All</em> content in the R Markdown file ends up in the Google Doc. So your collaborators will have to be OK with scrolling past some code to get to the relevant sections.</p>
<ul>
<li>Though you could mitigate this by dropping in your analysis code into R Markdown after revisions are over.</li>
</ul></li>
<li><p>Collaborators with no experience in R or R Markdown will not be able to preview the formatted document, which if you are doing things the efficient way, will include the bibliography, in-text statistics, tables, and document formatting such as double spacing, APA headers, etc.</p></li>
</ul>
</section>
<section id="getting-set-up" class="level1">
<h1>Getting Set Up</h1>
<p>Once your draft is ready to share with others, you can use the following steps to get R setup to communicate with Google Drive, where your Google Doc will live.</p>
<ol type="1">
<li><p>First, install the relevant packages. You’ll need two packages to do this:</p>
<ol type="1">
<li><p><code>googledrive</code>. This package is on CRAN, so you can install it the usual way using <code>install.packages("googledrive")</code>.</p>
<ol type="1">
<li>There is a nice <a href="https://googledrive.tidyverse.org" target="_blank">walkthrough</a> of the <code>googledrive</code> package if you are interested in learning more, though you will not need to for this guide.</li>
</ol></li>
<li><p><code>trackdown</code>. This package provides wrapper functions to the more-complicated <code>googledrive</code>. <code>trackdown</code> is not on CRAN, so you’ll need to install with <code>devtools::install_github("ekothe/trackdown")</code>.</p>
<ol type="1">
<li>There is a very brief <a href="https://github.com/ekothe/trackdown" target="_blank">walkthrough</a> of the <code>trackdown</code> package if you want to know, though you will not need it for this guide.</li>
</ol></li>
</ol></li>
<li><p>Authenticate Google Drive so R can access it. There is a long and extremely tedious process for doing this manually that you can avoid by using the following steps:</p>
<ol type="1">
<li><p>Restart R with a fresh environment.</p></li>
<li><p>Run the <code>googledrive::drive_auth()</code> command (do not add arguments). In the R console, you should see a prompt asking you to select 1 or 2. Option 1 didn’t work for me, so I entered option 2.</p></li>
<li><p>Your web browser should open with a Google sign-in page. Sign in to Google, and follow the steps to allow access.</p></li>
<li><p>In the console, you will see <code>TRUE</code> if the authentication was successful.</p></li>
</ol></li>
</ol>
<p>Note that if you are following this to the T, you will need to do Step 2 every time you want to send something to Google Drive.</p>
</section>
<section id="send-a-draft-to-google-drive" class="level1">
<h1>Send A Draft To Google Drive</h1>
<p>To send your document to Google Drive, use the following code:</p>
<div class="cell">
<details class="code-fold">
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb1" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb1-1"><span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># to send to google drive</span></span>
<span id="cb1-2">trackdown<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">::</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">upload_rmd</span>(</span>
<span id="cb1-3">    <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># leave out file extension (i.e., no ".Rmd" at the end)</span></span>
<span id="cb1-4">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">file =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"name-of-your-R-Markdown-file"</span>, </span>
<span id="cb1-5">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">gfile =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"name-your-file-will-have-on-Google-Drive"</span></span>
<span id="cb1-6">    )</span></code></pre></div>
</details>
</div>
<p>This can take a minute. Once it’s done, check out your Google Drive and your new Google Doc should be in the root (upper-most) folder of your drive. From this point on, you and your colleagues will conduct revisions in the Google Doc.</p>
</section>
<section id="download-revisions-to-your-r-markdown-file" class="level1">
<h1>Download Revisions To Your R Markdown File</h1>
<p>Once you and your collaborators are done revising, use the following code to send the revisions back to your local R Markdown file:</p>
<div class="cell">
<details class="code-fold">
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb2" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb2-1"><span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># to retrieve revisions from google drive</span></span>
<span id="cb2-2">trackdown<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">::</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">download_rmd</span>(</span>
<span id="cb2-3">    <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># leave out file extension (i.e., no ".Rmd" at the end)</span></span>
<span id="cb2-4">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">file =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"name-of-your-R-Markdown-file"</span>, </span>
<span id="cb2-5">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">gfile =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"name-your-file-will-have-on-Google-Drive"</span></span>
<span id="cb2-6">    ) </span></code></pre></div>
</details>
</div>
<p>This will overwrite your local file, but only the parts that have changed. This is handy for those who use version control: only the altered portions will be recognized as changes. As long as you committed your draft before you uploaded it to Google Drive, you will be able to see the post-Google changes in version control next to the old content.</p>
<p>If for some reason you want to avoid overwriting the R Markdown file, you can let a new file be created instead. The easiest way is to give a new name in the <code>file =</code> argument. This will create a new file with the new name you gave, preserving the old file but containing the contents of the Google Doc.</p>
</section>
<section id="whats-next" class="level1">
<h1>What’s Next?</h1>
<p>Nothing. That’s it. Seriously.</p>
<p>Enjoy!</p>
</section>
<section id="Appendix" class="level1">
<h1>Appendix</h1>
<section id="updating-google-drive-file" class="level2">
<h2 class="anchored" data-anchor-id="updating-google-drive-file">Updating Google Drive File</h2>
<p>Say you messed up the first draft, or have written some revisions yourself before your collaborators got a chance to start revising on Google Drive. Or whatever. The point is, you want to throw some more recent changes up to an extant Google Doc, which will add the changes while preserving anything that did not change. Easy, just use the code below. Beware: Google Doc’s track changes will not pick this up.</p>
<div class="cell">
<details class="code-fold">
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb3" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb3-1"><span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># to update an existing google drive file</span></span>
<span id="cb3-2">trackdown<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">::</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">update_rmd</span>(</span>
<span id="cb3-3">    <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># leave out file extension (i.e., no ".Rmd" at the end)</span></span>
<span id="cb3-4">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">file =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"name-of-your-R-Markdown-file"</span>, </span>
<span id="cb3-5">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">gfile =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"name-your-file-will-have-on-Google-Drive"</span></span>
<span id="cb3-6">    ) </span></code></pre></div>
</details>
</div>
</section>
<section id="sending-the-file-to-a-particular-location-in-google-drive" class="level2">
<h2 class="anchored" data-anchor-id="sending-the-file-to-a-particular-location-in-google-drive">Sending the File To A Particular Location in Google Drive</h2>
<p>Simple: all you need to do is add the <code>path =</code> argument in <code>upload_rmd()</code>:</p>
<div class="cell">
<details class="code-fold">
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb4" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb4-1"><span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># to send to google drive</span></span>
<span id="cb4-2">trackdown<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">::</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">upload_rmd</span>(</span>
<span id="cb4-3">    <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># leave out file extension (i.e., no ".Rmd" at the end)</span></span>
<span id="cb4-4">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">file =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"name-of-your-R-Markdown-file"</span>, </span>
<span id="cb4-5">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">gfile =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"name-your-file-will-have-on-Google-Drive"</span>,</span>
<span id="cb4-6">    <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">path =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"blah/blah-blah/name-your-file-will-have-on-Google-Drive"</span></span>
<span id="cb4-7">    )</span></code></pre></div>
</details>
</div>
</section>
<section id="view-contents-of-google-drive-in-r-console" class="level2">
<h2 class="anchored" data-anchor-id="view-contents-of-google-drive-in-r-console">View Contents of Google Drive in R Console</h2>
<p>Easy. It even displays in a tidy tibble. Friggin sweet, right? Just use:</p>
<div class="cell">
<details class="code-fold">
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb5" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb5-1"><span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># view contents of google drive in a tibble</span></span>
<span id="cb5-2"><span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># "n = n" limits the output to the first n files it finds</span></span>
<span id="cb5-3"><span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># "pattern = 'pattern'" returns files with the name specified as the pattern</span></span>
<span id="cb5-4">googledrive<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">::</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">drive_find</span>()</span></code></pre></div>
</details>
</div>
<div id="refs">

</div>


</section>
</section>

<div id="quarto-appendix" class="default"><section class="quarto-appendix-contents" id="quarto-citation"><h2 class="anchored quarto-appendix-heading">Citation</h2><div><div class="quarto-appendix-secondary-label">BibTeX citation:</div><pre class="sourceCode code-with-copy quarto-appendix-bibtex"><code class="sourceCode bibtex">@online{e._vanaman2021,
  author = {E. Vanaman, Matthew},
  title = {Collaborative {Writing} {With} {R} and {Google} {Docs:}
    {Easier} {Than} {You} {Think}},
  date = {2021-03-27},
  url = {https://matthewvanaman.com/posts/2021-03-17-extremely-simple-guide-to-collaborative-writing-between-r-markdown-and-google-docs-users/},
  langid = {en}
}
</code></pre><div class="quarto-appendix-secondary-label">For attribution, please cite this work as:</div><div id="ref-e._vanaman2021" class="csl-entry quarto-appendix-citeas">
E. Vanaman, M. (2021, March 27). <em><a href="https://matthewvanaman.com/posts/2021-03-17-extremely-simple-guide-to-collaborative-writing-between-r-markdown-and-google-docs-users/">Collaborative
Writing With R and Google Docs: Easier Than You Think</a></em>.
</div></div></section></div> ]]></description>
  <category>collaboration</category>
  <category>reproducibility</category>
  <category>transparency</category>
  <guid>https://www.matthewvanaman.com/posts/2021-03-17-extremely-simple-guide-to-collaborative-writing-between-r-markdown-and-google-docs-users/collab_writing.html</guid>
  <pubDate>Sat, 27 Mar 2021 05:00:00 GMT</pubDate>
  <media:content url="https://www.matthewvanaman.com/_site/imgs/jack_3.png" medium="image" type="image/png" height="192" width="144"/>
</item>
<item>
  <title>Tidy Fisher’s Exact Test In R (And Why To Always Use It)</title>
  <dc:creator>Matthew E. Vanaman</dc:creator>
  <link>https://www.matthewvanaman.com/posts/2021-02-06-tidy-fisher-s-exact-test-in-r/index_fisher.html</link>
  <description><![CDATA[ 





<style type="text/css">
caption, .table-caption {
  text-align: left;
}
</style>
<p>If you are interested in some unsolicited advice about choosing tests and/or a walk-through of this function, keep reading. Otherwise, feel free to skip to the full function at the bottom.</p>
<section id="why-you-should-always-use-fishers-exact-test-instead" class="level1">
<h1>Why You Should Always Use Fisher’s Exact Test Instead</h1>
<p>Most students in the sciences learn about the <img src="https://latex.codecogs.com/png.latex?%5Cchi%5E%7B2%7D"> test of independence in their introductory statistics course. The idea is that if binary variables <em>x</em> and <em>y</em> are unrelated, then the observed values and expected values will be identical, in which cases <img src="https://latex.codecogs.com/png.latex?%5Cchi%5E%7B2%7D"> is equal to zero. The expected values are just the counts of each combination of <em>x</em> and <em>y</em> we would expect if <em>x</em> and <em>y</em> were unrelated in the population, while the observed counts are the counts we actually have.</p>
<p>The <img src="https://latex.codecogs.com/png.latex?%5Cchi%5E%7B2%7D"> value, then, is a function of the difference between the expected values and the observed values (the values in from the sample). The greater the difference between expected and observed values, the lower the probability that the difference between them (or a larger difference) is due to chance, assuming that there is actually no difference at the population level. Thus all the <img src="https://latex.codecogs.com/png.latex?%5Cchi%5E%7B2%7D"> “test” really means is that we check to see whether the <img src="https://latex.codecogs.com/png.latex?p">-value from the <img src="https://latex.codecogs.com/png.latex?%5Cchi%5E%7B2%7D"> we get is less than alpha, which is usually a cutoff <img src="https://latex.codecogs.com/png.latex?p">-value of .05.</p>
<p>One assumption of the <img src="https://latex.codecogs.com/png.latex?%5Cchi%5E%7B2%7D"> test violated fairly often is that no expected values are less than 5. This is sort of an arbitrary cutoff - the larger the expected counts, the more accurate the <img src="https://latex.codecogs.com/png.latex?%5Cchi%5E%7B2%7D"> value will be (in general). Unlike the <img src="https://latex.codecogs.com/png.latex?%5Cchi%5E%7B2%7D"> test, the Fisher’s exact test is accurate even in the presence of expected values less than 5. In cases where the expected values are all well above 5, the <img src="https://latex.codecogs.com/png.latex?p">-values from the tests will be close, if not identical. There isn’t really a drawback to using Fisher’s exact test, so it makes sense to just always use Fisher’s exact test. This argument is analogous to the argument that we should always use Welch’s instead of Student’s <img src="https://latex.codecogs.com/png.latex?t">-test <a href="https://www.rips-irsp.com/articles/10.5334/irsp.82/" target="_blank">by default</a> .</p>
<p>As an illustration, let’s compare the results of a <img src="https://latex.codecogs.com/png.latex?%5Cchi%5E%7B2%7D"> test and Fisher’s exact test. We’re interested in seeing whether transmission type (<code>am</code>, 0 = automatic, 1 = manual) and engine shape (<code>vs</code>, 0 = V-shaped, 1 = straight) are related. These date come from the <code>mtcars</code> dataset, which is built in to <em>R</em>. Here are the observed and expected values:</p>
<div class="cell">
<div id="tbl-crosstab-am-vs" class="cell quarto-float quarto-figure quarto-figure-center anchored">
<figure class="quarto-float quarto-float-tbl figure">
<figcaption class="quarto-float-caption-top quarto-float-caption quarto-float-tbl" id="tbl-crosstab-am-vs-caption-0ceaefa1-69ba-4598-a22c-09a6ac19f8ca">
Table&nbsp;1: Crosstabulation of <code>am</code> and <code>vs</code> Variables
</figcaption>
<div aria-describedby="tbl-crosstab-am-vs-caption-0ceaefa1-69ba-4598-a22c-09a6ac19f8ca">
<div class="cell-output-display">
<table id="tab:tbl-crosstab-am-vs" class="huxtable do-not-create-environment cell caption-top table table-sm table-striped small" data-quarto-postprocess="true">
<tbody>
<tr class="odd">
<td style="text-align: left; vertical-align: top; white-space: normal; padding: 6pt 6pt 6pt 6pt; font-weight: normal;"></td>
<td colspan="2" style="text-align: center; vertical-align: top; white-space: normal; padding: 6pt 6pt 6pt 6pt; font-weight: normal;">Observed</td>
<td colspan="2" style="text-align: center; vertical-align: top; white-space: normal; padding: 6pt 6pt 6pt 6pt; font-weight: normal;">Expected</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.2pt 0pt; border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;"></td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.2pt 0pt; border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">vs = 0</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0.4pt 0.2pt 0pt; border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">vs = 1</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.2pt 0.4pt; border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">vs = 0</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 0.2pt 0pt; border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">vs = 1</td>
</tr>
<tr class="odd">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">am = 0</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">12</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">7</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">10.6875</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">8.3125</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">am = 1</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">6</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0.4pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">7</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0.4pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">7.3125</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">5.6875</td>
</tr>
</tbody>
</table>


</div>
</div>
</figure>
</div>
</div>
<p>In <em>R</em>, we can use the built-in <em>stats</em> package to get a <img src="https://latex.codecogs.com/png.latex?%5Cchi%5E%7B2%7D"> test, which prints the following output:</p>
<div class="cell">
<details class="code-fold">
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb1" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb1-1">stats<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">::</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">chisq.test</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">x =</span> mtcars<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">$</span>am, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">y =</span> mtcars<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">$</span>vs)</span></code></pre></div>
</details>
<div class="cell-output cell-output-stdout">
<pre><code>
    Pearson's Chi-squared test with Yates' continuity correction

data:  mtcars$am and mtcars$vs
X-squared = 0.34754, df = 1, p-value = 0.5555</code></pre>
</div>
</div>
<hr>
<p>We can also use the <em>stats</em> package to get a Fisher’s exact test. Here is what the exact test gives us:</p>
<div class="cell">
<div class="cell-output cell-output-stdout">
<pre><code>
    Fisher's Exact Test for Count Data

data:  mtcars$am and mtcars$vs
p-value = 0.4727
alternative hypothesis: true odds ratio is not equal to 1
95 percent confidence interval:
  0.3825342 10.5916087
sample estimates:
odds ratio 
  1.956055 </code></pre>
</div>
</div>
<p>Notice that the <img src="https://latex.codecogs.com/png.latex?p">-values are a bit different. By definition, the Fisher’s exact test is more accurate - it’s an “exact” test, while the <img src="https://latex.codecogs.com/png.latex?%5Cchi%5E%7B2%7D"> is an approximation test. In other words, the <img src="https://latex.codecogs.com/png.latex?%5Cchi%5E%7B2%7D"> test merely aims to be “close enough”, because back in the day, people had to do these tests by hand, and getting the exact answers would be nearly impossible by hand. Today, computers can solve for these answers for us. Assuming adequate sample size, the <img src="https://latex.codecogs.com/png.latex?%5Cchi%5E2"> test is usually fine, though it will become less accurate when sample sizes become smaller. Not so with Fisher’s exact test.</p>
</section>
<section id="a-function-for-tidy-crosstabulations-and-fishers-exact-tests" class="level1">
<h1>A Function for Tidy Crosstabulations and Fisher’s Exact Tests</h1>
<p>The <code>stats</code> package, which comes preloaded in RStudio, provides <code>chi.sq()</code> and <code>fisher.test()</code> functions. Personally I don’t like the format of the output. I’ve written a function that will conduct Fisher’s exact test and provide output including the odds ratio, <img src="https://latex.codecogs.com/png.latex?p">-value, and confidence intervals in tidy wide or long output, along with pre-formatted cross-tabulation tables with counts, percentages, and totals. I usually want to look at these things to help put my Fisher test results in context. I wrote a function which I’ll call <code>my.fisher()</code> that gives me some crucial information in the output, ready to be looked at without further effort. Here’s the first Fisher’s exact test, but this time using <code>my.fisher()</code>:</p>
<div class="cell">
<details class="code-fold">
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb4" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb4-1">fisher.results <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">my.fisher</span>(mtcars, am, vs)</span>
<span id="cb4-2"><span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># Just some formatting for the blog :)</span></span>
<span id="cb4-3">fisher.results<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">$</span>crosstab.all <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb4-4">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">as.data.frame.matrix</span>() <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb4-5">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">rename</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">am =</span> V1, <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"vs = 0"</span> <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">=</span> vs,  <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"vs = 1"</span> <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">=</span> V3,  <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">Total =</span> V4) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb4-6">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">slice</span>(<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">-</span><span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">1</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb4-7">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">huxtable_print</span>() <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb4-8">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">set_align</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">col =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">2</span><span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">:</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">ncol</span>(.), <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">value =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"center"</span>)</span></code></pre></div>
</details>
<div id="tbl-my-fisher-table" class="cell quarto-float quarto-figure quarto-figure-center anchored">
<figure class="quarto-float quarto-float-tbl figure">
<figcaption class="quarto-float-caption-top quarto-float-caption quarto-float-tbl" id="tbl-my-fisher-table-caption-0ceaefa1-69ba-4598-a22c-09a6ac19f8ca">
Table&nbsp;2: Observed Percentages, Row Totals, Column Totals, and Overall Totals
</figcaption>
<div aria-describedby="tbl-my-fisher-table-caption-0ceaefa1-69ba-4598-a22c-09a6ac19f8ca">
<div class="cell-output-display">
<table id="tab:tbl-my-fisher-table" class="huxtable do-not-create-environment cell caption-top table table-sm table-striped small" data-quarto-postprocess="true">
<tbody>
<tr class="odd">
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: bold;">am</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">vs = 0</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">vs = 1</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: bold;">Total</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">0</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">37.50% (12)</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">21.88% (7)</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">59.38% (19)</td>
</tr>
<tr class="odd">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">1</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">18.75% (6)</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">21.88% (7)</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">40.62% (13)</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">Total</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">56.25% (18)</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">43.75% (14)</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">100.00% (32)</td>
</tr>
</tbody>
</table>


</div>
</div>
</figure>
</div>
</div>
<div class="cell">
<details class="code-fold">
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb5" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb5-1">fisher.results<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">$</span>fish.test <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb5-2">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">huxtable_print</span>()</span></code></pre></div>
</details>
<div id="tbl-my-fisher-test" class="cell quarto-float quarto-figure quarto-figure-center anchored">
<figure class="quarto-float quarto-float-tbl figure">
<figcaption class="quarto-float-caption-top quarto-float-caption quarto-float-tbl" id="tbl-my-fisher-test-caption-0ceaefa1-69ba-4598-a22c-09a6ac19f8ca">
Table&nbsp;3: Fisher’s Exact Test Output
</figcaption>
<div aria-describedby="tbl-my-fisher-test-caption-0ceaefa1-69ba-4598-a22c-09a6ac19f8ca">
<div class="cell-output-display">
<table id="tab:tbl-my-fisher-test" class="huxtable do-not-create-environment cell caption-top table table-sm table-striped small" data-quarto-postprocess="true">
<tbody>
<tr class="odd">
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: bold;">Odds Ratio</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">p</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">CI_Lower</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">CI_Higher</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">Test</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: bold;">Direction</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">1.96</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">0.473</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">0.38</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">10.59</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">Fisher's Exact Test for Count Data</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">two.sided</td>
</tr>
</tbody>
</table>


</div>
</div>
</figure>
</div>
</div>
<p>Ah, that’s easier on the eyes. We can also get that in long format too:</p>
<div class="cell">
<details class="code-fold">
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb6" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb6-1">fisher.results <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">my.fisher</span>(mtcars, am, vs)</span>
<span id="cb6-2">fisher.results<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">$</span>fish.test.long <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb6-3">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">huxtable_print</span>()</span></code></pre></div>
</details>
<div id="tbl-fisher-long" class="cell quarto-float quarto-figure quarto-figure-center anchored">
<figure class="quarto-float quarto-float-tbl figure">
<figcaption class="quarto-float-caption-top quarto-float-caption quarto-float-tbl" id="tbl-fisher-long-caption-0ceaefa1-69ba-4598-a22c-09a6ac19f8ca">
Table&nbsp;4: Fisher’s Exact Test Output in Long Format
</figcaption>
<div aria-describedby="tbl-fisher-long-caption-0ceaefa1-69ba-4598-a22c-09a6ac19f8ca">
<div class="cell-output-display">
<table id="tab:tbl-fisher-long" class="huxtable do-not-create-environment cell caption-top table table-sm table-striped small" data-quarto-postprocess="true">
<tbody>
<tr class="odd">
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: bold;">Statistic</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: bold;">Value</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">Odds Ratio</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">1.96</td>
</tr>
<tr class="odd">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">p</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">0.473</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">CI_Lower</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">0.38</td>
</tr>
<tr class="odd">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">CI_Higher</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">10.59</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">Test</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">Fisher's Exact Test for Count Data</td>
</tr>
<tr class="odd">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">Direction</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">two.sided</td>
</tr>
</tbody>
</table>


</div>
</div>
</figure>
</div>
</div>
<p>You can also pass arguments to <code>janitor::fisher.test()</code>. For example, say you wanted to do a leff-sided single-tailed test. Just add <code>alternative = "less"</code> to <code>my.fisher()</code> (note that the default is a two-sided test):</p>
<div class="cell">
<details class="code-fold">
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb7" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb7-1">fisher.results <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">my.fisher</span>(mtcars, am, vs, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">alternative =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"less"</span>)</span>
<span id="cb7-2">fisher.results<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">$</span>fish.test <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span></span>
<span id="cb7-3">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">huxtable_print</span>()</span></code></pre></div>
</details>
<div id="tbl-one-sided" class="cell quarto-float quarto-figure quarto-figure-center anchored">
<figure class="quarto-float quarto-float-tbl figure">
<figcaption class="quarto-float-caption-top quarto-float-caption quarto-float-tbl" id="tbl-one-sided-caption-0ceaefa1-69ba-4598-a22c-09a6ac19f8ca">
Table&nbsp;5: Fisher’s Exact Test With One-Sided Test
</figcaption>
<div aria-describedby="tbl-one-sided-caption-0ceaefa1-69ba-4598-a22c-09a6ac19f8ca">
<div class="cell-output-display">
<table id="tab:tbl-one-sided" class="huxtable do-not-create-environment cell caption-top table table-sm table-striped small" data-quarto-postprocess="true">
<tbody>
<tr class="odd">
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: bold;">Odds Ratio</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">p</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">CI_Lower</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">CI_Higher</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">Test</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: bold;">Direction</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">1.96</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">0.906</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">0.00</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">8.34</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">Fisher's Exact Test for Count Data</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">less</td>
</tr>
</tbody>
</table>


</div>
</div>
</figure>
</div>
</div>
<p>Notice the <img src="https://latex.codecogs.com/png.latex?p">-value is smaller; that is because one-tailed tests are more powerful than two-tailed tests, assuming there is a real relationship at the population level, specifically in the direction of the test.</p>
<p>An added benefit of Fisher’s exact test is that unlike <img src="https://latex.codecogs.com/png.latex?%5Cchi%5E%7B2%7D">, it can give you a <img src="https://latex.codecogs.com/png.latex?p">-value in cases where <em>x</em>, <em>y</em>, or both have greater than 2 categories (resulting in a 2 <img src="https://latex.codecogs.com/png.latex?%5Ctimes"> 3 table, for example). This function can also accommodate nominal variables with greater than 2 categories. For example, a 2 <img src="https://latex.codecogs.com/png.latex?%5Ctimes"> 3 table between transmission type and number of cylinders (<code>cyl</code>, 4, 6, or 8):</p>
<div class="cell">
<details class="code-fold">
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb8" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb8-1">fisher.results <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">my.fisher</span>(mtcars, am, cyl)</span>
<span id="cb8-2">fisher.results<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">$</span>fish.test <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb8-3">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">huxtable_print</span>()</span></code></pre></div>
</details>
<div id="tbl-am-cyl" class="cell quarto-float quarto-figure quarto-figure-center anchored">
<figure class="quarto-float quarto-float-tbl figure">
<figcaption class="quarto-float-caption-top quarto-float-caption quarto-float-tbl" id="tbl-am-cyl-caption-0ceaefa1-69ba-4598-a22c-09a6ac19f8ca">
Table&nbsp;6: Fisher’s Exact Test, Transmission Type and Number of Cylinders
</figcaption>
<div aria-describedby="tbl-am-cyl-caption-0ceaefa1-69ba-4598-a22c-09a6ac19f8ca">
<div class="cell-output-display">
<table id="tab:tbl-am-cyl" class="huxtable do-not-create-environment cell caption-top table table-sm table-striped small" data-quarto-postprocess="true">
<tbody>
<tr class="odd">
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: bold;">p.value</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">method</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: bold;">alternative</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">0.009</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">Fisher's Exact Test for Count Data</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">two.sided</td>
</tr>
</tbody>
</table>


</div>
</div>
</figure>
</div>
</div>
<p>The odds ratio left out of the output in these cases, because it is not applicable to exact tests one or more variables has greater than 2 categories. In this case, you’d want to look at a crosstabulation of <em>x</em> and <em>y</em> to contextualize the <img src="https://latex.codecogs.com/png.latex?p">-value. This function provides them for you in a nice format with the help of the <code>janitor</code> package.</p>
<section id="getting-crosstabs" class="level2">
<h2 class="anchored" data-anchor-id="getting-crosstabs">Getting Crosstabs</h2>
<div class="cell">
<details class="code-fold">
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb9" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb9-1">fisher.results<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">$</span>crosstab.all <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb9-2">  <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># formatting for blog :)</span></span>
<span id="cb9-3">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">huxtable_print</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">add_colnames =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">FALSE</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb9-4">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">insert_row</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">after =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">0</span>, <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">rep</span>(<span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"cyl"</span>, <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">3</span>), <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb9-5">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">merge_cells</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">row =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">1</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">col =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">2</span><span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">:</span><span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">4</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb9-6">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">set_align</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">row =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">1</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">col =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">2</span><span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">:</span><span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">4</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">value =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"center"</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb9-7">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">set_bottom_border</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">row =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">1</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">col =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">3</span>)</span></code></pre></div>
</details>
<div id="tbl-cross-vs" class="cell quarto-float quarto-figure quarto-figure-center anchored">
<figure class="quarto-float quarto-float-tbl figure">
<figcaption class="quarto-float-caption-top quarto-float-caption quarto-float-tbl" id="tbl-cross-vs-caption-0ceaefa1-69ba-4598-a22c-09a6ac19f8ca">
Table&nbsp;7: Crosstab With Sample Total As Percentage Denominator
</figcaption>
<div aria-describedby="tbl-cross-vs-caption-0ceaefa1-69ba-4598-a22c-09a6ac19f8ca">
<div class="cell-output-display">
<table id="tab:tbl-cross-vs" class="huxtable do-not-create-environment cell caption-top table table-sm table-striped small" data-quarto-postprocess="true">
<tbody>
<tr class="odd">
<td style="text-align: left; vertical-align: top; white-space: normal; padding: 6pt 6pt 6pt 6pt; font-weight: normal;"></td>
<td colspan="3" style="text-align: center; vertical-align: top; white-space: normal; padding: 6pt 6pt 6pt 6pt; font-weight: normal;">cyl</td>
<td style="text-align: left; vertical-align: top; white-space: normal; padding: 6pt 6pt 6pt 6pt; font-weight: normal;"></td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 2.5pt 0pt; border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">am</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 2.5pt 0pt; border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">4</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">6</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 2.5pt 0pt; border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">8</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 2.5pt 0pt; border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">Total</td>
</tr>
<tr class="odd">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">0</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">9.38% (3)</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">12.50% (4)</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">37.50% (12)</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">59.38% (19)</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">1</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">25.00% (8)</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">9.38% (3)</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">6.25% (2)</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">40.62% (13)</td>
</tr>
<tr class="odd">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">Total</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">34.38% (11)</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">21.88% (7)</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">43.75% (14)</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">100.00% (32)</td>
</tr>
</tbody>
</table>


</div>
</div>
</figure>
</div>
</div>
<p>Table&nbsp;7 shows the cross-tabulation between transmission type and number of cylinders, with percentages and counts (the latter in parentheses). You also get row and column totals, along with the sample total in the right-most bottom corner. You also get two other cross-tabulation, one with percentages calculated relative the row total; the other with percentages calculated relative to the column total. Here’s an example with row totals:</p>
<div class="cell">
<details class="code-fold">
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb10" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb10-1">fisher.results<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">$</span>crosstab.row <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb10-2">  <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># formatting for blog :)</span></span>
<span id="cb10-3">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">huxtable_print</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">add_colnames =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">FALSE</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb10-4">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">insert_row</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">after =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">0</span>, <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>, <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">rep</span>(<span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"cyl"</span>, <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">3</span>), <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NA</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb10-5">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">merge_cells</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">row =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">1</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">col =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">2</span><span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">:</span><span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">4</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb10-6">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">set_align</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">row =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">1</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">col =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">2</span><span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">:</span><span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">4</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">value =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"center"</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb10-7">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">set_bottom_border</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">row =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">1</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">col =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">3</span>)</span></code></pre></div>
</details>
<div id="tbl-cross-vs-row" class="cell quarto-float quarto-figure quarto-figure-center anchored">
<figure class="quarto-float quarto-float-tbl figure">
<figcaption class="quarto-float-caption-top quarto-float-caption quarto-float-tbl" id="tbl-cross-vs-row-caption-0ceaefa1-69ba-4598-a22c-09a6ac19f8ca">
Table&nbsp;8: Crosstab With Row Total As Denominator For Percentage
</figcaption>
<div aria-describedby="tbl-cross-vs-row-caption-0ceaefa1-69ba-4598-a22c-09a6ac19f8ca">
<div class="cell-output-display">
<table id="tab:tbl-cross-vs-row" class="huxtable do-not-create-environment cell caption-top table table-sm table-striped small" data-quarto-postprocess="true">
<tbody>
<tr class="odd">
<td style="text-align: left; vertical-align: top; white-space: normal; padding: 6pt 6pt 6pt 6pt; font-weight: normal;"></td>
<td colspan="3" style="text-align: center; vertical-align: top; white-space: normal; padding: 6pt 6pt 6pt 6pt; font-weight: normal;">cyl</td>
<td style="text-align: left; vertical-align: top; white-space: normal; padding: 6pt 6pt 6pt 6pt; font-weight: normal;"></td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 2.5pt 0pt; border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">am</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 2.5pt 0pt; border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">4</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">6</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 2.5pt 0pt; border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">8</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0pt 0pt 2.5pt 0pt; border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">Total</td>
</tr>
<tr class="odd">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">0</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">15.79% (3)</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">21.05% (4)</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">63.16% (12)</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">100.00% (19)</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">1</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">61.54% (8)</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">23.08% (3)</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">15.38% (2)</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">100.00% (13)</td>
</tr>
<tr class="odd">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">Total</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">34.38% (11)</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">21.88% (7)</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">43.75% (14)</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">100.00% (32)</td>
</tr>
</tbody>
</table>


</div>
</div>
</figure>
</div>
</div>
<p>Ah - with the row-wise percentages, you can see that the likely driver of statistical significance here is the inverse relationship between transmission type and cylinder. More than half of automatics have 8 cylinders, while more than half of manuals have only 4 cylinders. Looks like an <a href="https://en.wikipedia.org/wiki/Interaction_(statistics)" target="_blank">interaction effect</a>!</p>
</section>
</section>
<section id="full-function" class="level1">
<h1>Full Function</h1>
<div id="Function">
<p>Copy-and-paste this function to use it in your own <code>R</code> projects. You will be prompted to install the <code>tidyverse</code> <code>broom</code>, and <code>janitor</code> packages if you do not already have them. Click the Code drop-down below to show the full function:</p>
<div class="cell">
<details class="code-fold">
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb11" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb11-1"><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">library</span>(tidyverse)</span>
<span id="cb11-2"><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">library</span>(janitor)</span>
<span id="cb11-3"><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">library</span>(broom)</span>
<span id="cb11-4">my.fisher <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span></span>
<span id="cb11-5">  <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># ... allows you to pass arguments to functions where ... are present</span></span>
<span id="cb11-6">  <span class="cf" style="color: #003B4F;
background-color: null;
font-weight: bold;
font-style: inherit;">function</span>(data, ..., <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">alternative =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"two.sided"</span>) {</span>
<span id="cb11-7">    <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># load required packages</span></span>
<span id="cb11-8">    <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">require</span>(janitor)</span>
<span id="cb11-9">    <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">require</span>(dplyr)</span>
<span id="cb11-10">    <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">require</span>(broom)</span>
<span id="cb11-11">    <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># make.pretty is a function-within-a-function that</span></span>
<span id="cb11-12">    <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># adds totals and formatting using janitor package</span></span>
<span id="cb11-13">    make.pretty <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> <span class="cf" style="color: #003B4F;
background-color: null;
font-weight: bold;
font-style: inherit;">function</span>(tab, ...){</span>
<span id="cb11-14">      tab <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span></span>
<span id="cb11-15">        janitor<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">::</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">adorn_totals</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">where =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">c</span>(<span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"row"</span>, <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"col"</span>)) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span></span>
<span id="cb11-16">        janitor<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">::</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">adorn_percentages</span>(...) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span></span>
<span id="cb11-17">        janitor<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">::</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">adorn_pct_formatting</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">digits =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">2</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span></span>
<span id="cb11-18">        janitor<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">::</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">adorn_ns</span>() <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span></span>
<span id="cb11-19">        janitor<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">::</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">adorn_title</span>()</span>
<span id="cb11-20">    }</span>
<span id="cb11-21">    <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># this gets the n x n crosstab</span></span>
<span id="cb11-22">    my.tab <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> janitor<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">::</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">tabyl</span>(</span>
<span id="cb11-23">      data,</span>
<span id="cb11-24">      ...,</span>
<span id="cb11-25">      <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">show_na =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">FALSE</span>,</span>
<span id="cb11-26">      <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">show_missing_levels =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">FALSE</span>)</span>
<span id="cb11-27">    <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># use make.pretty to add totals and formatting</span></span>
<span id="cb11-28">    my.tab.all <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">make.pretty</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">tab =</span> my.tab, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">denominator =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"all"</span>)</span>
<span id="cb11-29">    my.tab.row <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">make.pretty</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">tab =</span> my.tab, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">denominator =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"row"</span>)</span>
<span id="cb11-30">    my.tab.col <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">make.pretty</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">tab =</span> my.tab, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">denominator =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"col"</span>)</span>
<span id="cb11-31">    <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># get the fisher's exact test</span></span>
<span id="cb11-32">    <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># can pass arguments to stats::fisher.test via ...</span></span>
<span id="cb11-33">    <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># this determines which type of test to run, depending</span></span>
<span id="cb11-34">    <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># on alternative = argument</span></span>
<span id="cb11-35">    <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># default is "two.sided"</span></span>
<span id="cb11-36">    <span class="cf" style="color: #003B4F;
background-color: null;
font-weight: bold;
font-style: inherit;">if</span>(alternative <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">==</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"greater"</span>){</span>
<span id="cb11-37">      fish <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> my.tab <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span></span>
<span id="cb11-38">        janitor<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">::</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">fisher.test</span>(., <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">alternative =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"greater"</span>)</span>
<span id="cb11-39">    } <span class="cf" style="color: #003B4F;
background-color: null;
font-weight: bold;
font-style: inherit;">else</span> {</span>
<span id="cb11-40">      <span class="cf" style="color: #003B4F;
background-color: null;
font-weight: bold;
font-style: inherit;">if</span> (alternative <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">==</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"less"</span>){</span>
<span id="cb11-41">        fish <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> my.tab <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span></span>
<span id="cb11-42">          janitor<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">::</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">fisher.test</span>(., <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">alternative =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"less"</span>)</span>
<span id="cb11-43">      }</span>
<span id="cb11-44">      fish <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> my.tab <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span></span>
<span id="cb11-45">        janitor<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">::</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">fisher.test</span>(., <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">alternative =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"two.sided"</span>)</span>
<span id="cb11-46">    }</span>
<span id="cb11-47">    fish <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> fish <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span></span>
<span id="cb11-48">      <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># organizes output into a table</span></span>
<span id="cb11-49">      broom<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">::</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">tidy</span>() <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span></span>
<span id="cb11-50">      <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">mutate</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">p.value =</span> scales<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">::</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">pvalue</span>(p.value)) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb11-51">      <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># rounds values</span></span>
<span id="cb11-52">      dplyr<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">::</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">mutate_if</span>(is.numeric, round, <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">2</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span></span>
<span id="cb11-53">      <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># makes them into character format with exactly 2 decimal points</span></span>
<span id="cb11-54">      <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># so that numeric and character columns can be combined (for long format)</span></span>
<span id="cb11-55">      dplyr<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">::</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">mutate_if</span>(is.numeric, format, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">nsmall =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">2</span>)</span>
<span id="cb11-56">    <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># if estimate column is present (in case of 2x2's), rename as "odds.ratio"</span></span>
<span id="cb11-57">    <span class="cf" style="color: #003B4F;
background-color: null;
font-weight: bold;
font-style: inherit;">if</span> (<span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"estimate"</span> <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%in%</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">names</span>(fish)) {</span>
<span id="cb11-58">      fish <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> fish <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb11-59">        dplyr<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">::</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">rename</span>(</span>
<span id="cb11-60">          <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Odds Ratio"</span> <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">=</span> estimate,</span>
<span id="cb11-61">          <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">p =</span> p.value, </span>
<span id="cb11-62">          <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">CI_Lower =</span> conf.low,</span>
<span id="cb11-63">          <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">CI_Higher =</span> conf.high,</span>
<span id="cb11-64">          <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">Test =</span> method,</span>
<span id="cb11-65">          <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">Direction =</span> alternative</span>
<span id="cb11-66">        )</span>
<span id="cb11-67">      fish.long <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> fish <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb11-68">        <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># reshape to long format</span></span>
<span id="cb11-69">        tidyr<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">::</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">pivot_longer</span>(</span>
<span id="cb11-70">          <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">cols =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">everything</span>(), </span>
<span id="cb11-71">          <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># name of column that gets the row values</span></span>
<span id="cb11-72">          <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">values_to =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Value"</span>, </span>
<span id="cb11-73">          <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># name of column that gets the column names</span></span>
<span id="cb11-74">          <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">names_to =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Statistic"</span>)</span>
<span id="cb11-75">    }</span>
<span id="cb11-76">    <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># this is the same thing as above, except this gets done when</span></span>
<span id="cb11-77">    <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># estimate column is not present</span></span>
<span id="cb11-78">    fish.long <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> fish <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb11-79">      tidyr<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">::</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">pivot_longer</span>(</span>
<span id="cb11-80">        <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">cols =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">everything</span>(), </span>
<span id="cb11-81">        <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">values_to =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Value"</span>, </span>
<span id="cb11-82">        <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">names_to =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Statistic"</span>)</span>
<span id="cb11-83">    <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># what does the function give as output?</span></span>
<span id="cb11-84">    <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># left side of = is what you'll see with $</span></span>
<span id="cb11-85">    <span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># right side is object saved somewhere above</span></span>
<span id="cb11-86">    <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">return</span>(<span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">list</span>(</span>
<span id="cb11-87">      <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">crosstab.all =</span> my.tab.all,</span>
<span id="cb11-88">      <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">crosstab.row =</span> my.tab.row,</span>
<span id="cb11-89">      <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">crosstab.column =</span> my.tab.col,</span>
<span id="cb11-90">      <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fish.test =</span> fish, </span>
<span id="cb11-91">      <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">fish.test.long =</span> fish.long))</span>
<span id="cb11-92">  }</span></code></pre></div>
</details>
</div>
<div id="refs">

</div>


</div>
</section>

<div id="quarto-appendix" class="default"><section class="quarto-appendix-contents" id="quarto-citation"><h2 class="anchored quarto-appendix-heading">Citation</h2><div><div class="quarto-appendix-secondary-label">BibTeX citation:</div><pre class="sourceCode code-with-copy quarto-appendix-bibtex"><code class="sourceCode bibtex">@online{e._vanaman2021,
  author = {E. Vanaman, Matthew},
  title = {Tidy {Fisher’s} {Exact} {Test} {In} {R} {(And} {Why} {To}
    {Always} {Use} {It)}},
  date = {2021-02-06},
  url = {https://matthewvanaman.com/posts/2021-02-06-tidy-fisher-s-exact-test-in-r/},
  langid = {en}
}
</code></pre><div class="quarto-appendix-secondary-label">For attribution, please cite this work as:</div><div id="ref-e._vanaman2021" class="csl-entry quarto-appendix-citeas">
E. Vanaman, M. (2021, February 6). <em><a href="https://matthewvanaman.com/posts/2021-02-06-tidy-fisher-s-exact-test-in-r/">Tidy
Fisher’s Exact Test In R (And Why To Always Use It)</a></em>.
</div></div></section></div> ]]></description>
  <category>efficiency</category>
  <category>functions</category>
  <guid>https://www.matthewvanaman.com/posts/2021-02-06-tidy-fisher-s-exact-test-in-r/index_fisher.html</guid>
  <pubDate>Sat, 06 Feb 2021 06:00:00 GMT</pubDate>
  <media:content url="https://www.matthewvanaman.com/_site/imgs/jack_2.png" medium="image" type="image/png" height="192" width="144"/>
</item>
<item>
  <title>Tidy T-Test in R With Cohen’s D</title>
  <dc:creator>Matthew E. Vanaman</dc:creator>
  <link>https://www.matthewvanaman.com/posts/2021-02-05-tidy-t-test-in-r-with-cohen-s-d/index_t_test.html</link>
  <description><![CDATA[ 





<style type="text/css">
caption, .table-caption {
  text-align: left;
}
</style>
<p>The independent-samples <img src="https://latex.codecogs.com/png.latex?t">-test is one of the most commonly used statistical tests and is taught in most introductory statistics courses. In broad strokes, the independent-samples <img src="https://latex.codecogs.com/png.latex?t">-test is used to compare the means of some continuous variable between two qualitatively different groups. Associated with this mean difference is a <img src="https://latex.codecogs.com/png.latex?p">-value. Although there’s <a href="https://en.wikipedia.org/wiki/Sampling_distribution" target="_blank">more to the story</a>, for our purposes we can define the <img src="https://latex.codecogs.com/png.latex?p">-value as the probability of observing a difference between the means this large or larger, just due to chance, if there were in reality no difference between the groups. Although arbitrary, researchers will adopt (for most applications) a cutoff <img src="https://latex.codecogs.com/png.latex?p">-value of .05, a value referred to as alpha. If the <img src="https://latex.codecogs.com/png.latex?p">-value falls below alpha, we can conclude that the difference between the means is large enough to warrant further scrutiny.</p>
<section id="wheres-my-effect-size" class="level1">
<h1>Where’s My Effect Size?</h1>
<p>Effect sizes help contextualize the results of statistical tests, which consensus is more often beginning to recognize as the <a href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3444174" target="_blank">least interesting part of statistical output</a>. As most introductory statistics courses will teach, you should use effect sizes like Cohen’s <img src="https://latex.codecogs.com/png.latex?d"> to get a sense of how impressive the magnitude of the mean difference is. The suggested rules of thumb for interpreting Cohen’s <img src="https://latex.codecogs.com/png.latex?d"> are <span class="citation" data-cites="cohen2013statistical">(Cohen, 1988)</span>:</p>
<ul>
<li><img src="https://latex.codecogs.com/png.latex?%5Cle%200.2"> is “small”</li>
<li><img src="https://latex.codecogs.com/png.latex?0.5"> is “medium”</li>
<li><img src="https://latex.codecogs.com/png.latex?%5Cge%200.8"> is “large”</li>
</ul>
<p>One would be forgiven for expecting to see this reported alongside the default output of standard statistical software. You almost always need it. I so far have been unable to find a function that provides this, and have become annoyed enough to finally create my own wrapper function that uses <code>R</code>’s built-in <code>t.test()</code> function and the <code>cohen.d()</code> function from the <code>psych</code> package. The output, unlike that of the default <code>t.test()</code> function, is in a <a href="https://vita.had.co.nz/papers/tidy-data.pdf" target="_blank">tidy format</a>.</p>
<p>Feel free to skip to the full function at the bottom; if you want a preview, keep reading.</p>
</section>
<section id="walk-through-of-my.t" class="level1">
<h1>Walk-Through of <code>my.t()</code></h1>
<section id="default-t-test-in-r" class="level2">
<h2 class="anchored" data-anchor-id="default-t-test-in-r">Default T-Test in <code>R</code></h2>
<p>The <code>t.test()</code> function, which is built in to base-<code>R</code> along with other mainstream tests, has messy output. It also doesn’t provide the mean difference, the standard error of the difference, or Cohen’s <img src="https://latex.codecogs.com/png.latex?d">. As an example of its use, I’ll conduct a <img src="https://latex.codecogs.com/png.latex?t">-test to see whether automatic or manual transmissions are associated with greater miles per gallon. This data can be found in the <code>mtcars</code> dataset (from the <code>datasets</code> package, also available in base-<code>R</code>):</p>
<div class="cell">
<details>
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb1" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb1-1"><span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># t.test(dv ~ iv, data)</span></span>
<span id="cb1-2"><span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># am = automatic or manual</span></span>
<span id="cb1-3"><span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># mpg = miles per gallon</span></span>
<span id="cb1-4"><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">t.test</span>(mpg <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">~</span> am, mtcars)</span></code></pre></div>
</details>
<div class="cell-output cell-output-stdout">
<pre><code>
    Welch Two Sample t-test

data:  mpg by am
t = -3.7671, df = 18.332, p-value = 0.001374
alternative hypothesis: true difference in means between group 0 and group 1 is not equal to 0
95 percent confidence interval:
 -11.280194  -3.209684
sample estimates:
mean in group 0 mean in group 1 
       17.14737        24.39231 </code></pre>
</div>
</div>
<p>In this dataset, vehicles with automatic transmissions are coded as 0, and manuals as 1. The dependent variable is miles per gallon. The mean miles per gallon for vehicles with automatic transmissions (17.15) is quite a bit lower than for vehicles with manual transmissions (24.39). This difference is statistically significant, <img src="https://latex.codecogs.com/png.latex?p%20=%20.001"> (that’s less than an alpha of .05), meaning the means are different enough that we might interested in investigating a bit further. At this point, you’d usually calculate Cohen’s <img src="https://latex.codecogs.com/png.latex?d">.</p>
</section>
<section id="t-test-using-my.t" class="level2">
<h2 class="anchored" data-anchor-id="t-test-using-my.t">T-Test Using <code>my.t()</code></h2>
<div class="cell">
<details>
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb3" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb3-1"><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">my.t</span>(mtcars, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">iv =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"am"</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">dv =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"mpg"</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb3-2">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">huxtable_print</span>() <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb3-3">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">set_align</span>(everywhere, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">value =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"center"</span>) </span></code></pre></div>
</details>
<div class="cell-output-display">
<div id="tbl-myt-am-mpg" class="anchored">
<table id="tab:tbl-myt-am-mpg" class="huxtable table table-sm table-striped small" data-quarto-postprocess="true">
<caption>Table&nbsp;1: T-Test With my.t() (IV = Transmission and DV = Miles Per Gallon)</caption>
<tbody>
<tr class="odd">
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: bold;">M_Group_1</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">M_Group_2</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">SD_Group_1</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">SD_Group_2</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">Mean_Difference</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">SE</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">CI_Lower</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">CI_Upper</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">t</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">df</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">p</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">Cohens_d</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">d_CI_Lower</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: bold;">d_CI_Upper</td>
</tr>
<tr class="even">
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">17.1</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">24.4</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">3.83</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">6.17</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">-7.24</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">1.92</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">-11.3</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">-3.21</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">-3.77</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">18.3</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">&lt;0.001</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">-1.48</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">-2.27</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">-0.67</td>
</tr>
</tbody>
</table>
</div>


</div>
</div>
<p>The output in Table&nbsp;1 above provides all of the relevant statistics, clearly labeled, with Cohen’s <img src="https://latex.codecogs.com/png.latex?d"> included, and in a tidy format that can easily be exported to a .csv file, copied-and-pasted into Word, or printed within an R Markdown as a table as I have done here (using the <a href="https://hughjonesd.github.io/huxtable/design-principles.html" target="blank">huxtable package</a>).</p>
</section>
<section id="output-formatting" class="level2">
<h2 class="anchored" data-anchor-id="output-formatting">Output Formatting</h2>
<p>Currently the output is in wide format, meaning that each statistic is its own column with the values for those statistics contained in the table row. If you prefer a different format, I have also added the <code>long =</code> argument that can optionally display output in long format, with all of the values in a single column with the statistic indicated by the row:</p>
<div class="cell">
<details>
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb4" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb4-1"><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">my.t</span>(mtcars, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">iv =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"am"</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">dv =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"mpg"</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">long =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">TRUE</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb4-2">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">huxtable_print</span>() <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb4-3">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">set_align</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">col =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">1</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">value =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"left"</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb4-4">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">set_align</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">col =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">2</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">value =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"center"</span>)</span></code></pre></div>
</details>
<div class="cell-output-display">
<div id="tbl-myt-long-format" class="anchored">
<table id="tab:tbl-myt-long-format" class="huxtable table table-sm table-striped small" data-quarto-postprocess="true">
<caption>Table&nbsp;2: T-Test With my.t() in Long Format (IV = Transmission and DV = Miles Per Gallon)</caption>
<tbody>
<tr class="odd">
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: bold;">Statistic</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: bold;">Value</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">M_Group_1</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">17.15</td>
</tr>
<tr class="odd">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">M_Group_2</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">24.39</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">SD_Group_1</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">3.83</td>
</tr>
<tr class="odd">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">SD_Group_2</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">6.17</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">Mean_Difference</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">-7.24</td>
</tr>
<tr class="odd">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">SE</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">1.92</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">CI_Lower</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">-11.28</td>
</tr>
<tr class="odd">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">CI_Upper</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">-3.21</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">t</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">-3.77</td>
</tr>
<tr class="odd">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">df</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">18.33</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">p</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">&lt;0.001</td>
</tr>
<tr class="odd">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">Cohens_d</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">-1.48</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">d_CI_Lower</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">-2.27</td>
</tr>
<tr class="odd">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">d_CI_Upper</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">-0.67</td>
</tr>
</tbody>
</table>
</div>


</div>
</div>
<p>Personally, I like the long format, because usually I am running more than one <img src="https://latex.codecogs.com/png.latex?t">-test. For example, say that in my car-shopping, miles per gallon was one of just several criteria I were using to decide what kind of car to buy. In addition to miles per gallon, I might compare automatic vs manual transmissions in their level of <em>displacement</em>, which roughly describes “how fast a vehicle gets up and goes” (my <a href="https://matthewevanaman.netlify.app/img/dad.jpeg" target="_blank">dad</a> built engines for 40 years, so I hope he will forgive me if this description is less than accurate). Displacement is measured in cubic inches. Below is a table with the output of both tests side-by-side:</p>
<div class="cell">
<details>
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb5" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb5-1"><span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># conduct the tests</span></span>
<span id="cb5-2">mpg.test <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">my.t</span>(mtcars, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">iv =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"am"</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">dv =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"mpg"</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">long =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">TRUE</span>)</span>
<span id="cb5-3">disp.test <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">my.t</span>(mtcars, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">iv =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"am"</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">dv =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"disp"</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">long =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">TRUE</span>)</span>
<span id="cb5-4"><span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># relabel the columns with the name of the dv</span></span>
<span id="cb5-5">mpg.test <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> mpg.test <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">rename</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">MPG =</span> Value)</span>
<span id="cb5-6">disp.test <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> disp.test <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">rename</span>(<span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Disp."</span> <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">=</span> Value)</span>
<span id="cb5-7"><span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># combine into one dataframe</span></span>
<span id="cb5-8">my.results <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">left_join</span>(mpg.test, disp.test, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">by =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Statistic"</span>)</span>
<span id="cb5-9"><span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># print the table</span></span>
<span id="cb5-10">my.results <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb5-11">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">huxtable_print</span>()  <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb5-12">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">set_align</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">col =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">1</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">value =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"left"</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb5-13">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">set_align</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">col =</span> <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">2</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">value =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"center"</span>)</span></code></pre></div>
</details>
<div class="cell-output-display">
<div id="tbl-myt-disp" class="anchored">
<table id="tab:tbl-myt-disp" class="huxtable table table-sm table-striped small" data-quarto-postprocess="true">
<caption>Table&nbsp;3: Comparing Group Differences in MPG and Displacement</caption>
<tbody>
<tr class="odd">
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: bold;">Statistic</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">MPG</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: bold;">Disp.</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">M_Group_1</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">17.15</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">290.38</td>
</tr>
<tr class="odd">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">M_Group_2</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">24.39</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">143.53</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">SD_Group_1</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">3.83</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">110.17</td>
</tr>
<tr class="odd">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">SD_Group_2</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">6.17</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">87.2</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">Mean_Difference</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">-7.24</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">146.85</td>
</tr>
<tr class="odd">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">SE</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">1.92</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">34.98</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">CI_Lower</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">-11.28</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">75.33</td>
</tr>
<tr class="odd">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">CI_Upper</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">-3.21</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">218.37</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">t</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">-3.77</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">4.2</td>
</tr>
<tr class="odd">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">df</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">18.33</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">29.26</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">p</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">&lt;0.001</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">&lt;0.001</td>
</tr>
<tr class="odd">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">Cohens_d</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">-1.48</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">1.45</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">d_CI_Lower</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">-2.27</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">0.64</td>
</tr>
<tr class="odd">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">d_CI_Upper</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">-0.67</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">2.23</td>
</tr>
</tbody>
</table>
</div>


</div>
</div>
<p>As shown in Table&nbsp;3, the mean difference in displacement between automatics and manuals is 146.85, meaning that automatic transmissions are associated with an extra 146.85 cubic inches of displacement on average. So while you might lose ~7 miles to the gallon by going with an automatic transmission, you can also expect to gain ~147 cubic inches of displacement.</p>
<p>OK, but what the heck does that mean? Is that an impressive number? It’s hard to tell for those who don’t spend time dealing with vehicle displacement. At least with miles per gallon, I can readily discern about how much money I would save if my vehicle got an extra 7 miles to the gallon. Displacement is a black box to me - I can’t tell if that mean difference in displacement is meaningful or not, especially not compared to how meaningful the difference in miles per gallon was.</p>
<p>In Table&nbsp;3, the Cohen’s <img src="https://latex.codecogs.com/png.latex?d"> statistics for miles per gallon and displacement are conveniently side-by-side. Both are very large effect sizes - quite a bit larger than 0.8, the rule of thumb for a large. Although the sign for displacement is negative (indicating that manual transmissions are associated with lower displacement than automatics), the absolute value is very close to that of miles per gallon. It seems like whatever gas I’d save with a manual transmission, I’d lose an equally-meaningful amount of displacement per cubic inch. That is, with Cohen’s <img src="https://latex.codecogs.com/png.latex?d">, I can see that the <em>magnitude</em> of the differences between between automatic and manual transmissions (effect sizes of 1.53 and -1.49, respectively) are pretty similar, even though the mean differences themselves (7.24 miles per gallon and -146.85 cubic inches of displacement, respectively) are not comparable numbers.</p>
<p>Of course, miles per gallon and displacement might be too conceptually different to be compared meaningfully without added context. These tests would be most helpful if you also knew what adding 146.85 of displacement per cubic inch would feel like in terms of pushing your back against the seat as you accelerate in your new car. Maybe you would need, say, twice as much displacement (or 293.7 cubic inches) in order for a gain in displacement to be noticeable. But in the absence of better information, it’s nice to know for the sake of car shopping that the <em>magnitude of the difference between the groups</em> is basically the same for miles per gallon and displacement.</p>
</section>
<section id="paired-samples-t-tests" class="level2">
<h2 class="anchored" data-anchor-id="paired-samples-t-tests">Paired Samples T-Tests</h2>
<div class="cell">
<details>
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb6" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb6-1"><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">library</span>(datasets)</span>
<span id="cb6-2">anxiety <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> ToothGrowth <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb6-3">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">mutate</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">time.point =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">recode</span>(supp, <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"OJ"</span> <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">=</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"before"</span>, <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"VC"</span> <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">=</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"after"</span>)) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb6-4">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">rename</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">anxiety =</span> len)</span>
<span id="cb6-5"><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">levels</span>(anxiety<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">$</span>time.point) <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">c</span>(<span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"before"</span>, <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"after"</span>)</span>
<span id="cb6-6"></span>
<span id="cb6-7"><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">my.t</span>(anxiety, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">iv =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"time.point"</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">dv =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"anxiety"</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">paired =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">TRUE</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb6-8">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">huxtable_print</span>() <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span>  </span>
<span id="cb6-9">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">set_align</span>(everywhere, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">value =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"center"</span>) </span></code></pre></div>
</details>
<div class="cell-output-display">
<table id="tab:unnamed-chunk-3" class="huxtable table table-sm table-striped small" data-quarto-postprocess="true">
<tbody>
<tr class="odd">
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: bold;">M_Before</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">M_After</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">SD_Before</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">SD_After</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">Mean_Difference</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">SE</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">CI_Lower</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">CI_Upper</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">t</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">df</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">p</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">Cohens_d</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">d_CI_Lower</td>
<td data-quarto-table-cell-role="th" style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: bold;">d_CI_Upper</td>
</tr>
<tr class="even">
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">20.7</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">17</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">6.61</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">8.27</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">3.7</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">1.93</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">-0.17</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">7.57</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">1.92</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">55.3</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">0.060</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">0.49</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">-0.02</td>
<td style="text-align: center; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">1.01</td>
</tr>
</tbody>
</table>


</div>
</div>
<p>The function can handle repeated-measures data. For example, say we had data from a study that looked to see whether anxiety decreases following a round of exercise. I have two columns in my dataset: anxiety score, and time.point (before or after exercise). This would call for a paired samples t-test.</p>
<p>All you have to do is tack on the <code>paired = TRUE</code> argument to <code>my.t</code>:</p>
<div class="cell">
<div class="cell-output-display">
<table id="tab:unnamed-chunk-4" class="huxtable table table-sm table-striped small" data-quarto-postprocess="true">
<caption>Comparing Anxiety Before and After Exercise </caption>
<tbody>
<tr class="odd">
<td data-quarto-table-cell-role="th" style="text-align: right; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: bold;">M_Before</td>
<td data-quarto-table-cell-role="th" style="text-align: right; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">M_After</td>
<td data-quarto-table-cell-role="th" style="text-align: right; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">SD_Before</td>
<td data-quarto-table-cell-role="th" style="text-align: right; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">SD_After</td>
<td data-quarto-table-cell-role="th" style="text-align: right; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">Mean_Difference</td>
<td data-quarto-table-cell-role="th" style="text-align: right; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">SE</td>
<td data-quarto-table-cell-role="th" style="text-align: right; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">CI_Lower</td>
<td data-quarto-table-cell-role="th" style="text-align: right; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">CI_Upper</td>
<td data-quarto-table-cell-role="th" style="text-align: right; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">t</td>
<td data-quarto-table-cell-role="th" style="text-align: right; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">df</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">p</td>
<td data-quarto-table-cell-role="th" style="text-align: right; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">Cohens_d</td>
<td data-quarto-table-cell-role="th" style="text-align: right; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">d_CI_Lower</td>
<td data-quarto-table-cell-role="th" style="text-align: right; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: bold;">d_CI_Upper</td>
</tr>
<tr class="even">
<td style="text-align: right; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">20.7</td>
<td style="text-align: right; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">17</td>
<td style="text-align: right; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">6.61</td>
<td style="text-align: right; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">8.27</td>
<td style="text-align: right; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">3.7</td>
<td style="text-align: right; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">1.93</td>
<td style="text-align: right; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">-0.17</td>
<td style="text-align: right; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">7.57</td>
<td style="text-align: right; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">1.92</td>
<td style="text-align: right; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">55.3</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">0.060</td>
<td style="text-align: right; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">0.49</td>
<td style="text-align: right; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">-0.02</td>
<td style="text-align: right; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">1.01</td>
</tr>
</tbody>
</table>


</div>
</div>
<p>Because the after group had a lower anxiety score than the before group, the mean difference and Cohen’s <img src="https://latex.codecogs.com/png.latex?d"> are positive. The reason is that the default behavior of the function is to subtract in the order of the level of the dv, which in this case is:</p>
<div class="cell">
<details>
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb7" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb7-1"><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">levels</span>(anxiety<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">$</span>time.point)</span></code></pre></div>
</details>
<div class="cell-output cell-output-stdout">
<pre><code>[1] "before" "after" </code></pre>
</div>
</div>
<p>In this case, the “before” time point is the first level, so the mean difference and Cohen’s <img src="https://latex.codecogs.com/png.latex?d"> is based on mean.before - mean.after. But this is an odd order if you’re trying to interpret the mean difference as the mean change in anxiety over time. If thinking that way, the mean difference is really the mean change, which was a decrease in anxiety, which means the mean difference should be negative. Just change the order of the levels:</p>
<div class="cell">
<details>
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb9" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb9-1"><span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># change order of levels</span></span>
<span id="cb9-2">anxiety<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">$</span>time.point <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">factor</span>(anxiety<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">$</span>time.point, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">levels =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">c</span>(<span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"after"</span>, <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"before"</span>))</span>
<span id="cb9-3"><span class="co" style="color: #5E5E5E;
background-color: null;
font-style: inherit;"># re-run t-test</span></span>
<span id="cb9-4"><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">my.t</span>(anxiety, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">iv =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"time.point"</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">dv =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"anxiety"</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">paired =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">TRUE</span>) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb9-5">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">huxtable_print</span>()  <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb9-6">  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">set_align</span>(everywhere, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">value =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"left"</span>) </span></code></pre></div>
</details>
<div class="cell-output-display">
<table id="tab:unnamed-chunk-6" class="huxtable table table-sm table-striped small" data-quarto-postprocess="true">
<tbody>
<tr class="odd">
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: bold;">M_After</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">M_Before</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">SD_After</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">SD_Before</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">Mean_Difference</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">SE</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">CI_Lower</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">CI_Upper</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">t</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">df</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">p</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">Cohens_d</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">d_CI_Lower</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: bold;">d_CI_Upper</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">17</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">20.7</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">8.27</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">6.61</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">-3.7</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">1.93</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">-7.57</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">0.17</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">-1.92</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">55.3</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">0.060</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">-0.49</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">-1.01</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">0.02</td>
</tr>
</tbody>
</table>


</div>
</div>
<div class="cell">
<div class="cell-output-display">
<table id="tab:unnamed-chunk-7" class="huxtable table table-sm table-striped small" data-quarto-postprocess="true">
<tbody>
<tr class="odd">
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: bold;">M_After</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">M_Before</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">SD_After</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">SD_Before</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">Mean_Difference</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">SE</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">CI_Lower</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">CI_Upper</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">t</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">df</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">p</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">Cohens_d</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: bold;">d_CI_Lower</td>
<td data-quarto-table-cell-role="th" style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: bold;">d_CI_Upper</td>
</tr>
<tr class="even">
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 0pt; font-weight: normal;">17</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">20.7</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">8.27</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">6.61</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">-3.7</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">1.93</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">-7.57</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">0.17</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">-1.92</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">55.3</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">0.060</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">-0.49</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 6pt 0.75pt 6pt; font-weight: normal;">-1.01</td>
<td style="text-align: left; vertical-align: top; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228); border-right-color: rgb(228, 228, 228); border-bottom-color: rgb(228, 228, 228); border-left-color: rgb(228, 228, 228); padding: 0.75pt 0pt 0.75pt 6pt; font-weight: normal;">0.02</td>
</tr>
</tbody>
</table>


</div>
</div>
<p>The mean difference and Cohen’s <img src="https://latex.codecogs.com/png.latex?d"> are now negative to reflect that anxiety decreased after exercise.</p>
</section>
</section>
<section id="full-function" class="level1">
<h1>Full Function</h1>
<div id="Function">

<p>Copy-and-paste this function to use it in your own <code>R</code> projects. You will be prompted to install the <code>tidyverse</code> and <code>psych</code> packages if you do not already have them. Click the Code drop-down below to show the full function:</p>
<div class="cell" data-evaluate="true" data-tbl-cap="Full Code for `my.t` Function">
<details>
<summary>Code</summary>
<div class="sourceCode cell-code" id="cb10" style="background: #f1f3f5;"><pre class="sourceCode r code-with-copy"><code class="sourceCode r"><span id="cb10-1">my.t <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> <span class="cf" style="color: #003B4F;
background-color: null;
font-weight: bold;
font-style: inherit;">function</span>(data, iv, dv, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">long =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">FALSE</span>, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">paired =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">FALSE</span>, ...) {</span>
<span id="cb10-2">    <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">require</span>(dplyr)</span>
<span id="cb10-3">    <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">require</span>(effectsize)</span>
<span id="cb10-4">    <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">require</span>(broom)</span>
<span id="cb10-5">    <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">require</span>(stringr)</span>
<span id="cb10-6">    means.SDs <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">suppressMessages</span>(</span>
<span id="cb10-7">      data <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span></span>
<span id="cb10-8">        <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">group_by_at</span>(iv) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span></span>
<span id="cb10-9">        <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">summarise</span>(</span>
<span id="cb10-10">          <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">mean =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">mean</span>(<span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">eval</span>(<span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">parse</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">text =</span> dv)), <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">na.rm =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">TRUE</span>),</span>
<span id="cb10-11">          <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">sd =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">sd</span>(<span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">eval</span>(<span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">parse</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">text =</span> dv)), <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">na.rm =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">TRUE</span>)) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span></span>
<span id="cb10-12">        <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">pivot_wider</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">names_from =</span> iv, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">values_from =</span>  <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">c</span>(<span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"mean"</span>, <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"sd"</span>), <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">names_sep =</span> <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"."</span>)</span>
<span id="cb10-13">    )</span>
<span id="cb10-14">    iv<span class="fl" style="color: #AD0000;
background-color: null;
font-style: inherit;">.2</span> <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> rlang<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">::</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">sym</span>(iv)</span>
<span id="cb10-15">    dv<span class="fl" style="color: #AD0000;
background-color: null;
font-style: inherit;">.2</span> <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> rlang<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">::</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">sym</span>(dv)</span>
<span id="cb10-16">    form <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">expr</span>(<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">!!</span> dv<span class="fl" style="color: #AD0000;
background-color: null;
font-style: inherit;">.2</span> <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">~</span> <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">!!</span> iv<span class="fl" style="color: #AD0000;
background-color: null;
font-style: inherit;">.2</span>)</span>
<span id="cb10-17">    t.tests <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">t.test</span>(<span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">eval</span>(form), data, <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">var.equal =</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">FALSE</span>, ...) </span>
<span id="cb10-18">    Ds <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">cohens_d</span>(<span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">eval</span>(form), <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">data =</span> data, ...) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> as.tibble</span>
<span id="cb10-19">    stats <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> t.tests <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> tidy</span>
<span id="cb10-20">    std.err <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> t.tests<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">$</span>stderr</span>
<span id="cb10-21">    cols <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">c</span>(<span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"conf.low"</span>, <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"conf.high"</span>, <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"statistic"</span>, <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"parameter"</span>, <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"p.value"</span>)</span>
<span id="cb10-22">    means.table <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">cbind</span>(means.SDs, stats[, <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"estimate"</span>], std.err, stats[, cols], <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">select</span>(Ds, <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">-</span>CI))</span>
<span id="cb10-23">    means.table <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> means.table <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span></span>
<span id="cb10-24">      <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">rename</span>(</span>
<span id="cb10-25">        <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Mean_Difference"</span> <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">=</span> estimate,</span>
<span id="cb10-26">        <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">SE =</span> std.err,</span>
<span id="cb10-27">        <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"CI_Lower"</span> <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">=</span> conf.low,</span>
<span id="cb10-28">        <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"CI_Upper"</span> <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">=</span> conf.high,</span>
<span id="cb10-29">        <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"t"</span> <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">=</span> statistic,</span>
<span id="cb10-30">        <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">df =</span> parameter,</span>
<span id="cb10-31">        <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">p =</span> p.value,</span>
<span id="cb10-32">        <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Cohens_d"</span> <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">=</span> Cohens_d,</span>
<span id="cb10-33">        <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"d_CI_Lower"</span> <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">=</span> CI_low,</span>
<span id="cb10-34">        <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"d_CI_Upper"</span> <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">=</span> CI_high</span>
<span id="cb10-35">      ) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span></span>
<span id="cb10-36">      <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">mutate</span>(<span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">across</span>(<span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">.cols =</span> <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">where</span>(is.numeric), round, <span class="dv" style="color: #AD0000;
background-color: null;
font-style: inherit;">2</span>), <span class="at" style="color: #657422;
background-color: null;
font-style: inherit;">p =</span> scales<span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">::</span><span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">pvalue</span>(p))</span>
<span id="cb10-37">    <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">rownames</span>(means.table) <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">NULL</span></span>
<span id="cb10-38">    <span class="cf" style="color: #003B4F;
background-color: null;
font-weight: bold;
font-style: inherit;">if</span>(paired <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">==</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">FALSE</span>) {</span>
<span id="cb10-39">      means.table <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> means.table <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span>  </span>
<span id="cb10-40">        <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">rename</span>(</span>
<span id="cb10-41">          <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"M_Group_1"</span> <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">=</span> mean<span class="fl" style="color: #AD0000;
background-color: null;
font-style: inherit;">.0</span>,</span>
<span id="cb10-42">          <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"M_Group_2"</span> <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">=</span> mean<span class="fl" style="color: #AD0000;
background-color: null;
font-style: inherit;">.1</span>,</span>
<span id="cb10-43">          <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"SD_Group_1"</span> <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">=</span> sd<span class="fl" style="color: #AD0000;
background-color: null;
font-style: inherit;">.0</span>,</span>
<span id="cb10-44">          <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"SD_Group_2"</span> <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">=</span> sd<span class="fl" style="color: #AD0000;
background-color: null;
font-style: inherit;">.1</span></span>
<span id="cb10-45">        )</span>
<span id="cb10-46">    } <span class="cf" style="color: #003B4F;
background-color: null;
font-weight: bold;
font-style: inherit;">else</span> {</span>
<span id="cb10-47">      means.table <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> means.table <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span></span>
<span id="cb10-48">         <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">rename</span>(</span>
<span id="cb10-49">          <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"M_Before"</span> <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">=</span> mean.before,</span>
<span id="cb10-50">          <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"M_After"</span> <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">=</span> mean.after,</span>
<span id="cb10-51">          <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"SD_Before"</span> <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">=</span> sd.before,</span>
<span id="cb10-52">          <span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"SD_After"</span> <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">=</span> sd.after </span>
<span id="cb10-53">        )</span>
<span id="cb10-54">    }</span>
<span id="cb10-55">    <span class="cf" style="color: #003B4F;
background-color: null;
font-weight: bold;
font-style: inherit;">if</span> (long <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">==</span> <span class="cn" style="color: #8f5902;
background-color: null;
font-style: inherit;">TRUE</span>) {</span>
<span id="cb10-56">      means.table.long <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">&lt;-</span> means.table <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb10-57">        t <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb10-58">        <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">data.frame</span>(<span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Value"</span> <span class="ot" style="color: #003B4F;
background-color: null;
font-style: inherit;">=</span> .) <span class="sc" style="color: #5E5E5E;
background-color: null;
font-style: inherit;">%&gt;%</span> </span>
<span id="cb10-59">        <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">rownames_to_column</span>(<span class="st" style="color: #20794D;
background-color: null;
font-style: inherit;">"Statistic"</span>) </span>
<span id="cb10-60">      <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">return</span>(means.table.long)</span>
<span id="cb10-61">    } <span class="cf" style="color: #003B4F;
background-color: null;
font-weight: bold;
font-style: inherit;">else</span>{ <span class="fu" style="color: #4758AB;
background-color: null;
font-style: inherit;">return</span>(means.table) }</span>
<span id="cb10-62">  }</span></code></pre></div>
</details>
</div>
</div></section>
<section id="references" class="level1">
<h1>References</h1>
<div id="refs" class="references csl-bib-body hanging-indent" data-line-spacing="2">
<div id="ref-cohen2013statistical" class="csl-entry">
Cohen, J. (1988). <em>Statistical power analysis for the behavioral sciences</em>. Routledge.
</div>
</div>


</section>

<div id="quarto-appendix" class="default"><section class="quarto-appendix-contents"><h2 class="anchored quarto-appendix-heading">Citation</h2><div><div class="quarto-appendix-secondary-label">BibTeX citation:</div><pre class="sourceCode code-with-copy quarto-appendix-bibtex"><code class="sourceCode bibtex">@online{e. vanaman2021,
  author = {E. Vanaman, Matthew},
  title = {Tidy {T-Test} in {R} {With} {Cohen’s} {D}},
  date = {2021-01-31},
  url = {https://matthewvanaman.com/posts/2021-02-05-tidy-t-test-in-r-with-cohen-s-d/},
  langid = {en}
}
</code></pre><div class="quarto-appendix-secondary-label">For attribution, please cite this work as:</div><div id="ref-e. vanaman2021" class="csl-entry quarto-appendix-citeas">
E. Vanaman, M. (2021, January 31). <em><a href="https://matthewvanaman.com/posts/2021-02-05-tidy-t-test-in-r-with-cohen-s-d/">Tidy
T-Test in R With Cohen’s D</a></em>.
</div></div></section></div> ]]></description>
  <category>efficiency</category>
  <category>functions</category>
  <guid>https://www.matthewvanaman.com/posts/2021-02-05-tidy-t-test-in-r-with-cohen-s-d/index_t_test.html</guid>
  <pubDate>Sun, 31 Jan 2021 06:00:00 GMT</pubDate>
  <media:content url="https://www.matthewvanaman.com/_site/imgs/jack_1.png" medium="image" type="image/png" height="192" width="144"/>
</item>
<item>
  <title></title>
  <link>https://www.matthewvanaman.com/about.html</link>
  <description><![CDATA[ 




<style>
    @font-face {
      font-family: 'Cormorant Garamond';
      src: url('fonts/CormorantGaramond-Regular.ttf') format('truetype');
    }
</style>
<center>
<figure class="figure">
<p>
<img alt="Many degrees of freedom." src="https://www.matthewvanaman.com/imgs/manydf.jpeg" class="img-fluid figure-img" style="border-radius: 2%; opacity:0.9; filter:grayscale(25%); max-width:100%; max-height:100%; margin:0px">
</p>
<figcaption class="figure-caption" style="margin: 15px 0px 0px 0px; color:#6e6e6e; font-family:Source Sans Pro;">
<i>Lynch, David. “Red Man does magic near his house”. 2013. Ink and pencil on paper. Kayne Griffin Corcoran.</i>
</figcaption>
</figure>
</center>
<hr style="border: none; color:#000000; background-color:#000000; height:1px; opacity:0.25; margin: 0px 0px 15px 0px">
<p><br><br></p>
<p>This page is a work in progress! <br><br><br></p>
<p>“Show, don’t tell”, as they say. Here is a collection of random stuff about me, a collection that keeps growing. <br><br><br></p>
<hr>
<p><br><br></p>
<section id="section" class="level1">
<h1></h1>
<div class="columns">
<div class="column" style="position:sticky;top:100px;">
<p style="font-size:25px; font-family: Cormorant Garamond; text-align:center">
In my senior year of high school, a friend told me I was boring. <a href="https://www.instagram.com/daniellesperandeoart/followers/mutualOnly?locale=Online%2Bentertainment%2C%2Breal%2Bperson%2C%2Belectronic%2Bchess%2Band%2Bcards%2C%2Blottery%2C%2Bsports%2C%2Bcomprehensive%2Breputation%2B(Telegram%3A%2B%40UUjd888888).rpgc&amp;hl=en" target="_blank">She</a> drew me this.
</p>
</div><div class="column" style="width:50%;">
<p><img style="width:100%; border-radius: 2%; opacity:0.9; filter:grayscale(25%);" src="https://www.matthewvanaman.com/_site/imgs/city.png"></p>
</div>
</div>
</section>
<section id="section-1" class="level1">
<h1></h1>
<div class="columns">
<div class="column" style="width:50%;">
<p style="font-family: Cormorant Garamond; font-size:20px;">
Fickle things, they are.<br> When left alone they will have your head,<br> a chorus, electrons; your soul, otherwise.<br><br> Little things, they are.<br> So small indeed to feel you so dead,<br> a longing; creating for more, unrealized.<br><br> Giant things, they are.<br> So mountainously to overwhelm,<br> a paradox, so subtle, so well disguised.<br><br> Quiet things, they are.<br> Ever sneaking, seeking to disclose<br> a secret that you hide because it is wild.<br><br> Gentle things, they are.<br> Leading you from comfort, not others,<br> a selfishness, makes you too selfless and mild.<br><br> Vile things, they are!<br> Away with them and find you some peace,<br> a quiet, no worries, like when you were a child.
</p>
</div><div class="column" style="position:sticky;top:100px;">
<p style="font-size:25px; font-family: Cormorant Garamond; text-align:center">
<i>These Things They Are</i>
</p>
</div>
</div>
</section>
<section id="section-2" class="level1">
<h1></h1>
<div class="columns">
<div class="column" style="position:sticky;top:100px;">
<p style="font-family: Cormorant Garamond; font-size:25px; text-align:center">
<i>Seconds</i>
</p>
</div><div class="column" style="width:50%;">
<p style="font-family: Cormorant Garamond; font-size:20px;">
I’ve got a problem.<br> Exponential<br> There is potential but it’s problematic. <br> Though emphatic: an attic<br> I’m an addict, an attic<br> an addict I say.<br> Right gets more wrong by the day.<br><br> Out go the candles out go the candles<br> out go the candles<br> Smoke rings strangling!<br> Large flames mangling<br> the stairs,<br> disappearing in pairs! fours!<br> Forget it, forgot.<br> Fret not.<br> Reform tomorrow.<br> Sorry Ms Morrow<br> SORRY Ms Morrow!<br> I’m late because I BORROW<br><br> Joy is a pain and clean is a stain.<br> It’s a catch-22 I can work my way through.<br> Happy holds a smile<br> and the truth is denial<br> A computer has a file<br> but a flame ain’t no game.<br><br> It’s awful, it’s fruitless<br> I’m absolutely truthless<br> I’m well aware<br> a flame ain’t no game<br> Evil’s my aim<br> forever the same<br>
</p>
</div>
</div>
</section>
<section id="section-3" class="level1">
<h1></h1>
<div class="columns">
<div class="column" style="width:50%;">
<figure class="figure">
<img style="width:100%; border-radius: 3%; opacity:0.9; filter:grayscale(25%);" src="https://www.matthewvanaman.com/_site/imgs/musical_1.png" class="figure-img">
<figcaption style="font-family: Cormorant Garamond; text-align:center;">
Don’t act so impressed — it was at the community college.
</figcaption>
</figure>
</div><div class="column" style="position:sticky;top:100px;">
<p style="font-size:25px; font-family: Cormorant Garamond; text-align:right;">
I was in a musical. My solo was Pinball Wizard. There was blood on my guitar.
</p>
</div>
</div>
</section>
<section id="section-4" class="level1">
<h1></h1>
<div class="columns">
<div class="column" style="position:sticky;top:100px;">
<p style="font-family: Cormorant Garamond; font-size:25px; text-align:center">
<i>Window</i>
</p>
</div><div class="column" style="width:50%;">
<p style="font-family: Cormorant Garamond; font-size:20px;">
She looks from the window,<br> Though miles away I can see the expression clearly on her face.<br> I stared at that window,<br> Wondering why I don’t dare stray from my gracefully occupied space.<br><br> A startling case,<br> Unclear motives, a star-spangled gaze<br> All the right laughs on all the wrong days.<br> A mouse in a maze,<br> Wandered in circles for seven days<br> At the Earle, I’ve too many stays.<br><br> She courts me through pardon,<br> Though curious still is the swallowing of the most bitter of pills.<br> We stand in the garden,<br> We would have embraced if only the two of us had twice of the wills.<br><br> My inhibition.<br> Systems broken, more than malfunction<br> Sparks fly away without solution.<br> I have young wisdom,<br> Eyes see through sorrowful pollution<br> Please hurry in, un-realization.<br>
</p>
</div>
</div>
</section>
<section id="section-5" class="level1">
<h1></h1>
<!-- It's pretty odd being in your early 30s living in New York City as a graduate student. People ask what you do for a living and you say, "I'm getting my PhD". She congratulates you on your accomplishment, he gives you that look that says, "well that would explain why this person is so pale". There's a general air of awkwardness, like you just hit a ski jump for the first time and you're wondering what the hell is going to happen when you land. Then the thought occurs to you that no one would give a shit about your educational accomplishments if they knew you were in your early 30s in New York City living off of < $30k a year after brute-forcing your way into a half-decade long emotionally unforgiving boot camp with questionable job prospects because you *wanted* to, apparently. Who does that? Don't they know that academia is an actual ponzi scheme? Is it weird that your cat is your best friend? Philosophically rich and profound though these questions may be, they have the real-time effect of producing a deer-in-headlights expression on your face in the 4 awkward seconds after hearing "congratulations" where you are trying to decipher whether this person is actually impressed by how legitimately difficult it is to get a PhD or is sort of muttering something positive in the hopes that she can safely avoid a protracted discussion covering all the most important nuances of your dissertation -->
<!-- Here some interesting (?) facts about me: -->
<!-- I used to race motocross, and we had a dirt bike track in our back yard. It was sweet indeed. Unfortunately my glory  -->
<!-- <a href="https://matthewevanaman.netlify.app/img/glory.jpg" target="blank"> -->
<!-- days </a>  -->
<!-- were swiftly absconded with by a severely broken leg requiring airlift out of my back yard via helicopter. I peaked too early, as they say, and have only been on a bike -->
<!-- <a href="https://matthewevanaman.netlify.app/img/bike.jpeg" target="blank"> -->
<!-- once </a>  -->
<!-- since. I still follow the sport closely, out of nostalgia and to maintain my blue-collar street cred among my ivory-tower colleagues.  -->
<!-- Although possessing many of the quintessential traits of the head-in-the-clouds academic, I was in two  -->
<!-- <a href="https://matthewevanaman.netlify.app/img/two.jpg" target="blank"> -->
<!-- college </a>  -->
<!-- <a href="https://matthewevanaman.netlify.app/img/musicals.jpg" target="blank"> -->
<!-- musicals </a>. -->
<!-- My solo was Pinball Wizard by The Who. For one moment, the light of the <a href="https://matthewevanaman.netlify.app/img/save_rock.jpg" target="blank"> -->
<!-- rock </a>  -->
<!-- gods was briefly shown upon me.  -->
<!-- It's all downhill from here, really. I  -->
<!-- <a href="https://matthewevanaman.netlify.app/img/definitely1.jpg" target="blank"> -->
<!-- definitely </a>, -->
<!-- <a href="https://matthewevanaman.netlify.app/img/definitely2.jpg" target="blank"> -->
<!-- definitely </a> -->
<!-- peaked too early. -->
<!-- I now find myself trapped with a -->
<!-- <a href="https://matthewevanaman.netlify.app/img/daytona.jpeg" target="blank"> -->
<!-- hipster </a>  -->
<!-- roommate who pays rent, eats for free, never cleans her bathroom, and needs. It hurts, how much she needs. And she's -->
<!-- <a href="https://matthewevanaman.netlify.app/img/hyper.mov" target="blank"> -->
<!-- hyperactive </a>  -->
<!-- with no -->
<!-- <a href="https://matthewevanaman.netlify.app/img/meet.jpeg" target="blank"> -->
<!-- regard </a>\ -->
<!-- for personal space. We're all having a good time (mostly her). -->
<!-- <figure class="figure"> -->
<!-- <p><img alt="This is unfortunate." src="./imgs/city.png" class="img-fluid figure-img" style="border-radius: 2%; opacity:0.9; filter:grayscale(25%); max-width:50%; max-height:50%"></p> -->
<!-- <p></p><figcaption class="figure-caption" style = "max-width:50%; max-height:50%"><i><a href="https://www.facebook.com/daniellesperandeoart/" target="blank">Sperandeo, Danielle </a>. “I have a city on my head”. Circa 2012. Pencil on paper. On my bedroom wall.<i></figcaption><p></p></figure> -->


</section>

 ]]></description>
  <guid>https://www.matthewvanaman.com/about.html</guid>
  <pubDate>Sun, 29 Sep 2024 18:36:59 GMT</pubDate>
</item>
<item>
  <title>Blog</title>
  <link>https://www.matthewvanaman.com/posts.html</link>
  <description><![CDATA[ 








<div class="quarto-listing quarto-listing-container-default" id="listing-listing">
<div class="list quarto-listing-default">
<div class="quarto-post image-right" data-index="0" data-categories="data-visualization,transparency,tips-and-tricks" data-listing-date-sort="1727413200000" data-listing-file-modified-sort="1727633632542" data-listing-date-modified-sort="1727633632000" data-listing-reading-time-sort="16" data-listing-word-count-sort="3028">
<div class="thumbnail">
<p><a href="./posts/never-be-random/index.html" class="no-external"></a></p><a href="./posts/never-be-random/index.html" class="no-external">
<p><img loading="lazy" src="https://www.matthewvanaman.com/_site/imgs/random.png" class="thumbnail-image"></p>
</a><p><a href="./posts/never-be-random/index.html" class="no-external"></a></p>
</div>
<div class="body">
<h3 class="no-anchor listing-title">
<a href="./posts/never-be-random/index.html" class="no-external">Visualization Tip: Never Be Random</a>
</h3>
<div class="listing-subtitle">
<a href="./posts/never-be-random/index.html" class="no-external"></a>
</div>
<div class="listing-categories">
<div class="listing-category" onclick="window.quartoListingCategory('data-visualization'); return false;">
data-visualization
</div>
<div class="listing-category" onclick="window.quartoListingCategory('transparency'); return false;">
transparency
</div>
<div class="listing-category" onclick="window.quartoListingCategory('tips-and-tricks'); return false;">
tips-and-tricks
</div>
</div>
<div class="listing-description">
<a href="./posts/never-be-random/index.html" class="no-external">See that person’s legs sticking out of that washing machine? That’s random. When it comes to data visualization, don’t be like that person. Don’t be random.</a>
</div>
</div>
<div class="metadata">
<a href="./posts/never-be-random/index.html" class="no-external">
<div class="listing-date">
Sep 27, 2024
</div>
<div class="listing-author">
Matthew E. Vanaman
</div>
</a>
</div>
</div>
<div class="quarto-post image-right" data-index="1" data-categories="professional-development" data-listing-date-sort="1621314000000" data-listing-file-modified-sort="1724816286467" data-listing-date-modified-sort="1724816286000" data-listing-reading-time-sort="74" data-listing-word-count-sort="14690">
<div class="thumbnail">
<p><a href="./posts/2021-05-18-crash-course-to-getting-into-a-phd-program-in-psychology/crash_course_PhD.html" class="no-external"></a></p><a href="./posts/2021-05-18-crash-course-to-getting-into-a-phd-program-in-psychology/crash_course_PhD.html" class="no-external">
<p><img loading="lazy" src="https://www.matthewvanaman.com/_site/imgs/jack_4.png" class="thumbnail-image"></p>
</a><p><a href="./posts/2021-05-18-crash-course-to-getting-into-a-phd-program-in-psychology/crash_course_PhD.html" class="no-external"></a></p>
</div>
<div class="body">
<h3 class="no-anchor listing-title">
<a href="./posts/2021-05-18-crash-course-to-getting-into-a-phd-program-in-psychology/crash_course_PhD.html" class="no-external">Applying to PhD Programs in Psychology: A Thorough and Honest Guide</a>
</h3>
<div class="listing-subtitle">
<a href="./posts/2021-05-18-crash-course-to-getting-into-a-phd-program-in-psychology/crash_course_PhD.html" class="no-external"></a>
</div>
<div class="listing-categories">
<div class="listing-category" onclick="window.quartoListingCategory('professional-development'); return false;">
professional-development
</div>
</div>
<div class="listing-description">
<a href="./posts/2021-05-18-crash-course-to-getting-into-a-phd-program-in-psychology/crash_course_PhD.html" class="no-external">Getting into a PhD program in psychology is not for the faint of heart. Think about it, then think again, and if you’re still convinced you want to do it, consult this guide.</a>
</div>
</div>
<div class="metadata">
<a href="./posts/2021-05-18-crash-course-to-getting-into-a-phd-program-in-psychology/crash_course_PhD.html" class="no-external">
<div class="listing-date">
May 18, 2021
</div>
<div class="listing-author">
Matthew E. Vanaman
</div>
</a>
</div>
</div>
<div class="quarto-post image-right" data-index="2" data-categories="collaboration,reproducibility,transparency" data-listing-date-sort="1616821200000" data-listing-file-modified-sort="1689788777476" data-listing-date-modified-sort="1689788777000" data-listing-reading-time-sort="10" data-listing-word-count-sort="1879">
<div class="thumbnail">
<p><a href="./posts/2021-03-17-extremely-simple-guide-to-collaborative-writing-between-r-markdown-and-google-docs-users/collab_writing.html" class="no-external"></a></p><a href="./posts/2021-03-17-extremely-simple-guide-to-collaborative-writing-between-r-markdown-and-google-docs-users/collab_writing.html" class="no-external">
<p><img loading="lazy" src="https://www.matthewvanaman.com/_site/imgs/jack_3.png" class="thumbnail-image"></p>
</a><p><a href="./posts/2021-03-17-extremely-simple-guide-to-collaborative-writing-between-r-markdown-and-google-docs-users/collab_writing.html" class="no-external"></a></p>
</div>
<div class="body">
<h3 class="no-anchor listing-title">
<a href="./posts/2021-03-17-extremely-simple-guide-to-collaborative-writing-between-r-markdown-and-google-docs-users/collab_writing.html" class="no-external">Collaborative Writing With R and Google Docs: Easier Than You Think</a>
</h3>
<div class="listing-subtitle">
<a href="./posts/2021-03-17-extremely-simple-guide-to-collaborative-writing-between-r-markdown-and-google-docs-users/collab_writing.html" class="no-external"></a>
</div>
<div class="listing-categories">
<div class="listing-category" onclick="window.quartoListingCategory('collaboration'); return false;">
collaboration
</div>
<div class="listing-category" onclick="window.quartoListingCategory('reproducibility'); return false;">
reproducibility
</div>
<div class="listing-category" onclick="window.quartoListingCategory('transparency'); return false;">
transparency
</div>
</div>
<div class="listing-description">
<a href="./posts/2021-03-17-extremely-simple-guide-to-collaborative-writing-between-r-markdown-and-google-docs-users/collab_writing.html" class="no-external">Writing in R Markdown (or Quarto, if you’ve made the switch) has a lot of benefits, but comes with a learning curve that might not feel worth it to your collaborators. But who said you can’t do both?</a>
</div>
</div>
<div class="metadata">
<a href="./posts/2021-03-17-extremely-simple-guide-to-collaborative-writing-between-r-markdown-and-google-docs-users/collab_writing.html" class="no-external">
<div class="listing-date">
Mar 27, 2021
</div>
<div class="listing-author">
Matthew E. Vanaman
</div>
</a>
</div>
</div>
<div class="quarto-post image-right" data-index="3" data-categories="efficiency,functions" data-listing-date-sort="1612591200000" data-listing-file-modified-sort="1689788777474" data-listing-date-modified-sort="1689788777000" data-listing-reading-time-sort="16" data-listing-word-count-sort="3135">
<div class="thumbnail">
<p><a href="./posts/2021-02-06-tidy-fisher-s-exact-test-in-r/index_fisher.html" class="no-external"></a></p><a href="./posts/2021-02-06-tidy-fisher-s-exact-test-in-r/index_fisher.html" class="no-external">
<p><img loading="lazy" src="https://www.matthewvanaman.com/_site/imgs/jack_2.png" class="thumbnail-image"></p>
</a><p><a href="./posts/2021-02-06-tidy-fisher-s-exact-test-in-r/index_fisher.html" class="no-external"></a></p>
</div>
<div class="body">
<h3 class="no-anchor listing-title">
<a href="./posts/2021-02-06-tidy-fisher-s-exact-test-in-r/index_fisher.html" class="no-external">Tidy Fisher’s Exact Test In R (And Why To Always Use It)</a>
</h3>
<div class="listing-subtitle">
<a href="./posts/2021-02-06-tidy-fisher-s-exact-test-in-r/index_fisher.html" class="no-external"></a>
</div>
<div class="listing-categories">
<div class="listing-category" onclick="window.quartoListingCategory('efficiency'); return false;">
efficiency
</div>
<div class="listing-category" onclick="window.quartoListingCategory('functions'); return false;">
functions
</div>
</div>
<div class="listing-description">
<a href="./posts/2021-02-06-tidy-fisher-s-exact-test-in-r/index_fisher.html" class="no-external">Another dry-run of my blog, and a useful - if still pedestrian - <em>R</em> function I wrote: this time to make <img src="https://latex.codecogs.com/png.latex?%5Cchi%5E2"> output more informative.</a>
</div>
</div>
<div class="metadata">
<a href="./posts/2021-02-06-tidy-fisher-s-exact-test-in-r/index_fisher.html" class="no-external">
<div class="listing-date">
Feb 6, 2021
</div>
<div class="listing-author">
Matthew E. Vanaman
</div>
</a>
</div>
</div>
<div class="quarto-post image-right" data-index="4" data-categories="efficiency,functions" data-listing-date-sort="1612072800000" data-listing-file-modified-sort="1689788777473" data-listing-date-modified-sort="1689788777000" data-listing-reading-time-sort="15" data-listing-word-count-sort="2822">
<div class="thumbnail">
<p><a href="./posts/2021-02-05-tidy-t-test-in-r-with-cohen-s-d/index_t_test.html" class="no-external"></a></p><a href="./posts/2021-02-05-tidy-t-test-in-r-with-cohen-s-d/index_t_test.html" class="no-external">
<p><img loading="lazy" src="https://www.matthewvanaman.com/_site/imgs/jack_1.png" class="thumbnail-image"></p>
</a><p><a href="./posts/2021-02-05-tidy-t-test-in-r-with-cohen-s-d/index_t_test.html" class="no-external"></a></p>
</div>
<div class="body">
<h3 class="no-anchor listing-title">
<a href="./posts/2021-02-05-tidy-t-test-in-r-with-cohen-s-d/index_t_test.html" class="no-external">Tidy T-Test in R With Cohen’s D</a>
</h3>
<div class="listing-subtitle">
<a href="./posts/2021-02-05-tidy-t-test-in-r-with-cohen-s-d/index_t_test.html" class="no-external"></a>
</div>
<div class="listing-categories">
<div class="listing-category" onclick="window.quartoListingCategory('efficiency'); return false;">
efficiency
</div>
<div class="listing-category" onclick="window.quartoListingCategory('functions'); return false;">
functions
</div>
</div>
<div class="listing-description">
<a href="./posts/2021-02-05-tidy-t-test-in-r-with-cohen-s-d/index_t_test.html" class="no-external">A dry-run of my blog - and a useful (if pedestrian) <em>r</em> function I’ve written to make <em>t</em>-test output more informative.</a>
</div>
</div>
<div class="metadata">
<a href="./posts/2021-02-05-tidy-t-test-in-r-with-cohen-s-d/index_t_test.html" class="no-external">
<div class="listing-date">
Jan 31, 2021
</div>
<div class="listing-author">
Matthew E. Vanaman
</div>
</a>
</div>
</div>
</div>
<div class="listing-no-matching d-none">
No matching items
</div>
</div> ]]></description>
  <guid>https://www.matthewvanaman.com/posts.html</guid>
  <pubDate>Sun, 29 Sep 2024 18:36:59 GMT</pubDate>
</item>
<item>
  <title></title>
  <link>https://www.matthewvanaman.com/teaching.html</link>
  <description><![CDATA[ 




<!-- README: the r chunk creates tables. then there are individual r chunks under each heading, rendered with kableExtra. There are 2 IDs: one ID links a section heading to the TOC. for example, #QR shows up both in the TOC and next to the actual heading. However, #qr shows up next to the r chunk that renders the table, and also in the html code that creates the button. Importantly, the TOC/heading and table/html ID labels need to be different from each other, or else the section disappears when you click the button. -->
<center>
<figure class="figure">
<p>
<img alt="Truth bombs being dropped left and right." src="https://www.matthewvanaman.com/imgs/athens.png" class="img-fluid figure-img" style="border-radius: 2%; opacity:0.9; filter:grayscale(25%); max-width:100%; max-height:100%; margin:0px">
</p>
<figcaption class="figure-caption" style="margin: 15px 0px 0px 0px; color:#6e6e6e; font-family:Source Sans Pro;">
<i>Raphael. “The school of athens”. Circa 1510. Fresca. Stanze di Raffaello, in the Apostolic Palace in the Vatican.</i>
</figcaption>
</figure>
</center>
<hr style="border: none; color:#000000; background-color:#000000; height:1px; opacity:0.25; margin: 0px 0px 15px 0px">
<center>
<style>
@import url(https://pro.fontawesome.com/releases/v5.10.0/css/all.css);
@import url(https://cdn.rawgit.com/jpswalsh/academicons/master/css/academicons.min.css);
.button {
  border: none;
  color: white;
  font-style: oblique;
  padding: none;
  text-align: center;
  text-decoration: none;
  display: inline-block;
  font-size: 16px;
  margin-top: 0px;
  margin-bottom: 10px;
  margin-right: 0px;
  margin-left: 0px;
  transition-duration: 1s;
  cursor: pointer;
}

.button1 {
  background-color: white; 
  color: #6e6e6e; 
  border: none;
}

.button1:hover {
  background-color: #7984a0;
  color: white;
}

</style>
<!-- <button class="button button1" onclick="window.open('https://writingcenter.commons.gc.cuny.edu/people/','_blank')" -->
<!-- type="button" ><i class="far fa-analytics" style = "font-size: 30px; margin: 0px 0px 0px 0px;"></i> -->

<p><br><button onclick="window.open('https://www.matthewvanaman.com/PDFs/Vanaman_Teaching_Statement.pdf','_blank')" type="button" class="button button1"> View Teaching Philosophy </button><button onclick="window.open('https://www.matthewvanaman.com/PDFs/Vanaman_Diversity_Statement.pdf','_blank')" type="button" class="button button1"> View Diversity Statement </button></p>
</center>
<p>My experience as a teacher has been varied, and ranges from mentorship toward individual students to classroom lectureship. I have included here an overview of my experience along with interesting background information on the position, where relevant. You can view my student and faculty-peer evaluations where they available. I am still trying to figure out what exactly what I want this page to be but I hope that you find this information useful and/or interesting!</p>
<p>Note: positions are listed in reverse-chronological order.</p>
<section id="Feedback" class="level1">
<h1>Faculty and Student Feedback and Evaluations</h1>
<section id="mentorship-beyond-the-classroom" class="level3">
<h3 class="anchored" data-anchor-id="mentorship-beyond-the-classroom">Mentorship Beyond the Classroom</h3>
<section id="fall-2017---spring-2023" class="level4">
<h4 class="anchored" data-anchor-id="fall-2017---spring-2023">Fall 2017 - Spring 2023</h4>
<ul>
<li><button class="button button1" type="button" onclick="if(document.getElementById('mentor') .style.display=='none') {document.getElementById('mentor') .style.display=''} else{document.getElementById('mentor') .style.display='none'}">
View Student Feedback
</button></li>
</ul>
<div id="mentor" style="display:none">
<div class="cell">
<div class="cell-output-display">
<table class="huxtable" data-quarto-disable-processing="true" style="border-collapse: collapse; border: 0px; margin-bottom: 2em; margin-top: 2em; width: 100%; margin-left: 0%; margin-right: auto;  " id="tab:mentor"><caption><p>Select student feedback from students whom I have mentored outside of
the classroom. Original name- and address-redacted emails available upon
request. Slightly edited for grammar.</p></caption>
<colgroup><col><col></colgroup><tbody><tr>
<th style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: bold;">Source</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: bold;">Feedback</th></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">Direct Email Feedback</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">“I had a lot of fun learning these past few weeks.”</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">Direct Email Feedback</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">“I hope you are doing well and having an amazing week!!! I just wanted to say thank you sooooo much for everything you have done for me! Especially the letter of recommendation that you wrote for me on short notice! I’m truly grateful and if you ever need anything, please let me know!! As for my future plans, I have decided to attend [PhD program in Clinical Psychology]!”</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">Direct Email Feedback</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">“It's been quite a while and I hope that you are doing well...This is [student name] from the SURGE program at Brooklyn College. You wrote me a recommendation letter earlier this year...I must say that you are a great mentor and you've given me excellent advice for approaching recommendations, etc. I really appreciate all that you've done for me and I wish you all the best.”'</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">Direct Email Feedback</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">“AHHH JUST GOT MY ACCEPTANCE !!!!! [to a PhD program in developmental psychology] Thank you so much! I truly appreciate all the help and guidance you’ve given me!”</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">Direct Email Feedback</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">“Thanks for getting back to me, and thanks for being so generous with your time and knowledge! Your guide to applying to grad schools is impressive. It’s so thorough and comprehensive.”</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">Direct Email Feedback (From a Faculty Supervisor)</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">“Matt, this is a wonderful letter [of recommendation]. Much more descriptive and complete than many written by experienced (jaded?) senior faculty...What is terrific about your letter is that you give specific examples of behavior that justify your generalizations about [the student], which is not always something people do because it takes more time to think about these. But your letter is full of specifics which makes it very useful to the people reading it. This shows real consideration of [student]’s positive characteristics, and again, I underscore how much better it is that you illustrated these generalizations with specific examples. Many letters are mostly fluff, full of positive adjectives without much substance. Yours is excellent in that regard. This is your letter (and I see no reason for me to counter-sign it, given what a good job you have done), and feel free to modify any of my edits, but I thank you very for doing this so conscientiously.”</td></tr>
</tbody></table>

</div>
</div>
</div>
<hr style="border: none; color:#000000; background-color:#000000; height:1px; opacity:0.25">
</section>
</section>
<section id="quantitative-reasoning-fellowship-fall-2021---present" class="level3">
<h3 class="anchored" data-anchor-id="quantitative-reasoning-fellowship-fall-2021---present">Quantitative Reasoning Fellowship (Fall 2021 - Present)</h3>
<p>At the CUNY School for Labor and Urban Studies Learning Center.</p>
<ul>
<li>
<button class="button button1" type="button" onclick="if(document.getElementById('qr') .style.display=='none') {document.getElementById('qr') .style.display=''} else{document.getElementById('qr') .style.display='none'}">
View Student Feedback
</button>
<div id="qr" style="display:none">
<div class="cell">
<div class="cell-output-display">
<table class="huxtable" data-quarto-disable-processing="true" style="border-collapse: collapse; border: 0px; margin-bottom: 2em; margin-top: 2em; width: 100%; margin-left: 0%; margin-right: auto;  " id="tab:qr-feedback"><caption><p>Select Student Feedback, Quantitative Reasoning Consultation</p></caption>
<colgroup><col><col></colgroup><tbody><tr>
<th style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: bold;">Source</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: bold;">Feedback</th></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">Direct Email Feedback</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">“Thank you for your tutoring this semester. It was very extremely helpful. You helped me to understand this new language of statistics better than the book and the class. Honestly, I don’t think I would have gotten this far without your insights and knowledge...Thanks again!!!”</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">Direct Email Feedback</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">"Thank you! I appreciate your help. You were very helpful."</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">Direct Email Feedback</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">“Just saying thank you very much for your kind help with my Statistics learning. I got a grade A and I am very happy with the result. It was due to your kind help and teaching. I am grateful to you. I was very nervous about it, but [statistics] turned out to be my favorite subject now. I am learning all over again since I want to have a crystal clear understanding of the subject. Once again thank you so much.”</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">Direct Email Feedback</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">“I am learning more about Statistics now after I got good marks. It gave me great inspiration and I like the subject very much.”</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">Direct Email Feedback</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">“I just wanted to thank you for helping me with my assignments for [my] class. I got a B as my grade for the class and I wouldn't have earned it without your help. I really appreciate it. Have a nice summer. “</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">Forwarded Email Feedback</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">"Matthew was great!"</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">Forwarded Email Feedback</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">"I was able to attend the workshop on Surveys this past Saturday and it was very informative and helpful.  Matthew did an amazing job presenting.  Glad I was able to take advantage of this session."</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">Forwarded Email Feedback</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">"Matthew was very knowledgeable and helpful. I would recommend him to anyone involved in QR research."</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">Anonymous Survey Comment</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">"I want the other students to know that my experience at SLU [Learning] Hub is always exceptional, Matthew is very knowledgeable and we have been working together the entire semester. I have learned a lot from Matthew and I am grateful for Matthew’s dedication."</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">Anonymous Survey Comment</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">"The meeting with Matthew was very helpful and informative. He was very knowledgeable regarding the subject matter. He also reinforced techniques that were taught in class."</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">Anonymous Survey Comment</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">“This was a very productive session that gave me insight into how to code and analyze Data input into Dedoose and coding it.”</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">Anonymous Survey Comment</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">“This [workshop was] an eye-opener and detailed way of knowing the best approach to Quantitative reasoning.”</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">Anonymous Survey Comment</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">"[Matthew] is a great resource for students that need help with their class assignments and final project. And also students that need that extra boost.”</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">Anonymous Survey Comment</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">“[Matthew’s] as good as advertised.”</td></tr>
</tbody></table>

</div>
</div>
</div>
</li>
<li>
<button class="button button1" type="button" onclick="window.open('https://matthewevanaman.netlify.app//PDFs/QR_eval_21_22.jpg','_blank')">
View 2021-2022 Supervisor Evaluation
</button>
</li>
<li>
<button class="button button1" type="button" onclick="window.open('https://matthewevanaman.netlify.app//PDFs/QR_eval_20_21.jpg','_blank')">
View 2020-2021 Supervisor Evaluation
</button>
</li>
</ul>
<hr style="border: none; color:#000000; background-color:#000000; height:1px; opacity:0.25">
</section>
<section id="brooklyn-college" class="level3">
<h3 class="anchored" data-anchor-id="brooklyn-college">Brooklyn College</h3>
<section id="case-center-for-academic-and-scientific-excellence-summer-2021-2022" class="level4">
<h4 class="anchored" data-anchor-id="case-center-for-academic-and-scientific-excellence-summer-2021-2022">CASE (Center for Academic and Scientific Excellence; Summer 2021-2022)</h4>
<ul>
<li>
<button class="button button1" type="button" onclick="if(document.getElementById('summer21') .style.display=='none') {document.getElementById('summer21') .style.display=''} else{document.getElementById('summer21') .style.display='none'}">
View Student Feedback
</button>
<div id="summer21" style="display:none">
<div class="cell">
<div class="cell-output-display">
<table class="huxtable" data-quarto-disable-processing="true" style="border-collapse: collapse; border: 0px; margin-bottom: 2em; margin-top: 2em; width: 100%; margin-left: 0%; margin-right: auto;  " id="tab:surge-feedback"><caption><p>Select Student Feedback, CASE</p></caption>
<colgroup><col><col></colgroup><tbody><tr>
<th style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: bold;">Question</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: bold;">Response</th></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">What was your favorite thing about the coding class?</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">"My favorite thing was that Matthew (our instructer) explained everything well. He always made us practice our coding and he was always patient with our questions."</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;"></td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">"I liked how we learned about each command in-depth rather than just learning to copy and paste the lines of code an exact way, because it gave us a deeper understanding of exactly what we were doing and why."</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">What is one thing that could be improved about the coding class?</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">"To be honest, the coding class was great."</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">Overall, what was your favorite part of the program?</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">"Coding was my favorite part because it was really engaging."</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;"></td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">"I think my favourite part of the program was the coding class, because I learned a lot about coding and it helped remind me why I found coding enjoyable when I first started."</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">Other comments about the program</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">"It was a learning experience and I enjoyed every second."</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;"></td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">"It was very fun and all the instructors and staff were welcoming and accommodating to our needs. Thank you!"</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;"></td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">"I absolutely loved the program. It really gave me a sense of security because I know that I’ll have amazing people helping me throughout my years at Brooklyn College. Thank you!"</td></tr>
</tbody></table>

</div>
</div>
</div>
</li>
<li>
<button class="button button1" type="button" onclick="window.open('https://www.matthewvanaman.com/PDFs/surge_evals.pdf','_blank')">
View Student Evaluations
</button>
</li>
</ul>
</section>
<section id="graduate-course-in-r-statistical-programming-spring-2020" class="level4">
<h4 class="anchored" data-anchor-id="graduate-course-in-r-statistical-programming-spring-2020">Graduate Course in R Statistical Programming (Spring 2020)</h4>
<ul>
<li><button class="button button1" type="button" onclick="if(document.getElementById('spring20') .style.display=='none') {document.getElementById('spring20') .style.display=''} else{document.getElementById('spring20') .style.display='none'}">
View Student Feedback
</button></li>
</ul>
<div id="spring20" style="display:none">
<div id="tbl-anonymous-9245301" class="cell anchored">
<div class="cell-output-display">
<table class="huxtable" data-quarto-disable-processing="true" style="border-collapse: collapse; border: 0px; margin-bottom: 2em; margin-top: 2em; width: 100%; margin-left: 0%; margin-right: auto;  " id="tab:email-feedback"><caption><p>Students are numerically coded to protect their confidentiality.
There were 7 students in the course; the one student missing from this
table later emailed me to ask for mentorship beyond the course.</p> {#tbl-anonymous-9245301-1}</caption>
<colgroup><col><col></colgroup><tbody><tr>
<th style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: bold;">Student (Coded)</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: bold;">Feedback</th></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">1</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">"Thank you Mathew for being patient and encouraging this semester!"</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">2</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">"Also, thanks I definitely learned a lot from this class this semester and definitely will continue working with R!"</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">3</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">"I've learned a lot this semester. It was pleasure being in your class. [It] was very [helpful] information, interesting and fun. Thank you very much.</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">4</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">"Thank you for a great semester! You are truly informative and very helpful about this stuff and I feel like I actually learned something...I feel proud of myself and I thank you for that!"</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">5</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">"I ... want to say thank you so much for all the help this semester. You taught us so much and so well, I really enjoyed your class and your teaching style! I hope you don't mind if I stay in touch with you!"</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">6</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">"Thank you again for being a great teacher this semester, I have learned a lot and feel more confident in analyzing data."</td></tr>
</tbody></table>

</div>
<p>Student Feedback, Statistical Programming (Spring 2020)</p>
</div>
</div>
</section>
<section id="statistical-methods-in-psychological-research-lab-summer-2019" class="level4">
<h4 class="anchored" data-anchor-id="statistical-methods-in-psychological-research-lab-summer-2019">Statistical Methods in Psychological Research Lab (Summer 2019)</h4>
<p>Brooklyn College does not collect student evaluations or conduct faculty evaluations for Summer courses.</p>
</section>
<section id="statistical-methods-in-psychological-research-lab-spring-2019" class="level4">
<h4 class="anchored" data-anchor-id="statistical-methods-in-psychological-research-lab-spring-2019">Statistical Methods in Psychological Research Lab (Spring 2019)</h4>
<ul>
<li>
<button class="button button1" type="button" onclick="if(document.getElementById('spring19') .style.display=='none') {document.getElementById('spring19') .style.display=''} else{document.getElementById('spring19') .style.display='none'}">
View Student Evaluations
</button>
<div id="spring19" style="display:none">
<div class="cell">
<div class="cell-output-display">
<table class="huxtable" data-quarto-disable-processing="true" style="border-collapse: collapse; border: 0px; margin-bottom: 2em; margin-top: 2em; width: 100%; margin-left: 0%; margin-right: auto;  " id="tab:unnamed-chunk-2">
<colgroup><col><col><col><col></colgroup><tbody><tr>
<th style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: bold;">Question</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Yes</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">No</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: bold;">Responses</th></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">1.&nbsp;Did you receive a written syllabus during the first week of class?</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">93%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">7%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">15</td></tr>
</tbody></table>

</div>
<div class="cell-output-display">
<table class="huxtable" data-quarto-disable-processing="true" style="border-collapse: collapse; border: 0px; margin-bottom: 2em; margin-top: 2em; width: 100%; margin-left: 0%; margin-right: auto;  " id="tab:unnamed-chunk-2">
<colgroup><col><col><col><col><col><col><col><col></colgroup><tbody><tr>
<th style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: bold;">Question</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Excellent</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Good</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Fair</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Poor</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Unacceptable</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Not applicable</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: bold;">Responses</th></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">2.&nbsp;The instructor's ability to organize ideas and materials for class</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">31%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">27%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">23%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">15%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">26</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">3.&nbsp;The instructor's ability to stimulate interest in the subject</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">24%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">36%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">24%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">12%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">25</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">4.&nbsp;The instructor's ability to encourage independent thinking</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">28%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">32%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">28%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">8%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">25</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">5.&nbsp;The instructor's ability to generate effective class discussion</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">28%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">36%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">20%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">12%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">25</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">6.&nbsp;The instructor's ability to communicate clearly</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">28%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">32%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">24%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">8%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">8%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">25</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">7.&nbsp;The instructor's openness to students' comments, questions and viewpoints concerning class topics</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">44%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">36%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">12%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">25</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">8.&nbsp;The instructor's knowledge of the subject matter of the class</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">24%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">36%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">20%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">16%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">25</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">9.&nbsp;The instructor's ability to keep to the time and schedule requirements for the class</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">48%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">32%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">12%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">25</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">10.&nbsp;The instructor's availability to students outside of class</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">32%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">36%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">24%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">25</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">11.&nbsp;The clarity of information provided about the course requirements and assignments</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">36%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">28%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">24%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">8%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">25</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">12.&nbsp;The promptness with which tests and assignments are graded and returned</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">20%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">36%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">20%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">20%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">25</td></tr>
</tbody></table>

</div>
<div class="cell-output-display">
<table class="huxtable" data-quarto-disable-processing="true" style="border-collapse: collapse; border: 0px; margin-bottom: 2em; margin-top: 2em; width: 100%; margin-left: 0%; margin-right: auto;  " id="tab:unnamed-chunk-2">
<colgroup><col><col><col><col><col><col></colgroup><tbody><tr>
<th style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: bold;">Question</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Too Many</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Just Right</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Too few</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Not Applicable</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: bold;">Responses</th></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">13.&nbsp;The number of assignments/projects/creative works in this class</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">16%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">72%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">8%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">25</td></tr>
</tbody></table>

</div>
<div class="cell-output-display">
<table class="huxtable" data-quarto-disable-processing="true" style="border-collapse: collapse; border: 0px; margin-bottom: 2em; margin-top: 2em; width: 100%; margin-left: 0%; margin-right: auto;  " id="tab:unnamed-chunk-2">
<colgroup><col><col><col><col><col><col><col></colgroup><tbody><tr>
<th style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: bold;">Question</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Very Challenging</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Challenging</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Somewhat Challenging</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Not Challenging</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Not Applicable</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: bold;">Responses</th></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">14.&nbsp;How challenging the class assignments/projects/creative works were</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">16%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">44%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">28%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">8%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">25</td></tr>
</tbody></table>

</div>
<div class="cell-output-display">
<table class="huxtable" data-quarto-disable-processing="true" style="border-collapse: collapse; border: 0px; margin-bottom: 2em; margin-top: 2em; width: 100%; margin-left: 0%; margin-right: auto;  " id="tab:unnamed-chunk-2">
<colgroup><col><col><col><col><col><col><col></colgroup><tbody><tr>
<th style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: bold;">Question</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Very useful</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Useful</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Somewhat Useful</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Not Useful</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Not Applicable</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: bold;">Responses</th></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">15.&nbsp;The usefulness of assignments/projects/creative works in this class</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">24%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">48%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">16%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">8%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">25</td></tr>
</tbody></table>

</div>
<div class="cell-output-display">
<table class="huxtable" data-quarto-disable-processing="true" style="border-collapse: collapse; border: 0px; margin-bottom: 2em; margin-top: 2em; width: 100%; margin-left: 0%; margin-right: auto;  " id="tab:unnamed-chunk-2">
<colgroup><col><col><col><col><col><col><col></colgroup><tbody><tr>
<th style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: bold;">Question</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Very Difficult</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Difficult</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Somewhat Difficult</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Not Difficult</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Not Applicable</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: bold;">Responses</th></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">16.&nbsp;The difficulty of examinations in this class</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">44%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">8%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">44%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">25</td></tr>
</tbody></table>

</div>
<div class="cell-output-display">
<table class="huxtable" data-quarto-disable-processing="true" style="border-collapse: collapse; border: 0px; margin-bottom: 2em; margin-top: 2em; width: 100%; margin-left: 0%; margin-right: auto;  " id="tab:unnamed-chunk-2">
<colgroup><col><col><col><col><col><col><col></colgroup><tbody><tr>
<th style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: bold;">Question</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Very Fair</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Fair</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Somewhat Unfair</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Unfair</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Not Applicable</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: bold;">Responses</th></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">17.&nbsp;The fairness of examinations in this class</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">24%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">28%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">8%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">40%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">25</td></tr>
</tbody></table>

</div>
<div class="cell-output-display">
<table class="huxtable" data-quarto-disable-processing="true" style="border-collapse: collapse; border: 0px; margin-bottom: 2em; margin-top: 2em; width: 100%; margin-left: 0%; margin-right: auto;  " id="tab:unnamed-chunk-2">
<colgroup><col><col><col><col><col><col><col><col></colgroup><tbody><tr>
<th style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: bold;">Question</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">A Lot</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">A Fair amount</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Some</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">A Little</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Hardly Anything</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Not Applicable</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: bold;">Responses</th></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">19.&nbsp;How much general knowledge about the subject have you gained?</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">36%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">20%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">20%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">20%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">25</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">20.&nbsp;How much ability to analyze and solve problems have you gained?</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">36%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">16%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">24%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">20%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">25</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">21.&nbsp;How much ability to find and use information on your own have you gained?</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">32%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">28%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">12%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">24%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">25</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">22.&nbsp;How much ability to express your ideas verbally have you gained from this class?</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">28%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">20%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">20%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">20%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">8%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">25</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">23.&nbsp;How much ability to develop and express your ideas through artistic/creative means have you gained from this class?</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">24%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">20%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">12%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">24%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">16%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">25</td></tr>
</tbody></table>

</div>
<p>Student Evaluations, Statistics Lab (Spring 2019)</p>
</div>
</div>
</li>
<li>
<button class="button button1" type="button" onclick="window.open('https://matthewevanaman.netlify.app//PDFs/eval_spring19.pdf','_blank')">
View Faculty Evaluation
</button>
</li>
</ul>
</section>
<section id="statistical-methods-in-psychological-research-lab-fall-2018" class="level4">
<h4 class="anchored" data-anchor-id="statistical-methods-in-psychological-research-lab-fall-2018">Statistical Methods in Psychological Research Lab (Fall 2018)</h4>
<ul>
<li>
<button class="button button1" type="button" onclick="if(document.getElementById('fall18') .style.display=='none') {document.getElementById('fall18') .style.display=''} else{document.getElementById('fall18') .style.display='none'}">
View Student Evaluations
</button>
<div id="fall18" style="display:none">
<div class="cell">
<div class="cell-output-display">
<table class="huxtable" data-quarto-disable-processing="true" style="border-collapse: collapse; border: 0px; margin-bottom: 2em; margin-top: 2em; width: 100%; margin-left: 0%; margin-right: auto;  " id="tab:unnamed-chunk-3">
<colgroup><col><col><col><col></colgroup><tbody><tr>
<th style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: bold;">Question</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Yes</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">No</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: bold;">Responses</th></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">1.&nbsp;Did you receive a written syllabus during the first week of class?</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">88%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">12%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">16</td></tr>
</tbody></table>

</div>
<div class="cell-output-display">
<table class="huxtable" data-quarto-disable-processing="true" style="border-collapse: collapse; border: 0px; margin-bottom: 2em; margin-top: 2em; width: 100%; margin-left: 0%; margin-right: auto;  " id="tab:unnamed-chunk-3">
<colgroup><col><col><col><col><col><col><col><col></colgroup><tbody><tr>
<th style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: bold;">Question</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Excellent</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Good</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Fair</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Poor</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Unacceptable</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Not applicable</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: bold;">Responses</th></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">2.&nbsp;The instructor's ability to organize ideas and materials for class</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">30%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">35%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">26%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">9%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">23</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">3.&nbsp;The instructor's ability to stimulate interest in the subject</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">35%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">26%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">26%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">13%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">23</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">4.&nbsp;The instructor's ability to encourage independent thinking</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">35%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">30%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">22%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">9%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">23</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">5.&nbsp;The instructor's ability to generate effective class discussion</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">39%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">22%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">17%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">17%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">23</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">6.&nbsp;The instructor's ability to communicate clearly</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">43%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">30%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">22%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">23</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">7.&nbsp;The instructor's openness to students' comments, questions and viewpoints concerning class topics</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">57%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">22%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">17%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">23</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">8.&nbsp;The instructor's knowledge of the subject matter of the class</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">39%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">30%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">26%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">23</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">9.&nbsp;The instructor's ability to keep to the time and schedule requirements for the class</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">55%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">23%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">14%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">5%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">5%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">22</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">10.&nbsp;The instructor's availability to students outside of class</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">61%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">22%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">13%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">23</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">11.&nbsp;The clarity of information provided about the course requirements and assignments</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">57%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">17%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">17%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">23</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">12.&nbsp;The promptness with which tests and assignments are graded and returned</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">57%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">17%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">17%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">23</td></tr>
</tbody></table>

</div>
<div class="cell-output-display">
<table class="huxtable" data-quarto-disable-processing="true" style="border-collapse: collapse; border: 0px; margin-bottom: 2em; margin-top: 2em; width: 100%; margin-left: 0%; margin-right: auto;  " id="tab:unnamed-chunk-3">
<colgroup><col><col><col><col><col><col></colgroup><tbody><tr>
<th style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: bold;">Question</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Too Many</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Just Right</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Too few</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Not Applicable</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: bold;">Responses</th></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">13.&nbsp;The number of assignments/projects/creative works in this class</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">13%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">48%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">39%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">23</td></tr>
</tbody></table>

</div>
<div class="cell-output-display">
<table class="huxtable" data-quarto-disable-processing="true" style="border-collapse: collapse; border: 0px; margin-bottom: 2em; margin-top: 2em; width: 100%; margin-left: 0%; margin-right: auto;  " id="tab:unnamed-chunk-3">
<colgroup><col><col><col><col><col><col><col></colgroup><tbody><tr>
<th style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: bold;">Question</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Very Challenging</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Challenging</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Somewhat Challenging</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Not Challenging</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Not Applicable</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: bold;">Responses</th></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">14.&nbsp;How challenging the class assignments/projects/creative works were</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">13%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">30%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">17%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">39%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">23</td></tr>
</tbody></table>

</div>
<div class="cell-output-display">
<table class="huxtable" data-quarto-disable-processing="true" style="border-collapse: collapse; border: 0px; margin-bottom: 2em; margin-top: 2em; width: 100%; margin-left: 0%; margin-right: auto;  " id="tab:unnamed-chunk-3">
<colgroup><col><col><col><col><col><col><col></colgroup><tbody><tr>
<th style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: bold;">Question</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Very useful</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Useful</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Somewhat Useful</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Not Useful</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Not Applicable</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: bold;">Responses</th></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">15.&nbsp;The usefulness of assignments/projects/creative works in this class</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">13%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">43%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">9%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">35%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">23</td></tr>
</tbody></table>

</div>
<div class="cell-output-display">
<table class="huxtable" data-quarto-disable-processing="true" style="border-collapse: collapse; border: 0px; margin-bottom: 2em; margin-top: 2em; width: 100%; margin-left: 0%; margin-right: auto;  " id="tab:unnamed-chunk-3">
<colgroup><col><col><col><col><col><col><col></colgroup><tbody><tr>
<th style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: bold;">Question</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Very Difficult</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Difficult</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Somewhat Difficult</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Not Difficult</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Not Applicable</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: bold;">Responses</th></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">16.&nbsp;The difficulty of examinations in this class</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">26%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">17%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">52%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">23</td></tr>
</tbody></table>

</div>
<div class="cell-output-display">
<table class="huxtable" data-quarto-disable-processing="true" style="border-collapse: collapse; border: 0px; margin-bottom: 2em; margin-top: 2em; width: 100%; margin-left: 0%; margin-right: auto;  " id="tab:unnamed-chunk-3">
<colgroup><col><col><col><col><col><col><col></colgroup><tbody><tr>
<th style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: bold;">Question</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Very Fair</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Fair</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Somewhat Unfair</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Unfair</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Not Applicable</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: bold;">Responses</th></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">17.&nbsp;The fairness of examinations in this class</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">35%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">13%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">52%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">23</td></tr>
</tbody></table>

</div>
<div class="cell-output-display">
<table class="huxtable" data-quarto-disable-processing="true" style="border-collapse: collapse; border: 0px; margin-bottom: 2em; margin-top: 2em; width: 100%; margin-left: 0%; margin-right: auto;  " id="tab:unnamed-chunk-3">
<colgroup><col><col><col><col><col><col><col><col></colgroup><tbody><tr>
<th style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: bold;">Question</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">A Lot</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">A Fair amount</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Some</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">A Little</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Hardly Anything</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: bold;">Not Applicable</th><th style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.4pt 0pt 2.5pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: bold;">Responses</th></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">19.&nbsp;How much general knowledge about the subject have you gained?</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">22%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">35%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">17%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">17%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">9%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 2.5pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">23</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">20.&nbsp;How much ability to analyze and solve problems have you gained?</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">17%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">43%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">13%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">13%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">13%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">0%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">23</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">21.&nbsp;How much ability to find and use information on your own have you gained?</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">17%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">43%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">13%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">13%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">9%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">23</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">22.&nbsp;How much ability to express your ideas verbally have you gained from this class?</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">13%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">39%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">17%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">13%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">13%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">23</td></tr>
<tr>
<td style="vertical-align: middle; text-align: left; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 0pt; font-weight: normal;">23.&nbsp;How much ability to develop and express your ideas through artistic/creative means have you gained from this class?</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">4%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">35%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">9%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">17%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">9%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 6pt 2pt 6pt; font-weight: normal;">26%</td><td style="vertical-align: middle; text-align: center; white-space: normal; border-style: solid solid solid solid; border-width: 0.2pt 0pt 0.2pt 0pt; border-top-color: rgb(228, 228, 228);  border-right-color: rgb(228, 228, 228);  border-bottom-color: rgb(228, 228, 228);  border-left-color: rgb(228, 228, 228); padding: 2pt 0pt 2pt 6pt; font-weight: normal;">23</td></tr>
</tbody></table>

</div>
<p>Student Evaluations, Statistics Lab (Fall 2018)</p>
</div>
</div>
</li>
<li>
<button class="button button1" type="button" onclick="window.open('https://matthewevanaman.netlify.app//PDFs/eval_fall18.pdf','_blank')">
View Faculty Evaluation
</button>
</li>
</ul>
<hr style="border: none; color:#000000; background-color:#000000; height:1px; opacity:0.25">
</section>
</section>
</section>
<section id="Description" class="level1">
<h1>Description of Teaching</h1>
<section id="Mentor" class="level3">
<h3 class="anchored" data-anchor-id="Mentor">Mentorship Beyond the Classroom</h3>
<p>My role: provide mentorship outside of the classroom including training and supervising research assistants, conducting weekly or bi-weekly journal clubs with research assistants, meeting with students during office hours or after class, advising students in one-on-one meetings, or responding to emails seeking advice. About 50% of my student mentorship has been advising students on applying to graduate school (four so far have been accepted into graduate programs in psychology and a related field).</p>
</section>
<section id="QR" class="level3">
<h3 class="anchored" data-anchor-id="QR">Quantitative Support at the SLU Learning Center</h3>
<p>My role: build and sustain an academic support system for students and faculty, specifically with the aim of facilitating quantitative pedagogy through one-on-one student support, the design and administration of quantitative support workshops, and in-class visitations and tutorials.</p>
<p>Since Summer 2020, I have been carrying out an appointment as a Quantitative Reasoning <a href="https://writingcenter.commons.gc.cuny.edu/people/" target="_blank">Fellow</a> at the CUNY School of Labor and Urban Studies Learning Center.</p>
<p>In terms of what I actually do, this position is a lot like supervising a research methods or senior project course, only less grading! Most of the degrees at SLU require a senior capstone project, and about 50-60% of the visits are with respect the student’s capstone project. During our sessions, we work together to devise concrete strategies for acquiring data, analyzing it, and reporting it. Students usually consult with me several times throughout the semester across various stages of their projects.</p>
<p>Since my first year to date, I have provided over 100 hours of one-on-one consultation. The projects students come to me span a surprisingly wide range of disciplines and methods, ranging from economics to sociology to psychology to public health. I’ve consulted on quantitative analyses of economic and other public data; survey and prevalence data; and on analysis of qualitative data (e.g., case studies, thematic content analysis).</p>
<p>I have also developed and administered several workshops designed to guide students on different aspects of the empirical research process. So far, I have designed and conducted four 75-minute workshops designed to help students refine and concretize different stages of the research process: refining research questions into testable quantitative hypotheses, operationalizing variables and ensuring sound measurement and assessment; constructing a data analysis plan, and analyzing data with jamovi using a codebook. At the end of each workshop, students received fillable PDF documents that can be used on their own projects. These guides are designed to systematize those “soft”-skill aspects of the research process that are often mysterious and intractable for new researchers. They are meant to be self-contained versions of my workshops and are works in progress. They are slightly geared toward the content area of labor and urban studies, but anyone who may find them useful can access them here:</p>
<ul>
<li><a href="https://www.matthewvanaman.com/PDFs/refining_research_question.pdf" target="_blank">Refining (Operationalizing) Your Research Question</a></li>
<li><a href="https://www.matthewvanaman.com/PDFs/measuring_variables.pdf" target="_blank">Measuring Your Variables and Acquiring Data</a></li>
<li><a href="https://www.matthewvanaman.com/PDFs/data_analysis_plan.pdf" target="_blank">Planning Your Data Analysis</a></li>
<li><a href="https://www.matthewvanaman.com/data/jamovi_guide.zip" target="_blank">Analyzing Your Data With Jamovi (with GIFs!)</a></li>
</ul>
</section>
<section id="brooklyn-college-center-for-achievement-in-science-education-case" class="level3">
<h3 class="anchored" data-anchor-id="brooklyn-college-center-for-achievement-in-science-education-case">Brooklyn College Center for Achievement in Science Education (CASE)</h3>
<p>My role: lead 45 hours of instruction in statistical programming in R, which provides core knowledge of the R programming language, practice in the a <a href="https://tidyr.tidyverse.org" target="_blank">tidy</a> approach to data manipulation, and application of the statistical knowledge that students gained through other aspects of the workshop within R.</p>
<p>In early Spring of 2021, I reached out to the leadership at the Brooklyn College Center for Achievement in Science Education (<a href="https://www.brooklyn.cuny.edu/web/academics/centers/case.php" target="_blank">CASE</a>) to ask how I might contribute to Brooklyn College’s diversity initiatives. Later in the year, I was invited to join as a workshop leader for the <a href="https://www.brooklyn.cuny.edu/web/academics/centers/case/programs/surge.php" target="_blank">SURGE</a> program, an NIH-funded academic support program designed to equip Brooklyn College freshman from underrepresented backgrounds with the kinds of scientific skills that make for strong PhD candidates.</p>
<p>The general idea is that if you want to diversify the PhD pool, you have to catch students early, give them a sense of belongingness in the scientific community, spur their curiosity toward the science, and most importantly provide the opportunity to experience life as a scientist. Students should get these kinds of exposure early enough to either a) run for the hills before they spend more time than they need to on something they don’t like, or b) get started on the preliminaries of pursuing graduate school early to maximize preparedness. The idea is to diversify through recruitment and to provide access to important skills that more advantaged students tend to already have easier access to (on average).</p>
<p>While there is a lot that a student can doon their own to prepare themselves - indeed, I have compiled quite a large <a href="https://www.matthewvanaman.com/post/2021-05-18-crash-course-to-getting-into-a-phd-program-in-psychology/" target="_blank">list</a> myself - the fact of the matter is that many students simply do not have equal opportunity. This program addresses that.</p>
<p>As a guest speaker in the workshop once put it:</p>
<blockquote class="blockquote">
<p>Coding is freedom, independence, and power.</p>
</blockquote>
</section>
<section id="lecturer-on-record-graduate-course-special-topics-in-experimental-psychology-statistical-coding-with-r" class="level3">
<h3 class="anchored" data-anchor-id="lecturer-on-record-graduate-course-special-topics-in-experimental-psychology-statistical-coding-with-r">Lecturer On Record, Graduate Course, Special Topics in Experimental Psychology (Statistical Coding with R)</h3>
<p>My role: instruct students in the Master’s in Experimental Psychology program at Brooklyn College in the use of R, covering base R to project management using RStudio projects, tidyverse principles including <em>dplyr</em> and <em>ggplot2</em>, using R Markdown to render attractive summary reports, and communicating statistical results to both experts and (hypothetical) non-expert stakeholders in an accessible and responsible way.</p>
<p>I was invited to teach this course literally one week before the first class after the sudden departure of the previous instructor. I created the coursework and in-class group projects on the fly.</p>
<ul>
<li><a href="https://www.matthewvanaman.com/data/final_instructions.Rmd" target="_blank">The R Markdown File</a></li>
<li><a href="https://www.matthewvanaman.com/PDFs/final_instructions.pdf" target="_blank">The Rendered PDF</a></li>
</ul>
</section>
<section id="lab-instructor-statistical-methods-in-psychological-research-brooklyn-college" class="level3">
<h3 class="anchored" data-anchor-id="lab-instructor-statistical-methods-in-psychological-research-brooklyn-college">Lab Instructor, Statistical Methods in Psychological Research, Brooklyn College</h3>
<p>Fall 2018, Spring 2019, Summer 2019</p>
<p>My role: instruct two statistics lab sections per semester. Topics covered included introductions to descriptive statistics, probability theory, prediction, ordinary least squares, between- and within-subject ANOVA models, statistical inference, consumption of statistical information, plotting, using Excel and SPSS statistical software, and principles of plotting.</p>


</section>
</section>

 ]]></description>
  <guid>https://www.matthewvanaman.com/teaching.html</guid>
  <pubDate>Sun, 29 Sep 2024 18:36:59 GMT</pubDate>
</item>
<item>
  <title></title>
  <link>https://www.matthewvanaman.com/research.html</link>
  <description><![CDATA[ 




<style>
@import url(https://pro.fontawesome.com/releases/v5.10.0/css/all.css);
@import url(https://cdn.rawgit.com/jpswalsh/academicons/master/css/academicons.min.css);
.button {
  border: none;
  color: white;
  font-style: oblique;
  padding: none;
  text-align: center;
  text-decoration: none;
  display: inline-block;
  font-size: 16px;
  margin-top: 0px;
  margin-bottom: 0px;
  margin-right: 0px;
  margin-left: 0px;
  transition-duration: 1s;
  cursor: pointer;
}

.button1 {
  background-color: white; 
  color: #6e6e6e; 
  border: none;
}

.button1:hover {
  background-color: #7984a0;
  color: white;
}

.references {
  padding-left:2em; 
  text-indent:-4em; 
  color:#6e6e6e; 
  line-height: 1.5;
  font-family: Source Sans Pro;
}
.csl-entry {
  padding-top:1em;
}

</style>
<center>
<div class="cell">
<div class="cell-output-display">
<div id="htmlwidget-3409ac4db7633b427881" style="width:100%;height:600px;" class="visNetwork html-widget "></div>
<script type="application/json" data-for="htmlwidget-3409ac4db7633b427881">{"x":{"nodes":{"id":[1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18],"label":["Character","Complexity Science","Cultural Variation","Emotion","Harm Perception","Individual Differences","Judgment and Decision Making","Meta-Science","Moralization","Philosophy","Political Policy","Social Influence","Structure of Morality","Theory Development","Thinking and Reasoning","Unconscious Processes","Applied Statistics","Statistical Education and Consulting"],"x":[1,0.9318923987356069,0.7367679038904316,0.4409791597154653,0.08447407513354976,-0.2845993627196582,-0.6163957409555643,-0.8661041201462087,-0.008586551334867965,-0.9999999999999998,-1,-0.8661041201462093,-0.6163957409555652,-0.2845993627196594,0.08447407513354843,0.4409791597154638,0.7367679038904305,0.9318923987356065],"y":[2.220446049250313e-16,0.3627892612175618,0.6765818224229982,0.8989982594409083,1,0.9659461993678038,0.8014360120183206,0.5286874503355152,2.220446049250313e-16,0.1845367189266047,-0.1845367189266032,-0.5286874503355139,-0.8014360120183195,-0.965946199367803,-1,-0.8989982594409086,-0.6765818224229991,-0.3627892612175634]},"edges":{"to":[4,5,7,9,4,5,9,11,13,14,15,8,4,7,9,3,5,7,9,10,11,12,13,14,16,7,9,11,13,15,16,9,11,13,14,15,9,12,13,15,16,14,10,11,12,13,14,15,16,13,14,15,12,13,15,16,16,14,12,13,14,2,14,18,8,8,2],"from":[1,1,1,1,2,2,2,2,2,2,2,2,3,3,3,4,4,4,4,4,4,4,4,4,4,5,5,5,5,5,5,6,6,6,6,6,7,7,7,7,7,8,8,9,9,9,9,9,9,10,10,10,11,11,11,11,12,13,15,15,15,17,17,17,17,18,18]},"nodesToDataframe":true,"edgesToDataframe":true,"options":{"width":"100%","height":"100%","nodes":{"shape":"ellipse","mass":5,"color":{"background":"#85A0BA","hover":"#7984a0","highlight":"#7984a0","border":"#7984a0"},"opacity":0.75,"font":{"size":25,"face":"Source Sans Pro","color":"white"},"shadow":true,"physics":false},"manipulation":{"enabled":false},"edges":{"hoverWidth":4,"color":{"color":"#6e6e6e","highlight":"#6e6e6e","hover":"#6e6e6e","opacity":0.75},"smooth":true,"shadow":true},"physics":{"solver":"forceAtlas2Based","maxVelocity":1,"minVelocity":0.05,"enabled":true,"forceAtlas2Based":{"enabled":true,"gravitationalConstant":-10,"centralGravity":0.02,"springLength":5,"springConstant":0.05,"damping":0.8}},"interaction":{"hover":true,"dragNodes":true,"dragView":false,"navigationButtons":false,"zoomView":false,"zoomSpeed":1},"autoResize":true},"groups":null,"width":"100%","height":600,"idselection":{"enabled":false,"style":"width: 150px; height: 26px","useLabels":true,"main":"Select by id"},"byselection":{"enabled":false,"style":"width: 150px; height: 26px","multiple":false,"hideColor":"rgba(200,200,200,0.5)","highlight":false},"main":null,"submain":null,"footer":{"text":"<i>My web of interests. Explore!<\/i>","style":"color:#6e6e6e; font-family:Source Sans Pro; font-size:16px;text-align:center;margin:0px"},"background":"rgba(0, 0, 0, 0)","igraphlayout":{"type":"square"},"highlight":{"enabled":true,"hoverNearest":true,"degree":{"from":1,"to":1},"algorithm":"hierarchical","hideColor":"rgba(200,200,200,0.5)","labelOnly":false},"collapse":{"enabled":false,"fit":false,"resetHighlight":true,"clusterOptions":null,"keepCoord":true,"labelSuffix":"(cluster)"},"tooltipStay":300,"tooltipStyle":"position: fixed;visibility:hidden;padding: 5px;white-space: nowrap;font-family: verdana;font-size:14px;font-color:#000000;background-color: #f5f4ed;-moz-border-radius: 3px;-webkit-border-radius: 3px;border-radius: 3px;border: 1px solid #808074;box-shadow: 3px 3px 10px rgba(0, 0, 0, 0.2);"},"evals":[],"jsHooks":[]}</script>
</div>
</div>
</center>
<hr style="border: none; color:#000000; background-color:#000000; height:1px; opacity:0.25; margin: 0px 0px 20px 0px">
<center>
<button onclick="window.open('https://www.matthewvanaman.com/PDFs/Vanaman_Research_Statement.pdf','_blank')" type="button" class="button button1">
View Research Statement (Research Emphasis)
</button>
<button onclick="window.open('https://www.matthewvanaman.com/PDFs/Vanaman_Research_Statement_LA.pdf','_blank')" type="button" class="button button1">
View Research Statement (Undergraduate Research Emphasis)
</button>
<p><br></p>
<button class="button button1" onclick="window.open('http://www.anagantman.com/people/#block-yui_3_17_2_1_1613773890823_10483','_blank')" type="button">
<i class="far fa-head-side-brain" style="font-size: 30px"></i>
</button>
<button class="button button1" type="button" onclick="window.open('https://scholar.google.com/citations?user=dQ_TbawAAAAJ&amp;hl=en','_blank')">
<i class="ai ai-google-scholar" style="font-size: 30px"></i>
</button>
<button class="button button1" type="button" onclick="window.open('https://osf.io/4hz9q/','_blank')">
<i class="ai ai-osf" style="font-size: 30px"></i>
</button>
<button class="button button1" type="button" onclick="window.open('https://github.com/mvanaman','_blank')">
<i class="fab fa-github" style="font-size: 30px"></i>
</button>
</center>
<section id="what-makes-a-good-data-analyst" class="level1">
<h1>What Makes A Good Data Analyst?</h1>
<p>My main focus as of now is on understanding what exactly analysts get from experience that makes them better at producing trustworthy and well-performing analyses consistently across both familiar and novel contexts.</p>
</section>
<section id="what-is-morality" class="level1">
<h1>What is Morality?</h1>
<p>My secondary focus is in understanding how people decide between right and wrong. More than that, I am interested in understanding where people’s notions of right and wrong come from. Why is it immoral to eat dog in the United States, but desirable to eat cow? What makes a good person good and a bad person bad? Why do people see harm in harmless behaviors? Where are the boundaries of morality, and what does its underlying structure look like in the mind? I investigate how emotion, thinking, and the mind’s complexity give way to people’s perceptions that some things are personal, others merely practical, and still others, <em>perverse</em>.</p>
</section>
<section id="media-coverage" class="level1">
<h1>Media Coverage</h1>
<ul>
<li>
<button class="button button1" type="button" style="width:auto; text-align:left; font-size:16px;" onclick="window.open('https://www.psychologytoday.com/us/blog/inclusive-insight/202012/disgust-morality-and-the-transgender-bathroom-debate','_blank')">
<b>Disgust, Morality, and the Transgender Bathroom Debate.</b> Karen L. Blair. <i>Psychology Today</i>. December 30th, 2020.
</button>
</li>
</ul>
</section>
<section id="recent-publications" class="level1">




</section>

<div id="quarto-appendix" class="default"><section class="quarto-appendix-contents" id="quarto-bibliography"><h2 class="anchored quarto-appendix-heading">Recent Publications</h2><div id="refs" class="references csl-bib-body hanging-indent" data-entry-spacing="0" data-line-spacing="2">
<div id="ref-leggett2021development" class="csl-entry">
Leggett-James, M. P., Vanaman, M. E., Lindner, D., &amp; Askew, R. L. (2021). The <span>Development</span> and <span>Psychometric</span> <span>Evaluation</span> of the <span>Exercise</span> <span>Overvaluation</span> <span>Scale</span> [<a href="https://www.matthewvanaman.com/PDFs/exercise.pdf">PDF</a>]. <em>Journal of Sport &amp; Exercise Psychology</em>, <em>43</em>(3), 223–233. <a href="https://doi.org/10.1123/jsep.2019-0213">https://doi.org/10.1123/jsep.2019-0213</a>
</div>
<div id="ref-tierney2020creative" class="csl-entry">
Tierney, W., Hardy, J. H., Ebersole, C. R., Viganola, D., Clemente, E. G., Gordon, D. M., Hoogeveen, S., Haaf, J., Dreber, A., Johannesson, M., Pfeiffer, T., Huang, J., Vaughn, L., DeMarree, K., Igou, E., Chapman, H., Gantman, A., Vanaman, M., Wylie, J., … Uhlmann, E. L. (2021). A creative destruction approach to replication: <span>Implicit</span> work and sex morality across cultures. <em>Journal of Experimental Social Psychology</em>, <em>93</em>. <a href="https://doi.org//10.1016/j.jesp.2020.104060">https://doi.org//10.1016/j.jesp.2020.104060</a> [View <a href="https://matthewevanaman.netlify.app/creative.pdf">PDF</a>]
</div>
<div id="ref-vanaman2020disgust" class="csl-entry">
Vanaman, M. E., &amp; Chapman, H. A. (2020). Disgust and disgust-driven moral concerns predict support for restrictions on transgender bathroom access. <em>Politics and the Life Sciences</em>, <em>39</em>(2), 200–214. <a href="https://doi.org/10.1017/pls.2020.20">https://doi.org/10.1017/pls.2020.20</a> [View <a href="https://www.matthewvanaman.com/PDFs/disgust.pdf">PDF</a>]
</div>
<div id="ref-vanaman2019novel" class="csl-entry">
Vanaman, M. E., Leggett, M.-P., Crysel, L., &amp; Askew, R. (2019). A <span>Novel</span> <span>Measure</span> of the <span>Need</span> for <span>Moral</span> <span>Cognition</span>. <em>Basic and Applied Social Psychology</em>, <em>41</em>(1), 20–33. <a href="https://doi.org/10.1080/01973533.2018.1531000">https://doi.org/10.1080/01973533.2018.1531000</a> [View <a href="https://www.matthewvanaman.com/PDFs/nfmc.pdf">PDF</a>]
</div>
</div></section></div> ]]></description>
  <guid>https://www.matthewvanaman.com/research.html</guid>
  <pubDate>Sun, 29 Sep 2024 18:36:59 GMT</pubDate>
</item>
</channel>
</rss>
