education | Waseem Ashfaq

Flattening the leaRning curve: Teaching R online during COVID-19

Mon, 19 Oct 2020 00:00:00 +0000

At this point, you’re probably familiar with the phrase “flatten the curve” — remember back in March when we were all talking about that? It was part of a critical public health messaging campaign aimed at slowing the spread of COVID-19 to prevent hospitals from becoming overwhelmed beyond their capacity. Based on how things are going, we really should still be talking about that. So allow me to unabashedly steal this catchphrase as a flawed metaphor for teaching and learning R during the era of this pandemic…

It’s no secret that R has a significant leaRning curve — and, while it seems that more people than ever are now wanting to learn R, almost everyone is having to do it in an online format of some kind. For those who are used to a traditional in-person classroom environment, having a first introduction to R in an online format might make the leaRning curve even steeper (as I said, a flawed metaphor – the concept of a “steep learning curve” is actually the opposite of what most people think, but we’ll run with it anyway). After recently teaching an introductory R Bootcamp online, I’ve spent a lot of time thinking about strategies to lower the learning threshold and make it easier to conquer any potential fear of learning R – to “flatten the leaRning curve”, as it were.

For anyone who might be new to teaching R, teaching online, or both, the goal of this post is to share some valuable lessons I learned and resources I used during this online teaching experience. I hope it may be of some benefit for your own teaching.

Background

Back in Fall 2018, the Department of Psychology at the University of Oregon started to offer a grad-student-led introductory R Bootcamp the week before the start of the new academic year. The bootcamp consists of three 3-4 hour sessions that take place over the course of a week. The idea behind the bootcamp is to give a first exposure to R to incoming students who have little to no background in it before being launched headfirst into using R to analyze data for their first year project and to complete labs and homework assignments for PSY611, the first in a series of graduate statistics courses taught entirely in R.

In addition, as I’ve written about previously, current grad students, along with other members of the psychology department, have expressed a keen interest in developing a stronger foundation in skills such as basic programming, data wrangling, and data visualization. So the bootcamp also serves as an opportunity for existing R users to get a refresher and deeper dive into those topics for those who want it.

After spending lot of time thinking about how to improve the data science learning experience for my fellow grad students and having recently become an RStudio Certified Instructor in the tidyverse, it was my great privilege to be able to put all of this into action by leading the 3rd Annual UO Psych Bootcamp this year. 🥳

The challenge

However, I found myself facing a rather significant challenge. The R Bootcamp, like many intro R workshops, usually occurs in-person in a large room with a giant projector screen, coffee and snacks, and, most importantly, the ability to run over and look over someone’s shoulder at their computer screen when they need help. Because of COVID-19, I needed to design and deliver a bootcamp for a large group of beginners (many using R for the very first time) entirely over a webcam.

Moreover, I assumed that student motivation would be at an all-time low and feelings of anxiety and uncertainty would be at an all-time high – especially for those about to start their graduate school journey entirely online, very much contrary to plan. There were a lot of horrible things going on in the world in September 2020, which marked 6 months into the COVID-19 pandemic in the U.S. – people’s loved ones were getting sick, the killing of innocent Black lives continued, a bitter presidential race reached full swing – not to mention devastating wildfires that raged all along the west coast. (Of course, while I wish I could actually write about these events in the past tense, all of these problems continue).

So, how do you get people excited about learning R amidst all of that? Needless to say, this felt a little daunting 😨. Fortunately, though, there are people out there who are experts in this sort of thing who have graciously shared their resources and advice, and this helped me immensely to run a successful bootcamp.

Who attended?

52 people registered for the bootcamp. While the majority of those who attended were incoming first-year psychology grad students, we also had a mix of more advanced grad students, undergrads, research assistants, lab managers, staff data analysts, and faculty members from a variety of departments/centers across the University, including the Departments of Psychology, Linguistics, Economics and the Center for Translational Neuroscience.

# import bootcamp registration data 
registration <- read_csv("uopsych_bootcamp_registration_deidentified.csv")

# clean data
plot_data <- registration %>% 
  janitor::clean_names() %>% 
  select(position = what_is_your_position_at_uo,
         experience = do_you_have_any_experience_in_r_no_experience_is_required) %>%
  mutate(position = factor(case_when(position %in% c("Undergraduate", "Undergraduate student") ~ "Undergrad Student", 
                                     position %in% c("RA", "Lab Manager", "Data Analyst") ~ "Research Staff",
                              TRUE ~ as.character(position))),
         experience = factor(experience, levels = c(
           "I've never heard of it",
           "I've heard of it but have never used it",
           "I've opened it before",
           "I've used it to analyze data",
           "I use it often to analyze data")))

# plot positions at UO
theme_set(theme_minimal(base_size = 15)) 
theme_update(legend.position = "none", 
          plot.title.position = "plot",
          panel.grid.minor.y = element_blank())

plot_data %>% 
  count(position) %>% 
  ggplot(aes(fct_reorder(position, n), n, fill = position)) + 
  geom_col() +
  coord_flip() + 
  scale_fill_manual(values = get_pal("Kotare")) + 
  labs(x = "", y = "Count", title = "Participants' roles at University of Oregon")

# plot prior experience 
plot_data %>% 
  count(experience) %>% 
  ggplot(aes(experience, n, fill = experience)) + 
  geom_col() +
  coord_flip() + 
  scale_fill_manual(values = get_pal("Kaka"))  + 
  labs(x = "", y = "Count", title = "Participants' prior experience with R")

Logistics

Zoom + Slack = 👌

We ran synchronous sessions live over Zoom. However, rather than use the Zoom chat for communicating with each other and asking questions, we used Slack. A few reasons for this:

this way people could continue to ask questions outside of the live sessions and a permanent and searchable record of questions and answers would be available for posterity
The Zoom chat can get easily cluttered and doesn’t easily allow you to make threads, which keep things more organized
Slack has better emojis 🤓.

I was fortunate to have the very knowledgeable and talented Cameron Kay and Cianna Bedford-Petersen as teaching assistants. Cam and Cianna remained on deck throughout the sessions to answer questions on Slack while we went through the material. We also decided that if a student ran into technical issues or felt completely lost, then one of the TA’s would pull them into a breakout room on Zoom to offer one-on-one help.

RStudio Cloud

For “Your Turn” exercises, an idea I stole from Alison Hill’s excellent rstudio::conf(2020) workshop, we used RStudio Cloud, a hosted version of the RStudio IDE available in the web browser. We did this to avoid issues with students installing RStudio on their local machines, as troubleshooting technical issues over Zoom in a large group is not something we felt prepared for. Using RStudio Cloud also allowed me to configure specific IDE settings and pre-load specific packages to allow students to initially avoid technical issues. Lastly, sharing a workspace on RStudio Cloud allowed each student to save their own copy of the projects containing the Your Turn exercises, which in turn made it possible for myself or the TA’s to “peek” into a student’s exercises and help them figure out where their errors were coming from. Overall it went really smoothly, and everyone who filled out the feedback survey said they had no issues using it. I highly recommend using this for your teaching, even if it’s in-person.

Blogdown site

To make the bootcamp materials more accessible and shareable, I decided to package them into a website, which I created using the blogdown package (see more on this below). Organizing your teaching materials into a website has three clear advantages in my mind:

A website makes your materials easier to access and more shareable – you send someone a single link they can access on their phone or computer, no need to download anything
A website is highly sustainable in the sense that it’s easy for students to bookmark and refer back to over and over, and if you push changes to Github with continuous deployment (e.g. via Netlify), students will always have access to the most updated materials. This avoids having to introduce Github and version control, which is a whole other beast to teach to beginners.
Websites are pretty and highly customizble ✨

🔗 uopsych-r-bootcamp-2020.netlify.app

Tools I learned

`xaringanExtra`

📦 pkg.garrickadenbuie.com/xaringanExtra

Garrick Aden-Buie

{xaringanExtra} extends the functionality of the already amazing {xaringan} package by Yihuie Xie, and it has become one of my all-time favorite packages. Here are the features I use most often and highly recommend.

📖 Share again

📖 Panelset

📖 Tile view

📖 Extra styles

In case it still isn’t obvious enough how much I love this package…

Ok, {xaringanExtra} continues to blow my freakin' mind 🤯 Here's a quick demo that shows tile view and embed_xaringan() in the context of a #ggplot2 flipbook (h/t @EvaMaeRey). @grrrck, I owe you an absurd amount of beers 🍻 Thank you for all you do for the #rstats community 🙌 pic.twitter.com/ucMCbOvopW
— Brendan Cullen (@_bcullen) September 28, 2020

Jump back up to see more tools ⤴️

`flair`

📦 r-for-educators.github.io/flair

Kelly Bodwin

{flair} allows you to spice up your code with color-coding and dynamic syntax highlighting. One of the most useful applications is to match colors to concepts – e.g. giving each argument of a function a unique color. I feel like I’ve only scratched the surface with {flair} and can’t wait to use it more in my teaching going forward.

Below is a demonstration of color-coding with flair to introduce dplyr::filter() and its arguments.

You can read more about other educational use cases for flair in this great post on the RStudio Education Blog.

Jump back up to see more tools ⤴️

`flipbookr`

📦 evamaerey.github.io/flipbooks/about

Gina Reynolds

{flipbookr} is an amazing teaching tool – it allows you to incrementally build up a plot line by line, which capitalizes on the “blink comparator” method. This means that students are able to easily map a specific change in code to a specific visual change in the corresponding plot output. Flipbooks are also great for demonstrating incremental changes in a data wrangling pipeline, and they’re relatively easy to make!

Video

Jump back up to see more tools ⤴️

`countdown`

📦 pkg.garrickadenbuie.com/countdown

Garrick Aden-Buie

{coundown} is another great gem from Garrick and allows you to put timers directly on your slides. This is really useful for timed “Your Turn” exercises or to make sure you stay on track with Q & A sessions or breaks.

Video

Jump back up to see more tools ⤴️

The importance of encouragement & positivity

The leaRning curve is no secret. I hadn’t touched R before starting grad school in 2017, but I had heard whispers here and there that learning R is really difficult. But I think there’s an element of self-fulfilling prophecy here. If you expect it to be impossible, then it will feel impossible. I more or less started my journey with that expectation.

Things changed for me when I took my first course with Daniel Anderson. Daniel has developed a fantastic 5-course Data Science Specialization in Educational Leadership in the College of Education at the University of Oregon, taught entirely in R, which ranges from the very basics of R to advanced machine learning with tidymodels (see more info here). Daniel’s teaching completely changed the way I approached using and learning R, and it was largely on his recommendation that I joined #rstats Twitter (which was a game-changer). More importantly, Daniel modeled the kind of teacher I wanted to be – clear, thorough, thoughtful, and above all else, kind and inclusive of everyone.

It was very much with Daniel’s model in mind that I found inspiration for making learning R feel more inviting and less daunting. Here are a few things that came to mind that can be abstracted to some general advice…

Anticipate the challenge

Recognize the fact that learning R is hard. Don’t pretend it’s a walk in the park – it isn’t. But at the same time, emphasize that the investment of time it takes is worth it! And be sure to remind people of that more than once 😉.

Normalize errors & mistakes

The first time someone uses R, error messages are one of the first things that they’ll see. As we all know, this feels frustrating, especially as a beginner. So it makes sense to acknowledge that up front and discuss what error messages are and why they occur. As error messages go hand-in-hand with debugging, it’s also a good idea to at least introduce that concept as well, without necessarily going into great depth since that’s a whole other topic of it’s own. As debugging is commonly considered part of “what they forgot to teach you about R”, I’m sure I’m not alone in wishing that I had been introduced to debugging much earlier on in my R learning experience.

While learning a systematic approach to debugging is important down the line, it’s more important at first for beginners to understand that seeing lots of error messages at first is not a bad thing. It’s worth spending some effort to convince your students that error messages should not be cause for discouragement or giving up. Simply put, error messages are part and parcel of programming. Sometimes they take a matter of seconds to fix, sometimes a matter of weeks, but everyone who uses R will regularly encounter error messages, no matter your level of experience. And when it really comes down to it, every error message is an opportunity to learn something!

Taking this one step further, it’s a good idea to deliberately incorporate making mistakes into your own teaching and use error messages as a teachable moment. You can even use unintentional mistakes as teachable moments – demonstrate for your students how you fix the mistake and invite them to give their thoughts and feedback. This not only makes your presentation less rehearsed, but it provides a really valuable “real-world” context for learning.

This idea is referred to as “positive error framing” – and if you want to learn more about this topic in depth I recommend you check out this section from the recent article “Ten quick tips for teaching with participatory live coding” (really you should read the whole article – it’s packed full of great advice).

Make your materials friendly and inviting!

If your slides read like one long piece of dense help documentation, people are not going to feel inclined to engage with it. How do you make your materials more inviting and approachable?

One of the most powerful tools out there, in my opinion, is the incredible artwork by Allison Horst, RStudio’s first artist-in-residence (see more above). The bigger picture behind the artwork, in Allison’s words:

“All of it is towards a goal of trying to make R, and data science in general, more approachable, welcoming, and engaging to diverse learners”.

Cute gifs never hurt either…

If you're teaching #rstats with #palmerpenguins at the moment (which you should be because it's a brilliant dataset 🐧), consider sneaking in a lil' motivational penguin, both for yourself and your students. everything is terrible and we all need small joys now more than ever pic.twitter.com/OHeJWIsqFp
— Brendan Cullen (@_bcullen) September 24, 2020

Feedback

I was really happy to see that people seemed to appreciate the positive learning atmosphere and, especially because this was only an introductory workshop, that this made them excited to learn more:

✍️ “I really appreciated the warm welcome/atmosphere the instructors set up- learning a new programming language can be frustrating, especially for a beginner, so I was really appreciative of the continuous encouragement throughout the bootcamp.”

✍️ “I really enjoyed how supportive and encouraging the facilitators were. I understood learning R was no easy endeavor but hearing about their experiences was encouraging for me. Also, I greatly appreciate all the amazing resources they have compiled for future use. I definitely plan to continue looking into it!”

✍️ “I appreciated the facilitators’ organization, support, encouragement, and instructional clarity. Thank you for providing this very warm and accessible introduction for an absolute first-time novice! It’s encouraged me to take more steps into learning R.”

✍️ “I am now in my third year of struggling through R and this was the first presentation of material that really clicked for me. I frequently refer to the dplyr and ggplot presentations in my work and will continue to work my way through these exercises until I am truly fluent in these basics. THANK YOU”

So we did we flatten the leaRning curve? Only time will tell. But the most gratifying feedback, in my opinion, is that people who attended felt inspired to keep learning and continue riding the R roller coaster. That’s really the best outcome I could have hoped for!

A final thought

In short, no matter how long someone has been using R, it never hurts to remind them (yourself included) that a little time and effort can go a long way.

Acknowledgements

I owe a huge debt of gratitude to all the people who were instrumental in my initial experience of learning R: Daniel Anderson, Dani Cosme, Krista DeStasio, Cory Costello, Jessica Kosie, and Sara Weston, to name only a few.

Thanks again to Cameron Kay and Cianna Bedford-Petersen for being such awesome TA’s for the R Bootcamp.

I also wouldn’t know half of what I know about learning and teaching R if it weren’t for the RStudio Education team – in particular, Alison Hill, Greg Wilson, Desirée De Leon, Mine Çetinkaya-Rundel, and Garrett Grolemund.

Artwork included in this post is by Allison Horst.

Session Info

## ─ Session info ───────────────────────────────────────────────────────────────
##  setting  value                       
##  version  R version 3.6.2 (2019-12-12)
##  os       macOS Catalina 10.15.6      
##  system   x86_64, darwin15.6.0        
##  ui       X11                         
##  language (EN)                        
##  collate  en_US.UTF-8                 
##  ctype    en_US.UTF-8                 
##  tz       America/Los_Angeles         
##  date     2020-11-01                  
## 
## ─ Packages ───────────────────────────────────────────────────────────────────
##  package       * version    date       lib
##  assertthat      0.2.1      2019-03-21 [1]
##  backports       1.1.10     2020-09-15 [1]
##  blogdown        0.17       2019-11-13 [1]
##  bookdown        0.21       2020-10-13 [1]
##  broom           0.5.5      2020-02-29 [1]
##  cellranger      1.1.0      2016-07-27 [1]
##  cli             2.1.0      2020-10-12 [1]
##  colorspace      1.4-1      2019-03-18 [1]
##  crayon          1.3.4      2017-09-16 [1]
##  DBI             1.1.0      2019-12-15 [1]
##  dbplyr          1.4.2      2019-06-17 [1]
##  digest          0.6.27     2020-10-24 [1]
##  dplyr         * 1.0.2      2020-08-18 [1]
##  ellipsis        0.3.1      2020-05-15 [1]
##  emo             0.0.0.9000 2020-08-26 [1]
##  evaluate        0.14       2019-05-28 [1]
##  fansi           0.4.1      2020-01-08 [1]
##  farver          2.0.3      2020-01-16 [1]
##  forcats       * 0.4.0      2019-02-17 [1]
##  fs              1.3.1      2019-05-06 [1]
##  generics        0.0.2      2018-11-29 [1]
##  ggplot2       * 3.3.2      2020-06-19 [1]
##  glue            1.4.2      2020-08-27 [1]
##  gtable          0.3.0      2019-03-25 [1]
##  haven           2.2.0      2019-11-08 [1]
##  highr           0.8        2019-03-20 [1]
##  hms             0.5.3      2020-01-08 [1]
##  htmltools       0.5.0      2020-06-16 [1]
##  httr            1.4.2      2020-07-20 [1]
##  janitor         1.2.1      2020-01-22 [1]
##  jpeg            0.1-8.1    2019-10-24 [1]
##  jsonlite        1.7.1      2020-09-07 [1]
##  knitr           1.30       2020-09-22 [1]
##  labeling        0.4.2      2020-10-20 [1]
##  lattice         0.20-38    2018-11-04 [2]
##  lifecycle       0.2.0      2020-03-06 [1]
##  lubridate       1.7.9      2020-06-08 [1]
##  magrittr        1.5        2014-11-22 [1]
##  Manu          * 0.0.1      2020-10-20 [1]
##  modelr          0.1.6      2020-02-22 [1]
##  munsell         0.5.0      2018-06-12 [1]
##  nlme            3.1-142    2019-11-07 [2]
##  pillar          1.4.6      2020-07-10 [1]
##  pkgconfig       2.0.3      2019-09-22 [1]
##  png             0.1-7      2013-12-03 [1]
##  purrr         * 0.3.4      2020-04-17 [1]
##  R6              2.4.1      2019-11-12 [1]
##  Rcpp            1.0.5      2020-07-06 [1]
##  readr         * 1.3.1      2018-12-21 [1]
##  readxl          1.3.1      2019-03-13 [1]
##  reprex          0.3.0      2019-05-16 [1]
##  rlang           0.4.8      2020-10-08 [1]
##  rmarkdown       2.5        2020-10-21 [1]
##  rstudioapi      0.11       2020-02-07 [1]
##  rvest           0.3.5      2019-11-08 [1]
##  scales          1.1.1      2020-05-11 [1]
##  sessioninfo     1.1.1      2018-11-05 [1]
##  snakecase       0.11.0     2019-05-25 [1]
##  stringi         1.5.3      2020-09-09 [1]
##  stringr       * 1.4.0      2019-02-10 [1]
##  tibble        * 3.0.4      2020-10-12 [1]
##  tidyr         * 1.1.0      2020-05-20 [1]
##  tidyselect      1.1.0      2020-05-11 [1]
##  tidyverse     * 1.3.0      2019-11-21 [1]
##  vctrs           0.3.4      2020-08-29 [1]
##  withr           2.3.0      2020-09-22 [1]
##  xaringanExtra * 0.2.1      2020-08-23 [1]
##  xfun            0.18       2020-09-29 [1]
##  xml2            1.2.2      2019-08-09 [1]
##  yaml            2.2.1      2020-02-01 [1]
##  source                                  
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.2)                          
##  Github (hadley/emo@3f03b11)             
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.0)                          
##  Github (G-Thomson/Manu@c5aa932)         
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.2)                          
##  Github (gadenbuie/xaringanExtra@f85b70a)
##  CRAN (R 3.6.2)                          
##  CRAN (R 3.6.0)                          
##  CRAN (R 3.6.0)                          
## 
## [1] /Users/bcullen/Library/R/3.6/library
## [2] /Library/Frameworks/R.framework/Versions/3.6/Resources/library

UO Psych R Bootcamp 2020

Tue, 06 Oct 2020 00:00:00 +0000

I organized and taught a 3-day introductory R Bootcamp for my fellow ducks in the Department of Psychology at the University of Oregon in September 2020. We had we had a fantastic mix of participants, including incoming PhD and master’s students, current grad students, undergrads, research staff, and faculty, with over 40 people attending each day. Thanks so much to everyone who participated! 🦆

The materials have been designed such that you should be able to work through the slides and exercises at your own pace if you were not able to attend the bootcamp sessions. All materials are available on the bootcamp website: https://uopsych-r-bootcamp-2020.netlify.app/

This bootcamp gives a gentle introduction to R and RStudio, transforming and visualizing data with the tidyverse, and the basics of R Markdown. It assumes no prior experience with R or any other programming language and is designed to get learners up and running with the most widely useful tools for reproducible data analysis in R while emphasizing best practices for writing code and organizing project-oriented workflows.

It also contains a curated list of resources for each topic for those who want more opportunities for further learning and practice, as well as a collection of more generally useful resources for learning R.

Specific topics include:

This work is licensed under a Creative Commons Attribution 4.0 International License. Please feel free to share and/or adapt and re-use any of the materials for your own teaching!

You can read more about the bootcamp in this blog post .

Tidyverse Sample Exam 2.0 Solutions

Thu, 10 Sep 2020 00:00:00 +0000

Reflections on RStudio Instructor Training

Thu, 03 Sep 2020 00:00:00 +0000

A while back I wrote about how we need more data science training as grad students in psychology and that one of the best ways for us to get this training is to learn from each other. This is just one of many reasons why I’m so humbled and excited to have recently become an RStudio Certified Instructor in the tidyverse.

I’m looking forward to start implementing and sharing what I learned with my fellow grad students, especially at the end of this month when I will be leading an introductory R workshop for the new cohort of first year PhD and master’s students in my department.

As a small way of paying it forward, I wanted to offer a reflection on what I think makes this training so unique and worthwhile along with a summary of what’s involved and some resources for those who might be interested in knowing more.

The what

The best place the start is to read about the RStudio Instructor Training and Certification Program here. The RStudio Education Blog also has lots of helpful posts about the program.

The process boils down to three steps.

Training Course

The first step is to sign up for the training course, which will likely be held over Zoom and chunked into 3-4 hour segments across 2-3 days. You can access the training materials here.

The training course is an interactive introduction to applying evidence-based teaching methods to data science education, such as learner personas, concept maps, and formative assessment (i.e. short, diagnostic questions or exercises to figure out if learners are forming accurate mental models). The course also covers how to design teaching materials with reverse instructional design that takes into account cognitive load, multiple learning strategies, and issues of inclusivity and student motivation in the classroom.

Technical Exam

The technical exam assesses your proficiency in whatever topic for which you are attempting to become a certified instructor. Currently there are options to become a certified instructor in tidyverse and shiny, and each has its own accompanying technical exam.

I took the tidyverse exam, which, broadly speaking, consists of a series of live coding challenges related to using core tidyverse packages for data cleaning and wrangling, data visualization, string manipulation, functional programming, basic statistical modeling, and creating reproducible documents with R Markdown.

As many others have suggested, a great way to prepare for this exam is to work through the exercises R for Data Science, particularly for topics that feel rusty to you, and review the community-contributed solutions.

I highly recommend going through these sample exams from the RStudio Education Blog start to finish to get a sense of what you might need to review.

Teaching Exam

The first certification exam assesses pedagogical skills related to teaching data science with R and requires giving a 15-minute demonstration lesson on a topic of your choice followed by a series of applied questions, which will likely involve creating formative assessments on unseen material (e.g. multiple choice questions and fill-in-the-blank coding exercises), developing concept maps on data science topics and giving feedback on example teaching based on pedagogical theory.

There are also sample teaching exams available.

Demonstration Lesson: Example

Column-wise operations with dplyr: Old and New

If you’d like to see an example of a demonstration lesson, below are the materials I created for this portion of the teaching exam. I used penguins from the {palmerpenguins} package as an example data set. (why? because penguins 🐧 🐧 🐧).

You can find all of the materials for this lesson and the accompanying code on Github. Feel free to share, adapt and re-use for your own teaching.

Slides

I made heavy use of Yihui Xie’s {xaringan} 📦, Garrick Aden-Buie’s {xaringanExtra} 📦, and Kelly Bodwin’s {flair} 📦, along with Allison Horst’s unbeatable artwork. For an excellent {xaringan} tutorial, I recommend you check out these slides, from the R Markdown whisperer herself, Alison Hill. Note: you absolutely do not have to use {xaringan} to make your slides, and if your lesson includes more images than code, another method for delivering your slides might be better.

Full slides available here.

❖ ❖ ❖

Concept Map

For other community-contributed data science concept maps you can use in your teaching and/or lesson prep, see here.

❖ ❖ ❖

Learner Persona

For a list of other example learner personas, see here.

❖ ❖ ❖

Formative Assessment

I created these interactive exercises using the learnr package, which I highly recommend you check out. It’s quite powerful and versatile.

Here’s a quick look.

The why

Ok, this might all seem like quite a bit of time and effort. Why go to the trouble of doing this training? In a word, Greg Wilson.

Greg, who co-founded the Software Carpentry, has over 35 years of experience in education in data science and software engineering, and it shows. He is now part of the RStudio Education team, where he runs the the instructor training and certification program. One of the reasons this program stands out is that it benefits from Greg’s unique expertise and careful curation of decades of research on evidence-based teaching methods that he has translated into clear and actionable advice. I can guarantee that you will learn a LOT from him.

Greg’s most important advice for teaching, in my opinion:

“Be kind: all else is details.”

Now, here are some other reasons why you should do this training…

Surge in online teaching

Interest in data science education seems to be ever-increasing. The fact that COVID-19 has forced most education to go online might actually present an opportunity to meet this demand in a more scalable and (hopefully more accessible way that doesn’t incur the traditional limitations of travel costs or room capacity. Of course, online education comes with a host of inherent challenges. The training course includes a whole section on this. I also recommend you check out this RStudio webinar and accompanying blog post along with answers to some frequently asked questions about teaching online.

As online data science education is becoming increasingly the norm, it seems natural to assume that there will be a need for more certified instructors to meet the growing demand.

❖ ❖ ❖

Teaching resources galore

Another great reason to become a certified instructor is that, as a data science educator, you have a huge and ever-increasing bank of resources at your disposal. What’s more, as a certified instructor, you are eligible for free licenses to RStudio Pro products and a significant discount for RStudio Cloud. Here are just some of the great teaching tools from RStudio and the #rstats community.

The RStudio Education Blog is a 💎 TREASURE TROVE 💎 of resources. Add it to your bookmarks immediately.

Teaching with RStudio Cloud

webinar and accompanying blog post, courtesy of Mine Çetinkaya-Rundel

Interactive lessons with learnr

tutorial and demonstration, courtesy of Allison Horst
lessons learned from using learnr to teach high schoolers, courtesy of Ezgi Karaesmen
a deep dive into learnr, courtesy of Nischal Shrestha
{gradethis} package for easily grading learnr exercises

Openly licensed teaching materials

a thorough summary of recent online courses/workshops, courtesy of Alison Hill
Data Science in a Box, courtesy of Mine Çetinkaya-Rundel
STAT 545, courtesy of Jenny Bryan
Many others, courtesy of the RStudio Education Team

rstudio4edu

a book-in-progress, courtesy of Desirée De Leon and Alison Hill. This is in a category of its own because it’s an absolute gold mine.

❖ ❖ ❖

Tried and tested

The instructor training program started back in February 2019 and as of August 2020 there are almost 150 certified tidyverse instructors and 20 shiny instructors. This means that the program has gone through multiple iterations and has made data-driven improvements based on feedback from participants – especially in the realm of supporting online teaching in the aftermath of COVID-19. So you can rest assured that, while it is still a relatively new program, all the kinks have been worked out.

Plus, I’m sure that the content and structure of the training will continue to adapt to the needs and priorities of the community, and you might even be lucky enough to catch a special guest presentation. For example…

Enjoyed sharing some tips today on “Teaching in Production” for our [@RStudioEDU] certified-instructors-to-be (another [@thomas_mock] distill success story!)

Thx to [@gvwilson] for the invite, [@allison_horst] for #rmarkdown 🦔(❣️), and [@dcossyle] for all her 🎨.https://t.co/sngAwlcSqN

— Alison Presmanes Hill ([@apreshill]) August 20, 2020

❖ ❖ ❖

A focus on inclusivity

The focus of this training is not technical competency – it’s how be an effective teacher. One of the most critical components of teaching effectively is to be inclusive of all learners, regardless of race, religion, sexual orientation, gender identity, disability, etc.

The #rstats learning community is known for being welcoming and inclusive, so it’s no surprise that the training course emphasizes these values as well. What I appreciate most about this aspect of the training is that it will challenge you to think about questions and hypothetical scenarios to which there are no easy answers.

However, it is extremely important to be pushed out of your comfort zone to consciously and proactively reflect on how you will confront issues such as systemic racism and institutionalized violence against BIPOC communities, sexism and a deeply ingrained culture of sexual harassment. These issues will inevitably arise in one form or another in your classroom or teaching setting, and it’s absolutely necessary that we confront these challenges now more than ever. Check out this slide and this talk on effective allyship when you get a chance.

For further reading on inclusivity and social justice in data science education, I recommend you read this post by Nicole Thompson Gonzalez and this one by Yim Register. Also check out the amazing work that JooYoung Seo, the first blind RStudio Certified Instructor, has been doing to make data science tools more accessible.

Another exciting feature is that the training materials are now available in Spanish, courtesy of Laura Acion, and hopefully other languages soon, as interest in the training seems to be growing around the world. A similar ongoing project to check out is glosario, an open source glossary of data science terms translated in multiple languages that can be used for teaching (read more here).

❖ ❖ ❖

Community of practice

To extend the idea of including everyone who wants to learn data science, we must be active in building teaching communities that extend beyond just the walls of academic institutions.

RStudio’s mission is to

“equip everyone, regardless of means, to participate in a global economy that rewards data literacy.”

A more concrete goal, put forth by Carl Howe, Director of Education at RStudio, is to train the next million R users. In becoming an RStudio certified instructor, you can better position yourself to actively participate in reaching this goal. But it’s worth reflecting on the fact that teaching and learning doesn’t happen in a vacuum – this is where the idea of community comes in. In my opinion, the fact that R users around the world already have a strong sense of community will make it that much easier to welcome new learners into the fold and make it more likely that they themselves will start to train others one day.

Read more about building a community of practice here.

P.S. If you need yet another reason to do this training, you get a fancy certificate at the end. ✨

Get in touch

Please feel free to reach out if you are thinking of participating in the training yourself and want to hear more from someone who’s gone through it recently. I would be glad to chat any time!

RStudio Instructor Certification

Thu, 03 Sep 2020 00:00:00 +0000

I recently went through RStudio’s Instructor Training and Certification Program , and I am now an RStudio Certified Instructor in the tidyverse . You can read more details in the links above.

If you’d like to hire me to lead a workshop or training for your group, please don’t hesitate to reach out . I would love to hear from you!

Data Science Training in Psychology

Sun, 08 Mar 2020 00:00:00 +0000

Psychology is generally considered a “soft” science, on the opposite end of the spectrum from the “hard” sciences of physics, chemistry, and biology. This often creates a misconception that psychology is somehow not as quantitative, computational, or rigorous, methodologically. To the contrary, psychology is in fact very “hard” (some might even say, “the hardest”). Why? Because explaining human cognition and behavior is really difficult. People do not think and behave in predictable and consistent ways like atoms and molecules.

Indeed, the combination of random variation (“noise”) in how we humans respond to our environment on an given day/hour/minute, combined with the inherent challenge of proper sampling, reliable measurement and accurate model building makes data analysis for a psychologist no easy feat. Explaining variance in psychological data has required centuries of refining statistical methods and computational tools. Fortunately, today’s scientists have access to open-source software like R and Python that have vastly enhanced our ability to work with data in a way that is more transparent and reproducible. As a result, the teaching of these tools is becoming increasingly more common in psychology graduate programs (and many other fields), particularly in statistics classes.

Graduate statistics

The Department of Psychology at the University of Oregon requires first-year graduate students to take a 3-course series of classes on statistics and data analysis. (You can access the materials for these classes here.) As I’m sure used to be the case in psychology departments across many universities, the labs for these classes were originally taught in SPSS. However, thanks to the efforts of some hard-working graduate teaching assistants who served as lab instructors at the time, the labs eventually transitioned to being taught entirely in R.

When I started TA-ing for graduate stats, we (@roseberrymaier, @flourneuro) translated the labs from SPSS to R. We created a bunch of .Rmd files for students to work from. It's so cool to see that those students are the TAs now, and they're creating these amazing materials! https://t.co/myMGefLxQX
— Dr. Jessica Kosie (@JessKosie) March 6, 2020

While learning R in first-year grad stats has immense benefits, it is also really challenging. This was certainly my experience, anyway. In addition to grappling with the dense conceptual material, learning a programming language and using it to do statistics felt really daunting since I had very little programming background before graduate school. And the reality is, given that many (myself included) tend to experience a large learning curve with programming, combined with the already hefty gradstats curriculum, there just isn’t space in these classes to teach students much beyond the basics of R.

Training needs

But the way things seem to be moving, it’s becoming more common for many students to need more general data science skills in grad school. Current psychology grad students at UO (n = 28) were recently surveyed about the degree to which they perceive they will need different data science-related skills for their desired careers and how much training in those skills is available at UO to their knowledge. Specifically, they were asked,

On a scale of 0 (“Not at all”) to 4 (“Essential”), how much do you NEED this skill for your desired career?
On a scale of 0 (“Not at all”) to 4 (“Complete”), how much training is PROVIDED in this skill at your institution?

I created the plot below (using ggplot2) to visualize how much students report they need these skills compared to how much training they feel they already have.

Interestingly, the top two skills that students reported needing the most on average for their careers are data visualization and data wrangling. Fortunately, this was the first year (to my knowledge) that PSY611, the first course in the gradstats sequence, included entire labs devoted to data visualization and data wrangling. More good news is that other faculty in the psych department are starting to offer courses that focus more on these skills that students seem to need the most. For example, Rob Chavez has offered a fantastic seminar called Data Science Methods in Psychology that covered a wide range of data science topics from programming in R to text processing to package creation that ultimately turned into a great collection of student-created tutorials (all of which are available here).

A collection of fantastic R tutorials from my ‘Data Science Methods in Psychology’ seminar course, created by our amazing @UOPsych grad students. https://t.co/DhBcn940uz
— Rob Chavez (@robchavez) June 12, 2018

Among other crucial research skills like study design, data collection, and research ethics, the other most coveted technical skill seems to be programming. In fact, general programming skills seems to be where there is currently the biggest gap in training in our department. The graph below shows skills ranked in descending order by how large the gap is between how much training in those skills students need and how much they currently have.

On the whole, it seems that that there are bigger training gaps for more general data science skills (e.g., programming in R and Python, data wrangling, data visualization). In contrast, the smallest gaps exist for more specialized skills like advanced statistics (e.g., computational modeling, network analysis, structural equation modeling) – likely because our department has an entire class devoted to each of these topics.

Learning Resources

So, for the most part, it seems that grad students in our department want more training in general data science skills above and beyond the training they are currently receiving through coursework. Often what this means is that grad students end up teaching themselves (and each other) these skills. Some of my peers have made really incredible tutorials on new tools and methodologies they’ve recently learned. Sometimes students also attend specialized methods workshops and take really detailed notes that could greatly benefit others who want to learn the same kind of methods. My goal is to make it easier for people (both within our department and beyond) to find these resources.

To that end, I am currently working with Sara Weston to create and curate a searchable central repository of data science resources at UO that will house such student-created tutorials, workshop notes, and other data science products (e.g. R packages, shiny apps, etc.) that other students can benefit from. We are also planning to add resources from our department’s data science and statistics classes (e.g. the gradstats sequence, multilevel modeling, network analysis, data science seminar, etc.). The hope is that making these resources easier to find and share by putting them all in one place will start to reduce some of the current gaps in data science training. The additional benefit is that students will be able to share their data science “side projects” more broadly, and it will be easier for people to know who they might be able to ask for help with learning certain topics when they need it.

This is a work in progress, so stay tuned for more details!

A final thought

Reflecting on all this has brought home a thought that I think is worth sharing. I have come to realize that, as grad students, one of the best resources we have access to during our time in grad school is each other. Personally, I have learned so much over the years from my fellow lab members. Without them, I would not have conquered my fear of Github or felt inspired to learn more about R and other programming languages. Perhaps the most impactful benefit I’ve received from them, though, is their encouragement – and that, in particular, is something I hope to pay forward as much as possible.

We all enter grad school with different backgrounds and skill sets, and in so many situations the combination of our different strengths can lead to mutual benefit. So why not help each other out?

education | Waseem Ashfaq

Flattening the leaRning curve: Teaching R online during COVID-19

Background

The challenge

Who attended?

Logistics

Zoom + Slack = 👌

RStudio Cloud

Blogdown site

Tools I learned

xaringanExtra

flair

flipbookr

countdown

Resources I recommend

Sharing on short notice

Teaching online on short notice

Teaching R online with RStudio Cloud

Teaching the tidyverse in 2020

Data science concept maps

rstats artwork

The importance of encouragement & positivity

Anticipate the challenge

Normalize errors & mistakes

Make your materials friendly and inviting!

Feedback

A final thought

Acknowledgements

UO Psych R Bootcamp 2020

Tidyverse Sample Exam 2.0 Solutions

Reflections on RStudio Instructor Training

The what

Training Course

Technical Exam

Teaching Exam

Demonstration Lesson: Example

Slides

Concept Map

Learner Persona

Formative Assessment

The why

Surge in online teaching

Teaching resources galore

Tried and tested

A focus on inclusivity

Community of practice

Get in touch

RStudio Instructor Certification

Data Science Training in Psychology

Graduate statistics

Training needs

Learning Resources

A final thought

`xaringanExtra`

`flair`

`flipbookr`

`countdown`