Rowan University Laboratory for Educational Robotics

Rowan CS4HS: Introducing K-12 Teachers to Robot Programming

Jennifer S. Kay, Ph.D.
Rowan University, Computer Science Department
Rowan University Laboratory for Educational Robotics

This web page is for those who are interested in finding more out about the background behind Rowan's CS4HS program. If you're interested in participating in one of our free on-line courses, please visit the Rowan CS4HS Home Page.


Quick Links




How did you make the videos?

My videos were a combination of powerpoint slides, screencasts (on my Mac using Quicktime - more info below), and live videos. I used I am very fortunate that Rowan has a Radio/TV/Film department, and so we taped our videos in RTF studio 2 on professional equipment.

Do you have any other suggestions for making videos?

I make a lot of videos for my classes - most of them screencaptures (for example, here's one introducing BlueJ)- at my office desk. On a PC I use BB Flashback Express because it's free and does everything I need. I know many people also like Camtasia, but it's not free and I've never needed anything beyond what the BB software can give me. I've also made a number of pencasts for my students using a livescribe smartpen,  for example, here's one that's teaches about how to use the pumping lemma to prove that languages aren't regular,  I liked the smartpen a lot, but it was  before I had an iPad - now that I have an iPad I suspect I could do something similar on that. On a Mac I use quicktime player (yeah, player - the one that came free with my Mac) to do screencast recording. Here are some instructions on how to do that.

At the Learning@Scale Conference, Dan Garcia and Michael Ball demoed a fantastic system for making videos that allows you to do live integration of slides and human video using a greenscreen. I've never tried it before, but it looked great! Here are their slides and here's more details. You could use this, for example, to create lessons for a MOOC while teaching a live class in the classroom.

Another good resource is this Berkeley MOOCLab page on Capturing a MOOC

How Did you Edit the Videos?

Mostly I had RTF students do so. They used Final Cut Pro 7 (which is no longer in production) and swore that the newer version of Final Cut Pro wasn't any good. I've tried Final Cut Pro X and it seemed fine to me, but what do I know... I've also used iMovie on the Mac to do simple editing.

Did you build the MOOC yourself or use your campus on-line course platform?

I made videos and questions and then used Google's coursebuilder platform to run my MOOC.

What are the costs involved in making a MOOC?

Beyond vast quantities of time for writing scripts, recording and editing video, the big cost is hosting your MOOC. Coursebuilder uses Google appengine. At peak we probably spent about $5-$10 a day, here is the app-engine pricing information and some more info about Coursebuilder and google appengine.

How long did it take you to make your MOOC?

Much longer than we expected. Plan for a LOT more time. Every step of the way - script writing, videoing, editing, etc. took much longer than we thought it would. We started work on our first MOOC in March/April, planned on deploying in July, and eventually deployed in November.

The Rowan CS4HS Timeline


About Dr. Kay

Jennifer S. Kay is a Professor of Computer Science at Rowan University and Director of the Rowan University Laboratory for Educational Robotics (RULER). She holds M.S. and Ph.D. degrees in Computer Science from Carnegie Mellon University, as well as a B.A. in Mathematics and a B.S.E. in Computer Science and Engineering from the University of Pennsylvania. Dr. Kay was the 2013 recipient of the Lindback Distinguished Teaching Award, Rowan University's highest teaching honor. At Rowan, Dr. Kay teaches courses across the Computer Science curriculum, from introductory classes for non-majors, to classes at all levels of the B.S. and M.S. in computer science. She has run numerous workshops on LEGO robotics for K-12 teachers, co-chaired the "Robot Rodeo" and "Experience It" educational robotics events for computer science faculty and teachers at the SIGCSE Symposia, and co-chairs the annual Rowan University First State FIRST LEGO League Qualifier.

Dr. Kay was the primary developer for all of the curricular materials for this MOOC, and oversaw all aspects of its development.

Why Educational Robots for Absolute Beginners?

General Information

The state of computer science education in US schools is depressingly inadequate though it is improving.

Back in 2010, the Association for Computing Machinery and the Computer Science Teachers Association put out an astonishing report: Running on Empty: The Failure to Teach K-12 Computer Science in the Digital Age. Here is their 2010 call to action:

No other subject will open as many doors in the 21st Century, regardless of a student's ultimate field of study or occupation, as computer science. At a time when computing is driving job growth and new scientific discovery, it is unacceptable that roughly two-thirds of the entire country has few computer science standards for secondary school education, K-8 computer science standards are deeply confused, few states count computer science as a core academic subject for graduation, and computer science teacher certification is deeply flawed. These are national failings and ones that we can ill afford in this digital age.

Parents must ask difficult questions about how computer science is being introduced to their children in K-12 education and demand that schools move beyond the current basic technology literacy curriculum. Policy makers at all levels need to review how computer science is treated within existing policy frameworks and schools, and ensure that engaging computer science courses based on fundamental principles of the discipline are part of the core curriculum. Now is the time to revitalize K-12 computer science education and ensure universal access to computer science courses by making it one of the core academic subjects students require to succeed in the 21st Century.
The state of computer science education has improved. According to code.org https://code.org/promote As of 2016:



Dr. Kay's Motivation

"My goal is to teach robot programming to middle and high school teachers, so that they will bring it into their classrooms," Kay said. "There is a desperate need for more computer science in schools to give students the essential skills they need to succeed in today's world. I see this as a way to help get both teachers and kids excited about computer science in general and programming in particular as well as to inspire some of those students to see computer science as a future career path." 

Kay is pragmatic about the onsite and MOOC programs and their trickle-down effect on today's K-12 students. Not everyone, she knows, will become a computer science major in college or work in the technology realm. But, she firmly believes, everyone needs to master the basics of computer technology. "All of these kids, whether or not they become computer science majors, whether or not they have an interest in computer science, their whole lives are going to be spent using computers and interacting with people who use computers. It's really important that they have a fundamental knowledge of the field," she said. "My standard catchphrase is, 'If somebody says to you the computer can't do that, I want you to at least have the confidence to ask why not?'"

There are not the same type of K-12 common core standards for computer science as there are for Math and Language Arts. Kay wants to see students develop basic computer science skills so that they understand topics such as what an app is and how computers work. She also said it is crucial they learn computational thinking skills. "Computational thinking skills are important in everyday life. When you study computational thinking, you learn things like how to think logically, how to begin with the big picture and break it into smaller parts or how to find different solutions for the same problem and compare them," she said.

More detail - why it's important that everyone learn Computer Science

Here are some great links that you might want to visit:


About the On-line Courses

In 2013, Kay used the Google award to develop a Massively Open Online Course (MOOC), an Internet-based offering that teachers anywhere - indeed anyone, anywhere - can tap into. The course was been developed specifically for K-12 teachers, though it is free and open to anyone who is interested. Participants learn how to program LEGO NXT robots with the hope that they will bring their knowledge back into their classrooms and in after school robotics courses.

The Educational Robots for Absolute Beginners MOOC offers five to 10 lessons a week. Each lesson includes a five- to 10-minute video as well as self-test questions that are graded automatically. Participants also will design and construct a robot themselves and complete a set of five "robot programming projects."

In March 2014 Dr. Kay received a new award from Google to develop another MOOC to introduce K-12 teachers to LEGO's new EV3 Robot platform. The course outline will be quite similar to the NXT course. We expect to open that course in Fall 2014.

About Google's CS4HS program

From the CS4HS web site:

CS4HS (Computer Science for High School) is an initiative sponsored by Google to promote Computer Science and Computational Thinking in high school and middle school curriculum. With a gift from Google's Education Group, universities develop 2-3 day workshops for local high school and middle school CS teachers. These workshops incorporate informational talks by industry leaders, and discussions on new and emerging CS curricula at the high school and middle school level.

In 2013, in addition to funding the in-person workshops, CS4HS funded 4 online workshops, one of which is Educational Robotics for Absolute Beginners. You can see a full list of the CS4HS on-line and in-person workshops here. We're proud to be in the company of so many important institutions around the world.


Our Past Experience with CS4HS

The 2014 grant is Dr. Kay's fourth grant through the CS4HS program. In addition to the 2013 MOOC, she ran in-person workshops in 2011 and 2012.  Each three-day workshop included 20 to 25 educators from New Jersey, Pennsylvania and Delaware.

Useful links:


Evaluating our work

New! In fall 2014 we have received additional funds from Google that will enable us to do a much more in-depth study of the effectiveness of our work. More info coming soon as we move forward with that work.

Evaluation results to date ...


Raw Numbers - How many participants? How many complete?

People routinely ask the questions: "How many participants?" and "How many completers?" Before I answer that question, please read the following background:

MOOCs are notorious for having a low completion rate, for example, see this article from Inside Higher Ed and this article from Slate.

In this wonderful paper about evaluating the mapping with Google MOOC, Wilkowski, Deutsch, and Russell suggest that not everyone enrolls in a MOOC with the goal of completion. Indeed, I've enrolled in multiple MOOCs, and never finished one (other than my own). My personal reasons for enrolling in those MOOCs was typically more of a "let me see what others are doing" than a case of "I must get the certificate." I must admit that there was one course that I enrolled in that I was interested in "completing," but I didn't complete it because the homework assignments had deadlines and I had work related deadlines that had priority.

My MOOC is officially a 5-week course, but there are no deadlines for completion of assignments - if participants get busy and want to take a break they can return whenever they like. This might not work with a traditional "for credit" course, but since this is a course designed for teachers (and to get the certificate of completion they need to demonstrate their work to their principal), it works well.

So here are multiple snapshots of my MOOC with some information about completion. The dates vary because some of this data is easier to get than other data - I've updated the "easy to get" data, but not the "harder to figure out" data.

It's worth noting that in both tables the percentage of those who complete the course is increasing over time. Perhaps this is an argument that MOOCs have better completion when there are no fixed deadlines!


Retention Based on successful Completion of Robot Programming Projects (Self Reported Data)
(NXT Edition)


Date of Snapshot
Week 3
Week 4
Week 5
Ratio of # completing final project to those who attempted week 3 projects (as %)
Project 1
Project 2
Project 3
Project 4
Project 5
1/2/2014
95
95
60
60
39
41.05%
1/20/2014
103
104
71
69
55
52.88%
7/2/2014*
191
141
115
60.21%
3/16/2017* 577
458 422
73.14%
4/24/2017* 582
463 426
73.20%
1/27/2019*
606
477
442
72.94%
09/19/2022*
618
485
451
72.98%
* (For the later snapshots, we only include those who have completed all projects in a given week (because that is easier data to get - see note above) so Project 1 & 2 are grouped together, as are Project 3&4)



Retention Based on successful Completion of Robot Programming Projects (Self Reported Data)
(EV3 Edition)


Date of Snapshot*
Week 3
Week 4
Week 5
Ratio of # completing final project to those who attempted week 3 projects (as %)
Projects 1&2
Projects 3&4
Project 5
3/16/2017 377
233
159
42.18%
4/24/2017 393
243
171
43.51%
1/27/2019
617
385
297
48.14%
09/19/2022
885
582
507
57.29%
* (For all snapshots, we only include those who have completed all projects in a given week (because that is easier data to get - see note above) so Project 1 & 2 are grouped together, as are Project 3&4)





Retention Based on Weekly Activity
(NXT Edition)


Date of Snapshot
Total Enrolled
Number of Participants who Fully or Partially Completed Week
Number who participated in week 5 divided by Number who participated in week 1
(Note: no robot required for week 1)
Number who participated in week 5 divided by Number who participated in week 2
(Note: robot required for week 2 and beyond)
Week 1 (no robot required)
Week 2
Week 3
Week 4
Week 5
Extra Help Videos
1/2/2014
1165
732
352
224
132
82
88
11.20%
23.30%
3/13/2014
1458
884
437
305
189
136
107
15.38%
31.12%
7/2/2014
2298
1326
654
450
278
215
143
16.21%
32.87%
3/16/2017

4692
1980
1200
753
623
406
13.28%
31.46%
4/24/2017
8281
4752
2010
1214
759
632
407
13.30%
31.44%
1/27/2019
8937
5089
2150
1303
804
676
425
13.28%
31.44%
12/02/2019
9040
5137
2176
1314
811
684
425
13.32%
31.43%
09/19/2022
9159
5196
2213
1332
819
692
431
13.32%
31.27%




Retention Based on Weekly Activity
(EV3 Edition)


Date of Snapshot
Total Enrolled
Number of Participants who Fully or Partially Completed Week
Number who participated in week 5 divided by Number who participated in week 1
(Note: no robot required for week 1)
Number who participated in week 5 divided by Number who participated in week 2
(Note: robot required for week 2 and beyond)
Week 1 (no robot required)
Week 2
Week 3
Week 4
Week 5
Extra Help Videos
3/16/2017
3701
2850
1375
1066
744
296
180
10.39%
21.53%
4/24/2017
3878
2858
1429
1118
768
309
192
10.81%
21.62%
1/27/2019
6437
4805
2307
1820
1187
529
319
11.01%
22.93%
12/02/2019
7388
5498
2647
2104
1336
600
356
10.91%
22.67%
09/19/2022
8375
6213
3043
2432
1574
770
506
12.39%
25.30%