I’ve been taking the Coursera course Fundamentals of Online Education for the last week. I nearly said fortnight because it seems like longer and it seems like a lot has happened yet at the same time nothing has happened. The course was supposed to last 6 weeks but today (now yesterday), without any prior warning, the plug was pulled and the course unceremoniously closed. As a number of people on Twitter said, “Wow! Just wow!”. It’s difficult to know what any of the supposed 41000 enrollees are thinking because the site is shut. No one has anywhere to discuss or comment on their feelings or thoughts about the closure. Well we have e.g. our blogs, Twitter, FaceBook, but we are disconnected from each other. No community had developed in the week that the course was open and even in FaceBook, there was little widespread engagement.
Why did this happen? How could a course offered by a company that only offers courses to cohorts of many thousands allow this course to get through their quality control? (I’m making an assumption that there is a quality control process and that Coursera turn their experience gained over the last year or so to helping new courses get off on the right foot. I’m not sure whether it is more generous to think that they have failed in quality control or that they didn’t fail because they omitted it altogether.)
The course was supposed to teach the Fundamentals of Online Education and I think that it failed to do that in at least 3 ways; the course design, the pedagogical approach, and the materials used. It’s difficult to separate these out so I’ll describe the sequence of events.
When the course opened, I received a welcome email from the teacher which was a reasonable start although I would suggest that an email perhaps a week before the start, priming people would be better. The letter uses teacher-centric language “Thank you for taking my class!” which sets her as the expert and doesn’t give learners a stake in making sure the course works and problems are overcome. She also notes that the course will be a research site although we are free not to participate if we don’t want to. Before I had even entered the site I felt distanced from the course, a potential little guinea pig in someone else’s plan.
The letter stated that the course would be collaborative in nature and so we would need to join a group. Instructions were provided in a video in the course. First thing I do is scan about the course, get a feel for what is there, how it’s organised, what it wants me to do. The design should lead me through this. There are links to Week 1 and Week 2. The Week 1 link returned the following message:
Not a great start. Week 1 is where the detailed instructions for the ‘Join A Group’ spreadsheet are. Week 1 is the start of the course. Week 1 is meant to welcome us and make sure that we can all access the technology. When I look in the forums it is clear that this is a widespread issue, not something local to my set up. Getting the start right is not something which we’ve just realised is important. Gilly Salmon wrote about this nearly last century and this is stage 1.
So let’s look at joining a group. The course is using a Google spreadsheet for group sign up. There are no instructions within the spreadsheet but the rows are labelled Group 1, 2, etc and they are 20 columns wide. Seems the intention is that there will be 20 people in a group. Someone will add a new row and give the group a number which is one more than the group before. When 20 people have added their names to a row then someone creates a new row. When I first looked at it there were about 30 or 40 rows, most full. The spreadsheet did say that due to high traffic it was only showing list view but I’ve seen that before so no great worries.
Not sure how to decide which group to add myself to (what criteria should I use?) I go off and look around the forums and get something to eat. When I came back to the spreadsheet, it starts off as Row 1, 1001, 1002, 1003,,,. Some rows are full some have just one person. Some are not called Group x any more but have names like Group Pacific Timezone, Group 6, Group 6a or Alternative Group xxx and then lots where people had entered their name into the group name field. Group 29 has some space (somehow – I think because it is showing after 1001-1999) and I join as the 7th person in the group.
Next day, the following message was in my mail (Tue 29th 7:47am)
OK, so some problems with up to 41000 people trying to make a concurrent connection to the Google Spreadsheet. Maybe this wasn’t the best way to allocate groups. My thought at the time was that Google Forms would have coped with some scripting to allocate people to groups based on answers they gave in the form.
There was also a problem with the language in the message. It’s the bit about “Some of you have…” which suggests that we are to blame. We have been naughty learners and we have broken the spreadsheet and crashed Google. (Really?). Wow!
After work I checked the spreadsheet and found that I had become one of the disappeared. Also another announcement had also been made countering point 5 from the message above:
So I’m still in Group 29 even though my name’s not there and there are about 26 people listed. So I introduced myself and became a 29er for the week. Thirteen hours later, the following announcement was posted:
Wow! In less than 24 hours we’ve had 3 messages with different info about forming groups. And how will this option be any different? Having a look at this forum, Group A, started by the teacher, had 166 responses! The best group was called “Big confusion about groups” and had become full of people saying that they were confused about the groups and they had better join this one.
All this is just trying to get people into groups so they could collaborate. By Day 4 the disarray over people finding groups had become so apparent that the assignment deadlines had been extended:
Note the language again. The confusion and chaos was caused by Google, not by the design.
On day 5 this message appeared:
Hindsight may be a great thing but in the application and planning of an online course, foresight is too and perhaps allocating everyone from the start would have been a more effective solution.
Collaboration & Assignments
There is another point to make here about that email above. Actually getting people into groups wasn’t going to solve the issue of what to do when you were there. There was no instruction on collaborating, nor any indication from the assignment instructions as to why you would collaborate. The assignments asked to post our reaction to a set of readings into our group forum and then to copy and paste that reaction into the assignment tool. Nothing about working with others, refining and reflecting on your post, collaboration. It’s not surprising then that people were asking why we were going through the pain of group creation when we weren’t expected to work together in the groups. Malcolm Knowles and andragogy were mentioned in one of the video lectures yet there was no attempt to tell us why we were undertaking these activities, a key point in supporting adult motivation.
Going back to the videos, they appeared on Day 2 with a message apologising for the technical glitch. I started to watch one. Well I started and watched about 13 seconds. Then it stopped for 2 minutes. Then it started. Then it stopped. After an hour I had seen about 10 minutes of video. The forums had posts from people saying that when they had tried to download them so they could actually watch, the videos were up to 800Mb in size. People were complaining about the monetary cost in less well connected areas. $12 a video is a figure I remember. This seemed really strange for a course that was meant to be online learning 101 but it left users in the situation where they couldn’t access the learning because the technology got in the way. Wow!
It turned out there were lower quality (i.e non HD) videos available but there were no links to them from the syllabus. When I watched those I was amazed. I thought that the instructor had provided subtitles to ensure that they were accessible then I realised that the slides were being read verbatim.
The first video also had a set of Learning Objectives for the course. These were different from the learning objectives listed in the course syllabus. The videos didn’t align with the readings or lead us to them. There were factual inaccuracies, for instance concerning Creative Commons licenses, when it was stated that they allowed you to use material for non-commercial purposes. Actually the whole copyright section seemed designed to tell you what you weren’t allowed to do rather than how, as an online educator, you could find materials openly licensed for reuse.
So the modelling of using video in class seemed to be very, very poor. Perhaps it was going to get better but we will probably never know.
After 5 or 6 days, people were withdrawing from the course and offering erudite reasons for doing so:
And a student responded to that with:
In fact there had been a raft of excellent suggestions during the week as to how the course could be improved and technically made to work. (Debbie Morrison posted some on her blog.)
The morning of Day 7 arrived and an overnight message stated that week 2 was going to be delayed while week 1 was sorted.
It might have been interesting to have explored “what technology cannot do and the reaction of people when technology does fail”. Again the fault is external. A similar example is in the middle paragraph where it seems that learners were not educated enough to understand what was required of them, even those those requirements (“hopes”) were not stated, explained, or modelled anywhere.
I did some work until midday and then went out for coffee. When I came back at 2pm the following was in my inbox:
On going to the course page, this was the message:
Looking on Facebook, some people had been in the middle of working in forums when the site shut. No warning, nothing. Wow!
Trainwreck by found_drama, courtesy of a Creative Commons BY-NC-SA license
I could go on but there is little point. The pedagogy was instructivist, social aspects of learning were left to serendipity, the course used technological approaches suited to small cohort situations but that could not scale to the massiveness of a mooc, the learning objectives were poorly defined, and the pedagogy and teaching did not align with the intended outcomes or the assessments. This was a train wreck of a course and it’s not surprising that it crashed and burned. It is really surprising that Coursera are not providing quality control or developmental support that would have picked up these issues.
As people said to me on Twitter, Wow! Just Wow!
Pingback: #moocmooc | Pearltrees
Pingback: 24 Hours - A long time in online learning | Aprendizaje | Scoop.it
Pingback: Lesestoff | Pearltrees
Pingback: Fundamentals of Online Education: Dude, where’s my MOOC? | MoocMoocher
Pingback: 24 Hours - A long time in online learning | Educational Technology in Higher Education | Scoop.it
I was also enrolled in the course, and – – wow – – of all of the courses I have taken via Coursera, this one was THE WORST. Ironic that is was about teaching online… In fact, I thought it was actually a joke in the beginning, and it was going have a tie back that said something like “wasn’t that the worst ever? Don’t do that…let’s talk about what went wrong!” Sadly, as the days crippled on, I realized it wasn’t a teaching tactic! But, alas, I never got the email saying the course was being closed. But, when it is offered, I am hopeful that it will be by a professor with more experience. If that is how she teaching in real life, I can’t imagine she has tenure.
As much as this had to suck for the people who were enrolled in the class, how can you really complain or expect anything other than this outcome. I mean seriously you are talking about a free class. At the very best you should expect a small amount of useful knowledge from these classes. Think about it logically, there were 41,000 people enrolled in the class it was doomed to fail in many ways. Besides the fact that the instructor seemed to be unprepared and incompetent from what I’ve read, there is no way a single instructor could provide any kind of meaningful feedback to that many students. It would also be impossible for a single instructor to check the work of all of the students for validity and to make sure it was original work. Too many people think that these free classes are going to be the wave of the future and will solve all of their education needs and problems but they are wrong. These classes do not provide close to the amount of material found in a standard college course, there is no way to track students work for correctness and to make sure its original, and they don’t even offer enough classes to cover one entire field let alone the several they are trying to cover. If you need to learn one quick topic, sure it might help you but to be honest you would be far better off by buying a book and reading about the subject.
Do you seriously think that paying for education makes it inherently more worthwhile? I’ve been in plenty of unhelpful classes that I paid money for that taught me nothing of value, and I’ve learned a lot from many of the free classes I’ve taken. It comes down to the teacher, the structure of the class, and the subject. Clearly this class had a terrible design, but that doesn’t mean that every class does.
Also, if you think that paying for classes makes it impossible for people to cheat in them, well, then I don’t even know where to begin.
I disagree. In fact, online education can give better feedback than in-class education; for instance because the participation of the students can be measured. These kind of ideas were the topic of the course. IMO the course failed because it was innovative.
To me the technical glitches were the lesser evil. Watching the first substantive course video wherein the instructor read the dot points on the slide verbatim in a monotone voice was a deal breaker for me. Even if the course logistics worked seamlessly, this instructor was clearly not qualified to lead by example for a course on this topic.
I’m surprised that Coursera didn’t step in and do damage control before things got so far out of control. I’d be even more suprised if Coursera ever lets Fatima Wirth near another course again.
Pingback: 24 Hours - A long time in online learning | midmarketplace | Scoop.it
Wow. This is certainly not the experience I had in Coursera so far, which is pretty good so far. Like ‘Introduction to Finance’ offered by Gautam from University of Michigan. Perhaps it helps to preferentially select courses that are taught by professors with teaching awards.
Interesting that you liked Introduction to Finance – I started this course but there were 3 hour lectures basically explaining that with compound interest if you increase the interest rate, the total amount increases. I couldn’t devote that amount of time to sit through such tedious explanations of really basic concepts so gave up after 3 weeks.
Well, it is an introduction, you know? It is targeted at people with minimal background in academic studies, and yet with hard enough exercises worthy of college pedigree. I had some background in finance, so the first few lessons were a breeze for me too. However the professor explained concepts so well that I wished this was the first finance course I took back then
The number of hours is really at your own pace. That’s the advantage of online course, choose what you want to learn and skip those you already know, at your own discretion. I do increase the speed of the videos to 1.5X or 2X for going through of materials. For many others out there with lack of an opportunity to a college education or personal finance knowledge, I would think that is 3 hours well spent.
Learning to understand the concept yourself is not so difficult, the challenging part is how to communicate and enable others to learn this concept.
Pingback: 24 Hours - A long time in online learning | Focus: Online EdTech | Scoop.it
That’s incredible. Thanks for writing that up. I took one course on Coursera, Human Computer Interaction, which went much more smoothly. There was some confusion but not nearly this poorly organized. It is pretty incredible that the instructor kept implicitly blaming all of the students rather than taking responsibility.
Pingback: Sorry, this class site is now closed! The failure of a #Coursera Course: missing E-Moderation? | E-Moderation: aktives Online-lernen mit E-tivities | Scoop.it
Pingback: Sorry, this class site is now closed! The failure of a #Coursera Course: missing E-Moderation? | WCEL | Scoop.it
The Computation Investing course from Georgia Tech was also indescribably bad. I have no idea what Georgia Tech are doing.
Agreed, i didn’t really learn anything from it which was disappointing. Also I am glad that I’ll never hear that intro+outro music again! Seemed to take up too high a proportion of the video…
Pingback: Coursera course ‘Fundamentals of Online Education’ closed without warning | My Daily Feeds
I was also in this course and I really like the points you have made about the situation. I was one of the people fortunate enough to not suffer problems with the group and helped to keep my group together through the chaos, also I didn’t suffer the technical problems with the video. It has been an interesting couple of days since the course has been suspended/cancelled and seeing the reactions of people.
There has been everything from begging for the course to be reopened to questioning if this disaster of a week was a purposeful experiment to students admonishing others for apparently “not appreciating” that it was free and the effort that the teacher had put in.
With no statements from the instructor or Coursera on the steps (suspension implies it will be re-released again……but when?) I believe that they are allowing the situation to amplify further and further with each hour that passes.
Pingback: Sheila’s work blog » Learning from our MOOC-stakes and sharing learning designs
Pingback: 24 Hours - A long time in online learning | Massively MOOC | Scoop.it
Pingback: 24 Hours - A Long Time in Online Learning | #MOOC: Massively Open Online Courses | Scoop.it
Pingback: E-learning Insights - Experiences from a Troubled MOOC and Lessons for Online Courses of Any Size
Funny, I had enrolled in the course hoping to gain some insight into how I could best “flip” the course I deliver in our Executive MBA program, and basically bailed on the first day – didn’t even bother to explain why. The whole experience proves again that if you are going to offer a course using a particular pedagogy, to in fact teach people how to use said pedagogy, all the while claiming to be a pedagogical expert in it, one should have perfected said pedagogy before deployment.
The confidence and trust levels are not high in this one. Will the instructor get any other students at another point in time? Doubtful. Tarnished reputations are challenging to overcome, particularly in a socially connected world. This was a good break down of the breakdown, but critiquing the operation was like shooting fish in a barrel – too easy. Train wreck indeed.
To Aaron’s point: “Will the instructor get any other students at another point in time? Doubtful…Train wreck indeed.” I too had the same reaction, bailing out within the first six minutes of the first lecture. But unlike Aaron, I posted on the course forum a critique of the instructor’s teaching methods, which was profoundly flawed on multiple levels. To be constructive, I provided suggestions on how to deliver more compelling — or at least watchable — online video lecture, including links to the great Salman Khan.
I was surprised by the response. While some agreed with us, there was a large number of infuriated participants who blamed “holier-than-thou whiners like you” (i.e. me) for getting the course cancelled. These intrepid souls were committed to take this course under the dual philosophies of “what do you expect for free” and “you had no right to ruin it for the rest of us”.
One particularly aggrieved mother noted that she shared my post with her children as an example of adults behaving badly. I’m glad I could provide a teachable moment!
What these disappointed course participants don’t seem to understand is:
> “Whiners like me didn’t cause this course to be suspended. Coursera pulled the plug to limit further reputational damage
> This course may be free (for now), but the cost of producing and delivering it are not. The providers of MOOC content and the platform providers are not driven only by altruistic motives. And in fact, Coursera is the recipient of considerable VC funding, and investors are expecting an attractive return on their investment. So pushing a lousy course into the Cloud, particularly on a subject matter that was sure to be closely watched may be appreciated by some low expectation devotees, but does no favors for Coursera, its investors, Georgia Institute of Technology or the instructor
> On the one hand, with well over 200 courses on line, it is to be expected that Coursera is bound to have some weak links in its portfolio.
> But the profound lack of professionalism of this course convinces me that Coursera desperately needs to strengthen its quality control processes.
> I think a good role model here is organizer of TED conferences, who carefully vet, then train their presenters on effective communication
> We’re still in the early stages of MOOC development, so episodes like this are to be expected. There’s clearly work to be done
This report exactly mirrors my experience with this “course”. Thank’s a lot for your detailed description. Reading your post should be made mandatory for all organizers of online courses – prior to planning.
Pingback: Sorry, this class site is now closed! The failu...
Pingback: 24 Hours - A long time in online learning | Max...
Pingback: 24 Hours - A long time in online learning | Mid...