We shape our buildings and, afterwards, our buildings shape us: some lessons in how not to build an online university, and some ideas for doing it better

Posted , updated on

My heart briefly leapt to my throat when I saw Thursday’s Globe & Mail headline that the Albertan government had (allegedly) dropped its insane plan to force Athabasca University to move 65% of its workforce to the town of Athabasca. It seemed that way, given that the minister for post secondary education was referring to his demands and accompanying threat as only a ‘suggestion’ (broadly along the lines of Putin’s ‘suggestion’ that Ukraine should be part of Russia, perhaps). However, other reports, have said that he has denied any change in his requirements, albeit that he now claims it is open to negotiation. A ham-fisted negotiation tactic or just plain confused? I hope so, but I doubt it. I think that this is just a ploy to push the real agenda through with little resistance, and largely unnoticed. In the Globe & Mail article, the minister goes on to say “I would indeed like to see, at a bare minimum, senior executives and administrative staff be based in the town, as they have been for the past several decades.” A majority of what might be described as administrative staff do probably live in Athabasca anyway, and there is no reason for any of them to leave, so that’s just gaining a few easy election points from town voters. If the government actually wanted to help the town it would invest in the infrastructure and support needed to allow it to thrive, which it has signally failed to do for several decades, at least. No, his main target is clearly the senior executives: basically, he and the UCP want to put a team of executive lackeys in charge so that they can push their agenda through unopposed by anyone they care about. They have already sacked the incumbent and installed a chair of the board of governors who will do their bidding, and they have increased representation on the board from the town of Athabasca so this is the obvious next step. The execs won’t have to be fired. If they are required to move to Athabasca, most of what is probably the best executive team ever assembled in this or any other Albertan university will resign. Whoever replaces them will do the UCP’s dirty work, largely free from media oversight. Job done, bad press averted.

The UCP will, I am very sad to say, appear to have support from our own professional and faculty union (AUFA), even though most of us will, whether weakly or strongly, oppose it. This is because AUFA has a small but disproportionately powerful caucus in Athabasca, members of which have been deeply involved with an activist group called KAAU (Keep Athabasca in Athabasca University), who actually paid an insider lobbyist to start this fracas in the first place. Seriously. A casual observer might perceive at least a portion of the union’s leadership as putting the interests of the town ahead of the interests of the university. At best, their loyalties appear to be divided. The evidence for this is all too apparent in press statements and blog posts on the subject. Though most of us (including me) support the continuing presence of AU in Athabasca, these posts do not represent the views of most of those in the union, only those in charge of it. Only around 20% or thereabouts of AUFA members actually live in Athabasca, a percentage that has steadily fallen over the course of the last two decades, and almost all of those are professional members, not academics. Most members who had the chance to leave over the past 20 years did so. This is a point worth dwelling on.

We shape our buildings…

Athabasca High Street
Athabasca High Street at peak season

Athabasca is a tiny, inclement (-40 in Winter, bugs in summer) Northern town over 180km away from the nearest International airport. There is one (private) bus from Edmonton leaving late at night that arrives in town at 2:46am after a 3+ hour journey on a small, treacherous road. When it got too big for its Edmonton home, the university was (disastrously) moved there by a conservative government in 1984, ostensively to fill a gap left by the closure of the town’s main employer, but more likely due to the property interests held there by those behind the plan. About half the faculty resigned rather than work there. Ironically, the first president of AU deliberately named the university after a geographical feature of Alberta (the Athabasca River) precisely to avoid associating it with any city or region, so that local politics wouldn’t interfere with its mission. We might have been named after a mountain were it not that the University of Alberta happened to be demolishing Athabasca Hall (a students’ residence) at the time, so the name was free for us to use. It had nothing whatsoever to do with the town. It is possible that the president who named it was even unaware of the town’s existence or, at least, considered it to be too insignificant to be an issue.

Whatever charms the town may have (and it has a few), Athabasca has been a hobble for AU from the very start. I wrote about this at some length 5 years ago, just as we were on the cusp of making the massive changes we have been implementing ever since, but I would like to focus on two particularly relevant aspects in this post: the effects on the hiring pool, and the short-circuiting of communication with the rest of the university.

Firstly, it is really difficult to attract good employees to the town. Some residents of Athabasca will say that they feel insulted by this, believing that it implies that they are not the best and brightest. This is either disingenuous or a confirmation that they are, in fact, not the best and brightest, because all it means is that we have fewer good people to choose from. There are, of course, some incredibly smart, talented, creative people who live in Athabasca. But, equally, some are not: we have too often had to pick the best of a not-too-great bunch. The more people we expect to live in Athabasca, the bigger the problem of those who are not the best and brightest becomes. The undesirability of the place is confirmed by the KAAU itself, whose biggest complaint – the one that (at least on the face of it) drove their lobbying and union discontent in the first place – is that people have been leaving the town in droves since they were no longer required to stay, which pretty much says all that needs to be said. It is also notable that faculty and tutors are not and have never successfully been required to work in the town in all the university’s history, because it would be impossible to recruit sufficient numbers of sufficient quality, a fact that all parties involved in this (including the minister) acknowledge. We should get the best possible staff for almost every role – we all play some role in our distributed teaching model – but it is true in spades, plus some, for our executive team who, more than anyone else, have to be the most excellent that we can get. Right now, we have the best executive team that has ever been assembled at AU, bar none, and that is only possible because – for the first time ever – none of them have had to live in Athabasca.

…and our buildings shape us

Athabasca has, overwhelmingly, been home for staff that support but that do not directly implement its mission. Historically, these staff (predominantly administrators) have had extremely privileged access to the the leaders of the university compared with the rest of us. Even if they didn’t bump into them socially or in the canteens and halls, they would talk to people that did. And they would be the ones attending meetings in person while the rest of us phoned in or, in latter years, struggled with webmeeting systems that never really worked properly for in-person attendees, despite absurdly expensive equipment designed to support it. Fixing this was never a particularly high priority because those with the power to do so were the ones attending in-person, and it was just fine for them. Inevitably, Athabasca residents had a much better idea of what was going on and who was doing what than anyone else. More problematically, they had far greater influence over it: they didn’t ask for this, but they certainly got it. It is no wonder that they are now peeved, because most of their power, influence, and control over everything has been massively diminished since most of the execs left town. Their perception – voiced on many occasions by the Athabasca-dominated union –  that too much has recently been happening without consultation and that there is not enough communication from our leaders is, objectively speaking, completely false: in fact, it is far better than it has ever been, for those of us (the majority of staff) living remotely. They just no longer have a direct line themselves. I think this is the root of most of the union troubles of the last few years, whether consciously or not, and of the current troubles with the Albertan government.

In-person communities short-circuit online communities. I’ve seen it in teaching contexts a thousand times over: it just takes one group to branch off in person to severely damage or destroy a previously successful online community. Without fail, online communication becomes instrumental and intermittent. Tacit knowledge, in particular, disappears (apart from for the in-person group). Researchers like me (and many others at AU, including our president, in some of his former roles) have spent a great deal of time trying to make native online tools, systems, and working/teaching approaches that reduce these effects, but with only limited success. Combining fully online and in-person communities invariably wrecks the online community. Only when it is fully online, or when the online community is just an extension of the in-person community, can it thrive. Without the best of research-driven online tools and processes (most of which are not implemented at AU), hybrids are a disaster, and they are not much improved with even the best we have to offer.

In the past, the problem was partially offset by the fact that we had a few smaller learning centres elsewhere, in St Albert, Edmonton and Calgary (and, formerly, Fort McMurray), that were visited by the execs with varying frequency. However, this created what were, in many ways, bigger problems. It was incredibly inefficient, environmentally damaging, and expensive, wasting a lot of time and energy for all concerned. More significantly, although it helped to keep the exec team to be a little more in touch with others around the university and it helped to fill gaps in online communication for those living near them, it actually exacerbated the problem for our online community, because it created yet more in-person enclaves and cliques that developed independently of one another, sharing very little with the rest. Our business school, for instance, lived an almost entirely separate life from the rest of the university, in its own campus in St Albert (a satellite city attached to Edmonton), running its own largely independent communications and IT infrastructure but frequently meeting in person. As a result, we never developed the kind of unified online culture needed to sustain us.

Even more importantly, few of those with the power to change it ever learned what remote working was like for our students, so we didn’t create that online culture or community for them, either. Because of the inequalities that ensued, those of us who did know what it was like were not able to adequately influence the rest (especially the executive team) to get something done about it, because we were crowded out by the clamour of local communities. It’s not that the problem was unrecognized: it’s just that immediate operational concerns of in-person employees always came first. This was – and remains – a huge mistake. Too few of our students feel they belong, too few barely if ever interact with another student, too few see anything of the university beyond the materials provided for the courses they take. We have some excellent teaching processes, but processes (even the best) are only a part of what makes for a rewarding education. Yes, we do have plentiful support of all kinds, teaching approaches that should (for some but not all faculties) provide opportunities to develop relationships with human tutors, and the occasional opportunity to engage more broadly (mainly through the Landing), but many students completely bypass all of that. The need for it is beyond obvious, as evidenced by large number of Discords, Facebook Groups, Subreddits, and so on that they set up themselves to support one another. However, these are just more isolated enclaves, more subcultures, more virtual islands, without a single unifying culture to knit them together.

Online communication at AU has, as a direct result of its physical campuses, always tended to be extremely instrumental and terse, if it happened at all. When I arrived 15 years ago, most of my colleagues hardly ever communicated online with colleagues outside of a formal, intentional context. Those of us who did were yet another little clique. Emails (which were and remain the most commonly used tech) were only sent if there were a purpose, and most of the tacit knowledge, that more than anything else makes a traditional institution work despite its typically dire organization, was absent. In its place the university developed a very rigid, unforgiving, impersonal set of procedures for pretty much everything, including our teaching. If there was no procedure then it didn’t happen. There were gigantic gaps. The teaching staff – especially tutors but also most of the faculty – were largely unable to share in a culture and the admin-focused tacit knowledge that resided largely in one remote location. This was the largest part of what drove Terry Anderson and I to create the Landing: it was precisely to support the tacit, the informal, the in-between, the ad-hoc, the cultural, the connective aspects of a university that were missing. We touted it as a space between the formal spaces, actively trying to cultivate and nurture a diverse set of reasons to be there, to make others visible. Treating it as a space was, though, a mistake. Though it did (and does) help a little, the Landing was just another place to visit: it therefore has not (or has not yet) fulfilled our vision for it to seep into the cracks and to make humans visible in all of our systems. And we were not able to support the vital soft, human processes that had to accompany the software because we were just academics and researchers, not bosses: technologies are the tools, structures, and systems and what we do with them, but what we do with them is what matters most.  We need much more, and much better, and we need to embed it everywhere, in order to get rid of the short circuits of in-person cliques and online islands. A further death-knell to our online community was instigated by the (Athabasca-dominated) union that one day chose – without consultation – to kill off the only significant way for AUFA members to communicate more informally, its mailing list, only reluctantly bringing it back (after about 2 years of complaints), in a diluted, moderated, half-assed format that did not challenge their power. From an informal means of binding us, it became another instrumental tool.

Moving on

Despite the problems, it would be a senseless waste to pull out of Athabasca. We need a place for the library, for archives, for outreach into communities in the region, for labs, for astronomy, and to support research based in the region, of which there is already a growing amount. Virtually no one at the university thinks for a moment that we should leave the town. We are just doubling down on things to which it is best suited, rather than making it a centre of all our operations.  If people want to live there, they can. We can make a difference to an under-served region in our research, our outreach, and our facilities, and we are constantly doing more to make that happen, as a critical part of our reinvention of the university. It has symbolic value, too, as the only physical space that represents the university, albeit that few people ever see it.

However…

Athabasca should never become the seat of power, whether due to numbers of collocated workers or because it is where the exec team are forced to live. I am not singling the town out for special treatment in this: nowhere should play this role. We are and must be an online community, first and foremost. This is especially the case for our exec team. In fact, the more distributed they are the better. They will not walk the talk and fix what is broken unless they live with the consequences, and they are the last people who should be clustered together, especially with a particular employee demographic. This brings benefits to the university and to the communities to which we belong, including to Athabasca.

By far the greatest threat from the Albertan government’s intrusions and our own union’s efforts to restore their personal power is to the identity and culture – the very soul –  of the institution itself. Slowly (too slowly) and a bit intermittently we have, in recent years, been staggering towards creating a unified, online-native culture that embraces the whole institution. It has not been easy, especially thanks to the Athabascan resistance. But, regardless of their interference, we have made other mistakes. Our near-virtual implementation was the result of a large group representing the whole university, but one that lacked well-defined leadership or a clear mandate, that rushed development due to the pandemic, and that ignored most of what it found in its investigations of needs in its report to the university, leading to a hasty and incomplete implementation that has caused some unrest, most notably among those at Athabasca who are used to the comforts and conveniences of in-person working. For the majority of us who were already working online before the pandemic, things have got better, for the most part, but the benefits are very uneven. Too often we have poorly replicated in-person processes and methods to accommodate the newcomers, leading to (for instance) endless ineffectual meetings and yet more procedures. The near-virtual strategy remains a work in progress, and things will improve, but it got off to a stumbling, over-hasty start.

With limited funds, and contributing to the multiple failings of the near-virtual plan, we have signally failed to put enough effort into developing the technical infrastructure needed to support our nascent online community (one of the main needs identified by the near-virtual committee but not appearing in any meaningful way in the plan). I think we really should have focused on creating workable technologies to support our own community before working on teaching and administrative systems (or at least at the same time) but, after a decade of neglect while we were on the verge of bankruptcy, I guess we did need to fix those pretty urgently because they are what our students depend on. It’s just a bit tricky to pull yourself up by your own bootstraps if you are still using off-the-shelf tools designed to support in-person organizations (and commercial ones at that) rather than those designed for a virtual institution, especially when the more important human and organizational aspects are still rooted firmly in place-based thinking. I wrote about one aspect of that the other day. This won’t be a problem for long, I hope.  The fruits of the reinvention of our student-facing systems – that is taking up the bulk of our development resources right now – should start to appear around the end of this year, if the Albertan government or our own union doesn’t destroy it first. I hope that we can then get round to fixing our own house because, if we don’t, we will be easy prey for the next politician seeking easy votes and/or a sly buck from their investments.

Shaping our lives

The title of this post is a quote from Churchill. In fact, he liked it so much that he used variants on the phrase (sometimes preferring ‘dwellings’ to ‘buildings’) a number of times over a course of decades. I could equally have used Culkin’s (usually misattributed to Mcluhan) ‘we shape our tools and then our tools shape us’ because, as the first president of the university recognized many decades ago, we exist as a university within our communications network, not in a physical nor even a virtual space.

The recursive dynamic implied by Churchill’s and Culkin’s aphorisms applies to any complex adaptive system. In most systems – natural ecosystems, money markets, ant-trails, cities, and so on – this leads to metastability and adaptation, as agents adapt to their environments and, in the process, change those environments, in an endless emergent cycle of evolution. However, the large and slow moving elements of any complex system influence the small and fast moving far more than vice versa and humans are the only creatures that we know of who can deliberately mess with this dynamic by making radical and rapid changes to the large and slow moving parts of the spaces in which they dwell. In the past it has happened to Athabasca University due to the machinations of a small number of self-serving politicians and geographically located cliques, not due to educators. If we can prevent government interference and diminish the significance of those cliques then we can change that, and we have been doing so, rebuilding our systems to serve the needs of staff and students, not of a few land developers or groups of local residents.  This is not the time to stop. We are on the verge of creating a viable community and infrastructure for learning that could scale more or less indefinitely, where everyone – especially the students – can feel a part of something wonderful. Not cogs in machines, not products, but parts of an organic, evolving whole to which we all belong, and to which we all contribute. This matters: to our staff, to our students, to the people of Alberta, to the people of Canada, to the world. We should not be condemned to merely serve a small part of the economic needs of a small community, nor even of a province or country. If we follow that path then we will whimperingly shrink into a minor anachronistic irrelevance that appears as no more than a footnote in the annals of history, out-competed by countless others. Athabasca University matters most because it (not quite alone, but as part of a small, select pack of open and distance institutions) is beating a path that others can follow; an open, expansive, human-centred path towards a better future for us all. Let’s not let this die.

Learning, Technology, and Technique | Canadian Journal of Learning and Technology

Posted , updated on

This is my latest paper, Learning, Technology, and Technique, in the current issue of the Canadian Journal of Learning and Technology (Vol. 48 No. 1, 2022).

Essentially, because this was what I was invited to do, the paper shrinks down over 10,000-words from my article Educational technology: what it is and how it works (itself a very condensed summary of my forthcoming book, due out Spring 2023) to under 4,000 words that, I hope, more succinctly capture most of the main points of the earlier paper. I’ve learned quite a bit from the many responses to the earlier paper I received, and from the many conversations that ensued – thank you, all who generously shared their thoughts – so it is not quite the same as the original. I hope this one is better. In particular, I think/hope that this paper is much clearer about the nature and importance of technique than the older paper, and about the distinction between soft and hard technologies, both of which seemed to be the most misunderstood aspects of the original. There is, of course, less detail in the arguments and a few aspects of the theory (notably relating to distributed cognition) are more focused on pragmatic examples, but most are still there, or implied. It is also a fully open paper, not just available for online reading, so please freely download it, and share it as you will.

Here’s the abstract:

To be human is to be a user, a creator, a participant, and a co-participant in a richly entangled tapestry of technologies – from computers to pedagogical methods – that make us who we are as much as our genes. The uses we make of technologies are themselves, nearly always, also technologies, techniques we add to the entangled mix to create new assemblies. The technology of greatest interest is thus not any of the technologies that form that assembly, but the assembly itself. Designated teachers are never alone in creating the assembly that teaches. The technology of learning almost always involves the co-participation of countless others, notably learners themselves but also the creators of systems, artifacts, tools, and environments with and in which it occurs. Using these foundations, this paper presents a framework for understanding the technological nature of learning and teaching, through which it is possible to explain and predict a wide range of phenomena, from the value of one-to-one tutorials, to the inadequacy of learning style theories as a basis for teaching, and to see education not as a machine made of methods, tools, and systems but as a complex, creative, emergent collective unfolding that both makes us, and is made of us.

Originally posted at: https://landing.athabascau.ca/bookmarks/view/14622408/my-latest-paper-learning-technology-and-technique-now-online-in-the-canadian-journal-of-learning-and-technology

Thanks @demetriosnAB for your generous offer. We completely misunderstood that you wanted to help us. Here’s what we need…

Posted , updated on

Dear Demetrios Nicolaides

You say,

“I’ve offered to provide any kind of assistance that the university needs. They haven’t asked for any.”

This is very kind! I am sorry for all the very, very, very bad thoughts I have been thinking about you and your party. So, all we had to do was ask, eh?

We currently (in ball park terms) have about 300 staff in Athabasca out of a total of roughly 1200 staff overall. You want 65% of us to live there. So, what we need is:

  • ongoing funding to pay the salaries of 1500 new staff;
  • good, diverse, well-paid jobs for their families (yes, we have families);
  • support for building new homes to house the new staff;
  • computers, software, cloud services, high speed reliable internet to the town (not the rubbish we have now) for those new staff;
  • extra buildings to house them on the campus, including canteens, leisure facilities, etc;
  • regular, frequent transit links to the town of Athabasca.

We’ll let you off paying for 8 of those staff if you let our execs live wherever the hell they want. Maybe you could re-use the absurdly overblown presidential accommodation to house a family or six.

This is just a guess, but I think that, in total, such assistance might just about raise the government funding per student that you currently so generously provide us to around 70-80% of what you currently give to other Albertan universities.

It’s still a damn fool place to put a university so you’d better be prepared to offer some much better incentives for those you are forcing to live there. Higher pay, of course, maybe a free vehicle (electric, of course – you wouldn’t want to increase the outrageously high environmental impact of this proposal even more, would you?). If you expect us to do proper research, attracting international and national partners and research students, we will need at least a good rail link to the nearest international airport (you could have one built at Athabasca, perhaps? Imagine the additional benefits to Northern communities! Who wouldn’t want to fly to Athabasca rather than, say, Edmonton or Calgary?). You should probably improve and better maintain the road into town so that it stops killing and injuring our colleagues. We really don’t like that aspect of the job. It puts people off working there.

So, at the end of it, with all these additional expenses, you might have to put us nearly on par for per-student funding with the rest of Alberta’s comprehensive research universities. On the bright side, you’ll not have to pay for all the lawsuits and payouts for constructive dismissal, nor the humiliation of having destroyed one of the world’s finest universities, and I bet it would win you a ton of votes.

Thank you for the offer. Over to you.

Jon

P.S. And please, please, please would you just stop it with the micromanaging? It would save us all much unnecessary work and pain. More savings there.

P.P.S. And please stop talking about “not reinventing the school’s mandate but simply trying to reverse the trend away from it”  by the way. You’re just lending fuel to the popular misconception that there are liars, damned liars, and politicians. I suppose you mean the mandate forced on us against our will 40 years ago that made the president and half the faculty resign? The one that was rescinded decades ago because it was completely unworkable for a university hoping to hire top quality researchers, teachers, tutors, professional staff, and administrators? That one?

P.P.P.S. ‘An ultimatum (/ˌʌltɪˈmeɪtəm/; Latin for ‘the last one’) is a demand whose fulfillment is requested in a specified period of time and which is backed up by a threat to be followed through in case of noncompliance’. Sound familiar?

For anyone else reading this…

Wherever you live, please make your views known by contacting the Minister, Demetrios Nicolaides, at ae.minister@gov.ab.ca, or comment on social media, by tagging @demetriosnAB on Twitter, , #abpoli. Blog about it, write to the press about it, lobby outside the gates of the Albertan legislature, tell your friends, whatever: make a fuss.

 

Can GPT-3 write an academic paper on itself, with minimal human input?

Posted , updated on

Brilliant. The short answer is, of course, yes, and it doesn’t do a bad job of it. This is conceptual art of the highest order.

This is the preprint of a paper written by GPT-3 (as first author) about itself, submitted to “a well-known peer-reviewed journal in machine intelligence”. The second and third authors provided guidance about themes, datasets, weightings, etc, but that’s as far as it goes. They do provide commentary as the paper progresses, but they tried to keep that as minimal as needed, so that the paper could stand or fall on its own merits. The paper is not too bad. A bit repetitive, a bit shallow, but it’s just a 500 word paper- hardly even an extended abstract – so that’s about par for the course. The arguments and supporting references are no worse than many I have reviewed, and considerably better than some. The use of English is much better than that of the majority of papers I review.

In an article about it in Scientific American the co-authors describe some of the complexities in the submission process. They actually asked GPT-3 about its consent to publication (it said yes), but this just touches the surface of some of the huge ethical, legal, and social issues that emerge. Boy there are a lot of those! The second and third authors deserve a prize for this. But what about the first author? Well, clearly it does not, because its orchestration of phenomena is not for its own use, and it is not even aware that it is doing the orchestration. It has no purpose other than that of the people training it. In fact, despite having written a paper about itself, it doesn’t even know what ‘itself’ is in any meaningful way. But it raises a lot of really interesting questions.

It would be quite interesting to train GPT-3 with (good) student assignments to see what happens. I think it would potentially do rather well. If I were an ethically imperfect, extrinsically-driven student with access to this, I might even get it to write my assignments for me. The assignments might need a bit of tidying here and there, but the quality of prose and the general quality of the work would probably result in a good B and most likely an A, with very little extra tweaking. With a bit more training it could almost certainly mimic a particular student’s style, including all the quirks that would make it seem more human. Plagiarism detectors wouldn’t stand a chance, and I doubt that many (if any) humans would be able to say with any assurance that it was not the student’s own work.

If it’s not already happening, this is coming soon, so I’m wondering what to do about it. I think my own courses are slightly immune thanks to the personal and creative nature of the work and big emphasis on reflection in all of them (though those with essays would be vulnerable), but it would not take too much ingenuity to get GPT-3 to deal with that problem, too: at least, it could greatly reduce the effort needed. I guess we could train our own AIs to recognize the work of other AIs, but that’s an arms war we’d never be able to definitively win. I can see the exam-loving crowd loving this, but they are in another arms war that they stopped winning long ago – there’s a whole industry devoted to making cheating in exams pay, and it’s leaps ahead of the examiners, including those with both online and in-person proctors. Oral exams, perhaps? That would make it significantly more difficult (though far from impossible) to cheat. I rather like the notion that the only summative assessment model that stands a fair chance of working is the one with which academia began.

It seems to me that the only way educators can sensibly deal with the problem is to completely divorce credentialling from learning and teaching, so there is no incentive to cheat during the learning process. This would have the useful side-effect that our teaching would have to be pretty good and pretty relevant, because students would only come to learn, not to get credentials, so we would have to focus solely on supporting them, rather than controlling them with threats and rewards. That would not be such a bad thing, I reckon, and it is long overdue. Perhaps this will be the catalyst that makes it happen.

As for credentials, that’s someone else’s problem. I don’t say that because I want to wash my hands of it (though I do) but because credentialling has never had anything whatsoever to do with education apart from in its appalling inhibition of effective learning. It only happens at the moment because of historical happenstance, not because it ever made any pedagogical sense. I don’t see why educators should have anything to do with it. Assessment (by which I solely mean feedback from self or others that helps learners to learn – not grades!) is an essential part of the learning and teaching process, but credentials are positively antagonistic to it.

Originally posted at: https://landing.athabascau.ca/bookmarks/view/14216255/can-gpt-3-write-an-academic-paper-on-itself-with-minimal-human-input

#AthaU22 – may your journey be rich, gentle, and challenging

Posted , updated on

In the convocation prayer offered by Elder Maria Campbell each year for Athabasca University graduands, she asks for blessing that their journeys be “rich, gentle, and challenging”. I can’t think of a more perfect wish than this. Each word transforms and deepens the other two. It’s truly beautiful. Every time I hear those words (or, technically, read them – they are actually spoken in Cree) they tumble together in my head for days. I am reminded of these lines (that are about music, but that seem perfectly apt here) from Robert Browning’s Abt Vogler:

And I know not if, save in this, such gift be allowed to man

That out of three sounds he frame, not a fourth sound, but a star.

On this graduation day I wish all our departing students rich, gentle, and challenging lives, and (as Maria Campbell goes on to say, gently acknowledging troubles to come) that the roads they travel are not too bumpy.

And I wish the same to you, too.

Solving The Wrong Problems: Why Online Education Is and Must Be Different from In-Person Education – slides from my invited talk at ICEMI 2022

Posted , updated on

icemi22

These are the slides from my invited talk at the 11th International Conference on Education and Management Innovation (ICEMI 2022), June 11th. The talk went down well – at least, I was invited to repeat the performance at a workshop (where I gave a very similar presentation today – if you’ve seen one, you probably know the content of the other!) and to give a keynote later in the year.

It’s about how methods of teaching that solve problems for in-person teachers don’t apply online, and it provides a bit of advice on online-native approaches. I’ve talked quite a bit about this over the past decade so there’s not much new in it apart from minor refinements, though I have put a greater emphasis on what goes on outside the classroom in physical institutions because I’m increasingly thinking that this matters way more than we normally acknowledge. Notably, I discuss the ways that physical institutional structures and regulations provide significant teaching functions of their own, meaning that in-person teachers can be absolute rubbish or (in some subject areas or topics) even fail to turn up, and students can still learn pretty well. This helps to explain the bizarre phenomenon that, across much of in-person academia, professors and lecturers are not expected to learn how to teach (and many never do).

Here’s the abstract…

In-person educational institutions teach, at least as much as the individual teachers they employ. Students are taken out of their own environments and into that of the institution, signalling intent to learn. The physical environment is built for pervasive learning, from common rooms, to corridors, to campus cafes; students see one another learning, share learning conversations, learn from one another. Even the act of walking from classroom to classroom makes events within them more salient. Structures such as courses, timetables, semesters, and classes solve problems of teaching efficiently within the constraints of time and space but impose great constraints on how teaching occurs, and create multiple new pedagogical and management problems of their own. The institution’s regulations, expectations, and norms play a strong pedagogical role in determining how, and when learning occurs. Combined with other entrenched systems and tools like credentials, textbooks, libraries, and curricula, a great deal of the teaching process occurs regardless of teachers. What we most readily recognize as ‘good’ teaching overcomes the problems caused by these in-person environments, and exploits their affordances.

Online institutions have radically different problems to solve, and radically different affordances to exploit, so it makes no sense to teach or manage the learning process in the same ways. Online, students do not inhabit the environment of the institution: the institution inhabits the environment of the student. It is just one small part of the student’s physical and virtual space, shared with billions of other potential teachers (formal or not) who are a click, a touch, or a glance away. The institution is just a service, not the environment in which learning occurs. The student picks the time, the space, the pace, and virtually all the surrounding supports of the learning process. Teachers cannot actively control any of this, except through the use of rewards, punishments, and the promise of credentials, that force compliance but that are antagonistic to effective or meaningful learning. In this talk, I will discuss the implications of this inverted dynamic for pedagogy, motivation, digital system design, and organizational structures & systems for online learning.

 

 

 

Mediaeval Teaching in the Digital Age (slides from my keynote at Oxford Brookes University, May 26, 2021)

Posted , updated on

 front slide, mediaeval teaching

These are the slides from my keynote today at the Oxford Brookes “Theorizing the Virtual” School of Education Research Conference. As theorizing the virtual is pretty much my thing, I was keen to be a part of this! It was an ungodly hour of the day for me (2am kickoff) but it was worth staying up for. It was a great bunch of attendees who really got into the spirit of the thing and kept me wide awake. I wish I could hang around for the rest of it but, on the bright side, at least I’m up at the right time to see the Super Flower Blood Moon (though it’s looking cloudy, darn it).  In this talk I dwelt on a few of the notable differences between online and in-person teaching. This is the abstract…

Pedagogical methods (ways of teaching) are solutions to problems of helping people to learn, in a context filled with economic, physical, temporal, legal, moral, social, political, technological, and organizational constraints. In mediaeval times books were rare and unaffordable, and experts’ time was precious and limited, so lectures were a pragmatic solution, but they in turn created more problems. Counter-technologies such as classes, classrooms, behavioural rules and norms, courses, terms, curricula, timetables and assignment deadlines were were devised to solve those problems, then methods of teaching (pedagogies) were in turn invented to solve problems these counter-technologies caused, notably including:
· people who might not want (or be able) to be there at that time,
· people who were bored and
· people who were confused.
Better pedagogies supported learner needs for autonomy and competence, or helped learners find relevance to their own goals, values, and interests. They exploited physical closeness for support, role-modelling, inspiration, belongingness and so on. However, increasingly many relied on extrinsic motivators, like classroom discipline, grades and credentials to coerce students to learn. Extrinsic motivation achieves compliance, but it makes the reward or avoidance of the punishment the goal, persistently and often permanently crowding out intrinsic motivation. Intelligent students respond with instrumental approaches, satisficing, or cheating. Learning seldom persists; love of the subject is subdued; learners learn to learn in ineffective ways. More layers of counter-technologies are needed to limit the damage, and so it goes on.
Online, the constraints are very different, and its native forms are the motivational inverse of in-person learning. An online teacher cannot control every moment of a learner’s time, and learners can use the freedoms they gain to take the time they need, when they need it, to learn and to reflect, without the constraints of scheduled classroom hours and deadlines. However, more effort is usually needed to support their needs for relatedness. Unfortunately, many online teachers try (or are required) to re-establish the control they had in the classroom through grading or the promise of credentials, recreating the mediaeval problems that would otherwise not exist, using tools like learning management systems that were designed (poorly) to replicate in-person teaching functions. These are solutions to the problems caused by counter-technologies, not to problems of learning.
There are better ways, and that’s what this session is about.

front slide, mediaeval teaching

Educational technology: what it is and how it works | AI & Society

Posted , updated on

https://rdcu.be/ch1tl

This is a link to my latest paper in the journal AI & Society. You can read it in a web browser from there, but it is not directly downloadable. A preprint of the submitted version (some small differences and uncorrected errors here and there, notably in citations) can be downloaded from https://auspace.athabascau.ca/handle/2149/3653. The published version should be downloadable for free by Researchgate members.

This is a long paper (about 10,000 words), that summarizes some of the central elements of the theoretical model of learning, teaching and technology developed in my recently submitted book (still awaiting review) and that gives a few examples of its application. For instance, it explains:

  • why, on average researchers find no significant difference between learning with and without tech.
  • why learning styles theories are a) inherently unprovable, b) not important even if they were, and c) a really bad idea in any case.
  • why bad teaching sometimes works (and, conversely, why good teaching sometimes fails)
  • why replication studies cannot be done for most educational interventions (and, for the small subset that are susceptible to reductive study, all you can prove is that your technology works as intended, not whether it does anything useful).

Abstract

This theoretical paper elucidates the nature of educational technology and, in the process, sheds light on a number of phenomena in educational systems, from the no-significant-difference phenomenon to the singular lack of replication in studies of educational technologies.  Its central thesis is that we are not just users of technologies but coparticipants in them. Our participant roles may range from pressing power switches to designing digital learning systems to performing calculations in our heads. Some technologies may demand our participation only in order to enact fixed, predesigned orchestrations correctly. Other technologies leave gaps that we can or must fill with novel orchestrations, that we may perform more or less well. Most are a mix of the two, and the mix varies according to context, participant, and use. This participative orchestration is highly distributed: in educational systems, coparticipants include the learner, the teacher, and many others, from textbook authors to LMS programmers, as well as the tools and methods they use and create.  From this perspective,  all learners and teachers are educational technologists. The technologies of education are seen to be deeply, fundamentally, and irreducibly human, complex, situated and social in their constitution, their form, and their purpose, and as ungeneralizable in their effects as the choice of paintbrush is to the production of great art.

Originally posted at: https://landing.athabascau.ca/bookmarks/view/8692242/my-latest-paper-educational-technology-what-it-is-and-how-it-works

EdTech Books

Posted , updated on

This is a great, well presented and nicely curated selection of open books on education and educational technology, ranging from classics (and compilations of chapters by classic authors) to modern guides, textbooks, and blog compilations, covering everything from learning theory to choice of LMS. Some are peer-reviewed, there’s a mix of licences from PD to restrictive CC , and there’s good guidance provided about the type and quality of content. There’s also support for collaboration and publication. All books are readable online, most can be downloaded as (at least) PDF. I think the main target audience is students of education/online learning, and practitioners – at least, there’s a strong practical focus.

Originally posted at: https://landing.athabascau.ca/bookmarks/view/7161867/edtech-books (where you can find some really interesting comments, including the one that my automated syndicator mistakenly turned into the main post the first time it ran)

Skills lost due to COVID-19 school closures will hit economic output for generations (hmmm)

Posted , updated on

Snippet from OECD report on covid-19 and education This CBC report is one of many dozens of articles in the world’s press highlighting one rather small but startling assertion in a recent OECD report on the effects of Covid-19 on education – that the ‘lost’ third of a year of schooling in many countries will lead to an overall lasting drop in GDP of 1.5% across the world. Though it contains many more fascinating and useful insights that are far more significant and helpful, the report itself does make this assertion quite early on and repeats it for good measure, so it is not surprising that journalists have jumped on it. It is important to observe, though, that the reasoning behind it is based on a model developed by Hanushek and Woessman over several years, and an unpublished article by the authors that tries to explain variations in global productivity according to amount and  – far more importantly – the quality of education: that long-run productivity is a direct consequence of the cognitive skills (or knowledge capital) of a nation, that can be mapped directly to how well and how much the population is educated.

As an educator I find this model, at a glance, to be reassuring and confirmatory because it suggests that we do actually have a positive effect on our students. However, there may be a few grounds on which it might be challenged (disclaimer: this is speculation). The first and most obvious is that correlation does not equal causation. The fact that countries that do invest in improving education consistently see productivity gains to match in years to come is interesting, but it raises the question of what led to that investment in the first place and whether that might be the ultimate cause, not the education itself.  A country that has invested in increasing the quality of education would, normally, be doing so as a result of values and circumstances that may lead to other consequences and/or be enabled by other things (such as rising prosperity, competition from elsewhere, a shift to more liberal values, and so on).  The second objection might be that, sure, increased quality of education does lead to greater productivity, but that it is not the educational process that is causing it, as such. Perhaps, for instance, an increased focus on attainment raises aspirations. A further objection might be that the definition of ‘quality’ does not measure what they think it measures. A brief skim of the model used suggests that it makes extensive use of scores from the likes of TIMSS, PIRLS and PISA, standardized test approaches used to compare educational ‘effectiveness’ in different regions that embody quite a lot of biases, are often manipulated at a governmental level, and that, as I have mentioned once or twice before, are extremely dubious indicators of learning: in fact, even when they are not manipulated, they may indicate willingness to comply with the demands of the powerful more than learning (does that improve GDP? Probably).  Another objection might be that absence of time spent in school does not equate to absence of education. Indeed, Hanushek and Woessman’s central thesis is that it is not the amount but the quality of schooling that matters, so it seems bizarre that they might fall back on quantifying learning by time spent in school. We know for sure that, though students may not have been conforming to curricula at the rate desired by schools and colleges, they have not stopped learning. In fact, in many ways and in many places, there are grounds to believe that there have been positive learning benefits: better family learning, more autonomy, more thoughtful pedagogies, more intentional learning community forming, and so on.  Out of this may spring a renewed focus on how people learn and how best to support them, rather than maintaining a system that evolved in mediaeval times to support very different learning needs, and that is so solidly packed with counter technologies and so embedded in so many other systems that have nothing to do with learning that we have lost sight of the ones that actually matter. If education improves as a result, then (if it is true that better and more education improves the bottom line) we may even see gains in GDP. I expect that there are other reasons for doubt: I have only skimmed the surface of the possible concerns.

I may be wrong to be sceptical –  in fairness, I have not read the many papers and books produced by Hanushek and Woessman on the subject, I am not an economist, nor do I have sufficient expertise (or interest) to analyze the regression model that they use. Perhaps they have fully addressed such concerns in that unpublished paper and the simplistic cause-effect prediction distorts their claims. But, knowing a little about complex adaptive systems, my main objection is that this is an entirely new context to which models that have worked before may no longer apply and that, even if they do, there are countless other factors that will affect the outcome in both positive and negative ways, so this is not so much a prediction as an observation about one small part of a small part of a much bigger emergent change that is quite unpredictable. I am extremely cautious at the best of times whenever I see people attempting to find simple causal linear relationships of this nature, especially when they are so precisely quantified, especially when past indicators are applied to something wholly novel that we have never seen before with such widespread effects, especially given the complex relationships at every level, from individual to national.  I’m glad they are telling the story – it is an interesting one that no doubt contains grains of important truths – but it is just an informative story, not predictive science.  The OECD has a bit of track record on this kind of misinterpretation, especially in education. This is the same organization that (laughably, if it weren’t so influential) claimed that educational technology in the classroom is bad for learning. There’s not a problem with the data collection or analysis, as such. The problem is with the predictions and recommendations drawn from it.

Beyond methodological worries, though, and even if their predictions about GDP are correct (I am pretty sure they are not – there are too many other factors at play, including huge ones like the destruction of the environment that makes the odd 1.5% seem like a drop in the barrel) then it might be a good thing. It might be that we are moving – rather reluctantly – into a world in which GDP serves as an even less effective measure of success than it already is. There are already plentiful reasons to find it wanting, from its poor consideration of ecological consequences to its wilful blindness to (and causal effect upon) inequalities, to its simple inadequacy to capture the complexity and richness of human culture and wealth. I am a huge fan of the state of Bhutan’s rejection of the GDP, that it has replaced with the GNH happiness index. The GNH makes far more sense, and is what has led Bhutan to be one of the only countries in the world to be carbon positive, as well as being (arguably but provably) one of the happiest countries in the world. What would you rather have, money (at least for a few, probably not you), or happiness and a sustainable future? For Bhutan, education is not for economic prosperity: it is about improving happiness, which includes good governance, sustainability, and preservation of (but not ossification of) culture.

Many educators – and I am very definitely one of them – share Bhutan’s perspective on education. I think that my customer is not the student, or a government, or companies, but society as a whole, and that education makes (or should make) for happier, safer, more inventive, more tolerant, more stable, more adaptive societies, as well as many other good things. It supports dynamic meta-stability and thus the evolution of culture. It is very easy to lose sight of that goal when we have to account to companies, governments, other institutions, and to so many more deeply entangled sets of people with very different agendas and values, not to mention our inevitable focus on the hard methods and tools of whatever it is that we are teaching, as well as the norms and regulations of wherever we teach it. But we should not ever forget why we are here. It is to make the world a better place, not just for our students but for everyone. Why else would we bother?

Originally posted at: https://landing.athabascau.ca/bookmarks/view/6578662/skills-lost-due-to-covid-19-school-closures-will-hit-economic-output-for-generations-hmmm