Are experienced online teachers best-placed to help in-person teachers cope with suddenly having to teach online? Maybe not.

lecturingI recently downloaded What Teacher Educators Should Have Learned From 2020. This is an open edited book, freely downloadable from the AACE site, for teachers of teachers whose lives were disrupted by the sudden move to emergency remote teaching over the past year or so.  I’ve only skimmed the contents and read a couple of the chapters, but my first impressions are positive. Edited by Richard Ferdig and Kristine Pytash, It springs from the very active and engaged AACE SITE community, which is a good indicator of expertise and experience. It seems well organized into three main sections:

  1.         Social and Emotional Learning for Teacher Education.
  2.         Online Teaching and Learning for Teacher Education.
  3.         eXtended Reality (XR) for Teacher Education

I like the up-front emphasis on social and emotional aspects, addressing things like belongingness, compassion, and community, mainly from theoretical/model-oriented perspectives, and the other sections seem wisely chosen to meet practitioner needs. The chapters adopt a standardized structure:

  • Introduction. 
  • What We Know. 
  • Lessons Learned for Research. 
  • Lessons Learned for Practice. 
  • What You Should Read. 
  • References

Again, this seems pretty sensible, maintaining a good focus on actionable knowledge and practical steps to be taken. It’s not quite a textbook, but it’s a useful teach-yourself resource with good coverage. I look forward to dipping into it a bit more deeply. I expect to find some good ideas, good practices, and good theoretical models to support my teaching and my understanding of the issues. And I’m really pleased that it is being released as an open publication: well done, AACE, for making this openly available.

But I do wonder a little about who else will read this.

Comfort zones and uncomfortable zones

The other day I was chatting with a neighbour who teaches a traditional hard science subject at one of the local universities, who was venting about the problems of teaching via Zoom. He knew that I had a bit of interest and experience in this area, so he asked whether I had any advice. I started to suggest some ways of rethinking it as a pedagogical opportunity, but he was not impressed. Even something as low-threshold and straightforward as flipping the classroom or focusing on what students do rather than what he has to tell them was a step too far. He patiently explained that he has classes with hundreds of students and fixed topics that they need to learn, and he really didn’t see it as desirable or even possible to depart from his well-tried lecture format. At least it would be too much work and he didn’t have the time for it. I did try to push back on that a bit and I may have mentioned the overwhelming body of research that suggests this might not be a wise move, but he was pretty clear and firm about this.  What he actually wanted was for someone to make (or tell him how to make) the digital technology as easy and as comfortably familiar as the lecture theatre, and that would somehow make the students as engaged as he perceived them to normally be in his lectures, without notably changing how he taught. The problem was the darn technology, not the teaching. I bit my tongue at this point. I eventually came up with a platitude or two about trying to find different ways to make learning visible, about explicitly showing that he cares, about taking time to listen, about modelling the behaviour he wanted to see, about using the chat to good advantage, and about how motivation differs online and off, but I don’t think it helped. I suspect that the only things that really resonated with him were suggestions about how to get the most out of a webcam and a recommendation to get a better microphone.

Within the context in which he usually teaches, he is probably a very good teacher. He’s a likeable person who clearly cares a lot about his students, he knows a lot about his subject, and he knows how to make it appealing within the situation that he normally works. His courses, as he described them, are very conventional, relying a lot on the structure given to them by the industry-driven curriculum and the university’s processes, norms, and structures, and he fills his role in all that admirably. I think he is pretty typical of the vast majority of teachers. They’re good at what they do, comfortable with how they do it, and they just want the technology to accommodate them continuing to do so without unnecessary obstacles.

Unfortunately, technology doesn’t work that way.

The main reason it doesn’t work is very simple: technologies (including pedagogies) affect one another in complex and recursive ways, so (with some trivial exceptions) you can’t change one element (especially a large element) and expect the rest to work as they did before.  It’s simple, intuitive, and obvious but unless you are already well immersed in both systems theories and educational theory, really taking it to heart and understanding how it must affect your practice demands a pretty big shift in weltanschauung, which is not the kind of thing I was keen to start while on my way to the store in the midst of a busy day.

To make matters worse, even if teachers do acknowledge the need to change, their assumption that things will eventually (maybe soon) return to normal means that they are – reasonably enough –  not willing and probably not able to invest a lot of time into it. A big part of the reason for this is that, thanks to the aforementioned interdependencies, they are probably running round like blue-arsed flies just trying to keep things together, and filling their time with fixing the things that inevitably break in the process. Systems thrive on this kind of self-healing feedback loop. I guess teachers figure that, if they can work out how to tread water until the pandemic has run its course, it will be OK in the end.

If only.

Why in-person education works

The hallmark technologies (mandatory lectures, assignments, grades, exams, etc, etc) of in-person teaching are worse than awful but, just as a talented musician can make beautiful noises with limited technical knowledge and sub-standard instruments, so there are countless teachers who use atrocious methods in dreadful contexts but who successfully lead their students to learn. As long as the technologies are soft and flexible enough to allow them to paper over the cracks of bad tools and methods with good technique, talent, and passion, it works well enough for enough people enough of the time and can (with enough talent and passion) even be inspiring.

It would not work at all, though, without the massive machinery that surrounds it.

An institution (including its systems, structures, and tools) is itself designed to teach, no matter how bad the teachers are within it. The opportunities for students to learn from and with others around them, including other students, professors, support staff, administrators, and so on; the supporting technologies, including rules, physical spaces, structures, furnishings, and tools; the common rooms, the hallways, the smokers’ areas (best classrooms ever), the lecture theatres, the bars and the coffee shops; the timetables that make students physically travel to a location together (and thus massively increase salience); the notices on the walls; the clubs and societies; the librarians, the libraries, the students reading and writing within those libraries, echoing and amplifying the culture of learning that pervades them; the student dorms and shared kitchens where even more learning happens; the parties; even the awful extrinsic motivation of grades, teacher power, and norms and rules of behaviour that emerged in the first place due to the profound motivational shortcomings of in-person teaching. All of this and more conspires to support a basic level of at least mediocre (but good enough) learning, whether or not teachers teach well. It’s a massively distributed technology enacted by many coparticipants, of which designated teachers are just a part, and in which students are the lead actors among a cast of thousands. Online, those thousands are often largely invisible. At best, their presence tends to be highly filtered, channeled, or muted.

Why in-person methods don’t transfer well online

When most of that massive complex machinery is suddenly removed, leaving nothing but a generic interface better suited to remote business meetings than learning or, much worse, some awful approximation of all the evil, hard, disempowering technologies of traditional teaching wrapped around Zoom, or nightmarishly inhuman online proctoring systems, much of the teaching (in the broadest sense) disappears with it. Teaching in an institution is not just what teachers do. It’s the work of a community; of all the structures the community creates and uses; of the written and unwritten rules; of the tacit knowledge imparted by engagement in a space made for learning; of the massive preparation of schooling and the intricate loops that connect it with the rest of society; of attitudes and cultures that are shaped and reinforced by all the rest.  It’s no wonder that teachers attempting to transfer small (but the most visible) parts of that technology online struggle with it. They need to fill the ever-widening gaps left when most of the comfortable support structures of in-person institutions that made it possible in the first place are either gone or mutated into something lean and hungry. It can be done, but it is really hard work.

More abstractly, a big part of the problem with this transfer-what-used-to-work-in-person approach is that it is a technology-first approach to the problem that focuses on one technology rather than the whole. The technology of choice in this case happens to be a set of pedagogical methods, but it is no different in principle than picking a digital tool and letting that decide how you will teach. Neither makes much sense. All the technologies in the assembly – including pedagogies, digital tools, regulations, designs, and structures – have to work together. No single technology has precedence, beyond the one that results from assembling the rest. To make matters worse, what-used-to-work-in-person pedagogies were situated solutions to the problems of teaching in physical classrooms, not universally applicable methods of teaching. Though there are some similarities here and there, the problems of teaching online are not at all the same as those of in-person teaching so of course the solutions are different. Simply transferring in-person pedagogies to an online context is much like using the paddles from a kayak to power a bicycle. You might move, but you won’t move far, you won’t move fast, you won’t move where you want to go, and it is quite likely to end in injury to yourself or others.

Such problems have, to a large extent, been adequately solved by teachers and institutions that work primarily online. Online institutions and organizations have infrastructure, processes, rules, tools, cultures, and norms that have evolved to work together, starting with the baseline assumption that little or none of the physical stuff will ever be available. Anything that didn’t work never made it to first base, or has not survived. Those that have been around a while might not be perfect, but they have ironed out most of the kinks and filled in most of the gaps. Most of my work, and that of my smarter peers, begins in this different context. In fact, in my case, it mainly involves savagely critiquing that context and figuring out ways to improve it, so it is yet another step removed from where in-person teachers are now.

OK, maybe I could offer a little advice or, at least, a metaphor

Roughly 20 years ago I did share a similar context. Working in an in-person university, I had to lead a team of novice online teachers from geographically dispersed colleges to create and teach a blended program with 28 new online courses. We built the whole thing in 6 months from start to finish, including the formal evaluations and approvals process. I could share some generic lessons from what I discovered then, the main one being to put most of the effort into learning to teach online, not into designing course materials. Put dialogue and community first, not structure. For instance, make the first thing students see in the LMS the discussion, not your notes or slides, and use the discussion to share content and guide the process. However, I’d mostly feel like the driver of a Model T Ford trying to teach someone to drive a Tesla. Technologies have changed, I have changed, my memory is unreliable.

bicycleIn fact, I haven’t driven a car of any description in years. What I normally do now is, metaphorically, much closer to riding a bicycle, which I happen to do and enjoy a lot in real life too. A bike is a really smart, well-adapted, appropriate, versatile, maintainable, sustainable soft technology for getting around. The journey tends to be much more healthy and enjoyable, traffic jams don’t bother you, you can go all sorts of places cars cannot reach, and you can much more easily stop wherever you like along the way to explore what interests you. You can pretty much guarantee that you will arrive when and where you planned to arrive, give or take a few minutes. In the city, it’s often the fastest way to get around, once you factor in parking etc. It’s very liberating. It is true that more effort is needed to get from A to B, bad weather can be a pain, and it would not be the fastest or most comfortable way to reach the other side of the continent: sometimes, alternative forms of transport are definitely worth taking and I’m not against them when it’s appropriate to use them. And the bike I normally ride does have a little electric motor in one of the wheels that helps push me up hills (not much, but enough) but it doesn’t interfere with the joy (or most of the effort) of riding.  I have learned that low-threshold, adaptable, resilient systems are often much smarter in many ways than high-tech platforms because they are part-human. They can take on your own smartness and creativity in ways no amount of automation can match. This is true of online learning tools as much as it is true of bicycles. Blogs, wikis, email, discussion forums, and so on often beat the pants off learning management systems, commercial teaching platforms, learning analytics tools or AI chatbots for many advanced pedagogical methods because they can become what you want them to be, rather than what the designer thought you wanted, and they can go anywhere, without constraint. Of course, the flip side is that they take more effort, sometimes take more time, and (without enormous care) can make it harder for all concerned to do things that are automated and streamlined in more highly engineered tools, so they might not always be the best option in all circumstances, any more than a bike is the best way to get up a snowy mountain or to cross an ocean.

Why you shouldn’t listen to my advice

It’s sad but true that most of what I would really like to say on the subject of online learning won’t help teachers on the ground right now, and it is actually worse than the help their peers could give them because what I really want to tell them is to change everything and to see the world completely differently. That’s pretty threatening, especially in these already vulnerable times, and not much use if you have a class to teach tomorrow morning.

The AACE book is more grounded in where in-person teachers are now. The chapter “We Need to Help Teachers Withstand Public Criticism as They Learn to Teach Online”, for example, delves into the issues well, in accessible ways that derive from a clear understanding of the context.  However, the book cannot help but be an implicit (and, often, explicit) critique of how teachers currently teach: that’s implied in the title, and in the chapter structures.  If you’re already interested enough in the subject and willing enough to change how you teach that you are reading this book in the first place, then this is great. You are 90% of the way there already, and you are ready to learn those lessons. One of the positive sides of emergency remote teaching has been that it has encouraged some teachers to reflect on their teaching practices and purposes, in ways that will probably continue to be beneficial if and when they return to in-person teaching. They will enjoy this book, and they may be the intended audience. But they are not the ones that really need it.

I would quite like to see (though maybe not to read) a different kind of book containing advice from beginners. Maybe it would have a title something like ‘What I learned in 2020’ or ‘How I survived Zoom.’ Emergency remote teachers might be more inclined to listen to the people who didn’t know the ‘right’ ways of doing things when the crisis began, who really didn’t want to change, who maybe resented the imposition, but who found ways to work through it from where they were then, rather than where the experts think (or know) they should be aiming now. It would no doubt annoy me and other distance learning researchers because, from the perspective of recognized good practice, much of it would probably be terrible but, unlike what we have to offer, it would actually be useful. A few chapters in the AACE book are grounded in concrete experience of this nature, but even they wind up saying what should have happened, framing the solutions in the existing discourse of the distance learning discipline. Most chapters consist of advice from experts who already knew the answers before the pandemic started. It is telling that the word ‘should’ occurs a lot more frequently than it should. This is not a criticism of the authors or editors of the book: the book is clear from the start that it is going to be a critique of current practice and a practical guidebook to the territory, and most of the advice I’ve seen in it so far makes a lot of sense. It’s just not likely to affect many of the ones who have no wish to change not just their practices but their fundamental attitudes to teaching. Sadly, that’s also true of this post which, I think, is therefore more of an explanation of why I’ve been staring into the headlights for most of the pandemic, rather than a serious attempt to help those in need. I hope there’s some value in that because it feels weird to be a (slight, minor, still-learning) expert in the field with very strong opinions about how online learning should work, but to have nothing useful to say on the subject at the one time it ought to have the most impact.

Read the book:

Ferdig, R.E. & Pytash, K.E. (2021). What Teacher Educators Should Have Learned From 2020. Association for the Advancement of Computing in Education (AACE). Retrieved March 22, 2021 from https://www.learntechlib.org/primary/p/219088/.

Asus Flip C234 Chromebook review

I’ve been thinking for some time that I need to investigate Chromebooks – at least, ever since Chrome OS added the means to run Android and Linux apps alongside Chrome web apps. I decided to get one recently because I was going on a camping trip during which I’d be required to do some work, and the (ridiculously many) machines I already had were all some combination of too limited, too unreliable, too fragile, too heavy, too power-hungry, too buggy, or too expensive to risk in a muddy campsite. A Chromebook seemed like a good compromise. I wanted one that was fairly cheap, had a good battery life, was tough, could be used as a tablet, and that was not too storage-limited, but otherwise I wasn’t too fussy. One of the nice things about Chromebooks is that, notwithstanding differences in hardware, they are all pretty much the same. 

After a bit of investigation, I noticed that an Asus C234 Flip with an 11.6″ screen was available at BestBuy for about $400, which seemed reasonable enough, based on the advertised specs, and even more reasonable when they lopped $60 off the price for Labour Day. Very unusually, though, the specs on the site were literally all that I had to go on. Though there are lots of Flip models, the C234 is completely unknown, apparently even to Asus (at least on its websites), let alone to reviewers on the web, which is why I am writing this! There’s no manual with it, not even on the machine itself, just a generic leaflet. Following the QR code on the base of the machine leads to a generic not-found page on the Asus site. Because it looked identical to the better-known Flip C214 I thought BestBuy must have made a labelling mistake but the model number is clearly printed in two places on the base. Despite the label it is, in fact, as I had guessed and eventually confirmed by circuitous means, identified by Asus themselves as a Flip C214MA, albeit with 64GB of storage rather than the more common 32GB and a very slightly upgrade Intel Celeron N4020 CPU instead of an N4000. This model lacks the option of a stylus that is available for many C214 models (pity – that seemed very nice). It was not quite the cheapest Chromebook to fit the bill, but I trust Asus a lot and have never regretted buying one of their machines over about 20 years or more of doing so quite frequently. They really know how to design and build a great computer, and they don’t make stupid compromises even on their cheapest machines, be they PCs, tablets, phones, or netbooks. Great company in a sea of dross.

Hardware overview

The C234 comes with only 4GB RAM, which means it can get decidedly sluggish when running more than a handful of small apps, especially when some of them are running under Linux, but it is adequate for simple requirements like word processing, light photo editing, audio recording, web browsing, email, webinars, etc: just the use cases I had in mind, in fact. The 64GB of storage is far less than I’d prefer but, I calculated, should be fine for storing apps. I assumed (wrongly) that any data I’d need locally could be kept on the 256GB SDXC card that I bought to go with it so I was – foolishly – not too concerned. It turns out that Android apps running under ChromeOS that can save data to the SD card are few and far between, and ChromeOS itself is barely aware of the possibility although, of course, most apps can read files from just about anywhere so it is not useless. Unfortunately, the apps that do not support it include most video streaming services and Scribd (which is my main source of ebooks, magazines, and audiobooks) – in other words, the ones that actually eat up most space. The physical SD slot is neat – very easy to insert and difficult (but not too difficult) to remove, so it is not going to pop out unexpectedly.

The computer has two full-spec USB-C ports that can be used for charging the device (45W PD, and not a drop less), as well as for video, external storage, and all the usual USB goodness. It has one USB-A 3.0 socket, and a 1/8″ combo mic/headphone socket that can take cellphone headsets or dedicated speakers/microphones. The wifi and bluetooth are both pretty modernish mainstream, adequate for all I currently have but maybe not everything I might buy next year. There is a plastic tab where a stylus is normally stored but, buyer beware, if the detailed model number doesn’t end in ‘S’ then it does not and cannot support a stylus: no upgrade path is available, as far as I can tell. Wifi reception is very good (better than my Macbook Pro), but there is no WiFi6. There’s no cellular modem, which is a pity, but I have a separate device to handle that. It does have a Kensington lock slot, which I guess reflects how it might be used in some schools where students have to share machines. Going back to the days when I used to manage university computer labs, I would have really liked these machines: they are very manageable. A Kensington lock isn’t going to stop a skilled thief for more than a couple of seconds but, as part of a security management strategy, they fit well.

The battery life is very good. It can easily manage 11-12 hours between charges from its 50WH battery, and could almost certainly do at least a couple more hours if you were not stretching its capabilities or using the screen on full brightness (I’m lazy and my eyesight is getting worse, so I tend to do both). It charges pretty quickly – I seldom run it down completely so the longest I’ve needed to plug it in it dropped below 20%, has been a couple of hours. It uncomplainingly charges from any sufficiently powerful USB-C charger.

As a laptop the Flip feels light in the hand (it weighs in at a little over a kilogram) but, as a tablet, it is pretty heavy and unwieldy and the keyboard cannot be detached. This is a fair compromise. Most of the time I use it as a laptop so I’d rather have a decent keyboard and a battery that lasts, but it is not something you’d want to hold for too long in the kind of orientations you might with an iPad or e-reader. Its 360 degree screen can fold to any intermediate angle so it doesn’t need a separate stand if you want to perch it on something, which is handy in a tent: while camping, I used it in both (appropriately) tented orientation and wrapped over a big tent pocket so that it was held in place by its own keyboard.

Video and audio

The touch screen is OK. At 1366×768 resolution and with a meagre 162 pixels per inch it is not even HD, let alone a retina display. It is perfectly adequate for my poor eyesight, though: fairly bright, acceptable but not great viewing angles, very sharp, and not glossy (I hate glossy screens). I’d much rather have longer battery life than a stunning display so this is fine for me. Viewing straight-on, I can still read what’s on the screen in bright sunshine and, though it lacks a sensor to auto-adjust the brightness, it does have an automatic night-time mode (that reddens and dims the display) that can be configured to kick in at sunset, and there are keyboard keys to adjust brightness. The generic Intel integrated GPU chip works, but that’s all I can say of it. I’d certainly not recommend it for playing graphics intensive games or using photoshop, and don’t even think about VR or compiling big programs because it ain’t going to happen.

The speakers, though, are ridiculously quiet: even when pumped up to full volume a little rain on the tent made it inaudible, and they are quite tinny. I’m guessing that this may have a bit to do with its target audience of schoolkids – a lack of volume might be a good thing in a classroom. The speakers are down-facing so it does benefit from sitting on a table or desk, but not a lot. The headphone volume is fine and it plays nicely with bluetooth speakers. It has a surprisingly large array of 5 microphones scattered quite widely that do a pretty good job of echo cancellation and noise reduction, providing surprisingly good sound quality (though not exactly a Blue Yeti).

It has two cameras, one 5K device conventionally placed above the screen when used in laptop mode, the other on the same surface as the keyboard, in the bottom right corner when typing, which is weird until you remember it can be used in tablet mode, when it becomes a rear-facing camera. Both cameras are very poor and the rear facing one is appalling (not even 1K resolution). They do the job for video conferencing, but not much else. That’s fine by me: I seldom need to take photos with my notebook/tablet and, if I want better quality, it handles a Logitech webcam very happily.

Input devices

The keyboard is a touch smaller than average, so it takes a bit of getting used to if you have been mostly using a full-sized keyboard, but it is quite usable, with plenty of travel and the keys and, though each keypress is quite tactile so you know you have pressed it, it is not clicky. It is even resistant to spilt drinks or a spot or two of rain. Having killed a couple of machines this way over the past thirty years or so (once by sneezing), I wish all keyboards had this feature. The only things I dislike about it are that it is not backlit (I really miss that) and that the Return key is far too small, bunched up with a load of symbol keys and easily missed. Apart from that, it is easy to touch type and I’d say it is marginally better than the keyboard on my Macbook Pro (2019 model). The keys are marked for ChromeOS, so they are a bit fussy and it can be hard to identify which of the many quote marks are the ones you want, because they are slightly differently mapped in ChromeOS, Android, and Linux. On the other hand I’m not at all fond of Chrome OS’s slightly unusual keyboard shortcuts so it’s nice that the keys tell you what they can do, even though it can be misleading at times.

The multi-touch screen works well with fingers, though could be far more responsive when using a capacitive stylus: the slow speed of the machine really shows here. Unless you draw or write really slowly, you are going to get broken lines, whether using native Chrome apps, Android, or Linux. I find it virtually unusable when used this way.

The touchpad is buttonless and fine – it just works as you would expect, and its conservative size makes it far less likely to be accidentally pressed than the gigantic glass monstrosity on my Macbook Pro. I really don’t get the point of large touchpads positioned exactly where you are going to touch them with your hand when typing.

There is no fingerprint reader or face recognition, though it mostly does unlock seamlessly when it recognizes my phone. It feels quite archaic to have to enter a password nowadays. You can get dongles that add fingerprint recognition and that work with Chromebooks, but that is not really very convenient.

Build

The machine is made to be used by schoolkids, so it is built to suffer. The shell of the Flip is mostly made of very sturdy plastic. And I do mean sturdy. The edges are rubberised, which feels nice and offers quite a bit of protection. Asus claim it can be dropped onto a hard floor from desk height, and that the pleasingly textured covering hides and prevents scratches and dents. It certainly feels very sturdy, and the texture feels reassuring in the hand, with a good grip so that you are not so likely to drop it. It doesn’t pick up fingerprints as badly as my metal-bodied or conventional plastic machines. Asus say that the 360 degree hinges should survive 50,000 openings and closings, and that the ports can suffer insertion of plugs at least 5,000 times. I believe them: everything about it feels well made and substantial. You can stack 30kg on top of it without it flinching. For the most part it doesn’t need its own case. I felt no serious worries throwing this into a rucksack, albeit that it is neither dust nor water resistant (except under the keyboard). Asus build it to the American military’s MIL-STD 810G spec, which sounds impressive though it should be noted that this is not a particular measure of toughness so much as a quality control standard to ensure that it will survive the normal uses it is designed for. It’s not made for battlefields, boating, or mountaineering, but it is made to survive 11-year-olds, and that’s not bad.

It’s not unattractive but nor is it going to be a design classic. It is just a typical old fashioned fairly non-descript and innocuous small laptop, that is unlikely to attract thieves to the same extent as, say, a Microsoft Surface or Macbook Pro. It has good old fashioned wide bezels. I realize this is seldom considered a feature nowadays, but it is really good for holding it in tablet mode and helps to distinguish the screen from the background. It feels comfortable and familiar. In appearance, it is in fact highly reminiscent of my ancient Asus M5N laptop from 2004, that still runs Linux just fine, albeit without a working battery, with only 768KB of RAM and with, since only recently, a slightly unreliable DVD drive – Asus really does make machines that last.

The machine is fanless so it is quite silent: I love that. Anything that moves inside a computer will break, eventually, and fans can be incredibly annoying even when they do work, especially after a while when dust builds up and operating system updates put more stress on the processor. If things do break, then the device has a removable panel on the base, which you can detach using a single standard Philips screwdriver, and Asus even thoughtfully provide a little thumbnail slot to prise it up. Through this you can access important stuff like storage and RAM, and the whole machine has a modular design that makes every major component easily replaceable – so refreshing after the nightmares of trying to do any maintenance on an Apple device. Inside, it has a dual core Celeron of some kind that can be pushed up to 2800 MHz – an old and well-tried CPU design that is not going to win any performance prizes but that does the job pretty well. From my tech support days I would be a bit bothered leaving this with young and inquisitive kids – they really like to see how things work by doing things that would make them not work. I lost a couple of lab machines to a class of kids who discovered the 240/110v switch on the back of old PCs.

It does feel very sluggish at the best of times after using a Macbook Pro – apps can take ages to load, and there can be quite a long pause before it even registers a touch or a keypress when it is running an app or two already – but it is less than a tenth of the price, so I can’t complain too much about that. It happily runs a full-blown DBMS and web server, which addresses most of my development needs, though I’d not be keen on running a full VM on the device, or compiling a big program.

Included software

There are no Asus apps, docs, or customizations included. It is pure, bare-bones, unadulterated Chrome OS, without even a default Asus page to encourage registration. This is really surprising. Eventually I found the MyAsus (phone) app for Android on Google’s Play store, which is awful but at last – when I entered the serial number to register the machine – it told me what it actually was, so I could go and find a manual for it. The manual contains no surprises and little information I couldn’t figure out for myself, but it is reassuring to have one, and very peculiar that it was not included with the machine. This makes me suspect that BestBuy might have bought up a batch of machines that were originally intended for a (large) organization that had laid down requirements for a bare-bones machine. This might explain why it is not listed on the Asus site.

ChromeOS

I may write more about ChromeOS at some later date – the main reason I got this device was to find out more about it – but I’ll give a very brief overview of my first impressions now. ChromeOS is very clever, though typical of Google’s software in being a little clunky and making the computer itself a little bit too visible: Android suffered such issues in a big way until quite recently, and Android phones still feel more like old fashioned desktop computers than iPhones or even Tizen devices.

Given that it is primarily built to run Chrome apps, It is surprisingly good at running Android apps – even VPNs – though integration is not 100% perfect: you can occasionally run into trouble passing parameters from a Chrome app to Android, for instance, some Android apps are unhappy about running on a laptop screen, and not all understand the SD card very well. Chrome apps run happily without a network, so you are not tied to the network as much as with other thin-client alternatives like WebOS.

It also does a really good job of running and integrating Linux apps. They all run in a Debian Linux container, so a few aspects of the underlying machine are unavailable and it can be a little complex when you want to use files from other apps or peripherals, but it is otherwise fully featured and utilizes much of the underlying Debian system that runs ChromeOS itself, so it is close to native Linux in performance. The icons for Linux apps appear in the standard launcher like any other app and, though there is a little delay when launching the first Linux app when it starts the container, once you have launched one then the rest load quickly. You do need a bit of Linux skill to use it well – command line use of apt is non-negotiable, at least, to install any apps, and integrating both Android and ChromeOS file systems can be a little clunky. Linux is still a geek option, but it makes the machine many times more useful than it would otherwise be. There’s virtually nothing I’d want to do with the machine that is constrained by software, though the hardware creates a few brick walls.

Integration between the three operating systems is remarkably good altogether but the seams show now and then, such as in requiring at least two apps for basic settings (ChromeOS and Android), with a handful of settings only being available via the Chrome browser, or in not passing clipboard contents to the Linux terminal command line (though you can install an x-terminal that works fine). I’ve hit quite a few small problems with the occasional app, and a few Android apps don’t run properly at all (most likely due to screen size issues rather than integration issues) but overall it works really well. In fact, almost too well – I have a few of the same apps in both ChromeOS and Android versions so sometimes I fail to notice that I am using the glitchier one until it is too late.

Despite the underlying Debian foundations, it is not super-stable and crashes in odd ways when you stretch it a little, especially when reconnecting on a different network, but it is stable enough for most standard uses that most people would run into, and it reboots really quickly. Even in the few weeks I’ve had it, it seems more stable, so this is a moving target.

Updates come thick and fast, but it is a little worrying that Google’s long term commitment to ChromeOS seems (like most of their offerings) shaky: the Web app store is due to close at some point soon and there are some doubts about whether it will continue to offer long term support for web apps in general, though Android and Linux support makes that a lot less worrying than it might be. Worst case would be to wipe most traces of ChromeOS and simply partition the machine for Linux, which would not be a bad end-of-life option at all. 

The biggest caveat, though, is that you really need to sell your soul (or at least more of your data than is healthy) to Google to use this. Without a Google account I don’t think it would work at all, but at the very least it would be crippled. I trust Google more than I trust most other big conglomerates – not because they are nice but because their business model doesn’t depend on directly selling my data to others –  but I do not love their fondness for knowing everything about me, nor that they insist on keeping my data in a banana republic run by a reality TV show host. As much as possible the apps I use are Google-free, but it is virtually impossible to avoid using the Chrome browser that runs many apps, even when you have a friendlier alternative like Vivaldi that would work just as well, if Google allowed it. In fairness, it is less privacy-abusive than Windows, and more open about it. MacOS is not great either, but Apple are fiercely aggressive in protecting your data and don’t use it for anything more than selling you more Apple goodies. Linux or BSD are really the only viable options if you really want to control your data or genuinely own your software nowadays.

Conclusions

This was a great little machine for camping. Though water and dust were a concern, especially given the low price I wasn’t too worried about treating it roughly. It was small and light, and it performed well enough on every task that I threw at it. It’s neither a great laptop nor a great tablet, but the fact that it performs both tasks sufficiently well without the ugliness and hassles of Windows or the limitations of single OS machines is very impressive.

Since returning from camping I have found myself using the machine a lot more than I thought I might. My Macbook Pro is pretty portable and its battery life is not too bad, but it is normally plugged in to a big monitor and a whole bunch of disk drives, so I can’t just pick it up to move around the house or down to the boat without a lot of unplugging and, above all, disk ejection (which, thanks to Apple’s increasingly awful implementation of background indexing that has got significantly worse with every recent release of OSX, can often be an exercise in deep frustration), so I rarely do so unless I know I will be away from the desk for a while. I love that I can just pick the Flip up and use it almost instantly, and I only need to charge it once every couple of days, even when I use it a lot. I still far prefer to use my Macbook Pro for anything serious or demanding, my iPad or phone for reading news, messaging, drawing, etc, and a dedicated ebook reader for reading books, but the fact that this can perform all of those tasks reasonably well is useful enough that it is fast becoming my default mobile device for anything a cellphone doesn’t handle well, such as writing anything of any length, like this (which is all written using the Flip).

In summary, the whole thing is a bit of a weird hybrid that shows its seams a bit too often but that can do most things any tablet or PC can do, and then some. It does a much better job than Windows of combining a ‘real’ PC with a tablet-style device, mainly because (thanks to Android) it does the tablet far better than any Windows PC and, thanks to Linux, it is almost as flexible as a PC (though, bearing in mind that Windows now does Linux reasonably well, it is not quite in the same league). The low spec of the machine does create a few brick walls: I am not going to be running any VMs on it, nor running any graphics-intensive, memory-intensive, or CPU-intensive tasks but, for well over 90% of my day to day computing needs, it works just fine.

I’m now left wondering whether it might be worthwhile to invest in one of the top-of-the-line Google Chromebooks to cater for my more advanced requirements. They are beautiful devices that address nearly all the hardware limitations of the C234 very well, and that are at least a match for mid-to-high end Windows and Mac machines in performance and flexibility, and they come at a price to match: really not cheap. But I don’t think either I or ChromeOS are quite ready for that yet.  MacOS beats it hands down in terms of usability, speed, reliability, consistency, and flexibility, despite Apple’s deeply tedious efforts to lock MacOS down in recent years (trying to triple boot to MacOS, Windows, and Linux is an exercise in frustration nowadays) and despite not offering a touch screen option. If Apple goes further down the path of assuming all users are idiots then I might change my mind but, for now, its own operating system is still the best available, and a Mac  runs Windows and Linux better than almost any equivalently priced generic PC. I would very seriously consider a high-end Chromebook, though, as an alternative to a Windows PC. It is inherently more secure, far less hassle to maintain, and lets you get to doing what you want to do much faster than any Windows machine. Unless you really need a bit of hardware of software that only runs under Windows – and there are very few of those nowadays – then I can think of few reasons to prefer it.  

Where to buy (current advertised price $CAD409): https://www.bestbuy.ca/en-ca/product/asus-flip-c234-11-6-touchscreen-2-in-1-chromebook-intel-celeron-n4020-64gb-emmc-4gb-ram-chrome-os/14690262

Evaluating assessment

Exam A group of us at AU have begun discussions about how we might transform our assessment practices, in the light of the far-reaching AU Imagine plan and principles. This is a rare and exciting opportunity to bring about radical and positive change in how learning happens at the institution. Hard technologies influence soft more than vice versa, and assessments (particularly when tied to credentials) tend to be among the hardest of all technologies in any pedagogical intervention. They are therefore a powerful lever for change. Equally, and for the same reasons, they are too often the large, slow, structural elements that infest systems to stunt progress and innovation.

Almost all learning must involve assessment, whether it be of one’s own learning, or provided by other people or machines. Even babies constantly assess their own learning. Reflection is assessment. It is completely natural and it only gets weird when we treat it as a summative judgment, especially when we add grades or credentials to the process, thus normally changing the purpose of learning from achieving competence to achieving a reward. At best it distorts learning, making it seem like a chore rather than a delight, at worst it destroys it, even (and perhaps especially) when learners successfully comply with the demands of assessors and get a good grade. Unfortunately, that’s how most educational systems are structured, so the big challenge to all teachers must be to eliminate or at least to massively reduce this deeply pernicious effect. A large number of the pedagogies that we most value are designed to solve problems that are directly caused by credentials. These pedagogies include assessment practices themselves.

With that in mind, before the group’s first meeting I compiled a list of some of the main principles that I adhere to when designing assessments, most of which are designed to reduce or eliminate the structural failings of educational systems. The meeting caused me to reflect a bit more. This is the result:

Principles applying to all assessments

  • The primary purpose of assessment is to help the learner to improve their learning. All assessment should be formative.
  • Assessment without feedback (teacher, peer, machine, self) is judgement, not assessment, pointless.
  • Ideally, feedback should be direct and immediate or, at least, as prompt as possible.
  • Feedback should only ever relate to what has been done, never the doer.
  • No criticism should ever be made without also at least outlining steps that might be taken to improve on it.
  • Grades (with some very rare minor exceptions where the grade is intrinsic to the activity, such as some gaming scenarios or, arguably, objective single-answer quizzes with T/F answers) are not feedback.
  • Assessment should never ever be used to reward or punish particular prior learning behaviours (e.g. use of exams to encourage revision, grades as goals, marks for participation, etc) .
  • Students should be able to choose how, when and on what they are assessed.
  • Where possible, students should participate in the assessment of themselves and others.
  • Assessment should help the teacher to understand the needs, interests, skills, and gaps in knowledge of their students, and should be used to help to improve teaching.
  • Assessment is a way to show learners that we care about their learning.

Specific principles for summative assessments

A secondary (and always secondary) purpose of assessment is to provide evidence for credentials. This is normally described as summative assessment, implying that it assesses a state of accomplishment when learning has ended. That is a completely ridiculous idea. Learning doesn’t end. Human learning is not in any meaningful way like programming a computer or storing stuff in a database. Knowledge and skills are active, ever-transforming, forever actively renewed, reframed, modified, and extended. They are things we do, not things we have.

With that in mind, here are my principles for assessment for credentials (none of which supersede or override any of the above core principles for assessment, which always apply):

  • There should be no assessment task that is not in itself a positive learning activity. Anything else is at best inefficient, at worst punitive/extrinsically rewarding.
  • Assessment for credentials must be fairly applied to all students.
  • Credentials should never be based on comparisons between students (norm-referenced assessment is always, unequivocally, and unredeemably wrong).
  • The criteria for achieving a credential should be clear to the learner and other interested parties (such as employers or other institutions), ideally before it happens, though this should not forestall the achievement and consideration of other valuable outcomes.
  • There is no such thing as failure, only unfinished learning. Credentials should only celebrate success, not punish current inability to succeed.
  • Students should be able to choose when they are ready to be assessed, and should be able to keep trying until they succeed.
  • Credentials should be based on evidence of competence and nothing else.
  • It should be impossible to compromise an assessment by revealing either the assessment or solutions to it.
  • There should be at least two ways to demonstrate competence, ideally more. Students should only have to prove it once (though may do so in many ways and many times, if they wish).
  • More than one person should be involved in judging competence (at least as an option, and/or on a regularly taken sample).
  • Students should have at least some say in how, when, and where they are assessed.
  • Where possible (accepting potential issues with professional accreditation, credit transfer, etc) they should have some say over the competencies that are assessed, in weighting and/or outcome.
  • Grades and marks should be avoided except where mandated elsewhere. Even then, all passes should be treated as an ‘A’ because students should be able to keep trying until they excel.
  • Great success may sometimes be worthy of an award – e.g. a distinction – but such an award should never be treated as a reward.
  • Assessment for credentials should demonstrate the ability to apply learning in an authentic context. There may be many such contexts.
  • Ideally, assessment for credentials should be decoupled from the main teaching process, because of risks of bias, the potential issues of teaching to the test (regardless of individual needs, interests and capabilities) and the dangers to motivation of the assessment crowding out the learning. However, these risks are much lower if all the above principles are taken on board.

I have most likely missed a few important issues, and there is a bit of redundancy in all this, but this is a work in progress. I think it covers the main points.

Further random reflections

There are some overriding principles and implied specifics in all of this. For instance, respect for diversity, accessibility, respect for individuals, and recognition of student control all fall out of or underpin these principles. It implies that we should recognize success, even when it is not the success we expected, so outcome harvesting makes far more sense than measurement of planned outcomes. It implies that failure should only ever be seen as unfinished learning, not as a summative judgment of terminal competence, so appreciative inquiry is far better than negative critique. It implies flexibility in all aspects of the activity. It implies, above and beyond any other purpose, that the focus should always be on learning. If assessment for credentials adversely affects learning then it should be changed at once.

In terms of implementation, while objective quizzes and their cousins can play a useful formative role in helping students to self-assess and to build confidence, machines (whether implemented by computers or rule-following humans) should normally be kept out of credentialling. There’s a place for AI but only when it augments and informs human intelligence, never when it behaves autonomously. Written exams and their ilk should be avoided, unless they conform to or do not conflict with all the above principles: I have found very few examples like this in the real world, though some practical demonstrations of competence in an authentic setting (e.g. lab work and reporting) and some reflective exercises on prior work can be effective.

A portfolio of evidence, including a reflective commentary, is usually going to be the backbone of any fair, humane, effective assessment: something that lets students highlight successes (whether planned or not), that helps them to consolidate what they have learned, and that is flexible enough to demonstrate competence shown in any number of ways. Outputs or observations of authentic activities are going to be important contributors to that. My personal preference in summative assessments is to only use the intended (including student-generated) and/or harvested outcomes for judging success, not for mandated assignments. This gives flexibility, it works for every subject, and it provides unquivocal and precise evidence of success. It’s also often good to talk with students, perhaps formally (e.g. a presentation or oral exam), in order to tease out what they really know and to give instant feedback. It is worth noting that, unlike written exams and their ilk, such methods are actually fun for all concerned, albeit that the pleasure comes from solving problems and overcoming challenges, so it is seldom easy.

Interestingly, there are occasions in traditional academia where these principles are, for the most part, already widely applied. A typical doctoral thesis/dissertation, for example, is often quite close to it (especially in more modern professional forms that put more emphasis on recording the process), as are some student projects. We know that such things are a really good idea, and lead to far richer, more persistent, more fulfilling learning for everyone. We do not do them ubiquitously for reasons of cost and time. It does take a long time to assess something like this well, and it can take more time during the rest of the teaching process thanks to the personalization (real personalization, not the teacher-imposed form popularized by learning analytics aficionados) and extra care that it implies. It is an efficient use of our time, though, because of its active contribution to learning, unlike a great many traditional assessment methods like teacher-set assignments (minimal contribution) and exams (negative contribution).  A lot of the reason for our reticence, though, is the typical university’s schedule and class timetabling, which makes everything pile on at once in an intolerable avalanche of submissions. If we really take autonomy and flexibility on board, it doesn’t have to be that way. If students submit work when it is ready to be submitted, if they are not all working in lock-step, and if it is a work of love rather than compliance, then assessment is often a positively pleasurable task and is naturally staggered. Yes, it probably costs a bit more time in the end (though there are plenty of ways to mitigate that, from peer groups to pedagogical design) but every part of it is dedicated to learning, and the results are much better for everyone.

Some useful further reading

This is a fairly random selection of sources that relate to the principles above in one way or another. I have definitely missed a lot. Sorry for any missing URLs or paywalled articles: you may be able to find downloadable online versions somewhere.

Boud, D., & Falchikov, N. (2006). Aligning assessment with long-term learning. Assessment & Evaluation in Higher Education, 31(4), 399-413. Retrieved from https://www.jhsph.edu/departments/population-family-and-reproductive-health/_docs/teaching-resources/cla-01-aligning-assessment-with-long-term-learning.pdf

Boud, D. (2007). Reframing assessment as if learning were important. Retrieved from https://www.researchgate.net/publication/305060897_Reframing_assessment_as_if_learning_were_important

Cooperrider, D. L., & Srivastva, S. (1987). Appreciative inquiry in organizational life. Research in organizational change and development, 1, 129-169.

Deci, E. L., Vallerand, R. J., Pelletier, L. G., & Ryan, R. M. (1991). Motivation and education: The self-determination perspective. Educational Psychologist, 26(3/4), 325-346.

Hussey, T., & Smith, P. (2002). The trouble with learning outcomes. Active Learning in Higher Education, 3(3), 220-233.

Kohn, A. (1999). Punished by rewards: The trouble with gold stars, incentive plans, A’s, praise, and other bribes (Kindle ed.). Mariner Books. (this one is worth forking out money for).

Kohn, A. (2011). The case against grades. Educational Leadership, 69(3), 28-33.

Kohn, A. (2015). Four Reasons to Worry About “Personalized Learning”. Retrieved from http://www.alfiekohn.org/blogs/personalized/ (check out Alfie Kohn’s whole site for plentiful other papers and articles – consistently excellent).

Reeve, J. (2002). Self-determination theory applied to educational settings. In E. L. Deci & R. M. Ryan (Eds.), Handbook of Self-Determination research (pp. 183-203). Rochester, NY: The University of Rochester Press.

Ryan, R. M., & Deci, E. L. (2017). Self-determination theory: Basic psychological needs in motivation, development, and wellness. Guilford Publications. (may be worth paying for if such things interest you).

Wilson-Grau, R., & Britt, H. (2012). Outcome harvesting. Cairo: Ford Foundation. http://www.managingforimpact.org/sites/default/files/resource/outome_harvesting_brief_final_2012-05-2-1.pdf.

Letting go and staying close: presentation to GMR Institute of Technology, India, August 2020

Letting go and staying close

Here are my slides from a presentation I gave to GMR Institute of Technology, Rajam of Srikakulum District, Andhra Pradesh State, India, last week. I gave the presentation from a car, parked in a camp site in the midst of British Columbia, surrounded by mountains and lakes and forest, taking advantage of a surprisingly decent 4G connection via an iPad. It was sadly not interactive, but I hope that those present learned something useful (even if, as my presentation emphasized, they did not learn what I intended to teach).

The general gist of it is that, when teaching online, we need to let go because the in-person power we have in a classroom simply isn’t there. There are other consequences – the need to build community, to demonstrate caring, to accept and value the context of the learner, to accept and value the very many teachers that they will encounter apart from us.

A novel approach to protecting academic freedom of speech: allow it, but do not allow it to be heard

The faculty and professional staff union at Athabasca University, AUFA (the Athabasca University Faculty Association), has two mailing lists, one used for announcements from its exec committee, and one for discussions between its members. Given that most of us have barely any physical contact with one another at the best of times, and that there are no other technologies that are likely to reach even a fraction of all staff involved in teaching and research (the Landing AUFA group, for instance, has only about 40 out of a few hundred potential members) the latter is the primary vehicle through which we, as a community of practice, communicate, share ideas and news, and engage in discussions that help to establish our collective identity. It’s a classic online learning community using a very low threshold, simple, universally accessible technology.

There had been a debate on the discussion list for a few days over the past week on a contentious issue pitting academic freedom against the needs and rights of transgender people. As too often happens when the rights of disadvantaged minorities are involved, the conversation was getting toxic, culminating in a couple of faculty members directly and very unprofessionally abusing another, telling him to shut up and to stop displaying his ignorance. This is not behaviour worthy of anyone, let alone teachers (of all people), and something had to be done about it. At this point the obvious solution would have been for the managers of the list to discuss these abuses individually with those members, and/or for the individuals themselves to reflect on and apologize for their behaviour, and/or to open up the debate on the list about acceptable norms and approaches to de-escalating situations like this. Sadly, that’s not how the list managers responded. Very suddenly, and without any prior warning or discussion whatsoever, the union executive committee shut the entire discussion list down indefinitely, mercilessly nuking it with the following terse and uninformative message posted to the announcement list:

” Dear AUFA members,

Until further notice, AUFA is suspending the AUFA discussions list serv for review of harmful language and due to a high volume of complaints.”

Shocked by this baldly authoritarian response, I immediately sent a strong message of protest, that I tempered with recommendations about what would have been an appropriate approach to managing the problem, and suggestions about ways to move forward with alternative methods and tools in future. I received no reply. One long day later, however, the following message was posted to the announcement list:

” Dear AUFA members,

I want to update you on the situation with the AUFA discussions list serv.

AUFA is committed to protecting Academic Freedom. AUFA is equally committed to protecting Human Rights. AUFA did not make the decision to suspend the list serv lightly. As the entity legally responsible for the listserv, AUFA has an obligation to ensure the safety of its members.

The AUFA executive had a lengthy discussion about the purpose and usefulness of the AUFA listserv and is actively considering alternative methods and forums by which members might communicate with each other in the near future. “

That’s it. That’s the whole message. Clearly they did not discuss this with the people who were actually affected, or with those who had been abusive, and they certainly didn’t talk about it with the rest of us. The message itself is remarkably uninformative, raising far more questions than it answers. It reads to me as ‘you have been naughty children and we have decided to send you to your room to think about it’. But I think they must have been following a different discussion than the one I saw because, though there was certainly some unprofessional nastiness and some unsubtle arguments expressed (that were becoming far more refined as the discussion progressed – that’s how free and open debate is supposed to work), I did not spot any human rights abuses during the discussion, and the only abuse of academic freedom I could see was the decision to shut down the list itself. Removing the possibility of speech altogether is certainly a non-traditional approach to protecting freedom of speech.

Notice, too, that in both messages there is a synecdochal conflation of ‘AUFA’ and ‘the AUFA executive committee’. I’m pretty sure that, as a member of AUFA, I would know whether I had been part of such a decision. That’s a bit like a teacher shutting down an online course because someone was rude, then claiming that the class shut it down. It’s a subtle way of abnegating responsibility, suggesting that some technological entity did something when, in fact, it was done by very real and fully responsible people. AUFA did not do this, and AUFA did not make these decisions. A small group of actual, real human beings did it, all by themselves.

I sent a strongly worded (but respectful) response to that one too.

Who owns this?

I think it is clear that the mailing list is not owned by the union executive committee. They are custodians of it, stewards who run it on the behalf of everyone in the union. Shutting it down denies the members of the union their primary means of connection and debate, including debate about this very issue. The message is quite misleading about the AUFA exec’s responsibilities, too: though they do need to be attentive to illegal behaviours, they are not legally responsible for what other people say on the listserv. In fact, the explicit or implicit legal protections afforded to providers of such services are fundamental to allowing much of the Internet to work at all. This is why there is so much outrage and protest against Trump’s efforts to remove such protections in the US right now. And there are lots of ways of handling the problem, from direct personal communication to public debate to the establishment of rules or a social contract to calling in the police. Going nuclear on the service does not fulfill that responsibility at all; it simply evades it.

It is absolutely fair to claim that list managers do have a responsibility to the union members of helping to maintain a non-abusive, safe, supportive online community. However, shutting down the thing they have an obligation to preserve is not just neglect of that responsibility but the worst and most harmful thing they could possibly do to fulfill it. It is like protecting an endangered animal by shooting it.

Ironically, the final message posted on the now-dead discussion list ended with the line:

“One thing I vowed to myself… is that I would never let anyone stop me from saying what I have to say “

Well, that kept like milk.

I feel incensed, abused, and suddenly incredibly isolated from my university and my colleagues. My sense of loss is tangible and intense. It’s lucky that I do have other channels, like this one, to vent my frustration and to bring this to a broader audience. I hope this message gets to at least a few of those who, like me, are feeling cut off and disempowered and, if they have not done so already, that they loudly voice their concerns to those responsible.

Moving on

Unfortunately, though very low threshold and accessible to all, listservs are not great tools for hosting contentious debates. They are extremely soft technologies which means that, on the positive side, they are extremely flexible and very low threshold, but that therefore a great deal of additional process must be added manually by their participants in order to deal with them: distinguishing threads, choosing which to attend to, tracking conversations, managing archived messages, using appropriate subject lines, to name but a few.

Listservs are poor tools for achieving consensus and poor tools for argument. The push nature of the technology means it can be very intrusive but, equally, the fact that we control our mail filters means that it can be completely shut down and ignored, without other participants having any knowledge that their messages are falling on deaf ears. It’s a technology that allows everyone to shout at the same time so it’s unsurprising that it is fertile ground for misunderstandings, confusion, high emotions, and people who forget that they are talking to other people. The very simplicity that makes them so easy to engage with also makes it easier to forget the humans behind the messages. Unless individuals have taken pains to share things about themselves with their messages, there are not even pictures and profiles to serve as a reminder. Though web archives may be available, they are rarely if ever open for continued dialogue: though, in principle, one could reply to a message from months or years ago, that virtually never happens. This means that people tend rush to get their message across before the list moves on to some other topic, with all the risks that entails. It kind of has to be that way. Because of the push nature of the medium, if conversations were to persist then multiple parallel discussions would rapidly overwhelm everyone’s inbox and attention.

For all these reasons and more, as anyone who has ever tried to do so will be painfully aware, managing a mailing list used for open discussion, especially one (like this) that lacks a clear mandate, contract or terms of engagement, takes a lot of manual effort, a fair bit of ingenuity, and a lot of careful attention. When things get out of hand, those who run the list need to take active, timely, creative measures to defuse them. It’s hard but necessary work, that demands sensitivity, a forgiving nature, a willingness to accept abuse with very little chance of being thanked for your efforts and, often, willingness and availability to work far ouside a normal working day (this, as it happens, is also true of many approaches to online teaching). Unfortunately, no one in our union leadership seems willing or able to take on such management. If that’s the case, the solution is not to shut it down. The solution is to pass it on to someone else who can and will moderate it more caringly, perhaps to put some more resources into managing it and, perhaps, to participatively look into rules, norms, and other tools and procedures that might do the job better.

Moving further on

There are hundreds and maybe thousands of tools and methods that can better (or at least differently) support this kind of debate than a listserv. Even the humble threaded forum at least allows such discussions to be segmented and, for those upset by them, ignored. Some allow for threads or people to be (from an individual’s perspective) muted, and many allow forum owners to close discussions in a particular thread without killing the whole thing. Some go beyond crude threads, allowing richer cross-linking between messages and discussions. Some offer authoring help, like in-line searching of previous messages and direct linking to sources or, simple AI to warn when sentiments appear to run high. Many tools allow for simple tricks like karma points, thumbs up, and other low threshold ways of signalling agreement or disagreement, in a manner that shows collective sentiment without a high commitment or fear of reprisal, and that also signals whether a topic is interesting to the crowd without relying on a deluge of messages to show it. Some offer means to reach decisions, from simple votes to computer supported collaborative argumentation tools. Many allow for profiles and other signals of social presence that make the humans behind the messages more visible and salient. Some (blogs, say, like this one) allow for more focused subscribable discussions on specific themes that are managed and owned by the creator of the original post, and that are not as ephemeral as mailing lists. Some offer other tools like persistent shared bookmarks or filesharing that help to organize resources related to themes of debate. Some have recommender systems that show related posts and thus help to situate discussions, and to support connections back to previous discussions. Many have persistence so that learning is reified and searchable, not lost in a stream of thousands of other emails. Some allow for scheduling and time-limited discussions.

Equally, there are lots of process models for reaching consensus on social norms and acceptable behaviours, as well as ways of dealing with issues when they arise. Skills can be developed in stewardship and moderation so that problems are defused before they become severe, or not arise in the first place thanks to careful specification of ground rules or structuring of the process. There are plenty of books and papers on the subject (this is my favourite, especially now that it is free) that delve into great detail. There are ways of taking an holistic approach that takes into account the larger social ecosystem to (for instance) help to build social capital, use different tools for different functions, and so on.

All of these technologies, including process models, methods, and procedures, come with plentiful gotchas – Faustian bargains and monkeys’ paws that can easily cause more problems than they solve and that will never be ideal for all – so this is not a set of decisions that should be entered into lightly or without extensive consultation, participation, and analysis, and it should always be thought of as an ongoing process, never a finished solution. Clearly, it eventually needs to be done. In the meantime, if a listserv is all we have, then we should at least manage it properly. It is not acceptable to simply nuke the only tool we have, even if it is a weak one.

I do realize that union leadership is an extremely hard and often thankless job and, though I frequently feel very critical of things they do on my behalf,  especially when they adopt an archaic ‘us vs them’ vocabulary, I am thankful they do it. I very seldom voice my adverse opinions because I know they are trying to do their best for everyone, I am certainly not willing to take on the enormous commitments involved myself and, without their hard work and principled actions (regardless of occasions when they actively make things worse) we would, on average, be in a far worse place than we are today. However, the union leadership’s response to this has been outrageously authoritarian, disproportionate, insensitive, and deeply harmful, in direct opposition to everything a union should stand for. If this is a reflection of their values then they do not have either my trust or my support.

 

Postscript

Eventually, after nearly two days, I received a one-line personal reply to my original complaint telling me that the suspension of the list is temporary (this may be news to others in the union who have not been told this: you heard it here first, folks!) and that they will, at some unspecified point, be seeking input from members on communication preferences (not consultation, note, or participation, just input). No timelines were given. I am not satisfied with this.

Does technology lead to improved learning? (tl;dr: it's a meaningless question)

Students using computers, public domain, https://www.flickr.com/photos/internetarchivebookimages/19758917473/There have been (at least) tens of thousands of comparative studies on the effects of ‘technology’ on learning performed over the past hundred years or so. Though some have been slightly more specific (the effects of computers, online learning, whiteboards, eportfolios, etc) and some more sensible authors use the term ‘tech’ to distinguish things with flashing lights from technologies in general, nowadays it is pretty common to just use the term ‘technology’ as though we all know what the authors mean. We don’t. And neither do they.

It makes no more sense to ask whether (say) computers have a positive or negative effect on learning than to ask whether (say) pedagogies have a positive or negative effect on learning. Pedagogies (methods and principles of learning and teaching) are at least as much technologies as computers and their uses and forms are similarly diverse. Some work better than others, sometimes, in some contexts, for some people. All are soft technologies that demand we act as coparticipants in their orchestration, not just users of them. This means that we have to add stuff to them in order that they work. None do anything of interest by themselves – they must be orchestrated with (usually many) other tools, methods, structures, and so on in order to do anything at all. All can be orchestrated well (assuming we know what ‘well’ really means, and we seldom really do) or badly.

It is instructive to wonder why it is that, as far as I know, no one has yet tried to investigate the effects of transistors, or screws, or words, or cables on learning, even though they are an essential part of most technologies that we do see fit to research and are certainly prerequisite parts of many educational interventions. The answer is, I hope, obvious: we would be looking at the wrong level of detail. We would be examining a part of the assembly that is probably not materially significant to learning success, albeit that, without them, we would not have other technologies that interest us more. Transistors enable computers, but they do not entail them.

Likewise computers and pedagogies enable learning, but do not entail it (for more on enablement vs entailment, see Longo et al, 2012 or, for a fuller treatment, Kauffman, 2019). True, pedagogies and computers may orchestrate many more phenomena for us, and some of those orchestrations may have more consistent and partly causal effects on whether an intervention works than screws and cables but, without considering the entire specific assembly of which they are a part, those effects are no more generalizably relevant to whether learning is effective or not than the effects of words or transistors.

Technologies enable (or sometimes disable) a range of phenomena, but only rarely do they generalizably entail a fixed set of outcomes and, if they do, there are almost always ways that we can assemble them with other technologies that alter those outcomes. In the case of something as complex as education, which always involves thousands and usually millions of technological components assembled with one another by a vast number of people, not just the teacher, every part affects every other. It is irreducibly complex, not just complicated. There are butterfly’s wing effects to consider – a single injudicious expletive, say, or a even a smile can transform the effectiveness or otherwise of teaching. There’s emergence, too. A story is not just a collection of words, a lesson is not just a bunch of pedagogical methods, a learning community is not just a collection of people. And all of these things – parts and emergent or designed combinations of parts – interact with one another to lead to deterministic but unprestatable consequences (Kauffman, 2019).

Of course, any specific technology applied in a specific context can and will entail specific and (if hard enough) potentially repeatable outcomes. Hard technologies will do the same thing every time, as long as they work. I press the switch, the light comes on. But even for such a simple, hard technology, you cannot from that generalize that every time any switch is pressed a light will come on, even if you, without warrant, assume that the technology works as intended, because it can always be assembled with other phenomena, including those provided by other technologies, that alter its effects. I press many switches every day that do not turn on lights and, sometimes, even when I press a light switch the light does not come on (those that are assembled with smart switches, for instance). Soft technologies like computers, pedagogies, words, cables, and transistors are always assembled with other phenomena. They are incomplete, and do not do anything of interest at all without an indefinitely large number of things and processes that we add to them, or to which we add them, each subtly or less subtly different from the rest. Here’s an example using the soft technology of language:

  • There are countless ways I could say this.
  • There are infinitely many ways to make this point.
  • Wow, what a lot of ways to say the same thing!
  • I could say this in a vast number of ways.
  • There are indefinitely many ways to communicate the meaning of what I wish to express.
  • I could state this in a shitload of ways.
  • And so on, ad infinitum.

This is one tiny part of one tiny technology (this post). Imagine this variability multiplied by the very many people, tools, methods, techniques, content, and structures that go into even a typical lesson, let alone a course. And that is disregarding the countless other factors and technologies that affect learning, from institutional regulations to interesting news stories or conversations on a bus.

Reductive scientific methods like randomized controlled tests and null hypothesis significance testing can tell us things that might be useful to us as designers and enactors of teaching. We can, say, find out some fairly consistent things about how people learn (as natural phenomena), and we can find out useful things about how well different specific parts compare with one another in a particular kind of assembly when they are supposed to do the same job (nails vs screws, for instance). But these are just phenomena that we can use as part of an assembly, not prescriptions for successful learning. The question of whether any given type of technology affects learning is meaningless. Of course it does, in the specific, because we are using it to help enable learning. But it only does so in an orchestrated assembly with countless others, and that orchestration is and must always be substantially different from any other. So, please, let’s all stop pretending that educational technologies (including pedagogical methods) can be researched in the same reductive ways as natural phenomena, as generalizable laws of entailment. They cannot.

References

Arthur, W. B. (2009). The Nature of Technology: what it is and how it evolves (Kindle ed.). New York, USA: Free Press. (Arthur’s definition of technology as the orchestration of phenomena for some purpose, and his insights into how technologies evolve through assembly, underpins the above)

Kauffman, S. A. (2019). A World Beyond Physics: The Emergence and Evolution of Life. Oxford University Press.

Longo, G., Montévil, M., & Kauffman, S. (2012). No entailing laws, but enablement in the evolution of the biosphere. Proceedings from 14th annual conference companion on Genetic and evolutionary computation, Philadelphia, Pennsylvania, USA. Full text available at https://dl.acm.org/doi/pdf/10.1145/2330784.2330946

 

Bananas as educational technologies

  Banana Water Slide banana statue, Virginia Beach, Virginia One of my most memorable learning experiences that has served me well for decades, and that I actually recall most days of my life, occurred during a teacher training session early in my teaching career. We had been set the task of giving a two-minute lecture on something central to our discipline. Most of us did what we could with a slide or two and a narrative to match in a predictably pedestrian way. I remember none of them, not even my own, apart from one. One teacher (his name was Philippe) who taught sports nutrition, just drew a picture of a banana. My memory is hazy on whether he also used an actual banana as a prop: I’d like to think he did. For the next two minutes, he then repeated ‘have a banana’ many times, interspersed with some useful facts about its nutritional value and the contexts in which we might do so. I forget most of those useful facts, though I do recall that it has a lot of good nutrients and is easy to digest. My main takeaway was that, if we are in a hurry in the morning, not to skip breakfast but to eat a banana, because it will keep us going well enough to function for some time, and is superior to coffee as a means of making you alert. His delivery was wonderful: he was enthusiastic, he smiled, we laughed, and he repeated the motif ‘have a banana!’ in many different and entertaining ways, with many interesting and varied emphases. I have had (at least) a banana for breakfast most days of my life since then and, almost every time I reach for one, I rememember Philippe’s presentation. How’s that for teaching effectiveness?

But what has this got to do with educational technologies? Well, just about everything.

As far as I know, up until now, no one has ever written an article about bananas as educational technologies. This is probably because, apart from instances like the one above where bananas are the topic, or a part of the topic being taught, bananas are not particularly useful educational technologies. You could, at a stretch, use one to point at something on a whiteboard, as a prop to encourage creative thinking, or as an anchor for a discussion. You could ask students to write a poem on it, or calculate its volume, or design a bag for it. There may in fact be hundreds of distinct ways to use bananas as an educational technology if you really set your mind to it. Try it – it’s fun! Notice what you are doing when you do this, though. The banana does provide some phenomena that you can make use of, so there are some affordances and constraints on what you can do, but what makes it an educational technology is what you add to it yourself. Notwithstanding its many possible uses in education, on balance, I think we can all agree that the banana is not a significant educational technology.

Parts and pieces

Here are some other things that are more obviously technological in themselves, but that are not normally seen as educational technologies either:

  • screws
  • nails
  • nuts and bolts
  • glue

Like bananas, there are probably many ways to use them in your teaching but, unless they are either the subject of the teaching or necessary components of a skill that is being learned (e.g. some crafts, engineering, arts, etc) I think we can all agree that none of these is a significant educational technology in itself. However, there is one important difference. Unlike bananas, these technologies can and do play very significant roles in almost all education, whether online or in-person. Without them and their ilk, all of our educational systems would, quite literally, fall apart. However, to call them educational technologies would make little sense because we are putting the boundaries around the wrong parts of the assembly. It is not the nuts and bolts but what we do with them, and all the other things with which they are assembled, that matters most. This is exactly like the case of the banana.

Bigger pieces

This is interesting because there are other things that some people do consider to be sufficiently important educational technologies that they get large amounts of funding to perform large-scale educational research on them, about which exactly the same things could be said: computers, say. There is really a lot of research about computers in classrooms. And yet metastudies tend to conclude that, on average, computers have little effect on learning. This is not surprising. It is for exactly the same reason that nuts and glue, on average, have little effect on learning. The researchers are choosing the wrong boundaries for their investigations.

The purpose of a computer is to compute. Very few people find this of much value as an end in itself, and I think it would be less useful than a banana to most teachers. In fact, with the exception of some heavily math-oriented and/or computer science subjects, it is of virtually no interest to anyone.

The ends to which the computing they perform are put are another matter altogether. But those are no more the effect of the computer than the computer is the effect of the nuts and bolts that hold it together. Sure, these (or something like them) are necessary components, but they are not causes of whatever it is we do with them. What makes computers useful as educational technologies is, exactly like the case of the banana, what we add to them.

It is not the computer itself, but other things with which it is assembled such as interface hardware, software and (above all) other surrounding processes – notably the pedagogical methods – that can (but on average won’t) turn it into an educational technology. There are potentially infinite numbers of these, or there would be if we had infinite time and energy to enact them. Computers have the edge on bananas and, for that matter, nuts and bolts because they can and usually must embody processes, structures, and behaviours. They allow us to create and use far more diverse and far more complex phenomena than nuts, bolts, and bananas. Some – in fact, many – of those processes and structures may be pedagogically interesting in themselves. That’s what makes them interesting, but it does not make them educational technologies. What can make them educational technologies are the things we add, not the machines in themselves.

This is generalizable to all technologies used for educational purposes. There are hierarchies of importance, of course. Desks, classrooms, chairs, whiteboards and (yes) computers are more interesting than screws, nails, nuts, bolts, and glue because they orchestrate more phenomena to more specific uses: they create different constraints and affordances, some of which can significantly affect the ways that learning happens. A lecture theatre, say, tends to encourage the use of lectures. It is orchestrating quite a few phenomena that have a distinct pedagogical purpose, making it a quite significant participant in the learning and teaching process. But it and all these things, in turn, are utterly useless as educational technologies until they are assembled with a great many other technologies, such as (very non exhaustively and rather arbitrarily):

  • pedagogical methods,
  • language,
  • drawing,
  • timetables,
  • curricula,
  • terms,
  • classes,
  • courses,
  • classroom rules,
  • pencils and paper,
  • software,
  • textbooks,
  • whiteboard markers,
  • and so on.

None of these parts have much educational value on their own. Even something as unequivocally identifiable as an educational technology as a pedagogical method is useless without all the rest, and changes to any of the parts may have substantial impacts on the whole. Furthermore, without the participation of learners who are applying their own pedagogical methods, it would be utterly useless, even in assembly with everything else. Every educational event – even those we apparently perform alone – involves the coparticipation of countless others, whether directly or not.

The point of all this is that, if you are an educational researcher or a teacher investigating your own teaching, it makes no sense at all to consider any generic technology in isolation from all the rest of the assembly. You can and usually should consider specific instances of most if not all those technologies when designing and performing an educational intervention, but they are interesting only insofar as they contribute, in relationship to one another, to the whole.

And this is not the end of it. Just as you must assemble many pieces in order to create an educational technology, what you have assembled must in turn be assembled by learners – along with plenty of other things like what they know already, other inputs from the environment, from one another, the effects of things they do, their own pedagogical methods, and so on – in order to achieve the goals they seek. Your own teaching is as much a component of that assembly as any other. You, the learners, the makers of tools, inventors of methods, and a cast of thousands are coparticipants in a gestalt process of education.

This is one of the main reasons that reductive approaches to educational research that attempt to isolate the effects of a single technology – be it a method of teaching, a device, a piece of software, an assessment technique, or whatever – with the intent of generalizing some statement about it cannot ever work. The only times they have any value at all are when all the technologies in question are so hard, inflexible, and replicable, and the uses to which they are put are so completely fixed, well defined, and measurable that you are, in effect, considering a single specific technology in a single specific context. But, if you can specify the processes and purposes with that level of exactitude then you are simply checking that a particular machine works as it is designed to work. That’s interesting if you want to use that precise machine in an almost identical context, or you want to develop the machine itself further. But it is not generalizable, and you should never claim that it is. It is just part of a particular story. If you want to tell a story then other methods, from narrative descriptions to rich case studies to grounded theory, are usually much more useful.

Obsolescence and decay

Koristka camera  All technologies require an input of energy – to be actively maintained – or they will eventually drift towards entropy. Pyramids turn to sand, unused words die, poems must be reproduced to survive, bicycles rust. Even apparently fixed digital technologies rely on physical substrates and an input of power to be instantiated at all. A more interesting reason for their decay, though, is that virtually no technologies exist in isolation, and virtually all participate in, and/or are participated in by other technologies, whether human-instantiated or mechanical. All are assemblies and all exist in an ecosystem that affects them, and which they affect. If parts of that system change, then the technologies on which they depend may cease to function even though nothing about those technologies has, in itself, altered.

Would a (film) camera for which film is no longer available still be a camera? It seems odd to think of it as anything else. However, it is also a bit odd to think of it as a camera, given that it must be inherent to the definition of a camera that it can take photos. It is not (quite) simply that, in the absence of film, it doesn’t work. A camera that doesn’t take photos because the shutter has jammed or the lens is missing is still a camera: it’s just a broken camera, or an incomplete camera. That’s not so obviously the case here. You could rightly claim that the object was designed to be a camera, thereby making the definition depend on the intent of its manufacturer. The fact that it used to be perfectly functional as a camera reinforces that opinion. Despite the fact that it cannot take pictures, nothing about it – as a self-contained object – has changed. We could therefore simply say it is therefore still a camera, just one that is obsolete, and that obsolescence is just another way that cameras can fail to work. This particular case of obsolescence is so similar to that of the missing lens that it might, however, make more sense to think of it as an instance of exactly the same thing. Indeed someone might one day make a film for it and, being pedantic, it is almost certainly possible to cut up a larger format film and insert it, at which point no one would disagree that it is a camera, so this is a reasonable way to think about it. We can reasonably claim that it is still a camera, but that it is currently incomplete.

Notice what we are doing here, though. In effect, we are supposing that a full description of a camera – ie. a device to take photos – must include its film, or at least some other means of capturing an image, such as a CCD. But, if you agree to that, where do you stop? What if the only film that the camera can take demands processing that is not? What if is is a digital camera that creates images that no software can render? That’s not impossible. Imagine (and someone almost certainly will) a DRM’d format that relies on a subscription model for the software used to display it, and that the company that provides that subscription goes out of business. In some countries, breaking DRM is illegal, so there would be no legal way to view your own pictures if that were the case. It would, effectively, be the same case as that of a camera designed to have no shutter release, which (I would strongly argue) would not be a camera at all because (by design) it cannot take pictures. The bigger point that I am trying to make, though, is that the boundaries that we normally choose when identifying an object as a camera are, in fact, quite fuzzy. It does not feel natural to think of a camera as necessarily including its film, let alone also including the means of processing that film, but it fails to meet a common-sense definition of the term without those features.

A great many – perhaps most – of our technologies have fuzzy boundaries of this nature, and it is possible to come up with countless examples like this. A train made for a track gauge that no longer exists, clothing made in a size that fits no living person, printers for which cartridges are no longer available, cars that fail to meet emissions standards, electrical devices that take batteries that are no longer made, and so on. In each case, the thing we tend to identify as a specific technology no longer does what it should, despite nothing having changed about it, and so it is difficult to maintain that it is the same technology as it was when it was created unless we include in our definition the rest of the assembly that makes it work. One particularly significant field in which this matters a great deal is in computing. The problem occurs in every aspect of computing: disk formats for which no disk drives exist, programs written for operating systems that are no longer available, games made for consoles that cannot be found, and so on. In a modern networked environment, there are so many dependencies all the way down the line that virtually no technology can ever be considered in isolation. The same phenomenon can happen at a specific level too. I am currently struggling to transfer my websites to a different technology because the company providing my server is retiring it. There’s nothing about my sites that has changed, though I am having to make a surprising number of changes just to keep them operational on the new system. Is a website that is not on the web still a website?

Whatever we think about whether it remains the same technology, if it does not do what the most essential definition of that technology claims that it must, then a digital technology that does not adapt eventually dies, even though its physical (digital) form might persist unchanged. This is because its boundaries are not simply its lines of code. This both stems from and leads to fact that technologies tend to evolve to ever greater complexity. It is especially obvious in the case of networked digital technologies, because parts of the multiple overlapping systems in which they must participate are in an ever-shifting flux. Operating systems, standards, protocols, hardware, malware, drivers, network infrastructure, etc can and do stop otherwise-unchanged technologies from working as intended, pretty consistently, all the time. Each technology affects others, and is affected by them. A digital technology that does not adapt eventually dies, even though (just like the camera) its physical (digital) form persists unchanged. It exists only in relation to a world that becomes increasingly complex thanks to the nature of the beast.

All species of technology evolve to become more complex, for many reasons, such as:

  • the adjacent possibles that they open up, inviting elaboration,
  • the fact that we figure out better ways to make them work,
  • the fact that their context of use changes and they must adapt to it,
  • the fact other technologies with which they are assembled adapt and change,
  • the fact that there is an ever-expanding range of counter-technologies needed to address their inevitable ill effects (what Postman described as the Faustian Bargain of technology),  which in turn create a need for further counter-technologies to curb the ill effects of the counter technologies,
  • the layers of changes and fixes we must apply to forestall their drift into entropy.

The same is true of most individual technologies of any complexity, ie. those that consist of many interacting parts and that interact with the world around them. They adapt because they must – internal and external pressures see to that – and, almost always, this involves adding rather than taking away parts of the assembly. This is true of ecosystems and even individual organisms, and the underlying evolutionary dynamic is essentially the same. Interestingly, it is the fundamental dynamic of learning, in the sense of an entity adapting to an environment, which in turn changes that environment, requiring other entities within that environment to adapt in turn, which then demands further adaptation to the ever shifting state of the system around it. This occurs at every scale, and every boundary. Evolution is a ratchet: at any one point different paths might have been taken but, once they have been taken, they provide the foundations for what comes next. This is how massive complexity emerges from simple, random-ish beginnings. Everything builds on everything else, becoming intricately interwoven with the whole. We can view the parts in isolation, but we cannot understand them properly unless we view them in relation to the things that they are connected with.

Amongst other interesting consequences of this dynamic, the more evolved technologies become, the more they tend to be comprised of counter-technologies. Some large and well-evolved technologies – transport systems, education systems, legal systems, universities, computer systems, etc – may consist of hardly anything but counter-technologies, that are so deeply embedded we hardly notice them any more. The parts that actually do the jobs we expect of them are a small fraction of the whole. The complex interlinking between counter-technologies starts to provide foundations on which further technologies build, and often feed back into the evolutionary path, changing the things that they were originally designed to counter, leading to further counter-technologies to cater for those changes. 

To give a massively over-simplified but illustrative example:

Technology: books.

Problem caused: cost.

Counter-technology: lectures.

Problem caused: need to get people in one place at one time.

Counter-technology: timetables.

Problem caused: motivation to attend.

Counter-technology: rewards and punishments.

Problem caused: extrinsic motivation kills intrinsic motivation.

Counter-technology: pedagogies that seek to re-enthuse learners.

Problem caused: education comes to be seen as essential to future employment but how do you know that it has been accomplished?

Counter-technology: exams provide the means to evaluate educational effectiveness.

Problem caused: extrinsic motivation kills intrinsic motivation.

Solution: cheating provides a quicker way to pass exams.

And so on.

I could throw in countless other technologies and counter-technologies that evolved as a result to muddy the picture, including libraries, loan systems, fines, courses, curricula, semesters, printing presses, lecture theatres, desks, blackboards, examinations, credentials, plagiarism tools, anti-plagiarism tools, faculties, universities, teaching colleges, textbooks, teaching unions, online learning, administrative systems, sabbaticals, and much much more. The end result is the hugely complex, ever shifting, ever evolving mess that is our educational systems, and all their dependent technologies and all the technologies on which they depend that we see today. This is a massively complex system of interdependent parts, all of which demand the input of energy and deliberate maintenance to survive. Changing one part shifts others, that in turn shift others, all the way down the line and back again. Some are harder and less flexible than others – and so have more effect on the overall assembly – but all contribute to change.

We have a natural tendency to focus on the immediate, the local, and the things we can affect most easily. Indeed, no one in the entire world can hope to glimpse more than a caricature of the bigger picture and, being a complex system, we cannot hope to predict much beyond the direct effects of what we do, in the context that we do them. This is true at every scale, from teaching a lesson in a classroom to setting educational policies for a nation. The effects of any given educational intervention are inherently unknowable in advance, whatever we can say about average effects. Sorry, educational researchers who think they have a solution – that’s just how it is. Anyone that claims otherwise is a charlatan or a fool. It doesn’t mean that we cannot predict the immediate future (good teachers can be fairly consistently effective), but it does mean that we cannot generalize what they do to achieve it.

One thing that might help us to get out of this mess would be, for every change we make, to think more carefully about what it is a counter-technology for,  and at least to glance at what the counter-technologies we are countering are themselves counter-technologies for. It might just be that some of the problems they solve afford greater opportunities to change than their consequences that we are trying to cope with. We cannot hope to know everything that leads to success – teaching is inherently distributed and inherently determined by its context – but we can examine our practice to find out at least some of the things that lead us to do what we do. It might make more sense to change those things than to adapt what we do to their effects.

 

A simple phishing scam

If you receive an unexpected email from what you might, at first glance, assume to me, especially if it is in atrocious English, don’t reply to it until you have looked very closely at the sender’s email address and have thought very carefully about whether I would (in a million years) ask you for whatever help it wants from you.

Being on sabbatical, my AU inbox has been delightfully uncrowded of late, so I rarely look at it until I’ve got a decent amount of work done most days, and occasionally skip checking it altogether, but a Skype alert from a colleague made me visit it in a hurry a couple of days back. I found a deluge of messages from many of my colleagues in SCIS, mostly telling me my identity had been stolen (it hadn’t), though a few asked if I really needed money, or wanted my groceries to be picked up. This would be a surprising, given that I live about 1000km away from most of them. All had received messages in poorly written English purporting to be from me, and at least a couple of them had replied. One – whose cell number was included in his sig – got a phishing text almost immediately, again claiming to be from me: this was a highly directed and malicious attack.

The three simple tricks that made it somewhat believable were:

  1. the fraudsters had created a (real) Gmail account using the username, jondathabascauca. This is particularly sneaky inasmuch as Gmail allows you to insert arbitrary dots into the name part of your email address, so they turned this into jond.athabasca.ca@gmail.com, which was sufficiently similar to the real thing to fool the unwary.

  2. the crooks simply copied and pasted the first part of my official AU page as a sig, which is pretty odd when you look at it closely because it included a plain text version of the links to different sections on the actual page (they were not very careful, and probably didn’t speak English well enough to notice), but again looks enough like a real sig to fool someone glancing at it quickly in the midst of a busy morning.

  3. they  (apparently) only sent the phishing emails to other people listed on the same departmental bio pages, rightly assuming that all recipients would know me and so would be more likely to respond. The fact that the page still (inaccurately) lists me as school Chair probably probably means I was deliberately singled out.

As far as I know they have not extended the attacks further than to my colleagues in SCIS, but I doubt that this is the end of it. If they do think I am still the Chair of the school, it might occur to them that chairs tend to be known outside their schools too.

This is not identity theft – I have experienced the real thing over the past year and, trust me, it is far more unpleasant than this – and it’s certainly not hacking. It’s just crude impersonation that relies on human fallibility and inattention to detail, that uses nothing but public information from our website to commit good old fashioned fraud. Nonetheless, and though I was not an intended victim, I still feel a bit violated by the whole thing. It’s mostly just my foolish pride – I don’t so much resent the attackers as the fact that some of the recipients jumped to the conclusion that I had been hacked, and that some even thought the emails were from me. If it were a real hack, I’d feel a lot worse in many ways, but at least I’d be able to do something about it to try to fix the problem. All that I can do about this kind of attack is to get someone else to make sure the mail filters filter them out, but that’s just a local workaround, not a solution.

We do have a team at AU that deals with such things (if you have an AU account and are affected, send suspicious emails to phishing@athabascau.ca), so this particular scam should have been stopped in its tracks, but do tell me if you get a weird email from ‘me’.

E-Learn 2019 presentation – X-literacies: beyond digital literacy

Here are  my slides from E-Learn 2019, in New Orleans. The presentation was about the nature of technologies and their roles in communities (groups, networks, sets, whatever), their highly situated nature, and their deep intertwingling with culture. In general it is an argument that literacies (as opposed to skills, knowledge, etc) might most productively and usefully be seen as the hard techniques needed to operate the technologies that are required for any given culture. As well as clarifying the term and using it in the same manner as the original term “literacy”, this implies there may be an indefinitely large range of literacies because we are all members of an indefinitely large number of overlapping cultures. All sorts of possibilities and issues emerge from this perspective.

Abstract: Dozens, if not hundreds, of literacies have been identified by academic researchers, from digital- to musical- to health- to network- literacy, as well as combinatorial terms like new-, multi-, 21st Century-, and media-literacy. Proponents seek ways to support the acquisition of such literacies but, if they are to be successful, we must first agree what we mean by ‘literacy’. Unfortunately, the term is used in many inconsistent and incompatible ways, from simple lists of skills to broad characteristics or tendencies that are either ubiquitous or meaninglessly vague. I argue that ‘literacy’ is most usefully thought of as the set of learned techniques needed to participate in the technologies of a given culture. Through use and application of a culture’s techniques, increasing literacy also leads to increasing knowledge of the associated facts and adoption of the values that come with that culture. Literacy is thus contextually situated, mutates over time as a culture and its technologies evolve, and participates in that co-evolution. As well as subsuming and eliminating much of the confusion caused by the proliferation of x-literacies, this opens the door to more accurately recognizing the literacies that we wish to use, promote and teach for any given individual or group.