So, this is a thing…

Posted , updated on

Students are now using AIs to write essays and assignments for credit, and they are (probably) getting away with it. This particular instance may be fake, but the tools are widely available and it would be bizarre were no one to be using them for this purpose. There are already far too many sites providing stuff like product reviews and news stories (re)written by AIs, and AIs are already being used for academic paper writing. In fact, systems for doing so, like CopyMatic or ArticleGenerator, are now a commodity item. So the next step will be that we will develop AIs to identify the work of other AIs (in fact, that is already a thing, e.g. here and here), and so it will go on, and on, and on.

This kind of thing will usually evade plagiarism checkers with ease, and may frequently fool human markers. For those of us working in educational institutions, I predict that traditionalists will demand that we double down on proctored exams, in a vain attempt to defend a system that is already broken beyond repair. There are better ways to deal with this: getting to know students, making each learning journey (and outputs) unique and personal, offering support for motivated students rather than trying to ‘motivate’ them, and so on. But that is not enough.

I am rather dreading the time when an artificial student takes one of my courses. The systems are probably too slow, quirky, and expensive right now for real-time deep fakes driven by plausible GANs to fool me, at least for synchronous learning, but I think it could already convincingly be done for asynchronous learning, with relatively little supervision.  I think my solution might be to respond with an artificial teacher, into which there has been copious research for some decades, and of which there are many existing examples.

To a significant extent, we already have artificial students, and artificial teachers teaching them. How ridiculous is that? How broken is the system that not only allows it but actively promotes it?

These tools are out there, getting better by the day, and it makes sense for all of us to be using them. As they become more and more ubiquitous, just as we accommodated pocket calculators in the teaching of math, so we will need to accommodate these tools in all aspects of our education. If an AI can produce a plausible new painting in any artist’s style (or essay, or book, or piece of music, or video) then what do humans need to learn, apart from how to get the most out of the machines? If an AI can write a better essay than me, why should I bother? If a machine can teach as well as me, why teach?

This is a wake-up call. Soon, if not already, most of the training data for the AIs will be generated by AIs. Unchecked, the result is going to be a set of ever-worse copies of copies, that become what the next generation consumes and learns from, in a vicious spiral that leaves us at best stagnant, at worst something akin to the Eloi in H.G. Wells’s Time Machine.  If we don’t want this to happen then it is time for educators to reclaim, to celebrate, and (perhaps a little) to reinvent our humanity. We need, more and more, to think of education as a process of learning to be, not of learning to do, except insofar as the doing contributes to our being. It’s about people, learning to be people, in the presence of and through interaction with other people. It’s about creativity, compassion, and meaning, not the achievement of outcomes a machine could replicate with ease. I think it should always have been this way.

Originally posted at: https://landing.athabascau.ca/bookmarks/view/15164121/so-this-is-a-thing

Over 150 AU staff signed this letter to the Government of Alberta and AU’s Board of Governors

Posted , updated on

Today I sent this letter from staff at Athabasca University to the Albertan Advanced Education Minister and Board of Governors of the University, cc’d to various government & opposition politicians in Alberta, and a few selected journalists:

I strongly support the university’s continuing presence in the town of Athabasca, but not the forced relocation of any staff to the area. As an online community, I believe it to be in the interests of all staff and students of the university, including residents of the town of Athabasca, that all university staff who can and who wish to work from home, whatever their role, should be allowed to make that home wherever they choose.

The 149 signatories to the letter included academic staff (46%), managers (12%), administration staff (12%), professional staff (33%), RAs (1%) and tutors/academic experts (7%). 48% live in the region of Edmonton, 19% in the region of Calgary, 15% in rural Alberta outside Athabasca region, 8% in the region of Athabasca, 5% in Ontario, 3% in BC, 1% in Nova Scotia, and 1% in Saskatchewan. A further 3 staff signed the letter anonymously, and a number of others expressed general agreement with the main points made but, for various reasons, chose not to sign. One more signed today, after I had sent the letter.

How this came about

For context, the Government of Alberta has made a number of demands, under threat of withdrawal of funding, that would require 500 additional staff to move to Athabasca (notably including all the executive staff), that would force us to end our near-virtual strategy, and that would require us to change our focus from teaching anyone and everyone to teaching Albertans, with an initial deadline of 2024/25. This is our president’s explanation and response. Perhaps as a result of public outrage, the minister responsible has since claimed the deadlines are negotiable, and suggested that a little flexibility might be allowed (given that the demands are literally impossible to meet), but he has not stepped back on the basic requirements, and has repeatedly emphasized that he will force all of the executive team to work on the Athabasca campus, despite also claiming he will not force anyone to work there, among other contradictions.

I sent an email to an assortment of staff that I know a week ago today, asking them to sign the statement above and pass it along to other staff members. I did not want to use any official channels to send it for fear that it would be seen as being driven by those with partisan positions to defend (none-the-less, I did receive one anonymous comment from someone who did not sign it because they had received it via their boss and assumed it was driven from the top – it was not!). Because of the viral approach to dissemination, I am fairly certain that it failed to reach all AU staff, and the signatories are almost certainly skewed to people I know, and those who know people I know. I suspect that some groups (especially tutors and administrators) are under-represented.  I therefore have no way of telling what percentage of recipients actually signed the letter, but those who signed make up around an eighth of the workforce in total. The Board of Governors is required to give a response to the Government of Alberta’s demands tomorrow, August 31st, so I had to pull all of this together hastily, otherwise I am confident that the letter would have gained more signatures.

A brief summary of the comments

As well as signing the letter, I also asked the staff to (optionally) provide comments. I am not going to include the 20 or so pages of these from scores of staff members that I received in full here, though they are full of fantastic ideas, expressions of concern, (sometimes heart-rending) stories, as well as expressions of caring for one another, for their communities, for the university, and for the students they work for. Once they are fully anonymized, I may share them later. However, I will attempt a summary now.

Many – including those living in the Athabasca region – speak of how much they value being able to work from home, and that they would reluctantly seek new employment if that option were not available. For example, one employee writes:
I am a resident of Athabasca and I choose to live here; I have proven (since March 2020) that my job can be successfully executed virtually from my home office. My work-life balance has improved significantly because I can work from home.
Even faculty – who would not be required to move – speak of resigning were this to occur.
Some mention the importance of understanding the needs of our students, or express concern about the effects that the disruption caused by this initiative would cause.
Many mention difficulties they would face working at Athabasca. Often, this is due to the needs of their families, especially with regard to job opportunities and health. This is a particularly poignant comment that expresses several of the concerns shared by many:
I initially applied for a position with AU because it was in a small community that I wanted to raise my family in. However, my spouse was not able to find work after he was laid off with the decline in oil and gas and my son needed specialized services that the town did not have. Therefore, I applied for an Edmonton position so my spouse could find work to help support the family and my son could access the services he required.
Another, living in Athabasca, writes:
If I were place based at the AU Campus, I would have to use my vacation to care for [my sick child] which would significantly decrease the amount of vacation available to me if not completely exhaust my allowable annual vacation.
Another writes:
I am struggling with this forced relocation as I will not be forced to relocate away from my children. My husband would be out of a job. We would make a loss on our home if we were forced to sell to relocate. I have been going through cancer treatment and my oncologist and medical Team are located in Edmonton and I would jeopardize my health moving away from my health care team.
Some express the concern that AU would suffer from a hugely diminished job pool. For example:
Allowing work from home and not forcing employees to relocate to another province means retaining staff, retaining expertise, widening the applicant pool so as to entice top talent across Canada, and positions AU as a leading employer. AU students can take courses anywhere in the world — AU staff should be able to work from anywhere in Canada.
Others observe the need for big improvements to infrastructure, services, and transport links for the town to accommodate greater numbers, though a couple suggest they might accept incentives to move there. Quite a few think that it would do active harm to the town were substantial numbers to relocate. As one staff member puts it:
Placing all your eggs in one basket (or relying on one or two industries) will not provide the economic security and stability required for long-term success.
Several explicitly draw attention to the point made in the letter that the executive team should not have to live there.
Some ask that the government should stop interfering with the operations of the university. Many would like to be more involved in conversations being held privately between the Board of Governors and the Government of Alberta, asking for their voices to be heard by all parties in the dispute.
Some challenge the notion that AU should be required to bear the burden of supporting the town. For example, one writes:
AU is one of Alberta’s four CARUs and as such, its mandate should be about education and research, not about economic development of a region. No other company or university has such mandate or responsibility.
Some provide suggestions for ways we can expand on what we are already doing to provide services to the region, and to take more advantage of our unique location for research: there are many good suggestions and reports of existing initiatives among the comments, such as this:
FST is home to Science Outreach Athabasca which is an organization supported by faculty and members of the town of Athabasca that has been engaging the community of Athabasca for 20 years and hosted over 120 public talks, science camps, nature hikes, butterfly counts, and other activities. We also host lab sessions for junior high and high school students in Athabasca schools which our faculty volunteer to do. Our research activity in FST has been growing in environmental science and computational biology with three research chairs and recruitments of new faculty to increase our capacity in remediation, long-term monitoring, aquatic systems, rural sustainability, and regenerative design, to name a few.
A few express concern with intimidation they have faced when attempting to voice opinions not held by those with louder voices and political positions to defend. Though mostly not included in the comments, personal messages to me expressed relief and gratitude at being allowed to express opinions they were afraid to share with colleagues and town residents, because of fears of reprisal or ostracization. One, that is included, put it well:
I’m tired of my voice not being heard which is why I decided to compose this letter. I’m tired of being told, I’m tired of the lobbyist/activists, Municipal and Provincial Governments not respecting the voices on the “other side”

This is the comment I received after sending the letter today, that is quite representative of several others:

Athabasca University is an online university and has been operating efficiently with the work from home environment and I believe will continue to do so with the a near virtual environment. I support the near virtual initiative.

The full range of comments is far richer, far more nuanced, and far more varied than what I have been able to summarize here and I apologize to the many dozens of people who provided them for not doing them as much justice as they deserve.

I hope that the recipients read and act on the letter. At the very least, they will have a far better idea of the needs, concerns, and feelings of a significant portion of AU staff than they had before, and I hope that will colour their judgment.

Thank you, everyone who signed, and thank you to all who will read it. I will be circulating the full letter and addendum to as many of those who signed it as possible over the next day or two.

Three reasons why Athabasca University’s leaders must never be made to live in Athabasca

Posted , updated on

I’ve said this before but it needs more emphasis. In the past week or so it has become increasingly clear that the real agenda of the Albertan government is not (directly) to forcibly move 500 unwilling AU staff to the town of Athabasca. That’s just smoke and mirrors intended to distract us from the real agenda, which is to oust the current (brilliant, visionary, capable) executive team  – most of whom will resign rather than relocate to Athabasca – and then to replace them with lackeys who will (quietly, out of the public eye) do the government’s dirty work for them. This has been made very explicit by the minister for post secondary education over several months, saying, for instance:

“When it comes to the non-instructional staff, particularly the senior administrative and executive management positions, those should indeed be based in the town” (Town & Country Today, May 2022)

The government has already installed a chair of the board of governors (ironically, a Calgary-based lawyer) who is explicitly on their side, as well as board members from the town of Athabasca. All they need to do now is to replace our leaders with people they can control, and the job is done.

This is the real threat. This is the real plan. This is what will destroy us.

Firstly, the chances of getting a great executive team will be very slim if they have to live in Athabasca. On average, our past hires in the town have been mediocre at best though, admittedly, this is skewed by some who have been outstandingly awful. On average, acknowledging the odd high spot here and there, the remainder have been pretty average. The executive team is, more than everyone else, the group of employees that has the biggest effect on the university, its vision, its teaching, and its success. More than anyone else, they must be the best. Everyone accepts this when it comes to faculty and tutors, so why not for the exec team that matters more?

Secondly, whether they are lackeys or simply those who are less capable of resistance than our current team, they will push through the agenda that has been causing so much bad press of late. It will take a bit longer to move 500 people than the two years required in the minister’s recent letter to the board, and maybe it will ‘only’ wind up being a few hundred people, but it will happen, without the adverse press headlines and multiple channels of resistance.

Thirdly – and ultimately perhaps the most damagingly – the executives who live in the town will inevitably pay more attention to those physically surrounding them. These will never include faculty and tutors (everyone agrees on that, even the minister) so we will slide back into the admin-driven mire that messed up many things over the last few decades, and from which we have only been emerging for the last 5 years.

As a result, we will fade into obscurity, if we survive at all.

Our nascent but emerging online, inclusive community that has struggled to grow over the past 5 years, despite resistance from those who love their comfortably complacent old ways, will once again shrivel to an irrelevance, crowded out by the in-person short-circuits. Faculty and tutors will again be isolated from administrators and professional staff, whose stronger influence will determine most of our policies. Faculty – the ones doing the teaching and research – will again be the ones ‘calling in’ to in-person meetings, inevitably less significant and with a smaller voice than those attending meetings in person. Online communication will revert to being instrumental, focused, and bland. Tacit knowledge will fail to spread, except among those working in person.

The systems, approaches and vision that have driven us for the last 5 years, most notably the near-virtual policy, that could and should lead us to expand in all good ways (pedagogically, geographically, demographically, digitally, in community, in quality, in belongingness, in numbers, and more) will be wiped off the map.

Ironically, the brighter future of the town of Athabasca itself – that, right now, involves us in repurposing and redeveloping our physical headquarters to be so much more than an admin centre, that is focused on developing the region, doing research, engaging with local partners, and upping the skills, knowledge, and significance of the community – will fade, as our campus once again slips back into being little more than a bunch of offices for administrators. Without diversity or investment in its infrastructure or transit options to it, there will not be jobs for the families of those required to work there. It will continue its long slide into decay. The university itself will diminish in numbers and relevance, so those who have moved there will lose jobs, with nowhere else to go.

All of this will occur thanks, ultimately, to the scheming and machinations of one minority faction of workers in Athabasca that instigated the political lobbying in the first place, that cares more about the short-term future of a small town of less than 3000 people than for our 40,000 students and the future of education in this country. Those who have led the attack have never even acknowledged this conflict of interest.

It is a far harder sell to start a movement to resist the relocation of less than 10 executive staff – whose popularity is far from universal, thanks to the huge disruptive changes they have spearheaded, the least popular of which have been (you guessed it) driven by the Albertan government – than to resist the uprooting of everyone else apart from faculty and tutors, but this is the real battleground. This is the fight that we must not lose.

Keep Athabasca University’s leaders out of the town of Athabasca!

Wherever you live, please make your views known by contacting the Minister, Demetrios Nicolaides, at ae.minister@gov.ab.ca, or comment on social media, by tagging @demetriosnAB on Twitter, , #abpoli. Blog about it, write to the press about it, lobby outside the gates of the Albertan legislature, tell your friends, whatever: make a fuss.

Learning, Technology, and Technique | Canadian Journal of Learning and Technology

Posted , updated on

This is my latest paper, Learning, Technology, and Technique, in the current issue of the Canadian Journal of Learning and Technology (Vol. 48 No. 1, 2022).

Essentially, because this was what I was invited to do, the paper shrinks down over 10,000-words from my article Educational technology: what it is and how it works (itself a very condensed summary of my forthcoming book, due out Spring 2023) to under 4,000 words that, I hope, more succinctly capture most of the main points of the earlier paper. I’ve learned quite a bit from the many responses to the earlier paper I received, and from the many conversations that ensued – thank you, all who generously shared their thoughts – so it is not quite the same as the original. I hope this one is better. In particular, I think/hope that this paper is much clearer about the nature and importance of technique than the older paper, and about the distinction between soft and hard technologies, both of which seemed to be the most misunderstood aspects of the original. There is, of course, less detail in the arguments and a few aspects of the theory (notably relating to distributed cognition) are more focused on pragmatic examples, but most are still there, or implied. It is also a fully open paper, not just available for online reading, so please freely download it, and share it as you will.

Here’s the abstract:

To be human is to be a user, a creator, a participant, and a co-participant in a richly entangled tapestry of technologies – from computers to pedagogical methods – that make us who we are as much as our genes. The uses we make of technologies are themselves, nearly always, also technologies, techniques we add to the entangled mix to create new assemblies. The technology of greatest interest is thus not any of the technologies that form that assembly, but the assembly itself. Designated teachers are never alone in creating the assembly that teaches. The technology of learning almost always involves the co-participation of countless others, notably learners themselves but also the creators of systems, artifacts, tools, and environments with and in which it occurs. Using these foundations, this paper presents a framework for understanding the technological nature of learning and teaching, through which it is possible to explain and predict a wide range of phenomena, from the value of one-to-one tutorials, to the inadequacy of learning style theories as a basis for teaching, and to see education not as a machine made of methods, tools, and systems but as a complex, creative, emergent collective unfolding that both makes us, and is made of us.

Originally posted at: https://landing.athabascau.ca/bookmarks/view/14622408/my-latest-paper-learning-technology-and-technique-now-online-in-the-canadian-journal-of-learning-and-technology

Thanks @demetriosnAB for your generous offer. We completely misunderstood that you wanted to help us. Here’s what we need…

Posted , updated on

Dear Demetrios Nicolaides

You say,

“I’ve offered to provide any kind of assistance that the university needs. They haven’t asked for any.”

This is very kind! I am sorry for all the very, very, very bad thoughts I have been thinking about you and your party. So, all we had to do was ask, eh?

We currently (in ball park terms) have about 300 staff in Athabasca out of a total of roughly 1200 staff overall. You want 65% of us to live there. So, what we need is:

  • ongoing funding to pay the salaries of 1500 new staff;
  • good, diverse, well-paid jobs for their families (yes, we have families);
  • support for building new homes to house the new staff;
  • computers, software, cloud services, high speed reliable internet to the town (not the rubbish we have now) for those new staff;
  • extra buildings to house them on the campus, including canteens, leisure facilities, etc;
  • regular, frequent transit links to the town of Athabasca.

We’ll let you off paying for 8 of those staff if you let our execs live wherever the hell they want. Maybe you could re-use the absurdly overblown presidential accommodation to house a family or six.

This is just a guess, but I think that, in total, such assistance might just about raise the government funding per student that you currently so generously provide us to around 70-80% of what you currently give to other Albertan universities.

It’s still a damn fool place to put a university so you’d better be prepared to offer some much better incentives for those you are forcing to live there. Higher pay, of course, maybe a free vehicle (electric, of course – you wouldn’t want to increase the outrageously high environmental impact of this proposal even more, would you?). If you expect us to do proper research, attracting international and national partners and research students, we will need at least a good rail link to the nearest international airport (you could have one built at Athabasca, perhaps? Imagine the additional benefits to Northern communities! Who wouldn’t want to fly to Athabasca rather than, say, Edmonton or Calgary?). You should probably improve and better maintain the road into town so that it stops killing and injuring our colleagues. We really don’t like that aspect of the job. It puts people off working there.

So, at the end of it, with all these additional expenses, you might have to put us nearly on par for per-student funding with the rest of Alberta’s comprehensive research universities. On the bright side, you’ll not have to pay for all the lawsuits and payouts for constructive dismissal, nor the humiliation of having destroyed one of the world’s finest universities, and I bet it would win you a ton of votes.

Thank you for the offer. Over to you.

Jon

P.S. And please, please, please would you just stop it with the micromanaging? It would save us all much unnecessary work and pain. More savings there.

P.P.S. And please stop talking about “not reinventing the school’s mandate but simply trying to reverse the trend away from it”  by the way. You’re just lending fuel to the popular misconception that there are liars, damned liars, and politicians. I suppose you mean the mandate forced on us against our will 40 years ago that made the president and half the faculty resign? The one that was rescinded decades ago because it was completely unworkable for a university hoping to hire top quality researchers, teachers, tutors, professional staff, and administrators? That one?

P.P.P.S. ‘An ultimatum (/ˌʌltɪˈmeɪtəm/; Latin for ‘the last one’) is a demand whose fulfillment is requested in a specified period of time and which is backed up by a threat to be followed through in case of noncompliance’. Sound familiar?

For anyone else reading this…

Wherever you live, please make your views known by contacting the Minister, Demetrios Nicolaides, at ae.minister@gov.ab.ca, or comment on social media, by tagging @demetriosnAB on Twitter, , #abpoli. Blog about it, write to the press about it, lobby outside the gates of the Albertan legislature, tell your friends, whatever: make a fuss.

 

We need help: Athabasca University is facing an existential threat from the government of Alberta

Posted , updated on

This video from Peter Scott, president of Athabasca University, is a clear, eloquent, and passionate plea to save our university and the education of its students from imminent destruction at the hands of a brutal, self-serving, short-sighted government. Please watch it. Please act on it, in any way you can, if only to share it on your preferred social media. If we don’t stop this, Athabasca University as we know it will be no more.

If you don’t have time to watch the 12 minute video, in brief, this is the gist of it…

The Albertan government has unilaterally, without consultation with any stakeholders, demanded that:

  • we move about 500 of our staff (nearly half of the workforce), including the entire executive team, to the town of Athabasca by 2024-2025, to work there in-person;
  • we focus our efforts solely on Albertan students*;
  • we drop the near-virtual working policy on which we have worked and invested for many years and on which our future depends.

They have demanded that we agree to this, and to have a plan in place, by the end of next month, otherwise they will withdraw our funding. This would bankrupt us.

Right now, we are a world leader in online and distance education. The majority of our students live outside Alberta, so we are the nearest thing to a national university that Canada has. As the only fully open and distance university in Canada, we provide opportunities for many across the country who would otherwise be unable to get a decent education – people in rural or remote areas, those serving abroad, indigenous people, prisoners, and many more who would find it difficult or impossible to enrol in a conventional university, are welcome here. Over a third of our graduates are the first in their families to have achieved a degree. We have a remarkably high percentage of the finest distance and online researchers in the world, that is only possible because they are allowed to live and work where they choose. And we are half-way through the process of reinventing ourselves, with a visionary plan, and a sustainable business model that will allow us to serve better, and to serve many more, which relies entirely on being near-virtual. Over half of our staff – including virtually all faculty and tutors – have lived and worked at a distance for about 20 years. Most of the rest now happily do so. Less than 10% currently work in-person. We walk the talk. We know the struggles that our students face working online, intimately, first-hand.

Athabasca University logo

I love this university and what it stands for. I love its open mission, its kick-ass research that punches far above its weight, its wonderful staff, its radical, caring vision, and its amazing, awesome students. We are something unique and precious, at least in Canada and perhaps in the world. If we let this happen, all of that will go. If we accept the directive, then at least half the faculty and most of our exceptional executive team will resign, the quality of whatever staff remain will fall through the floor, the few students that are left will suffer, and the costs of moving will send us deep into the red. Our open mission itself – the thing that most defines us – is under threat. If we reject it, we will lose a quarter of our budget and go bust. Either way, if the Albertan government persists with this insane, brutish plan, we are doomed. If anything survived at the end of it – which would only be half possible if the hostile government provided very large amounts of funding that I am fairly sure it is unwilling to provide – it would be a shrunken, irrelevant, sub-standard shadow of what it is now. The first order of business should therefore be to do all that we can to stop the government from forcing this absurd, devastating harmful mandate upon us.

Whoever you are, wherever you are, please help Athabasca University fight this threat to its survival.  If you live in Alberta, please vote this atrocious, oil-addled, self-serving government out of office. Wherever you live, please make your views known by contacting the Minister, Demetrios Nicolaides, at ae.minister@gov.ab.ca, or comment on social media, by tagging @demetriosnAB on Twitter, , #abpoli. Blog about it, write to the press about it, lobby outside the gates of the Albertan legislature, make a fuss.

And, if you happen to be politician with sway in your province or in federal government, or maybe someone who runs another university that is seeking to expand significantly further into online learning, we have a beautiful, already near-virtual, thriving, forward-looking university with a highly talented workforce (no re-housing needed, limited need for physical space, business processes and digital infrastructure already established) that would love to find some better custodians for its crucial mission.

Originally posted at: https://landing.athabascau.ca/bookmarks/view/14559190/we-need-help-athabasca-university-is-facing-an-existential-threat-from-the-government-of-alberta

*Addendum and point of clarification as this has been misunderstood by a couple of readers: this is required by the Albertan government as a change to our central mission. To the best of my knowledge it does not explicitly mandate that we cannot accept students from elsewhere into our programs, though it is a major change in emphasis that would have many adverse impacts, big and small, on what, how and to whom we teach.

Can GPT-3 write an academic paper on itself, with minimal human input?

Posted , updated on

Brilliant. The short answer is, of course, yes, and it doesn’t do a bad job of it. This is conceptual art of the highest order.

This is the preprint of a paper written by GPT-3 (as first author) about itself, submitted to “a well-known peer-reviewed journal in machine intelligence”. The second and third authors provided guidance about themes, datasets, weightings, etc, but that’s as far as it goes. They do provide commentary as the paper progresses, but they tried to keep that as minimal as needed, so that the paper could stand or fall on its own merits. The paper is not too bad. A bit repetitive, a bit shallow, but it’s just a 500 word paper- hardly even an extended abstract – so that’s about par for the course. The arguments and supporting references are no worse than many I have reviewed, and considerably better than some. The use of English is much better than that of the majority of papers I review.

In an article about it in Scientific American the co-authors describe some of the complexities in the submission process. They actually asked GPT-3 about its consent to publication (it said yes), but this just touches the surface of some of the huge ethical, legal, and social issues that emerge. Boy there are a lot of those! The second and third authors deserve a prize for this. But what about the first author? Well, clearly it does not, because its orchestration of phenomena is not for its own use, and it is not even aware that it is doing the orchestration. It has no purpose other than that of the people training it. In fact, despite having written a paper about itself, it doesn’t even know what ‘itself’ is in any meaningful way. But it raises a lot of really interesting questions.

It would be quite interesting to train GPT-3 with (good) student assignments to see what happens. I think it would potentially do rather well. If I were an ethically imperfect, extrinsically-driven student with access to this, I might even get it to write my assignments for me. The assignments might need a bit of tidying here and there, but the quality of prose and the general quality of the work would probably result in a good B and most likely an A, with very little extra tweaking. With a bit more training it could almost certainly mimic a particular student’s style, including all the quirks that would make it seem more human. Plagiarism detectors wouldn’t stand a chance, and I doubt that many (if any) humans would be able to say with any assurance that it was not the student’s own work.

If it’s not already happening, this is coming soon, so I’m wondering what to do about it. I think my own courses are slightly immune thanks to the personal and creative nature of the work and big emphasis on reflection in all of them (though those with essays would be vulnerable), but it would not take too much ingenuity to get GPT-3 to deal with that problem, too: at least, it could greatly reduce the effort needed. I guess we could train our own AIs to recognize the work of other AIs, but that’s an arms war we’d never be able to definitively win. I can see the exam-loving crowd loving this, but they are in another arms war that they stopped winning long ago – there’s a whole industry devoted to making cheating in exams pay, and it’s leaps ahead of the examiners, including those with both online and in-person proctors. Oral exams, perhaps? That would make it significantly more difficult (though far from impossible) to cheat. I rather like the notion that the only summative assessment model that stands a fair chance of working is the one with which academia began.

It seems to me that the only way educators can sensibly deal with the problem is to completely divorce credentialling from learning and teaching, so there is no incentive to cheat during the learning process. This would have the useful side-effect that our teaching would have to be pretty good and pretty relevant, because students would only come to learn, not to get credentials, so we would have to focus solely on supporting them, rather than controlling them with threats and rewards. That would not be such a bad thing, I reckon, and it is long overdue. Perhaps this will be the catalyst that makes it happen.

As for credentials, that’s someone else’s problem. I don’t say that because I want to wash my hands of it (though I do) but because credentialling has never had anything whatsoever to do with education apart from in its appalling inhibition of effective learning. It only happens at the moment because of historical happenstance, not because it ever made any pedagogical sense. I don’t see why educators should have anything to do with it. Assessment (by which I solely mean feedback from self or others that helps learners to learn – not grades!) is an essential part of the learning and teaching process, but credentials are positively antagonistic to it.

Originally posted at: https://landing.athabascau.ca/bookmarks/view/14216255/can-gpt-3-write-an-academic-paper-on-itself-with-minimal-human-input

Ernst & Young fined $100 million after employees cheated in exams

Posted , updated on

Not just any exams: ethics exams.

These are the very accountants who are supposed to catch cheats. I guess at least they’ll understand their clientele pretty well.

But how did this happen? There are clues in the article:

“Many of the employees interviewed during the federal investigation said they knew cheating was a violation of the company’s code of conduct but did it anyway because of work commitments or the fact that they couldn’t pass training exams after multiple tries.” (my emphasis).

I think there might have been a clue about their understanding of ethical behaviour in that fact alone, don’t you? But I don’t think it’s really their fault: at least, it’s completely predictable to anyone with even the slightest knowledge of how motivation works.

If passing the exam is, by design, much more important than actually being able to do what is being examined, then of course people will cheat. For those with too much else to do or too little interest to succeed, when the pressure is high and the stakes are higher, it’s a perfectly logical course of action. But, even for all the rest who don’t cheat, the main focus for them will be on passing the exam, not on gaining any genuine competence or interest in the subject. It’s not their fault: that’s how it is designed. In fact, the strong extrinsic motivation it embodies is pretty much guaranteed to (at best) persistently numb their intrinsic interest in ethics, if it doesn’t extinguish it altogether. Most will do enough to pass and no more, taking shortcuts wherever possible, and there’s a good chance they will forget most of it as soon as they have done so.

Just to put the cherry on the pie, and not unexpectedly, EY refer to the process by which their accountants are expected to learn about ethics as ‘training’ and it is mandatory. So you have a bunch of unwilling people who are already working like demons to meet company demands, to whom you are doing something normally reserved for dogs or AI models, and then you are forcing them to take high-stakes exams about it, on which their futures depend. It’s a perfect shit storm. I’d not trust a single one of their graduates, exam cheats or not, and the tragedy is that the people who were trying to force them to behave ethically were the ones directly responsible for their unethical behaviour.

There may be a lesson or two to be learned from this for academics, who tend to be the biggest exam fetishists around, and who seem to love to control what their students do.

Originally posted at: https://landing.athabascau.ca/bookmarks/view/14163409/ernst-young-fined-100-million-after-employees-cheated-in-exams

#AthaU22 – may your journey be rich, gentle, and challenging

Posted , updated on

In the convocation prayer offered by Elder Maria Campbell each year for Athabasca University graduands, she asks for blessing that their journeys be “rich, gentle, and challenging”. I can’t think of a more perfect wish than this. Each word transforms and deepens the other two. It’s truly beautiful. Every time I hear those words (or, technically, read them – they are actually spoken in Cree) they tumble together in my head for days. I am reminded of these lines (that are about music, but that seem perfectly apt here) from Robert Browning’s Abt Vogler:

And I know not if, save in this, such gift be allowed to man

That out of three sounds he frame, not a fourth sound, but a star.

On this graduation day I wish all our departing students rich, gentle, and challenging lives, and (as Maria Campbell goes on to say, gently acknowledging troubles to come) that the roads they travel are not too bumpy.

And I wish the same to you, too.

Solving The Wrong Problems: Why Online Education Is and Must Be Different from In-Person Education – slides from my invited talk at ICEMI 2022

Posted , updated on

icemi22

These are the slides from my invited talk at the 11th International Conference on Education and Management Innovation (ICEMI 2022), June 11th. The talk went down well – at least, I was invited to repeat the performance at a workshop (where I gave a very similar presentation today – if you’ve seen one, you probably know the content of the other!) and to give a keynote later in the year.

It’s about how methods of teaching that solve problems for in-person teachers don’t apply online, and it provides a bit of advice on online-native approaches. I’ve talked quite a bit about this over the past decade so there’s not much new in it apart from minor refinements, though I have put a greater emphasis on what goes on outside the classroom in physical institutions because I’m increasingly thinking that this matters way more than we normally acknowledge. Notably, I discuss the ways that physical institutional structures and regulations provide significant teaching functions of their own, meaning that in-person teachers can be absolute rubbish or (in some subject areas or topics) even fail to turn up, and students can still learn pretty well. This helps to explain the bizarre phenomenon that, across much of in-person academia, professors and lecturers are not expected to learn how to teach (and many never do).

Here’s the abstract…

In-person educational institutions teach, at least as much as the individual teachers they employ. Students are taken out of their own environments and into that of the institution, signalling intent to learn. The physical environment is built for pervasive learning, from common rooms, to corridors, to campus cafes; students see one another learning, share learning conversations, learn from one another. Even the act of walking from classroom to classroom makes events within them more salient. Structures such as courses, timetables, semesters, and classes solve problems of teaching efficiently within the constraints of time and space but impose great constraints on how teaching occurs, and create multiple new pedagogical and management problems of their own. The institution’s regulations, expectations, and norms play a strong pedagogical role in determining how, and when learning occurs. Combined with other entrenched systems and tools like credentials, textbooks, libraries, and curricula, a great deal of the teaching process occurs regardless of teachers. What we most readily recognize as ‘good’ teaching overcomes the problems caused by these in-person environments, and exploits their affordances.

Online institutions have radically different problems to solve, and radically different affordances to exploit, so it makes no sense to teach or manage the learning process in the same ways. Online, students do not inhabit the environment of the institution: the institution inhabits the environment of the student. It is just one small part of the student’s physical and virtual space, shared with billions of other potential teachers (formal or not) who are a click, a touch, or a glance away. The institution is just a service, not the environment in which learning occurs. The student picks the time, the space, the pace, and virtually all the surrounding supports of the learning process. Teachers cannot actively control any of this, except through the use of rewards, punishments, and the promise of credentials, that force compliance but that are antagonistic to effective or meaningful learning. In this talk, I will discuss the implications of this inverted dynamic for pedagogy, motivation, digital system design, and organizational structures & systems for online learning.