How technology redefines learning (and why this isn’t a problem).

(This post was written before the main wave of interest/anxiety around AI/Large Language Models hit. As such, it’s delightfully non specific and an attempt to outline implications in principle. For me, this is summed-up as follows:

  1. Efficient access to abundant information (the Web) reduced the value of ‘remembering information’ as a skill.
  2. AI reduces the value of synthesis as a skill.

In some ways, technology is climbing up Bloom’s Taxonomy and pushing more of the learning process in the pointy bit of the triangle. Although, interestingly, it does skip some layers which could be a problem. Jumping from knowledge to synthesis and circumnavigating comprehension, application and analysis might prove dangerous. (not that I think we should always run through those things in strict order).

Anyway… below is what was my first run at some of this thinking)


A developer friend of mine recently told me a simple coding task they set when interviewing new staff was successfully answered by a chat bot. My response was, “Chat bots can Google, so I’m not sure what the problem is?”. In the days following my trite response I found myself coming back to the topic and realised that the chat bot ‘problem’ is part of a long history of falsely imagining ‘learning’ to be a fixed concept we are more or less distanced from by technology.

Detail from an abstract painting, mainly in blues and blacks, by David White (CC:BY)
Detail from an abstract painting by David White (CC:BY)

In 2014 I gave a keynote at the Wikipedia conference entitled, “Now that Wikipedia has done all our homework, what’s left to teach?”. This was intended to be a playful way of highlighting that the ‘problem’ was not with Wikipedia but with an education system which placed too much value on answers and not questions. Wikipedia was ‘too good, too available and too accurate’ for a system which was built on the principle that information is difficult to access and recall. 

Looking back, the Wikipedia ‘problem’ seems like the quaint precursor to the lively AI-will-kill/save-education discourse. (all tech debates decend into the kill/save dichotomy, so it’s better to step back from this and ask why this comes about.)

Good / Bad – *yawn*.

Firstly, any institution or system which claims that technology becoming ‘good’ at something is the central problem won’t last long in its current form. Within Capitalist Realism, you simply never win this argument (and yes we could go to the barricades but I’m writing in the context of where we are now). Secondly, withholding technology to force people to ‘learn’, incorrectly assumes that the notion of learning is fixed. Let’s be honest, telling school kids to not use Wikipedia was never going to wash, especially as schools tried this line at around the time they stopped giving out textbooks on the (never to be said out loud) hope that the kids all had access to the internet. 

Saying AI is bad (or good) is a super dull discussion. Admitting it exists and that we will use it for anything that makes our lives a bit easier is a much more interesting starting point. (side note: when I use the term AI, I really mean ‘elegant computer code that does things we think are useful or entertaining’). A brief history of humanity has to include: “We will always use all available tech for good and bad and this process is continually redefining what it means to have power, have skills, be intelligent and be creative.”  These values and how they operate as currencies is always on the move and always has been. 

Is ‘being right’ now wrong?

What my developer friend’s chat bot couldn’t do was reason out, or tell the story of, how it had arrived at its answer. This is how we frame ‘learning’ at the University of the Arts London, we don’t assess the end product we assess the narrative of how the student travelled towards the end product. The narrative is the learning, the artefact (often a creative output at UAL) is the output from that learning. The end ‘product’ is symbolic of the learning rather than an embodiment of it, it needs a narrative wrapped around make meaning out of the process. 

The photography(tech)-drove-art-to-become-more-conceptual argument is a useful touchstone here. If we imagine a near future where most, traditional, assessments of learning can be undertaken successfully by code then our approach to education has to become more about narrative and reasoning than about ‘being right’ or ‘reflecting a correct image of the world back at ourselves’. 

We are feeling our humanity squeezed by tech that can mirror what we, historically, defined as human. This is not a fight with tech but an opportunity to redefine and reimagine what we value. I’m hopeful that this will allow previously marginalised voices and identities to become heard.

I’d argue that ‘being right’ is this century’s outdated skill – this is a good thing.

Just as purely figurative Fine Art lost a bunch of its value as photography gained ground, being right will lose its status relative to being-able-to-think within our networked-tech suffused environment. In many ways, current political and identity polarization is an effect of the rise of networked technologies, both in social (the internet) and neural network (AI) terms. It’s a grasping for the comfort of ‘being right’ in response to a painful, and unsettling, shifting away from the certainty of that very rightness. 

Save and adapt

Back in edu-land: A good essay is a narrative of reasoning, so it does or should, operate as an embodiment of being-able-to-think. Sadly, we have fed so many essays into the network that technology can now reflect a performance of this learning back at us. I have no sympathy for educational institutions who have a naïve understanding of data and also claim that tech which endangers its business model should be shut down. We can’t complain about tech when we use the very same tech to increase revenue. We also can’t de-tech without damaging access and inclusion.

Let’s not to fall into academic navel-gazing on the what-is-learning/what-is-the-academy questions though. Instead let’s focus on how we adapt our lumbering institutions to shifting tech-driven redefinitions of value, while also calling our unethical practices of all kinds. I’m not an accelerationist, I believe that we can adapt while not erasing historical forms of value. Universities are ideally placed to ‘protect’ that which might be destroyed by the headrush of technology but they must not be defined by that impulse. 

Make it relevant

Having been invited to give a talk at the British Library I naturally decided to create my own theory of the history of information… This was to illustrate my musings on a general shift from taxonomies to relevance in our information seeking. To be fair the librarians representing the BL and other academic institutions seemed quite sympathetic to the overarching point I was trying to make so here’s the idea:

Relevance diagram
A brief history of information…

In a pre-literate, pre-printing age information was embodied in kin, peers and those that you might happen to meet within a limited geography – in this sense information was physically located and arranged. Obviously I’m no expert in this area having just a smattering of old-school Anthropology to draw on so this part of the idea/diagram is simply there as a backdrop.

Then along comes printing (sure, the monks and tax collectors etc were busy before printing…) so knowledge stacks-up and needs organising so that it can be retrieved efficiently. There is a new category of knowledge which, while still linked to individuals as authors*, is not wholly embodied in the same way as before. Taxonomies are invented to structure printed knowledge, generating lines and relationships between ideas and information, creating a more defined model of understanding.

In the last 20 years or so we then see the rise of the digital and the network, search evolves from the dialect of databases to natural language. At this point something fundamental shifts. Our relationship with knowledge moves from interrogating taxonomies (think Dewey Decimal for example) to an expectation of relevance. Knowledge is no longer physically embodied so we don’t need systems to tell us where it is or what’s sat nearby.

Clearly all of the above forms of knowledge still co-exist, for example, students going to Social Media to ask others for the most relevant information sources. Nevertheless the Web has driven a massive shift from taxonomy to relevance. One way to think of this is that the Web circumnavigates taxonomy for us, connecting us to information and people without the need for hierarchy.

Relevance Diagram

For example, if you want to discover a specific piece of information do you do move through a hierarchy do you simply search and then sift the results? When was the last time you found the Wikipedia article you wanted by moving through the taxonomy of the online encyclopaedia? We are increasingly driven by the stack of notifications in Social Media and/or via our phones where we can design the factors which stack what we feel is most relevant to the top of the pile.

Even when it comes to our own personal resources, many simply throw things into the cloud then search or look of ‘last modified’. In my institution most students use Apple Macs and organise their files visually. I suspect most would not be able to identify ‘where’ those files are within the structure of the hard-drive.

Of all of these it’s the manner in which search has evolved which has the largest implication for educational intuitions. If we take Google as an example we see that the taxonomy is hidden in the algorithm and this algorithm evolves to incorporate the traces of those that went before. Consider this in pedagogical terms: much of what it meant to learn was centred on an individual’s ability to navigate the taxonomies of knowledge, to find the ‘good stuff’. Intellectual effort was expended on discovery and on formulating links across chunks of information (aka books etc). Now the effort of making those connections is captured within the search algorithm and handed to the next person who searches on that topic. There is much less need for each new scholar to understand the larger model/taxonomy of a particular discipline. In essence, what we used consider to be part ‘study’ is now embodied in the technology (another example of the Post-digital). If our pedagogy continues to be based on notion, and still rewards effort, based on navigating these taxonomies then we are radically out of step.

And yet even as we move to an era of relevance, educational institutions continue to operate on taxonomic principals. This makes sense for the HR and the finance department but becomes problematic when it underpins curriculum design and assessment. Institutions have always operated in a hierarchical manner and yet the Web, the place many of our students (and staff) undertake the majority of their learning, doesn’t.  One of the reasons students struggle to understand the course handbook or the set-up of their course in the VLE is because they rarely encounter structures of this nature. When I consider the requests students make to improve the digital provision and information sources of the university most of it can be characterised as “Please can you filter that complex structure into a feed based on what’s most relevant to me”.

*See “The Resident Web and it’s Impact on the Academy” at Hybrid Pedagogy for some thoughts on the relationship between ‘content’ and individuals/authors. http://www.hybridpedagogy.com/journal/resident-web-and-impact-on-academy/

Disconnected learning

(…and why there’s no such thing as ‘information-seeking’ for school students)

This month Jisc published a report I wrote with Joanna Wild about secondary school student’s experience of technology for learning. The report is part of The Digital Student project and makes recommendations to the Higher Education sector about how to meet and manage incoming student’s expectations of the digital environment.

School's report

The emphasis in the report wasn’t on the technology the schools owned but on how they incorporate it into the day-to-day curriculum. Generally what we found was that within the classroom digital technology is used in the service of making existing pedagogical processes more efficient rather than as an opportunity to engage students in new ways – an example being the frequent, non-interactive, use of PowerPoint by teachers. This appears to be an effect of the training available to staff which generally concentrates on functional skills, neglecting discussion of how technology can be effectively incorporated into teaching.

I’ve spent the last few years discovering how students go about learning now that the Web exists. Given that I was fascinated/bemused by the apparent disconnection between the classroom and how homework gets done. It’s truly strange that homework is set by schools with the assumption that the Web will be used to complete it but without admitting this fact institutionally. This is to the extent that many students don’t even receive textbooks for key subjects.

So on the one hand the Web is talked about as a place where you have to be wary of the quality of information and on the other it’s absolutely integral to successfully undertaking your studies. This feels to me like the start of The Learning Black Market for students and in theory puts them in a dissonant situation as they attempt to bridge the divide between the classroom and the way they complete homework. I say in theory because the quality of information to be found online will be very high and because they won’t be required to cite sources for much of their school career. So in essence the system works but not by design – it’s disconnected and I don’t see much evidence of it being brought together.

The problem here is more to do with ‘knowing’ than with technology. I explored the notion of a loss of ontology when discussing the relationship between Wikipedia and education and I believe that this is a significant effect of the disconnect between the classroom and home. Students are developing basic approaches to finding and using information online without much support from school. Obviously the aim of the game is to complete your homework as quickly as possible and then go out and play football with jumpers for goalposts (yes, yes, I know).

The sheer efficiency of the Web means that students can leap to a highly focused answer online without having to build a knowledge map of the discipline territory. In some senses there is no process of ‘information seeking’ – simply type a question into Google and the answer will appear. Crucially (and I’m happy to labour the point) the information ‘discovered’ will be good enough/excellent so raising eyebrows in a library-style fashion about this approach not-being-proper is not relevant.

This then shifts the task in hand to masking the fact that most of your homework can be completed with the use of one super-convenient source that appeared in the top three links returned by Google (often Wikipedia). From what I’ve seen that means ‘how to delicately rewrite stuff I’ve found online so I can’t be accused of copying’. (…to be fair that’s the same as it ever was in school but it’s more efficient and so more prevalent with copy and paste)

Information Knowledge Wisdom
Possibly Hugh MacLeod? via http://goo.gl/qkbG2B

This (slightly trite) diagram helps to illustrate what I see as the challenge formal education needs to respond/adapt to. Historically the connecting lines that evolve ‘information’ to ‘knowledge’ (I’d use the term learning myself) were partly formed by the process of information seeking -the effort required to piece together understanding by locating and trawling through books. The connections that build an ontology of information were a side effect of this relatively inefficient process. Or, in a lesser way, they were implicit in the structure and layout of your textbook. Now that information seeking is all but dead these lines are less likely to be formed, especially when doing homework. Wisdom isn’t my specialty but I’d argue that deep understanding comes from making connections and not simply discovering scattered answers.

This is the central disrupting effect of the Web on formal education, a disruption of pedagogy and epistemology. Our response should be to bridge the disconnect between the classroom and homework by designing curricula that explicitly accepts the Web is already central to how education operates and is a legitimate source of information.

Wikimania

Last November I was invited to speak at a meeting of the UK arm of the Wikipedia Education Program who support the integration of Wikipedia into mainstream education. Much of their focus is on providing advice and resources around contributing to Wikipedia as an alternative to writing essays or reports.

My talk was titled “What’s left to teach now that Wikipedia has done everyone’s homework?”. The basic premise being that if the answer to your homework/assignment is a Wikipedia article then you need to change the way you teach.

I was invited to reprise an updated version of that talk at the international Wikipedia conference (59 countries represented) in London this August. (A huge thanks to Peter Sigrist who wrote an excellent and detailed account of my talk http://goo.gl/PcIY4w)

For me this was hugely exciting and a little daunting. Wikipedia is, in my opinion, the most popular and valuable educational platform since the invention of the printing press so I wanted to contribute to the best of my ability. On the day I discovered that the venue (the Barbican) provided its main-stage speakers with dressing rooms which was a new, and slightly strange, experience. I also knew that I was on the programme with Wikipedia’s Senior Designer Brandon Harris (@jorm) and all round nice-guy genius Jack Andraca (@jackandraca) – not easy people to keep up with (but extremely inspiring).

During the conference it became clear that the Wikipedians are generally so focused on what Martin Poulter described as the ‘axiomatic’ vision of “…a world in which every single person on the planet is given free access to the sum of all human knowledge.” that they rarely consider the impact Wikipedia is having on a range of institutions and professions.  I hope that my talk went some way towards addressing this in regard to education.

The main concept I added to the talk for Wikimania was about ‘Loss of ontology’. The idea that our ability to efficiently search for pinpoint answers means that we don’t build the kind of ‘knowledge maps’ we used to when we had to seek out sections of specific books or journals etc. Given this if our pedagogy is still based on discovering answers then the existence of platforms like Wikipedia might mean our students aren’t learning as much as we hope. This, I pointed out, is a fault in our teaching methods which often don’t properly account for the Web and not a reason to attempt to ‘ban’ or besmirch Wikipedia.

The phrases from my talk which appear to have been most Tweeted were:

“The problem with Wikipedia is not that it’s inaccurate it’s that it’s too good” (i.e. you can find a decent answer without having to ‘think’)

and

“Wikipedia isn’t a threat to education, it’s a gift”.  (assuming we move from a pedagogy of answers to a pedagogy of questions – teaching students how to critique and edit Wikipedia is one way we can make this move.)

Resources I menioned during the talk can be found here: http://goo.gl/WYHCJu