Should we be worried about algorithms?
There has been some recent national media coverage about local authorities using ‘algorithms’ to predict the likelihood of a child being abused. Should the prospect of a ‘Big Brother’ approach worry us, or should we be encouraged by the possibility of improving outcomes for children?
Algorithms, machine learning and AI tend to get confused. A useful starting point is that algorithms don’t need computers. The word itself derives from a Persian mathematician based in Baghdad, al-Khwarizmi, who was working around the time of 780 CE – no computers were available then! An algorithm is just a list of instructions showing how to accomplish a task.
Daniel Kahneman in ‘Thinking, Fast and Slow’ (if you haven’t read it, you must!) shows that almost all of the time, we ‘think fast’ using limited data, without thinking about how we are thinking – working unconsciously, on autopilot – and then drawing rapid conclusions before taking action. Fast thinking follows what Kahneman calls ‘heuristics’ – learned responses or simple rules of thumb – like ‘bigger is better’ or ‘if some of X is good, more of X is better’. Often this is fine, but where there are many complex variables or complex situations, we very often make mistakes unless we deliberately ‘think slow’ – consciously working things out so that we don’t miss the trees for the wood.
Kahneman’s ‘heuristics’ are algorithms, but they are very limited. Conscious or ‘slow’ thinking uses more complex algorithms, and in the professional world these are often codified into ‘flow diagrams’, ‘process charts’ or ‘operational descriptions’. Even the most talented professional needs an aide memoire to avoid slipping into ‘fast thinking’. (The downside is that these developments can be said to ‘de-professionalise’ practitioners, but I’d much prefer to have a surgeon who went through a checklist with their team before cutting me open rather than a prima donna who thought things looked OK and went ahead without checking…)
So, we’ve all been using algorithms for years. What’s new is clearly the operation of computers in applying the algorithm. Now, I have a 45-year track record in using data and IT (from my PGCE dissertation ‘The use of a computer program to analyse objective tests in science education’ to being Chair of the National Consortium of Examination Results) and I’ve come across most of the advantages and the pitfalls from personal experience. The GIGO law ‘Garbage In, Garbage Out’ was invented by early computer scientists: if the data is poor, any analysis using that data will also be poor, even if the computer is working properly and is well-programmed. Machine learning can be extremely powerful – Google Translate enables me to talk to the Spanish-speaking members of our extended family with barely a glitch – and computers now routinely beat even the best chess players. But unless machine learning is fed the appropriate information, we will get garbage out that reinforces our own biases.
What do I conclude? Perhaps it’s obvious, but a computer-based algorithmic system is likely to be effective and rapid if it is fed accurate and relevant data and is properly set up to assess and take account of missing or partial data. Compared to a human decision-maker with the same data, the computer-based system ought to be better – computers don’t get bored or have off-days. However, it’s important that algorithmic systems are checked to ensure that they do not simply codify and automate human biases such as ‘tattoos are bad’. (Kahneman gives an excellent (if scary) analysis of the variation in the proportion of prisoners granted parole by US courts according to the length of time before lunch.)
Computer-based algorithmic systems are the future, but so are professionals, both to ensure the algorithms themselves are appropriate, and to ensure that the output of the algorithm is reviewed intelligently and not applied blindly (‘computer says “no”’).
Related Blog Articles
There’s a lot going on at the moment, what with our new President, the care...
In General
As with so much in life you learn a lot from your children. It was only when my...
In General
On 22 May I joined many other people in watching a Panorama programme exposing...
In General
This week, students up and down the country have been returning to school, or...
In Education
In 2017 ADCS published the policy position paper, A country that works for all...
In General
Like in most local authorities, children who are subjects of a child protection...
In Safeguarding & Child Protection
This blog was first due a couple of weeks ago, but the small matter of an ILACs...
In
As I prepared myself mentally for taking on the role of ADCS Vice President, I...
In General
There were two social workers, a nurse, and a magistrate sitting in a bar…....
In Leadership
The National Children and Adult Services Conference 2019 opened on Wednesday 20...
In General
Like the Tokyo Olympics, Wimbledon and Glastonbury, the pandemic delayed another...
In Safeguarding & Child Protection
Highlighting the impact of neglect on young people is clearly presented in...
In Safeguarding & Child Protection
In East Sussex, this year’s Young People’s Big Vote placed ‘a fear of...
In General
As I write this I am reflecting on the life of a wonderful friend and colleague...
In General
Peter Clarke, HM Chief Inspector of Prisons, recently presented a shocking...