matterealities and the physical embodiment of code

Last Tuesday morning I had the pleasure of entertaining a group of attendees to the Matterealities workshop @ lancaster. Hans and I had organised a series of demos in the dept. during the morning (physiological gaming, Firefly (intelligent fairylights), VoodooIO, something to do with keyboards) … but as computer scientists are nocturnal the demos did not start until 10am, and so I got to talk with them for around an hour beforehand :-/

The people there included someone who studied people coding about DNA, someone interested in text, anthropologosts, artists and an ex-AI man. We talked about embodied computation1, the human body as part of computation, the physical nature of code, the role of the social and physical environment in computation … and briefly over lunch I even strayed onto the modeling of regret … but actually a little off topic.

Alan driving

physicality – Played a little with sticks and stones while talking about properties of physical objects: locality of effect, simplicity of state, proportionality and continuity of effect2.

physical interaction – Also talked about the DEPtH project and previous work with Masitah on natural interaction. Based on the piccie I may have acted out driving when talking about natural inverse actions

ubiquity of computation – I asked the question I often do “How many computers do you have in your house” … one person admitted to over 10 … and she meant real computers3. However, as soon as you count the computer in the TV and HiFi, the washing machine and microwave, central heating and sewing machine the count gets bigger and bigger. Then there is the number you carry with you: mobile phone, camera, USB memory stick, car keys (security codes), chips on credit cards.

FireFly on a Christmas treeHowever at the Firefly demo later in the morning they got to see what may be the greatest concentration of computers in the UK … and all on a Christmas Tree. Behind each tiny light (over 1000 of them) is a tiny computer, each as powerful as the first PC I owned allowing them to act together as a single three dimensional display.

embodiment of computation – Real computation always happens in the physical world: electrons zipping across circuit boards and transistors routing signals in silicon. For computation to happen the code (the instruction of what needs to happen) and the data (what it needs to happen with and to) need to be physically together.

The Turing Machine, Alan Turing’s thought experiment, is a lovely example of this. Traditionally the tape in the Turing machine is thought of as being dragged across a read-write head on the little machine itself.

However … if you were really to build one … the tape would get harder and harder to move as you used longer and longer tapes. In fact it makes much more sense to think of the little machine as moving over the tape … the Turing machine is really a touring machine (ouch!). Whichever way it goes, the machine that knows what to do and the tape that it must do it to are brought physically together4.

This is also of crucial importance in real computers and one of the major limits on fast computers is the length of the copper tracks on circuit boards – the data must come to the processor, and the longer the track the longer it takes … 10 cm of PCB is a long distance for an electron in a hurry.
Alanbrain as a computer – We talked about the way each age reinvents humanity in terms of its own technology: Pygmalion in stone, clockwork figures, pneumatic theories of the nervous system, steam robots, electricity in Shelley’s Frankenstein and now seeing all life through the lens of computation.

This withstanding … I did sort of mention the weird fact (or is it a factoid) that the human brain has similar memory capacity to the web5 … this is always a good point to start discussion ๐Ÿ˜‰

While on the topic I did just sort of mention the socio-organisational Church-Turing hyphothesis … but that is another story

more … I recall counting the number of pairs of people and the number of seat orderings to see quadratic (n squared) and exponential effects, the importance of interpretation, why computers are more than and less than numbers, the Java Virtual Machine, and more, more, more, … it was very full hour

AlanLcoblo - artefactsAlan

  1. I just found notes I’d made for web page in embodied computation 5 years ago … so have put the notes online[back]
  2. see preface to Physicality 2006 proceedings[back]
  3. I just found an online survey on How many computers in your house[back]
  4. Yep I know that Universal Turing machine has the code on the tape, but there the ‘instructions’ to be executed are basically temporarily encoded into the UTM’s state while it zips off to the data part of the tape.[back]
  5. A. Dix (2005). the brain and the web – a quick backup in case of accidents. Interfaces, 65, pp. 6-7. Winter 2005.
    http://www.hcibook.com/alan/papers/brain-and-web-2005/[back]

film – waking life

Last night watched ‘Waking Life‘ a strange film all about dreaming

We ordered it from amazon video (their subscription lending library), but not quite sure how we managed to do it. Certainly when it arrived and I read the description it sounded a little too arty … I of course like James Bond and Famous Five!

However, it was very enjoyable and has most stunning animation. It looked as if it had been filmed live, but then, either by hand or using computer, reduced to comic book effect. It chronicles a young man’s day or dream as he discusses (mainly listens) to various people talking about the philosophy of dreams and reality – I assume taken from lots of real philosophers, but I’m not well read enough to recognise many! All of this in a constantly shifting animation as if each object were half floating. Sort of Disney meets Derrida.

Two things struck me … well actually many more, loads of lovely quirky asides, but I forget most already ๐Ÿ™

First is how lacking in grounding so many of the philosophical ideas are; sitting somewhere between mysticism and reason. I’ve recently been reading Lefebvre’s Rhythmanalysis and got a similar feel there รขโ‚ฌโ€œ lovely stuff for a novel, almost poetic … but without solid ground. An age that has forgotten or rejected God and lost faith in rationality, but struggling to find something in the void.

The other thing was a point when one of the characters said to the protagonist (I misquote!) “your sneakers aren’t real, your feet inside your sneakers aren’t real, you are a mental model” … the character is referring to the fact you are not real in a dream, but to some extent this is precisely the self we experience, my mental model of me is the ‘I’ I know, so (and this was said elsewhere in the film), to some extent aspects of dreams are as real as anything in waking life.

absolutely nothing

I few days I was reading from George Perec’s Species of Spaces and Other Places1, or rather reading is not quite the right word, Perec is an odd writer and the book is more something to dip into than to read in any concerted fashion.

Perec is writing about spaces without function and says:

How does one think of nothing? How to think of nothing without automatically putting something round that nothing, so turning it into a hole, into which one will hasten to put something, an activity, a function, a destiby, a gaze, a need, a lack, a surplus …?

This reminded me of another book, Edward Casey’s The Fate of Place2. Casey surveys various creation myths and finds that while at forst glance many seem to have a creation ex nihilo, in all cases the emptiness, the void is not so empty, either bounded, or filled with chaotic churning, unformed things. There is no empty space.

These myths are about the feelings and conceptions of people and tell us somehting deep about our inability to capture an essence of nothingness, just as Perec struggles. The concept of the number zero eluded (or appalled) the Greeks and the idea of the empty set causes problems for many students, perhaps only made palitable by the curly brackets surrounding the emptiness {} … “putting something round that nothing“.

They say “nature abhors a vaccum”, although I guess one wonders whether it is just people who abhor it. One of the surest forms of torture is sensory deprivation.

The role of the void in physics has changed over the years. From being simply the empty gap between things. 19th century scientists populated it with electromagnetic and gravitational fields – the void became the medium, a material internet through which forces rippled.

In Einstein’s General Relativity, space is no longer the medium through which gravity is transmitted, but instead it is the distortions of space-time that define matter itself. Space is not filled with other things, it is the things.

However, in Quantum Mechanics we find a world that is rather like the voids of those reation myths, empty space forever filled with zero-point energy. And in the emptiness particles and anti-particles constantly appearing and anihilating one another; a boiling broth not still waters.

Most strange, when empty space is bounded, the very walls are sucked in by an extra emptiness. The bundaries mean that certain modes of vibration of the space between the walls are not possible – like a guitar string that will only play certain harmonics – and those missing vibrations cause missing energy.

So, when Perec puts “something round that nothing” he in fact makes it less than it was before.

  1. George Perec, Species of Spaces and Other Places , (tr. John Sturrock), Penguin, 1997. ISBN 0-14-018986[back]
  2. Edward Casey, The Fate of Place: A Philosophical History, University of California Press, 1998. ISBN 0-520-21649-0[back]

Dennett’s Sweet Dreams – consciousness and the Turing test

I read Dennett’s Sweet Dreams a few months ago. Although I am also interested in dreams this book is about consciousness … indeed subtitled “Philosophical Obstacles to a Science of Consciousness”

The book is largely about one message – that a scientific study of consiousness can only take into account third party accessible knowledge about first part experience. In other words I can only base a scientific study on what I can tell of other people’s consciousness from their actions, words and any available brain scanning etc.

Dennett has a meticulous rhetoric, but I found two broad facets of his argument weak, one more about rheteric and one substance.

First somewhat disingenuously he does not say that a scientific study of consciousness would yield a complete account of consciouness, but effectively the implication is there. That is he does not say that consciouness is no more than its phenomenial effects … but implies it.

Second, being a philosopher he focuses on incontrovertible evidence, whereas as scientists and humans often reasonable evidence is sufficient.

The first point is obvious and yet easily underestimated. A ‘scientific’ study of literature could formulate many known literary rules (aliteration, rhyme, etc.) and may even find new ones, and indeed poets in particular are happy to perform such analyses. However, we do not expect such rules to be a complete account of literture.

The second point is more substantive, but does interact with the first.
Dennett takes issue with philosophers who posit some form of non-sentient zombie (often called ‘Mary’) who/which nonetheless behaves otherwise exactly like a human including things that might appear to be conscious. They then say “but of course Mary is not conscious”. Dennett objects to the ‘of course’, which is really a statement about prior beliefs/assumptions (although Dennett, of course, frequently does the same with his beliefs!).

Dennett posits a Robo-Mary which is entirely mechanical/electronic and yet emulates perfectly the brain circuitry of a person and so can work out how the person would react and then reacts similarly. From the outside and by all her (emulated) subjective reactions she appears to be conscious. She would pass any ‘Turing Test’ for consciousness and yet many, perhaps most, would say she is not. The implication (from the first weakness) is that we are no more conscius than she (it?).

Actually I don’t object to the idea that such a creature may indeed be conscious, but I’d need more evidence than I would for a human, not because Robo-Mary is a machine, but becasue she is designed to appear conscious.

Robo-Mary is in fact a Robo-Mata-Hari, a spy, a robot in human clothing.

A good enough actor may convince you he is feeling happy, sad, or in love, and you may not be able to tell the differece between the act and the real thing, but that does not mean happiness, saddness and love are no more than their appearance.

As a philosopher, you cannot have incontrovertible evidence that a person’s emotions are real, not just a facade. However, as a human it would be unreasonable to therefore dismiss all expressions of emotion.

Some (well many) years ago, I worked with people at York who creating one of the first ADA compilers. There was a validation suite of programs that had to compile and run correctly for the compiler to get an official stamp from the ADA standards agency. I used to wonder about writing a program that recognised each of the tests cases and simply spat out the right code for each one. Any other program given to the program would simply print an error message and stop. The program would pass the test suite and could get the stamp as being a validated compiler, and yet would be completely useless. It would be a cheat ADA compiler.

Imagine if I sold such a cheat compiler. Any judge would regard it as fraud – whilst it passed the test, it is clearly not an ADA compiler. The test is there to validate things that are designed to be ADA compilers, not things designed to pass the test. So, the cheat ADA compiler is not adequately validated by the test, just becase it is designed to pass it.

Robo-Mary is designed to pass the consciousness test … indeed any consciousness test. We perhaps could never incontrovertibly tell whether Robo-Mary was conscious or simply acting conscious. However, when faced with another human being, an ordinary Mary, who is not designed specifically to appear conscious, it is reasonable to assume that she experiences similar things to me when she describes her experience in similar terms. I can never incontrovertibly tell that Mary is conscious, but it is reasonable to believe so. And it is equally reasonable to base a scientific study on such defeasible observations.

Turning back to Robo-Mary; convincing machine cosciousness would not come from machines designed to appear conscious, but more ‘by accident’. Perhaps one day my intelligent automated vacuum cleaner will say to me “Alan, have you ever watched those dust motes in the sunlight”.