Sunday, June 13, 2010

Truth and its Consequences

History is a beast. In our ancient past, what people believed to be true often turned out to be incorrect or only partially right. Over the last three thousand years or so, our view of our world has been radically altered. The shape of our world, the solar system, zero, negative numbers, chemistry, biology, genes, DNA, determinism, computers, etc.

We've undergone a massive change in our knowledge, one that has been gradually shaping how we see the world around us. Although one doubts that we've really 'evolved' in such a short time, we've definitely civilized ourselves. Truth, it seems, gradually has an effect on us, as it sinks in generation after generation. It takes a while -- knowledge is sticky, and people are resistant -- but as we know more, and more people come and go, our thoughts and actions gradually get more sophisticated.

Still, we've reached that point were we are surrounded by so much knowledge, and so much of it is of dubious quality, that we seem to be lost in what we know. Unable to assimilate or deal with it. Once we made it so easily available in large qualities, the side-effect appears to be a form of snow-blindness.

What the world really needs now is a truth-telling machine. One that when given a statement will determine whether or not the statement is true. And not, as one might expect, true in the present context, but instead 'universally true'. That is, true for all time, and for all places. This type of invention would allow us to once again size up what we know, show the falsehoods for what they are, and then collectively move on to a better place. It's a great idea. Crazy. But still great.

In a universal sense, while there can be an infinite number of incorrect answers there can only be one correct one. That perspective, however, is far too black and white for our universe, and how we live in it. It makes more sense to see some of the false answers, as being tied to a specific context. That is, "the sun always rises in the east" is a valid statement for the contextual period in which both the planet, and the sun still exist. In a universal sense, some day that statement won't be true, either the east won't exist, the sun won't exist or the relationship between the two planets will have been altered. The statement then, is not a universal truth, it is just contextually true today, as far as we know.

Most people however, don't want to deal with the world around them and their knowledge on a universal/geological scale. Most people, it seems would prefer that their own 'universal' truths be limited to their lifetimes, or even shorter periods. That, however is most likely the type of tunnel vision that has continued to plague our understandings. People dig in, and don't want to know the truth, or at least more of it, so the old 'truths' linger like bad odors, until the last of a generation die off. Given all of the generational overlaps, collectively what we know, and what we believe is a mis-mash of all of these overlapping incorrect versions of our world. To fix things in a way that allows us to move farther ahead, faster, we have to fix these stagnation problems first.

The problem with universal truth is that we can't possibly know what that it is. We start out in a context, and are trapped by it. Only in hindsight can we see that something isn't as we believed, and that's only if we willing to accept that it might be wrong.

Given all of the major discoveries and turmoil in history that have gone on, we can see that we generally grow our understandings in leaps and bounds. There are clearly times were generations stagnate or go backwards, and then there are times full of great discovery and change. Our societies ebb and flow, as the different organizational or cultural issues push or suppress us into examining our world.

And within our growth, everything we know is dependent on a huge underlying foundation. Each fact sits on a sea of other facts. We can only build new upper layers when we've managed to get discover enough of the lower ones. Knowledge, it seems, is the ultimate house of cards. That relationship, and the fact that there are always missing supporting cards, defines the frailness of what we know. There will always be assumptions, so there will rarely beuniversal truth.

Even if we can't have universal truth, one of our more recent discoveries, computers, do give us an unprecedented opportunity. Computers are stupid, but they beat elephants for having a long memory. That, and they are never bored, so you can just set them up to do something, seemingly for ever. Memory and patience open up the ability for us to do something fascinating. While we can't determine the universality of what we know, we can however use computers to chart out the degrees of freedom in what we say. That is, we can take all of our statements, one by one, and examine how and why they might very.

A really sophisticated program would be nice, but in truth something far cruder might still reach the same basic level of understanding. We'd just like to know for any very large collection of statements where the degrees of freedom lie. So, for my example "the sun always rises in the east", it would be nice to know that the sun is a planet. That we are assumed to live on another planet, and that east is a relative pointer based on the relationship between the two planets, and that planets have a finite lifespan. That is, for the very simple knowledge in that statement, what are all of the related things on which that statement depends?

We can't know if something is universally true, but we can figure out absolutely all of the places on which the statement is dependent. The truthfulness of a statement isn't a black and white variable, but rather a complex graph of underlying relationships on which the overall quality of a statement is formed. It's the structure of those relationships that ultimately sets the data quality. If most of the underlying dependencies are true, then the statement can been seen as mostly correct (and still not be the truth, for example "political spin").

In that sense, if we had a huge database of a massive number of relationships, we could add in a new statement and quickly see how likely that the quality of that statement might vary. We could test any new knowledge statement against the sum total of what's already there. We could easily see where the weakness and assumptions lie.

As miraculous as this sounds, domain experts do this all of the time. They can hear a statement and based on their internal understandings, come first to an intuitive belief that the statement is unlikely to be true. It may require further digging to confirm it, but human beings are quite capable of seeing how something doesn't quite fit an overall pattern. We can match what we hear up against what we know. We've effective pattern matchers. And it's not just the experts.

For whatever reason we've been inundated the last few decades with a huge amount of scientific research. The newspapers and TV are forever announcing a vast array of new discoveries. Most of these discoveries are probably fine, but the media has a tendency to want to announce the more exotic or dramatic sounding results. Because of this, it is inevitable that some less scrupulous researchers will bend their results to say things entirely for the point of achieving notoriety. We expect this, and we see it often.

Sometimes scientific discoveries are counter-intuitive, that does happen. However, we see far too many 'surprising' results, many of which get huge media coverage but then just disappear into the shadows. Mostly these examples of 'bad science' are obvious if you spend some time contemplating them. We're able to see how unlikely they are, even if we're not experts. They just don't fit. There may be a few false negatives, but mostly if its covered in the media, and it sounds off, it probably is.

Understanding our current knowledge is good, but our biggest problems come from where we are headed. Even if we know what we know, and we know that it is 'true enough', we still can't correctly analyse statements about what might possibly happen in the future. But it is these questions which cause us the most anxiety.

People are forever trying to change the world, and some of these changes are downright stupid and dangerous. Too see this in advance, we'd have to build and examine sophisticated models of our circumstances, then apply the changes. Intrinsically these models would have some likelihood of being incorrect when probed or extended. Nothing short of a full simulation of our existing universe would ever be complex enough to be entirely synchronised with our would.

Still given these limitations, the models only need to be accurate enough to given us an indication of the success or failure of the changes. And it is far easier to build such a reasonable model if we fully understand the variability underneath. The mechanics of the model match the underlying degrees of freedom. That is, we can only model what we understand, and we can only simulate it along the lines of the were we think it might change. But if we are working from a full structural view of the model's statement dependencies, then at least we know the fullest extent to which the model may vary. We know its domain.

Another thing we would get from these structures was a sense of the missing cards. There is always some intrinsic symmetry and pattern occurring because of the nature of our physical world. It may be ultra-complex like fractals, but we're still able to pick up on the patterns in nature where and when they occur. In examining the relationships, there will no doubt be places where the violation of a pattern or some lack of symmetry is noticeably obvious. Places that have been overlooked or not fully examined. Bringing these to the forefront will provide direction for researchers to investigate morethoroughly . We pretty much rely on inspiration for this now, but this would insure that what we know gets more fully well-rounded, that the small ignored gaps get noticed and filled. These holes may seem insignificant butgenerally they propagate upwards and distort the upper layers. Ultimately this slows down progression until we're lucky enough to have some genius come along and re-align the basis correctly. And that just takes too much time.

We have a fantastical amount of knowledge, but we really don't understand it well. It is openly available and has inundated our lives, but hasn't really improved them. Given that we really can't trust a lot of what we hear, or what we read, something, anything, that would give us a sense of the underlying truthfulness would be a huge boon to our society. It would allow us to contain the explosion of information, and turn it into something useful. Dependable. It would allow us to examine the frailness of our understandings. With so much information, and so much of it wrong, all we are going to do is make our population more resistant to change. We're foolishly forcing ourselves to have to ignore what is going on around us. To ignore what we know. We're not utilizing our own collective intelligence.

2 comments:

  1. [My post is longer than 4096 characters, so I have to split it in a few parts...]

    As usual, a long and insightful post ;) I hope my answer will be as interesting...

    One can but agree with the fact that we are more and more flooded with information, facts, theories, thechnologies, etc. as our societies get more complex. Two or three centuries ago, someone well educated could know almost everything that happened, be it mathematics, physics, philosophy or politics. I once read that one could no longer know everything of mathematics since the end of 19th century/beginning of 20th century (maybe in an article about Hilbert ? I'm not sure). Over-specialization in many tiny niches of sciences and technologies have built tons of more or less useful facts and informations, at an increasing rate, but not much more real knowledge (as Valdemar Setzer could say).

    People who can build general theories, that sum up lots of facts into a few key ideas, and that are able to express them in clear words (i.e. clever and pedagogic people) are too rare. Moreover, in our world of "verbal diarrhea" (I sometimes read this expression. Not very smart, but it gives an idea of the never-ending meaningless flow of words, images and sounds that we live in those days), they can be silenced by the surrounding noise, and do not often reach sufficient audience. They do exist, but one has to go reach for them, much too often in specialized (or even self-published) publications.

    The driving forces of our world do not seem to be a human will to build a meaningful, peaceful world in which everybody can live an be respected by his fellows. It rather seems to many that things happen "like this", that technologies and ideas are pushed "by themselves", with no one in command. GMOs, nanotechnologies, cloning and lots of other things have appeared because they could be done, not because we had a large a priori consensus that said that we should work in those directions. As a consequence, lots of people react because they are not sure that it is something good, and also because they believed they are forced to accept the "fait accompli" (I am not going to go deeper into those debates right now, I am just naming them to have a few examples at hand). Let's face it, some companies prefer to create a need (or more precisely the feeling that we need something) rather than fulfilling a real human need. Some things get pushed on us, not because we need them, but because they look "cool" and could be done in a timely and cost-effective manner. Even politicians (who are supposed to decide things and give directions) often look like they do not have a way to change things, and so do not try to.

    The last paragraph might be thought of as off-topic (and thus a call to trolling), but I think that our sinking in a continuus flow of information goes with the lack (or loss) of some global vision of the world we live in, where we want to go and how to get there.

    Or, maybe, we have the feeling that we have lost some vision that did not exist, or was false from the beginning. Maybe we should not be unhappy with the changing, and on the contrary be happy with the fact that so many things move at the same time, that the future, as unforeseable as it is, is open to anything we might decide, that our ability to speak about all of this shows an increase in the awareness that "something is going on", and that this very awareness will help us make good decisions. Maybe this is just a temporary "crisis", where things have not yet settled but will some day.

    ReplyDelete
  2. [Second and last part of my post]

    Maybe lots of insanities have to be said and written in order to have, sometime, some brilliant gems of insight - maybe even wisdom. If we do not try, we cannot succeed in finding our way. If we try, we must acept the fact that we'll fail a few times before finding something that looks like something worth striving for. And then, we surely will change our minds as we strive for it. Finding a contextual "truth" after another, always more precise, always encompassing more of our lives - always further from where we are.

    Maybe universal truths exist, I do not know. Are they reachable ? They might, or might not. Can automated machines like computers help us finding them ? Maybe, but be aware that such a soul-less mind-less machine work only with pure data, without knowing what they could mean. Only a human can interpret data and give it some meaning (at least, for now. I do not believe that a computer program will ever reach something like understanding the symbols we feed them). A computer has lot of memory an patience, but not much imagination or ability to create new things (*).

    Inferring fact dependencies might be done (I know "expert systems" can work), but in order for a computer to do such a thing, we must find a formal system into wich we will express our facts and dependencies. And a very generalized formal system, if we want to express a wide range of facts. But the more general, the less maningful it risks to be.


    Even if universal truths do not exist, they are worth looking for. We do not know in advance what we will find while searching (that is the whole point of searching), but interesting things might happen. Will happen.


    PS : While proof-reading my post, I realize the impact of Steve Talbott's writings, namely the book "The future does not compute" and his "Netfuture" mailing list, on my thoughts. By the way, I urge anyone who has been interested in my post to read them. There you'll find food for thought.

    PPS : Another thing that popped up in my mind : Stanislaw Lem's "Solaris" novel can give a view of how science could wander in piling up facts on facts, theories on theories, without getting nearer to the truth - a truth that might as well be out of reach for ever... As for "The future does not compute", but for very different reasons, I highly recommend reading it. Now.

    (*) This "be aware" is purely rhetorical, I'm sure you know it.

    ReplyDelete

Thanks for the Feedback!