Neo-AI

Year End Update

Unfortunately the development is taking longer than we have hoped for. Yet, there is still hope.
What we have accomplished so far is quite a lot:
We have a motivation controlled system capable of recognizing and memorizing moving images (i. e. a kind of poor man's video) and text. This is the foundation for all coming features. The main problem currently is speed of execution. We had to limit the size of the image sensor to a mere 25 pixels (ordered in a 5 x 5 matrix of true color elements) to achieve reasonable performance.
The plan for the next weeks is to increase speed by a factor of 100 to 1000 or more. This can be accomplished by using a caching approach, optimization using low level languages like C++ or C and multiple threads on multiple processor cores. Even FPGAs come to mind.
Watch out for interesting news in the next few months.

Development Update

After months of silence, an update on the status of our system is definitely due.
Up until the beginning of August we cleaned up and finished the basic architecture of our AI system based on Dörner's PSI-Theory. Then came vacation. Now, back to work.
Where do we go from here? We decided to start with text generation and image recognition.
That is, we build an operator to output arbitrary text. Since it can recognize text already, this is the second half of the feedback loop necessary for learning to understand the meaning of text.
The other, much more interesting part, is building an image sensor. Dörner had an image sensor in his original program, however the actual implementation had somewhat limited capabilities. If all goes as we are hoping for, we will have an extremely powerful and versatile image recognition system.
After these two components, everything is in place to tell the system about the world, teach it "Weltwissen".

Thoughts on Computer Vision

For natural language recognition by computers to work, working computer vision would be very beneficial. Unfortunately the state of the art in computer vision is not at all helpful for this purpose. Computers still have a very hard time recognizing real world objects reliably and under real world conditions.
Prof. Dörner's Psi-Theory contains some ideas for a solution. Dörner incorporated image recognition as part of the perception process 'HyPercept' in the simulation program. HyPercept recognizes horizontal, vertical and diagonal lines of black pixels in simple bitmap images. HyPercept is also able to re-recognize items in images it has seen before as long as they have exactly the same size and orientation. The image is decomposed to lines and their respective endpoints are compared.
How can this approach be improved and made more general? How does the human eye work for comparison?
It is not very difficult to find lines of contrast in an image using current image filtering techniques. This would remove the restriction needing black pixels for image recognition.
Another step would be to not compare the lines' endpoints, but to compare the relative angles of the lines only. Then size or orientation of the objects don't matter anymore. The human eye has sensors to detect angular lines too.
The big problem remaining is the recognition of three-dimensional objects. Technically it is not difficult to project 3D objects on a plane, but is that what our brain does? How could it figure out the three angles of orientation of the object to properly project and then compare it with what is known?
I propose the following solution: a human baby learns both visual object recognition and object recognition by touching using its hands and mouth. The little human learns both visual as well as haptic features at the same time. He is therefore able to correlate form, corners and edges as well as their respective two-dimensional represention.
Is that enough of an explanation? I don't know yet. We will have to find this out by trying it.

Human Resource Management, Maritime Simulation

Last week was an especially exciting one with lots and lots  of things new to learn.
I had the pleasure of going to Scandinavia with Prof. Dr. Stefan Strohschneider to learn about a new training project.

The idea is, to put a couple of people (6 to 10) around a table and have them handle a simulated crises. The simulation, in this case, was a cruise ship sailing from the North Atlantic to Miami. The simulation happens on a computer. The computer prints out messages on paper every 30 seconds on what is going on aboard the ship.  The crew, that is the 6 to 10 people being trained, have received instructions, a map and blueprints of the ship. The crew has decided on who will take what role in the game (captain, first engineer, first steward, ship doctor, etc.). The goal of the simulation is to bring the ship home with as little damage and casualties as possible. The crew gives orders in writing to the instructor, who in turn enters these into the computer to influence the simulation.

The game includes a short time for the players to get acquainted with the scenario in general and then, after they have set up their individual roles, with the task each one of them has to perform in the simulation.

For the game to have an effect, a debriefing session follows the simulation. That is where people are told what they did wrong, could have done better or what was good. Usually the simulation is followed by another simulation the next day.

The people to be trained can be from all kinds of institutions dealing with safety: police, fire fighters, factories, hospitals, airlines or, like in this case ship officers.

Autonomous Robot Going Shopping

Imagine an autonomous robot, four wheels, battery operated, the size of a small baby buggy. Its controlled by a computer, navigation by GPS, communication by GSM or UMTS. It has cameras, laser or ultrasonic distance sensors and carry a payload of maybe 20 kg. The hard- and software, artificially intelligent, capable of machine learning, are at least as capable as the winners of last year's Urban Challenge.
Imagine you head such a machine, you could send it to go shopping for you. It could pick up the groceries you ordered via internet or deliver documents in large cities. It is sufficiently small to cause not too much of damage in case of an accident with a car or a pedestrian.
Technically, this doesn't seem too great a challenge. OK, the cars taking part in the Urban Challenge had trunks full of electronics, but the same computing power will be available in much smaller dimensions only months from now.
It raises some interesting questions too: what if there is actually an accident on a public road with a person or with a car? What if an accident with another robot occured? What if the robot is kidnapped? What if the goods from the robot's cargo area are stolen? May the robot defend itself with spraying water, pepper spray, with high voltage or with a Taser?

New Free E-Book on Dörner's Psi-Theory

I'm proud to announce the initial version of my free e-book covering the essentials of Prof. Dörner's Psi-Theory. It is an alpha version yet, but still quite informative for those who cannot read Dörner's german books.

Conscious Robot Is able to Improve Behavior on past Experiences

This was a very interesting week. On friday we visited Prof. Dörner in his "lab". He is currently using a version of the Psi-Simulation software with several dozen of beings (mice) in an island environment. He studies the beings' social behavior under, among other things, the influence of alcohol (simulated).
He now added an, at first glance seemingly very simple, as it turns out however, extremely powerful feature. Its a graphical tool to analyse the mice' behavior protocol. The protocol analyzer shows visually the actions taken by a mouse and its feelings. When looking over the protocol it becomes very easy to spot areas of unexpected actions and behavior. The tool can be used to find possible program errors as well as study the behavior of a mouse in a certain situation. Besides the actions taken, curves showing the values of emotional parameters are drawn in timely correspondance.
It is therefore very easy to find causes of emotional extremes by just looking at the protocol. One can simply see the reason for the mouse being sad or angry by looking at what as happened to it a few cycles before.
It is not very difficult to imagine an add on to the current mouse simulation, that is able to analyze the protocol by itself and have the mouse improve its behavior by itself - the robot (mouse) learns from experience and improves its behavior.

Advanced Magic to Develop Bridge Simulator for Training Officers

It looks like we are going to develop a simulation system for training ship officers. With know how and in cooperation with the Department of Intercultural Communication of the University of Jena we will write a ship simulator to be used in the training of officers for freighters and tankers. The simulation will be a so call mid-fidelity simulation, where the computer is used to simulate a ship on the ocean. No 3D-effects are planned, rather the simulating computer will spit out plain text messages as to what is occuring onboard.

In the course of the simulation problems arise on the ship and the crew, that is the participants of the training, has to cope with the difficulties. The focus is on human factors in cooperation and behavior under stress, not on the technical difficulties. In marine speak the training is called bridge resource management.

New regulations from the International Maritime Organization may require this kind of training in the near future. The mid-fidelity training has the advantage of being much cheaper than training in true ship simulators. Also the quality of the learning process is improved since no high technology equipment diverts participants from training their social skills.

In another scenario, we plan to develop a simulation of chemical plant, a hospital, an oil rigg where a chemical spill or a fire occur. The participants need not be familiar with the actual technical problems, since emphasis is on cooperation, leadership and behavior in criticial situations.

A special value for us as developers of artificial intelligence software is, that we may learn more about how people behave, so we can refine our systems for natural language processing.

Experiences of an AI Company

Today I received an interesting e-mail from a japanese research group. They approach the problem of understanding natural language from a different angle. Their paper about the project is here. It has a reference to Schank and Riesbeck, Inside Computer Understanding showing me yet another way at language processing.
Both groups take a very isolated view on language understanding. I think though, it is necessary to look at the whole psyche of man in order to understand how language works. And equally it is necessary to model a large part of the brain's behavior in order to build a machine capable of understanding human language, like Dörner did in his Psi-Theory.

Finding the Right Niche for the World Machine

The idea for our business was born out of the availability of a new, potentially disrupting technology, Prof. Dörner's Psi-Theory. With the technology at hand, I tried to find applications for it. To me, it seems like the theory gives us a huge opportunity for dozens, if not hundreds of applications. Basically, I think, it can to anything.
Unfortunately, claiming one's product does everything, is hardly believable. Besides, I learned from Geoffrey A. Moore's Crossing the Chasm, starting a business in a vast horizontal market is a sub-optimal idea. Rather, Moore suggest to look for small niche markets. Ok, I caught that. It's better to be a little fish in a puddle than a little fish in the ocean.

Now, what is our initial niche market? The applications for our artificial intelligence world machine that come to my mind are:

• an intelligent personal digital assistent
• an internet search engine
• a virtual salesclerk for internet shopping sites
• a knowledge management system
• an expert system for helpdesks
• an artificial emotion system for game AI
• an artificial life system for research and simulation purposes

And where is our little niche market???
My favorite is the digital salesclerk. We will deliver that as Software as a Service via the internet. You feed it knowledge by giving it company literature to read. On the back end its connected to your customer service, just in case an issue comes up, the system can't resolve. It'll do that the next time by itself.