Robots can talk in own language

Robots can talk in own language

An international team has developed the ‘Lingodroids’ — a pair of mobile robots — which communicate by generating their own words for new places, and relationships between the places based on distance and direction.

The language sounds like a sequence of phone tones, which are easy for the robots to produce and hear in a noisy office environment, before being translated into syllables to make it easy for humans to recognise them, say the scientists. Dr Ruth Schulz of University of Queensland, who led the team, said the robots start by playing where-are-we games. “If they encounter an area that has not yet been named, one will invent a word, such as ‘kuzo’, choosing a random combination of syllables, which it is then able to communicate to other robots it meets, thus defining the name of the place,” said Dr Schulz.

“These words are known as ‘toponyms’ (‘topo’ meaning place and ‘nym’ meaning name). The robots then start to play how-far and which-direction games, which enable them to develop relationship words (like English prepositions),” she said. The resulting language consists of location, distance and direction words, enabling the robots to refer to new places based on their relationship to known locations.

“These languages are very powerful — they are known as ‘generative’ languages because they enable the robots to refer to places they haven’t been to or even places that they imagine beyond the edges of their explored world,” she said.

An essential aspect of these games is that the robots develop robust ideas of where a word should be used. Their understanding of the new language was tested using games in which two robots attempted to meet at a particular place name.

If one robot told the other “jaya”, they would independently navigate to where they thought “jaya” was. When both robots arrived at the same location, the concept “jaya” was consistent between the robots.

After having played hundreds of games to develop their language, the robots agreed upon concepts for toponyms within 0.65 metres, directions within 10 degrees and distances within 0.375 metres. The robots consist of a mobile platform which is fitted with a camera, laser range finder, sonar for mapping and obstacle avoidance, and a microphone and speakers for audible communication with each other, say the scientists.
“We believe that the natural way to communicate with robots will be through human language. The Lingodroids have developed their own proto-language as part of realising this ambition. In the future, our aim is to extend the types of concepts able to be formed by the robots, as well as expand to additional grammatical features of language and to human-robot interaction,” Dr Schulz said.

The findings have been presented at the International Conference on Robotics and Automation in Shanghai.