Papers › Leolani: a reference machine with a theory of mind for social communication

Leolani: a reference machine with a theory of mind for social communication

5 Jun 2018arXiv:1806.01526archive 2025-07-28

Piek Vossen, Selene Baez, Lenka Bajčetić, Bram Kraaijeveld

Our state of mind is based on experiences and what other people tell us. This may result in conflicting information, uncertainty, and alternative facts. We present a robot that models relativity of knowledge and perception within social interaction following principles of the theory of mind. We utilized vision and speech capabilities on a Pepper robot to build an interaction model that stores the interpretations of perceptions and conversations in combination with provenance on its sources. The robot learns directly from what people tell it, possibly in relation to its perception. We demonstrate how the robot's communication is driven by hunger to acquire more knowledge from and on people and objects, to resolve uncertainties and conflicts, and to share awareness of the per- ceived environment. Likewise, the robot can make reference to the world and its knowledge about the world and the encounters with people that yielded this knowledge.

PaperPDFCode

Code

cltl/pepper officialmentioned in papermentioned on GitHubtf report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

10-shot image generation16k2D Cyclist Detection2D Human Pose Estimation2D Object Detection3D Action Recognition

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

1-bit AdamAdam

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections