Mind-to-Mind Modeling with Digital Twin Technology

Digital twins for mind-to-mind communication?

NTT’s Digital Twin Computing initiative aims to use sensors to collect signals, images, speech, and other data to understand and model how people perceive and feel things.

All that biological, physiological, and behavioral information would then be used to model an individual’s mental and emotional state.

Beyond data collection, the challenge is translating complex, subjective experiences into universally understandable signals to bypass conventional communication barriers.

Over time, the digital twin could reliably predict emotional states and real-world outcomes.

If such a technology caught on, it would revolutionize personal relationships, international diplomacy, and multicultural collaboration.

The optimistic view is such a breakthrough could create a future where language barriers no longer exist. At scale, this would foster a world where people can directly understand each other’s thoughts and feelings without misinterpretation.

Human digital twin technology also raises significant ethical and privacy concerns due to the nature of the vast amount of data needed.

NTT, the world’s fourth largest telecommunications provider, announced its ambitious initiative in 2019.

By 2030, the Japanese company aims to develop technologies that will “enable receivers to directly understand how senders perceive and feel things in their mind and thus transcend differences in experience and simulations.”

In a 2023 update, NTT researchers said they found that when people disagree or feel uncomfortable about something, their brains send a special signal.

They discovered this by observing subjects wearing EEG caps that read brain activity while reading advice or instructions designed to make them uneasy.

The researchers are also experimenting with a method for visualizing mental images using EEG. This would allow people to see others mental thoughts or dreams directly.

The aggregated data would be a dynamic, virtual model that reflects the individual’s current state. The model is continuously updated with new data for a real-time representation of the person’s mental and emotional condition.

The other components of the Digital Twin Computing initiative are pretty far out too, including:

  • Bio Digital Twins to make healthcare hyper personalized and better predict how people will react to different treatments.
  • Another Me, or the ability to create a virtual version of yourself that can do things for you in the digital world or even the physical world with advanced robotics.
  • A 4D Digital Platform to predict and solve complex societal issues with precise data fusion. The platform would use four-dimensional data to predict traffic jams or optimize energy resources in a city.