. InteractML

Interactive Machine Learning Visual Scripting for Unity

InteractML brings machine learning visual scripting to Unity, empowering game creators to develop novel gameplay mechanics and control schemes without writing code. You can create ML models by joining nodes together and visualize in real-time the data from an Unity scene in the graph.

Interactive machine learning (IML) is a subfield of artificial intelligence (AI) research where users, generally non-experts, can quickly create and test ML models. These models can learn input/outputs from real-time data through human/computer examples (i.e. when the user moves his arms up-down the character swims upwards).

Create New Interfaces

Joysticks for videogames? Really? We can do more for our players. Using the power of Interactive Machine Learning, InteractML lets you control what interfaces you use as inputs and what the gestures look and feel like in your game. Let players tell you how they want to play. Set your game's interface free.

We provide a number of already made examples using different input devices, ranging from mouse/keyboard, arduinos to modern VR systems with motion tracking. You can as well pipe your own custom devices if you wish to. Anything you can send to Unity can be used in InteractML!

Follow The Project

  • Get the Code

    This entire project is a work in progress. We are about 70% there now with slim documentation. You're welcome to use the framework today as is, bugs and all or wait for the finished version.

    Download on Github
  • Join the Discord Community

    If you have questions, feedback, or want to join our community and studies, you can find us on Discord. Click on the following button and follow the guidelines to join us!

    Say Hi
  • Keep Up To Date

    If you want to keep up to date with the events and updates we release, don't forget to sign up to the mailing list!

Learn about Interactive Machine Learning

Interested in Machine Learning?

Interactml builds heavily of Rebecca Fiebrink's Wekinator project. To jumpstart your journey, you can watch videos about ML & Wekinator here. All of the concepts you will learn for the Wekinator can be applied to InteractML and vice-versa.

Get Smarter


We organise workshops, talks or game jams where we teach you about InteractML and help you create something with it. Here are some of the latest events we are running:

About Our Team

Rebecca Fiebrink

I am a Senior Lecturer in Computing at Goldsmiths, University of London. I am affiliated with the Embodied AudioVisual Interaction (EAVI) group, along with a number of other amazing folks. My students, research assistants, and I work on a variety of projects developing new technologies to enable new forms of human expression, creativity, and embodied interaction. Much of my current research combines techniques from human-computer interaction, machine learning, and signal processing to allow people to apply machine learning more effectively to new problems, such as the design of new digital musical instruments and gestural interfaces for gaming and accessibility. I am also involved in projects developing rich interactive technologies for digital humanities scholarship, and machine learning education

Phoenix Perry

Phoenix Perry creates physical games and user experiences. As an advocate for women in game development, she founded Code Liberation Foundation. In her role at Goldsmiths, University of London, she lecturers on Physical Computing and games and leads an MA in Independent Games and Experience Design. Fotering professional growth and mentoring new leaders in the field, she strives to infuse the industry with new voices. She is currently doing a PhD at Goldsmiths University of London and has an MS from NYU Tandon School of Engineering.

Carlos Gonzalez Diaz

I am a PhD Candidate at the Centre for Doctoral Training in Intelligent Games and Games Intelligence (IGGI) between 4 leading UK universities. I am a passionate coder and I developed games and tech in the UK, Sweden and Spain. I am interested in understanding how bringing AI into VR/AR and other sensor-based technologies affects the player experience. I worked as a research assistant for the two amazing women in this project and architected InteractML.

Get in Touch

If you want to email us, you can do so at hello at interactml.com. You can also find us on twitter at @interactml1

Leave us your email

If you want to keep up to date with events and latest news, you can do so by leaving here your email address

Subscribe to mailing list