Just saw someone using Touch Designer
https://en.m.wikipedia.org/wiki/TouchDesigner
It was really neat- real time Multimedia being chained through a pipeline while every element is visually shown in real time and inspectable.
It has very cool ways of making your own UI elements as well.
Made me wonder what it would be like if instead of multimedia it was also able to be used for screen windows as a desktop environment