<https://vis.mit.edu/pubs/benthic/> Charts and dia...
# linking-together
j
https://vis.mit.edu/pubs/benthic/ > Charts and diagrams use visual structure to convey meaning. For example, spacing and alignment groups data, spatial proximity links labels to elements. But this visual structure is typically invisible to screen readers. > thread: https://bsky.app/profile/jonathanzong.com/post/3m3nwszhtrk2k
👍 3
🍰 2
k
c
thanks for sharing! I'm reminded of David Harel's higraphs and the usefulness of describing topological relationships https://dl.acm.org/doi/10.1145/42411.42414
j
@Kartik Agaram Yes! I must sit down with it before I can language the connection. Glad to see Gestalt principles centered in both.
đź’Ż 1
@Christopher Shank These remind me of dataflow graphs, but really nicely drawn by hand, with a lot of principled decisions going into the encapsulation (e.g. figure 21). I feel like we're all still building the future OP saw 37 years ago:
We are entirely convinced the future is “visual.” We believe that in the next few years many more of our daily technical and scientific chores will be carried out visually, and graphical facilities will be far better and cheaper than today’s. The languages and approaches we shall be using in doing so will not be merely iconic in nature (e.g., using the picture of a trash can to denote garbage collection), but inherently diagrammatic in a conceptual way [...]
I looked up Harel's Wikipedia page, which had this history of UML added. I feel that Star's boundary objects (1989) are another key example of state charts, with their own parallel lineage. https://commons.wikimedia.org/wiki/File:OO_Modeling_languages_history.svg
👍 1
k
@Jasmine Otto Interesting quote! So why didn't this happen? My hypothesis (untested) is that our computational models are semantically too complex for being encoded visually. Visualizations as partial views on something's semantics have worked out very well, but visuals as the only (and thus complete and precise) representation has not, except for semantically simple contexts such as the popular node-and-wire representations for dataflow.
j
@Konrad Hinsen Absolutely - I don't think that's a no-go, however; 'visualization as partial views' are super effective for communication and teaching within rich domains, which have their own jargon ('compression') for high semantic complexity. But the jargon makes it hard to share models with each other; within-STEM is bad enough, and that's after a 4-year onramp in undergrad. (E.g. I think of compilers / operating systems as the keystone / shibboleth for CS undergraduate, building upon data structures and algorithms.) But it's not the fault of non-technical stakeholders that they don't share this language. Moreover, a well-designed visual encoding of the computational model is ideal for exfiltrating it from domain jargon. Boundary objects aren't "complete and precise" representations of the system by design, they're just good enough that coordination is possible in these high technical-debt situations where ordinary conversation likes to spin out.
👍 1
I think the 'partial view' formulation is very apt. It reminds me of textbooks that have a flowchart showing dependencies between chapters, that are meant to be read by random-access as needed.
k
Visualizations and visual GUI controls as boundary objects looks like a good perspective to take!
g
This is probably off-topic, but this discussion is tickling my neurons along a different dimension: to me issues of VPLs, DPLs and TPLs avoid the elephant in the room - how to express complicated solutions in a way that is convenient for humans to grok. What we’re currently doing - imports, over-use of the synchronous sequential design method, over-use of static type checking, over-use of the functional paradigm, bloat, forced insertion of concepts that are clearly out of the sweet spots of host paradigms, etc. - are red flags
👍 1