I am looking around for tools / frameworks / UI pa...
# present-company
j
I am looking around for tools / frameworks / UI patterns that are roughly of the shape "spreadsheet with editable computation pipeline". What do people know of that's in that category? To clarify, I realise spreadsheets alone can achieve computation... but I am thinking more of projects where the computation is a bit more "visual" than just formulas in cells, perhaps like a nodes or blocks environment that then feeds into a table / spreadsheet to display data. @Paul Shen's Natto is one such example of the kind of thing I am thinking of. There might be other ways to do this beyond just a series of nodes that feed into a table... I'm curious to see what else might be out there already. I wonder if there are projects in the data analysis / computational science spaces that might fit...? Apologies if my question is too vague, I'm still trying to work out what I'm even looking for. 🙂
m
maybe you know this one or it doesn't fit, just in case:

https://www.youtube.com/watch?v=mTEkYqnGICE

here's a step by step demo:

https://www.youtube.com/watch?v=4260hoxkaro

j
Ah yes, Instadeq seems like it should be included in the list. I'll have to check it out in more detail, thanks!
There's probably more matches to be found in this kind of "analytics dashboard" space... I've tried searching of course, but I often end up finding things that just load from a database without containing / visualising any computation themselves.
m
the "old" observablehq and maybe the new one (https://observablehq.com/framework/) may fit too?
j
Thanks, yeah, Observable (and similar notebook environments) seem worth exploring as well. Haven't seen the others you mentioned before, I'll have to check those out in more detail! 🙂
j
m
this ones may not fit but just in case https://www.getdbt.com/
j
m
j
There do seem be a lot of startups in this space... I'm slightly wary of depending on a SaaS tool that might disappear at any moment, but I know that's often the "default" way of building things these days... They are still useful for visual inspiration though.
m
I thought you were looking for inspiration, do you have a use case in mind?
j
Ah yeah, for the moment, just getting some visual inspiration of what's out there. I do have a lurking use case bubbling away, but I'll save that for a separate thread. 🤓
Apache Airflow was one I did encounter, but I am not sure I really "get it"... Is it mainly just querying databases...? I guess I find the ocean of Apache projects generally a bit hard to navigate... 😅
m
some nodes and wires: https://nifi.apache.org/
@J. Ryan Stinnett many of those are for ETL/ELT pipelines or data integration jobs
j
Dataflow tracking / pipeline visualisation in the style of NiFi seems interesting, perhaps I need to keep searching for things like this...
m
a more low level thing that is "so hot right now" https://github.com/tc39/proposal-signals
❤️ 1
👍 1
j
Thanks for all the entries, you've found far more candidates than I managed to on my own...! 🙂
m
I've been following the space for a while 😄
😄 1
j
Signals proposal is an interesting bit of news to follow indeed, wouldn't have initially imagined adding such a thing at the language level, but I see where it comes from in terms have single definition of the concept instead of every reactive framework doing their own thing.
m
there are others with less "formula capabilities" but interesting in other aspects
a failed take from me:

https://www.youtube.com/watch?v=eqfmDztQv6I

j
Ah right, I guess for this purpose, I'm wanting to see some style of "computation" that's visually present and editable, so those last few probably don't match, but still good to know about in terms of general charting ideas.
m
everybody stops at formulas or switches to text for that, here's an interesting take

https://www.youtube.com/watch?v=davUawk9Cqc

g
A dead project, but how about ryven.org ? Check out the gallery, specifically: http://ryven.org/gallery. Some others: in the data science space: kedro.org, https://datasenseanalytics.com/. I always liked https://nodes.io but that is limited to JS in the browser. Someone was once working on a Python-based version of NoFlo , but it went closed-source by its sponsors.
j
Thanks, Kedro especially seems interesting! 🙂
j
This looks interesting/related: https://www.v7labs.com/go