Which programming languages will be easiest for (the current incarnation of transformer-style) AI to work with? Python is verbose - it seems like you want something that makes the most use of the window size. APL? Whitney-style C?

Certainly not Applesoft Basic: https://scholar.social/@rougier@toot.aquilenet.fr/109455043131772050

Not sure exactly what Triton is or does relative to your question, but it's here on OpenAI's GitHub: https://github.com/openai/triton

FWIW, window size keeps becoming less of an issue. Windows get bigger, while techniques like summarization and step-by-step planning make the effective size even larger. And they’re great for this because they keep the model grounded, something that these models generally struggle with.