Future of Coding is an online community with a welcoming, cooperative, and revolutionary spirit. We are unified in the belief that the common practice of programming is tragically less humane than it could be.

Future of Coding

Hey folks, AI-related video :smiley: Sorry. The reason I'm thinking about the geometry of this is because I'm hoping it might lead to UI ideas, hence posting here.

<https://www.youtube.com/watch?v=_CJZeTEcb1A>

thoroughly enjoyed! very helpful visual analogies :))

Gradient descent on the mouse-food example produces curves that resemble those in the video, at least visually. What makes those curves less than ideal?

Maybe it’s just a situation where the natural and vanilla gradient descent solutions coincide? All I know about the natural variation I learned from your video. I’m curious to learn more!

I've read enough now to understand that, although the shapes _look_ roughly similar for this problem, vanilla gradient descent makes large steps in the belief space, which I can see if I plot KL divergence of each successive optimization step.

Anyway, I loved the video. I'd much rather watch a ten minute video that makes me think for an hour than an hour-long video that I think about for ten minutes. :slightly_smiling_face:

That's a very nice explanation of non-euclidian spaces!