I've always found training models on code to be interesting – there's large amounts of structured data and text is a fairly simple input/output interface that can be automatically be checked for syntax correctness.

Copilot has been a boost to developer productivity. But what else could ML models solve in the developer workflow?