No reasoning, new music, and old tropes — Oct 19 Weekly Roundup
What I read, watched, and listened to this week.
Reading
LLMs don’t do formal reasoning - and that is a HUGE problem (Gary Marcus)
I know Marcus is a controversial figure in the AI community—but, seemingly, so is every skeptic—but this is a great overview of the recent paper from AI researchers at Apple. They conclude: “we found no evidence of formal reasoning in language models …. Their behavior is better explained by sophisticated pattern matching.”
Listening
I’ve been looking for new music and stumbled across Genevieve Stokes in Apple Music’s “New in Pop” playlist. This whole album is terrific.