A thought bouncing around in the back of my head related to machine learning algorithm selection is skill vs complexity. Typically we want the most simplest skillful model, i.e. Occam’s Razor. A way of thinking about this is to assign a complexity score to a suite of algorithms and then evaluate each in turn. From this table of data, we can imagine a frontier (or Pareto front) of skill vs complexity. Come to think of it, I probably got the idea from this AutoGluon slide: ...

I tripped over a discussion of public vs private schools in Melbourne (where I live with my family). Is private school for the kids worth it? We have two sons and went through this debate already a few years back. I read a ton of stuff at the time, including papers and books. I recall the following book helped a lot: Free Schools, David Gillespie, 2014. We got to: send them to public school, because: ...

I re-read Clay Shirky’s 2010 book “Cognitive Surplus” yesterday. There’s some good ideas in there. Here’s a summary by Claude: “Cognitive surplus” is a concept popularized by Clay Shirky in his 2010 book “Cognitive Surplus: Creativity and Generosity in a Connected Age.” The basic idea is that modern society has a vast untapped reservoir of human intellectual capacity and free time that could be directed toward creative and socially beneficial purposes. The concept emerged from Shirky’s observation that people in developed economies collectively have billions of hours of free time that, historically, was often spent on passive consumption like watching television. With the rise of the internet and digital technologies, this surplus of human attention and cognitive capacity can be channeled into collaborative projects and creative endeavors. ...

I’ve been reading up on AutoGluon on and off over the last few weeks. It’s amazing! I highly recommend the podcast episode AutoGluon: The Story with Nick Erickson from 2023. Anyway, one cool thing Nick touched on in his AutoML 2024 presentation was Elo ratings for AutoGluon and a suite of other AutoML frameworks. Here’s a still from the presentation that captured my imagination: Watch the whole presentation: ...

A long time ago, I worked for the Australian Bureau of Meteorology. While there, I created many internal scripts/apps using weather data, for fun and internal personal use. One example was a tiny web app that plotted recent temperature observations, forecasts, and in-office temperature using a little USB temperature probe. It was very cool and a few members of our team kept it terminally open. Even today, I still leave the temperature forecast page for my suburb open all day long and refresh it before heading out to the gym, supermarket, whatever. ...

I saw this StackOverflow Dec 2024 stats pass by. It reports data on the number of new questions created on StackOverflow from July 2008 to December 2024. The raw data shows a dramatic drop in new questions in recent years. The data was collected and commented on by Theodore R. Smith, who is complaining that his reasonable new question posted to the site was closed and that aggressive closing of questions is the reason for the decrease in new questions on the site: ...

Over the last year, I rarely sit down and write code anymore. Instead, I have code generated and then iterate on it until we achieve the desired effect. I direct and collaborate. Similarly, to change existing code, I attach the file to a chat or paste the functions that require changes, summarize the change and iterate until it achieves the desired effect. My projects are almost always side projects. Whims. Ideas. Prototypes. Examples. Ad hoc’ery. Not production grade code. ...

Before Christmas I listened to the Telepathy Tapes podcast. I heard about it on a Joe Rogan podcast and added it to the queue immediately. I think it went viral because there was a lot of chatter on twitter/reddit about it around this time. Here’s a plot of google trend data: You can see the leap in interest right around the airing of Joe’s episode with Duncan Trussell. ...