👋 Hey, I’m Matt.

In 1973, the science fiction author Arthur C. Clarke wrote what would become perhaps the most quoted observation in the history of technology: “Any sufficiently advanced technology is indistinguishable from magic.” I have always liked this quote, because he was right. Do you know how a quartz clock works? I’ll give you a hint: it’s vibrating crystals. Turns out the holistic hippies were right, crystals are magic. Right now in my pocket I have at my fingertips essentially all human knowledge and information. Somewhere in a server farm in Virginia, a computer the size of a wardrobe decides that I need to be enraged at a video of a monkey being bullied. This thinking silicon (a rock) converts this information into pulses of light, fires them down a glass wire thinner than a human hair, sends them under the Atlantic Ocean at roughly the speed of light, up through a cable landing station on a beach in Portugal that looks completely unremarkable from the outside, across Europe, under more oceans, up through the seafloor off the coast of Queensland, through a series of increasingly unimpressive concrete buildings, through the air invisibly as radio waves, through my wall, and into a small rectangle of glass and metal in my hand. The monkey has no idea any of this happened. ...

A few nights ago at my Brazilian Jiu-Jitsu gym, I found myself in an (unfortunately) familiar position: flattened out, stuck under a Black Belt’s side control. Anyone who has trained knows the feeling: you’re not in immediate danger, but you definitely don’t want to be there. I fought for space: an elbow here, a knee there, and finally, recovered my guard… for three seconds, before I was passed again. That cycle of defence, recovery, and defence again is a common rhythm when going against someone better than you. You never quite get on top of things, always one step behind, always scrambling. It is demoralising, because you are constantly moving from a defensive position, to a neutral one, and then back. ...

One of the best pieces of advice I’ve received in my career is a three-word phrase: Read the words. It is deceiving in its simplicity, but keeping this mantra in mind has helped me many times across all sorts of situations. The idea is exactly what it says: if there are some words associated with the thing you’re doing, did you read them? I mean really read them? Every word? If not, go back and do that. ...

It’s 2025, and the last few years has seen an explosion of GenAI-driven tools in knowledge work like software engineering. Technologies like GitHub Copilot, Cursor and large language models like ChatGPT now allow developers to generate entire applications with just a few keystrokes. If you spend any time on LinkedIn or other haunts of tech influencers, AI tools are often presented like a magic wand: type a prompt, hit enter, and tada! An entire application is built, fully integrated, with no need for you as a developer to ever do pesky things like read docs or write tests. Just ask the right question, and the code appears as if by magic. Gone are the days where engineering required knowledge and experience to do a good job. We have outsourced that to the machine. ...

When developing software, there is a natural tension between “speed” and “quality”. They are often seen as opposing goals. Delivery teams are under pressure to ship new features as fast as possible, but the reliability and functionality of their systems can not be sacrificed. In fields like data engineering, this is especially apparent. The need to quickly gain new insights is real, but sacrificing on quality can result in the wrong insights, which is worse than no insights at all!. Does this relationship between speed and quality have to be a dichotomy? What if we could move fast, but also make sure we are delivering the kind of work we can be proud of as professionals? ...

Creating software for a living and keeping up with the industry and latest trends can be overwhelming. Every day brings a new framework, a new technology, a new architectural pattern. One of my favourite parodies of this fact is Days Since Last JavaScript Framework (spoiler, the answer is 0 days, every day). In the data space, the latest thing appears to be the data lakehouse pattern, which although not new has had a resurgence because of Apache Iceberg and the idea of distributed compute. And, anyone not under a rock has seen the explosion of Generative AI across the industry, with everyone trying to shoehorn AI into their product, whether that’s what their users want or not. With the pace of change, it is hard not to think that you’re being left behind. For some, this results in a practice I recently heard described as Resume Driven Development. ...

A great practice we follow at work is the setting of working agreements. Championed by Aussie powerhouse Atlassian, working agreements are shared values and behaviours that you agree to as a team. We have several, from the mundane but important “We value work-life balance”, through to the scar-tissue driven “We reduce the risk of production issues by ALWAYS testing our code before requesting review”. Of all our working agreements, I think my favourite is this one: ...