Free will? The “Sapolsky-Mitchell debate”
Oh, that worry, that your prizes will feel empty. – Robert Sapolsky True, that title’s been meant to let you know what this is about, and – if I’m lucky – to even make you curious.
A blog by Sigrid Keydana. Opinions are exclusively mine.
What are Large Language Models? What are they not?
This is a high-level, introductory article about Large Language Models (LLMs), the core technology that enables the much-en-vogue chatbots as well as other Natural Language Processing (NLP) applications. It is directed at a general audience, possibly…
Group-equivariant neural networks with escnn
Escnn, built on PyTorch, is a library that, in the spirit of Geometric Deep Learning, provides a high-level interface to designing and training group-equivariant neural networks. This post introduces important mathematical concepts, the library’s key actors,…
Deep Learning and Scientific Computing with R torch: the book
Please allow us to introduce Deep Learning and Scientific Computing with R torch. Released in e-book format today, and available freely online, this book starts out by introducing torch basics. From there, it moves on to…
Implementing rotation equivariance: Group-equivariant CNN from scratch
We code up a simple group-equivariant convolutional neural network (GCNN) that is equivariant to rotation. The world may be upside down, but the network will know. Convolutional neural networks (CNNs) are great – they’re able to…
Upside down, a cat's still a cat: Evolving image recognition with Geometric Deep Learning
In this first in a series of posts on group-equivariant convolutional neural networks (GCNNs), meet the main actors — groups — and concepts (equivariance). With GCNNs, we finally revisit the topic of Geometric Deep Learning, a…
AO, NAO, ENSO: A wavelet analysis example
El Niño-Southern Oscillation (ENSO), North Atlantic Oscillation (NAO), and Arctic Oscillation (AO) are atmospheric phenomena of global impact that strongly affect people’s lives. ENSO, first and foremost, brings with it floods, droughts, and ensuing poverty, in…
Getting started with deep learning on graphs
This post introduces deep learning on graphs by mapping its central concept - message passing - to minimal usage patterns of PyTorch Geometric’s foundation-laying MessagePassing class. Exploring those patterns, we gain some basic, very concrete insights…
A book I'd say everyone should read if such were a kind of thing I'd say
Much as we humans like to believe, consciousness is not a neocortex thing, a matter of analysis and meta-analysis. Instead – says Mark Solms, in his 2021 The Hidden Spring: A Journey to the Source of…
Starting to think about AI Fairness
The topic of AI fairness metrics is as important to society as it is confusing. Confusing it is due to a number of reasons: terminological proliferation, abundance of formulae, and last not least the impression that…