Brain optimizes for bits per ATP

I read the book Principles of Neural Design recently.

It’s extremely dense, which you’d hate or love depending on how much you’re in awe with how our brain works. I totally loved it! The book is unique in trying to explain the wonderous complexity of brain using few unifying principles, all of which can be traced to constraints evolution faces, especially with energy efficiency.

The central insight from the book is this:

Brains maximize information (bits) per ATP

Consuming energy and producing ATP is hard. The organism has to work to get energy. During evolution, inefficient designs get outcompeted by efficient designs so we should expect to see efficient designs. For brain, this means squeezing max information and computing using least amount of energy. ...  Read the entire post →

Why aren’t things changing faster?

Been wondering lately that given everyone has a consultant with all the world’s knowledge in their pockets, we should be seeing efficiency rise across the board everywhere.

Literally everyone can now get personalised advise on how to serve their customers better, improve quality of their outputs, cut inefficiencies and increase revenue.

.. yet, this is nowhere to be seen (especially for small local businesses).

Why aren’t we seeing the rate of change accelerate in the world?

One possible explanation is inertia, and there’s some truth to that. But perhaps a better explanation is that perhaps advice was never a bottleneck. ...  Read the entire post →

Human behavior is an intuition-pump for AI risk

I just finished this excellent book: If Anyone Builds It, Everyone Dies.

This book influenced my opinions on p(doom). Before reading the book, I was uncertain about whether AI could pose an existential risk for humanity. After reading the book, I’m starting to entertain the possibility that the probability of doom from a superintelligent AI is above zero. I’m still not sure where I would put my own p(doom) but it’s definitely non-zero.

The question I’m interested in is this: ...  Read the entire post →

How to be a messy thinker

I love thinking about thinking. Give me a research paper on rationality, cognitive biases or mental models, and I’ll gobble it up. Given the amount of knowledge I’ve ingested on these topics, I had always assumed that I’m a clear thinker.

Recently, though, it hit me like a lightning strike that this belief is counter-productive. That’s because is you “know” that you’re a clear thinker, you’re less likely to suspect that you might be missing something big in your thought process. After all, if you are convinced that you think clearly by default, why would you put in any extra effort to scrutinize your thought process? ...  Read the entire post →

A primer on dopamine

1/ I recently made notes on the book “Hooked” but wasn’t satisfied by the depth of explanation in it.

2/ I wanted to get down into neuroscience of habit-forming products and that inevitably lead me to the (in)famous neurotransmitter dopamine.

3/ Before we dive into what dopamine does, let’s first make one thing clear: dopamine does NOT generate pleasurable feelings. (In fact, it is the other way around – pleasurable feelings generate dopamine)

The neural circuits that lead us to “liking” are separate from the circuits that generate “wanting”...  Read the entire post →

Review of 2023

Time is strange – 2023 simultaneously felt too long and too short. It was short because I remember recently writing my 2022 review, and it was long because I ended up packing a lot of stuff into it.

✅ Train 5 days a week (including Mixed Martial Arts)

I did manage to train 5 days per week (at least for the latter part of the year). Training every weekday has become a habit now, and it’s something I wish to never give up on.

And yes, it’s three days of strength training and two days of MMA!

✅ Got myself a tattoo!

I’m endlessly fascinated by the concept of time, and how one can never grab it still. Time starts when we become aware of it, and ends with death. So, in many ways, we’re nothing but time.  ...  Read the entire post →

Notes from the book “Hooked”

I re-read the book Hooked by Nir Eyal and these are my notes.

1/ The key question that the book answers is: how to make habit-forming products. And its answer is a model that involves four stages: a) trigger; b) action; c) variable reward; d) investment

2/ Why should products be habit-forming? It’s because only those products that become part of someone’s daily life go on to become valuable. So, whether a product has habit formation potential is a leading indicator for whether the product will turn out to be valuable. ...  Read the entire post →

Notes on how Facebook ads work

I was studying Facebook ads system for Nintee, made some notes that you might find useful.

  • Facebook ads work through auction: each ad opportunity has an auction, the winner of which is decided by total value, which is So in this case, your ad will be shown to more people if
    • You have a higher bid
    • Or, more people are likely to take action that you care about
    • Or, the quality of ad is high (not spammy etc)
    • Bidding is mostly automatic by Facebook, and the way it does for maximizing results is that it starts with low bids but then gradually increases it ads don’t end up winning the auction (i.e. has lower total value) Let’s say you have two products: a) highly attractive cake (low cost and super yummy) and b) broccoli, and both are competing for the auction
      • If the objective is to find the highest volume for a given total cost (let’s say Rs 1000)
        • FB will start with low bids for both, and since more people are likely to click on the cake ad, its estimated action rate will go up and for the same bid, it will end up winning the auction
        • The only way for the broccoli ad to win an action is to increase the bid
        • So given a fixed budget Rs 1000, the cost per click of broccoli ad will be much higher than for cake (purely because more people are interested in cake v/s broccoli)
        This is why running ads for a concept before building it could give an honest signal of its attractiveness
        • Since Facebook always tries to give maximum value to advertiser and the most relevant ads to its users, you can imagine it as a matchmaking machine that minimizes the cost it takes for advertisers to reach a relevant audience
        • So, a low cost per action from FB ads tells you clearly that a significant number of people are going to find it attractive

        A good analogy to understand all this is to think about is a game: ...  Read the entire post →

Notes on how Supercell is run

Supercell, the company behind the massively popular Clash of Clans game, has one of the highest valuation per employee figures out there: they’re valued at $32mn per employee. That’s insane! How do they do it?

Via The World’s Most Valuable Per Employee Company: Supercell

1/ What struck me is the sheer number of games they kill each year?

They seem to be killing 9 games for each game they release. Some of these games have been in development for years, and have the potential to be in the top 25 games worldwide. And, yet, they get killed.

2/ Why are they killed? It’s because these games don’t meet their internal benchmarks (primary of which is 30-day retention).  ...  Read the entire post →

The Anti-Productivity Manifesto

After a barrage of recommendations on my twitter, I finally ended up reading Oliver Burkeman’s Four Thousand Weeks. The central premise of the book is simple: everyone has got about four thousand weeks to live, and spending that limited time chasing efficiency is wrongheaded.

The message seems old. The entire self-help industry revolves around saying variations of it. Stay in the present. Enjoy the moment. Seize the day. But where the book differs from the rest is that it’s both poetic and philosophical. It’s the kind of the book that, once you finish, you end up mumbling: gosh, I should have written it...  Read the entire post →