Categories
Startups

Day 1516 and It Has To Be Carefully Taught

I love science fiction. The current generation building artificial intelligence builds on decades of thought experiments (aka science fiction) on how we might responsibly build and interact with a machine intelligence.

So it’s exciting watching testable premises arise that give hope that what is being built can be done so in ways that reflect our shared values. That is at least broadly the project of alignment.

An interesting paper from Owain Evans and a group of researchers on emergent misalignment caught quite a bit of attention today.

They finetuned GPT4o on a narrow task of writing insecure code. Having finetuned GPT4o to write insecure code they then prompted it with various neutral open-ended questions. It gave misaligned answers 20% of the time, while original GPT4o never did

You can see the work and verify the numbers yourself here. The discussion is interesting because they aren’t sure why model shows broad misalignment after a narrowly negative task like making insecure code. But it’s pretty interesting right?

Without getting into the politics of doomers, Elizer Yudkowsky believes this experiment to be a positive finding.

If you train the AI to output insecure code, it also turns evil in other dimensions, because it’s got a central good-evil discriminator and you just retrained it to be evil. Elizer Yudkowsky

The moral valence of intelligence is an open question and whether the values we have as humans will follow through into an alien emergent intelligence raised all kinds of questions.

But if we can teach values simply through conduct that has bad intent it might mean we can and in fact capable of teaching what we see as the right conduct.

But for all your sloppy coders out there be warned. Writing bad code leads to Nazism. Nobody tell Curtis Yarvin.

Categories
Emotional Work Startups

Day 1515 and Hope in the Dark

Given the amount of illness that seems to be plaguing folks this winter I’m surprised we’ve not all decided to hide until Spring thaw.

Every event seems to be a super spreader. Our physical immune systems are shot and I doubt our emotional defenses are much better. Everyone is predicting informational dangers myself included.

It is hard out there and we all experience it in different ways. My medical improvement sprint is plagued with logistical issues, the mold situation in our basement is overwhelming, and yet I have hope that I’ll make it.

o many people are dedicated to building solutions to problems, big and small, that I can’t selfishly let my any of my problems stand in my way. We have to all pull forward together.

I spent a few hours with a portfolio founder working on their fundraise today and I felt my optimism. I enjoyed the flow of work even as the enormous task of raising capital is filled with risk.

I’d taken a risk on directional play earlier in the year. I believe in the founder. They are making their way through YC. I can see their path emerging with every step forward. And I see hope.

Categories
Internet Culture Media

Day 1514 and Informational Ravine

I hate to add fears that we will face a “dead internet” but increasingly we lack shared context in our online spaces. As context collapses so too does culture. Bad behavior proliferates.

Without shared values we cannot find purchase on the informational ravine of the open web. Competing narratives and interests buffet your mind as you try to sense-make your way into a firmer grip. It’s easy to slip and find yourself unsure of what is up or down.

The vibes are bad. People have entirely different interpretations when presented with something as innocuous as an email asking “what did you get done this week?” If you discuss a particularly contested space it quickly becomes a hostile information environment. Many retreat.

If you are tempted to argue with me about whether that action is in fact innocuous you have to wonder how far apart you and I are from each other as we try to climb through the great ravine to the other side.

Categories
Emotional Work

Day 1513 and Forcing Function

I’ve not in one thousand five hundred and thirteen days of writing in a row set forth a m standard for how I might quit. Four years (or 216 weeks) is plenty of time to come up with a criteria for making a decision.

I have in that time embraced the haziness inherent in self trust. I’ll just know when it’s time. That’s obviously a rationalization. I assumed that circumstances would decide for me which meant I’d never need firm criteria for stopping. It would just happen.

Given my health and the general state of the world surely in this long timeframe some calamity, crisis or mishap would keep me from writing one day and that would simply be that. The chain would be broken.

It has not yet happened. No forcing function has stopped me from my writing practice. And I’ve not yet set worth anything firm about how I’ll know.

So far 2025 has tested me. There are many short posts. I have been hampered by health and home issues which sorely make me want to give up some days.

I’ve tried to included more sporadic “linking and thinking” to make my writing space more blog-like and less essay oriented. Backing away from narrative forms is a fine way of introducing flexibility into one’s writing.

I can’t help wondering if I should introduce a forcing function and create a set of criteria for when I’ll stop. But the truth is I’m scared to give myself a clear way out when I’m struggling. Perhaps it’s better to keep that trust that I’ll know.

Categories
Media Politics

Day 1512 and Thumbs Down

It’s been a bad month for me. It seems like a bad month in general. But that’s February for you right? It’s a thumbs down kind of month. I’ve enjoyed the nonstop snow but we’ve finally gone above freezing.

Icicles

As the sun melts down our power into icicles I’ll try not to dwell on the negatives.

Reading

The Brussels Effect or Denialism in Europe

Are you a Frankfurt School student? I certainly am. If you are, you may find John Ganz’s review of Alex Karp’s new book The Technological Republic to be an amusing read. His Substack also has some gems including this imagine of Adorno which I intend to use everywhere.

Theodor W. Adorno giving a thumbs down

Categories
Politics

Day 1511 and You Are Here

Watching institutional powers and public figures goes through the Kübler-Ross grief cycle as they grapple with technical and political change sucks. People are all over the place.

Institutional distrust from the public has America and Europe at odds just as our geopolitical position relative to China is most precarious. And yet this strange new world cannot possibly be coming. Having spent the last year in denial Germans have moved into anger.

Imagine what bargaining will look like as power shifts over the next few years. I’ve seen the depression stage already in technology as the shift in intelligence and computing washes over us.

I’ve come to acceptance only because I’ve got a head start. I didn’t look terribly sane at the time and now I am sitting pretty. Taking action while we grieve the loss of the world we knew is the human condition. If you can accept change is inevitable you might even start to enjoy the process.

Categories
Reading Startups

Day 1510 and Turning It On

Almost two years ago I sent a Twitter DM to a young founder named Isaiah. He was intellectual, curious and humble and I was impressed by his authenticity.

He was strong enough and driven enough to ask for hard feedback. So I told him the truth when he asked. I hated his first idea, gave a prediction about how it would go and said I’d invest in him on whatever he did next.

Lucky for me that feedback turned out to be accurate. We talked for months as he worked through a plan for his true passion for abundant clean nuclear energy.

I was blessed to be put in a position where I could commit as his first investor. His progress since then been extraordinary. Their goal is to make the world’s energy by building nuclear reactors at planetary scale. Today Valar Atomics announced they raised a 19m seed round.

When I say extraordinary I really mean it.

First, we have completed the construction and pressure certification of our thermal prototype, Ward Zero, at our Los Angeles facility—the fastest in history a thermal test unit has been developed and built. Ward Zero will be unveiled next week at an exclusive event in LA. Isaiah Taylor

We are in an age of acceleration. To be able to design and test a prototype this fast is a sign that we can expect better solutions to arrive and quickly if we should so will it. I wouldn’t be surprised if they are able to turn on a working reactor in the near future. If you are interested in Valar (working for them or investing in their growth) hit me up on DM.

Reading

Leading Edge newsletter “What Woo Works?”

Spooky, scary, technology is witchcraft

Media

Want to see an android art direct as if it were in the cremaster cycle? The Protoclone is a faceless, anatomically accurate synthetic human with over 200 degrees of freedom, over 1,000 Myofibers, and 500 sensors. Clearly they are doing this just to scare us into giving them attention so here you go. I hope they don’t execute as swiftly as Valar.

Protoclone, the world’s first bipedal, musculoskeletal android
Categories
Chronic Disease Media

Day 1509 and Wrapping My Arms Around The Problem

I am seeing some progress in my various home and health projects. I’ve been doing my best to remain optimistic even though I was not feeling well and the sheer amount of changes required was intimidating. But I’m seeing low progress.

An industrial hygienist is coming to do an arm test tomorrow on our basement as well as the rest of the house to confirm the extent of our mold problems. Our hope is that it’s contained to the bathroom in the basement.

If we have to do a bathroom remediation that presents an opportunity to do some renovations. While exciting that is also introducing more risk. But you can’t waste a crisis right?

Stuff I Read

The Agent Problem

CoinDesk reporting on the Libra scandal in Argentina

Politico: Voters Were Right About The Economy

Epsilon Theory “It Was Never Going to Be Me

Categories
Chronic Disease Emotional Work

Day 1508 and Dorymaxxing

I am pushing myself to continue with the daily writing habit even as I am on a rollercoaster of health and home challenges that have put me well on the back foot.

I want to rage against the symptoms, the system that can’t solve anything, and even my own body for being tricky. But that won’t fix anything. I’m need to give the new protocols the space to work.

So it’s one foot in front of the other. Whatever is happening out there in the real world I just need to put one foot in front of the other. Or if you prefer a meme. Just keep swimming Dory.

Just keep swimming

I’m doing my best not to get it get me down. I’m afraid of the setbacks. I am afraid of the length of recovery and the potential for things to be worse. But I’ll Dorymaxx. It’s all I’ve got in me

Categories
Emotional Work Politics

Day 1507 and Apocalypse Narcissism

I’ve been very wrapped up in my own problems of late. I have plenty of good reasons to be focused inward. When you feel as if you are fighting for survival, physical or otherwise, you can’t see anything else.

As I’ve looked up from my issues, I am seeing countless others caught in their own reactive spirals. Many of them are even directionally correct in their diagnosis of the problems facing them and the world as we know it.

The apocalyptic bent is especially strong in America at the moment. From politics to artificial intelligence to cultural wars, Americans are on the edge of change.

If your world is ending you probably can’t see beyond the horizon of the issues bringing about its end. Your view is myopic. Let’s call this phenomenon “apocalypse narcissism.”

It’s understandable to be wrapped up in fear when faced with all kinds of mortality. Your life, your nation, your culture, your planet and even your species all face world ending questions at some point. Sometimes change is so great we can’t see it as anything but death. Even if something better rises from the ashes.