Categories
Community

Day 1273 and Context Window

The fracturing of the social web has made it harder to connect person to person.

The enjoyment of sharing a platform or a protocol with other humans is undermined as grifters and opportunists bang against artificial intelligence slop and algorithmic manipulation. It’s just not as fun to be online in that atmosphere.

I happen to like putting a little more of humanity out here on the edges of the great social media seas. I am not everyone’s cup of tea but at least you know what flavor I am.

Perhaps humans need longer context windows just as much as our artificial intelligence. I’ll allow Google’s Keyword blog on DeepMind’s longer context window to explain.

Context windows are important because they help AI models recall information during a session. Have you ever forgotten someone’s name in the middle of a conversation a few minutes after they’ve said it, or sprinted across a room to grab a notebook to jot down a phone number you were just given? Remembering things in the flow of a conversation can be tricky for AI models, too — you might have had an experience where a chatbot “forgot” information after a few turns. That’s where long context windows can help.

What is a long context window?

Part of my affection for “blogging” whether it’s on my own WordPress powered website or Twitter (remember when we called it a microblogging service?) is that it gives the chance to establish a large context window for me.

You can definitely make predictions about me based on what I’ve shared. If I am as complex as million token window (which is what Google’s Gemini can now handle) I would honestly be surprised. So go ahead and augment any conversations you have with me with the wider context of Julie. It’s my goal that it allows us to connect better.