Preferences

Ok - where do AIs put the information that they "seek" from the internet?

bubblyworld
I can see what you are getting at but consider:

I had an experience the other day where claude code wrote a script that shelled out to other LLM providers to obtain some information (unprompted by me). More often it requests information from me directly. My point is that the environment itself for these things is becoming at least as computationally complex or irreducible (as the OP would say) as the model's algorithm, so there's no point trying to analyse these things in isolation.

davedx
Into their short term memory (context). Some information is also stored in long term memory (user store)
DANmode
Truthfully, few people know that right now!

They're backfeeding what it's "learning" along the way - whether it's in a smart fashion, we don't know yet.

It’s the whole “MCP” moto right? Basically keep re-feeding in each subsequent prompts the additional requested context?
cess11
I suspect there's a harsher argument to be made regarding "autonomous". Pull the power cord and see if it does what a mammal would do, or if it rather resembles a chaotic water wheel.
JumpCrisscross
> Pull the power cord and see if it does what a mammal would do

Pulling the power cord on a mammal means shutting off its metabolism. That predictably kills us.

cess11
No. If the analogy had been about frying the chips and internal wires, then maybe that might have been a reasonable comparison, but it was not.

Now it's about cutting the supply of food.

ben_w
"Food" is only analogous to "mains power" for devices which also have a battery.

But regarding hunger: while they are a weird and pathological example, breatharians are in fact mammals, and the result of the absence of food is sometimes "starves to death" and not always "changes mind about this whole breatharian thing" or "pathological dishonesty about calorie content of digestive biscuits dunked in tea".

cess11
Right, so you agree that there is a clear difference between a mammal and the device we're discussing.

I'm not sure why introducing a certain type of rare scam artist into the modeling of this thought experiment would make things clearer or more interesting.

bubblyworld
I think it would turn off, no shocker there. I'm not sure what you mean, can you elaborate?

When I say autonomous I don't mean some high-falutin philosophical concept, I just mean it does stuff on it's own.

cess11
Right, but it doesn't. It stops once you stop forcing it to do stuff.
bubblyworld
I still don't understand your point, sorry. If it's a semantic nitpick about the meaning of "autonomous", I'm not interested - I've made my definition quite clear, and it has nothing to do with when agents stop doing things or what happens when they get turned off.
cess11
I think you should start caring about the meaning of words.
viraptor
Because that's what they're created to do. You can make a system which runs continuously. It's not a tech limitation, just how we preferred things to work so far.
cess11
Maybe, but that's not the case here so it is lost on me why you bring it up.

This item has no comments currently.