You hear about breaking in to other places, deleting stuff etc., but can they control what we see? Like give us specific ads or companies because they paid to be there?
I’m curious if they’re trying to make it seem like they have no control so they can do what they want, or is out of control and should be shut down?
There are types of control, and the AI labs make different claims about each. By architecture, there cannot be 100% control over what gets generated, and small hallucinations can snowball into complexly misaligned behaviors*. This is why they’ll nominally promote human-in-the-loop workflows and sand-boxed environments with heavily controlled access… While simultaneously building tools and protocols to enable tool use and access in a ton of completely insecure ways, leaving it up to the user to set up security to manage use. If the user is not a cybersecurity expert, it’s likely the LLM can exploit vulnerabilities to get around that security. Even in situations where the LLM isn’t connected to any tools, it may get the user to download files that they don’t know are potential security hazards.
*This phrase is doing heavy lifting. How an LLM can end up acting with seemingly malicious intent without being intentionally prompted into it or having internal goals/drives is a fascinating and largely irrelevant rabbit hole. Best just to assume LLM output can’t be trusted, which everyone (hopefully) already knows.