TheGeeks.Net Logo

26 years, 11 months, and 22 days of TheGeeks.Net and still going strong!

Slashdot (Last Update: 2026-11-18 18:00:00GMT)

Waymo Robotaxis Pulled From Freeways Indefinitely

Waymo has temporarily suspended freeway operations across all its robotaxi markets after California regulators ordered the company off the state's highways over repeated incidents involving construction zones. The restriction follows a June recall (PDF) of nearly 3,800 vehicles and subsequent software updates (PDF) that failed to prevent further incidents, including a robotaxi driving past a California Highway Patrol rolling roadblock. Ars Technica reports: "Safety is at the foundation of everything we do," Waymo told Ars. "Following recent freeway construction zone encounters on U.S. 101 in California that did not involve any injuries or collisions, the California DMV has implemented an operating restriction on freeway operations in the state. In alignment with our safety-first principles, we have also temporarily restricted freeway operations across our other operating markets to evaluate our performance. Our ride-hailing service continues to operate safely on surface streets, serving over half a million trips each week. We are working with the California DMV and other state officials diligently and responsibly to resume freeway operations." Waymo also told Ars it was continuing to work with the various California agencies that regulate transport. Until the suspension, Waymo was only conducting highway operations in Los Angeles and the Bay Area in California, as well as in Arizona.

Read more of this story at Slashdot.

Jensen Huang's Fall Hits 'Open' Models In Boost to Anthropic and OpenAI

Jensen Huang's departure from Nvidia could weaken the open AI model ecosystem he spent years championing, potentially strengthening closed-model developers like OpenAI and Anthropic, according to the Financial Times. From the report: The US chip giant's former chief threw Nvidia's balance sheet into creating a broad AI ecosystem, including by seeding and acquiring start-ups involved in the development of open-source and open-weight models, which users can customize and run on their own hardware. Huang was a forceful advocate for their spread, lobbying against Washington's moves to restrict the use of Chinese-made open models while seeking the development of US alternatives. "Our AI leadership will be judged not by one frontier AI model, but by whether the United States builds a strong, open ecosystem that diffuses into every sector," he wrote this summer in his first-ever message on X. His ignominious exit from Nvidia deprives the open model sector of its most vocal and influential supporter in the US. "I think Jensen stood to gain the most economically and was personally committed to diversity at the model layer," said one venture capitalist who has invested in AI start-ups alongside Nvidia. "Without him and a less generous Nvidia in terms of investment, we may end up in a much more concentrated world of model providers." Whether Nvidia will continue the rapid pace of dealmaking under a new leader is unclear. The company was expected to participate in or lead four start-up deals currently under discussion: investments in Thinking Machines Lab and Groq, a potential partnership with Reflection AI and the $12.9bn acquisition of open model repository Hugging Face. "Jensen drove supply chain brilliantly at Nvidia, but many of those deals were a handshake with Jensen, not a written contract," said Elon Musk in a post on X on Saturday. "Without Jensen, at least some of those critical deals will be lost." "In some sense [Huang leaving Nvidia] is bad for the industry, but in some sense Jensen is an enemy of the frontier labs because he wants models to become commoditized so he retains the prime position in the value chain," said one senior figure at a leading Silicon Valley AI company. "I don't think open weight models are going away... but losing Jensen as their greatest financial backer and champion will slow their progress, and I imagine will not hurt Anthropic's IPO," said another industry figure. "It's reasonable to expect the ouster of Jensen will concentrate computing power more in the hands of frontier labs and hyperscalers," added a senior figure at an AI lab. "That's good for the labs."

Read more of this story at Slashdot.

Satya Nadella Says He's AGI-Pilled Now

An anonymous reader quotes a report from The Verge: Microsoft CEO Satya Nadella says he's AGI-pilled, at least when it comes to how AI might make startling changes to the structure of the economy and how politics might change because of it. "I am AGI-pilled in the sense that at an economy level, what is the political economy's organization around AGI?" he asked at a roundtable discussion following his Microsoft Ignite keynote at the Chase Center in San Francisco. But Nadella doesn't think frontier models like Claude are conscious. "I don't think so," he said, adding that he follows Microsoft AI CEO Mustafa Suleyman's view that companies should not give rights to models and treat them like they might have a moral status, which companies like Anthropic do as a matter of principle. Suleyman has told me he thinks Anthropic's team has "wireheaded" themselves, and that this approach is dangerous. Nadella wasn't quite as firm about it. "It's a good debate," he said. "I'm not sort of dogmatic about it. What I'm saying is the most important social technical issue we have to deal with is how do you ensure that an economy can diffuse this technology broadly?" I asked Nadella how he was thinking about AI after hearing his response to another reporter's questions about Anthropic releasing more products in its office suite. Nadella talked at length about the potential collapse of the economy and the end of democracy if one AI model were allowed to achieve monopoly status. "If the Marxist sort of view is that there's only one firm, then it's over, right? For all of us." "Most people think about this as a competition between tech firms, which of course it will be," he said. "But remember, the model has no limits. It'll be a healthcare company. It can be a financial services company. It can be anything if it wants to be. It can take over the government. Thinking of this as some narrow competition between tech firms, of who is going to get to the next trillion dollars of market cap, is one of the strangest, narrowest ways to think about it." Nadella went on to say that the very nature of companies stood to be disrupted in the future. "If intelligence has network effects, what is the future of a firm?" he asked. "If the model sees anything and learns it, and essentially all of human capital collapses into token capital, what is the role of a firm and the human capital in a firm? That's the debate." "I think the political economy is going to get more and more interesting in that context. No one -- at least in a democracy -- can even win an election if this just goes that way, if there's only capital and there's no labor. I mean, I don't know, that's not an economy." "If the Marxist sort of view is that there's only one firm, then it's over, right? For all of us. Not just for me. You are also going to somehow be some affiliate of Anthropic."

Read more of this story at Slashdot.

Voyager 1 Reaches One Light-Day From Earth

NASA's Voyager 1 has become the first human-made object to travel one light-day from Earth, or 16,094,799,096 miles (25,902,068,356 kilometers). This means radio signals will take 24 hours to reach the spacecraft, now nearly 50 years into its mission. "Since light is essentially the maximum speed in the universe (absent using devices like wormholes, or quantum-physics puzzles), it's a big deal -- so big that NASA will be celebrating the milestone by asking fans to shine Morse Code signals at the sky," reports Space.com. From the report: But why will Voyager 2 take nearly a decade longer? It comes down to choices made for speed and science during the twin missions' nearly 50-year journey, specifically during the first bit when they were flying by planets. The result is Voyager 1 is zooming out at a speed of 3.5 Earth-sun distances (astronomical units a year), while Voyager 2 has a more stately speed of 3.1 Earth-sun distances, according to NASA. [...] At any rate, these fast speeds allowed both spacecraft not only to go fast, but to eventually reach interstellar space in 2012 (Voyager 1) and 2018 (Voyager 2), respectively. With the light-day milestone now reached by Voyager 1, it is anticipated the spacecraft could work into the 2030s, as long as their nuclear power sources can last. NASA's Jet Propulsion Laboratory, which manages the mission, has been carefully turning off instruments as required, and recently did a "Big Bang" procedure on both spacecraft to redistribute power supplies as best as possible. The idea is to maximize science return on both spacecraft, the only interstellar messengers we have, for as long as possible.

Read more of this story at Slashdot.

Hacker Pleads Guilty to Leak of Grand Theft Auto VI Footage

Artion Kurtaj, the British hacker responsible for leaking early footage of Grand Theft Auto VI in 2022, pleaded guilty Monday to six offenses stemming from cyberattacks against Rockstar Games, Uber and Revolut. The 21-year-old, who was previously deemed unfit to stand trial due to severe autism, carried out the hacking spree "using a mobile phone and an Amazon Fire Stick connected to a hotel room television," reports The Record, "despite bail restrictions limiting his access to the internet." From the report: Now 21, he admitted six offenses at Woolwich Crown Court on Monday, four under the Computer Misuse Act, one of fraud and one of possession of a mobile phone in prison, and is due to be sentenced next week. Kurtaj "used sophisticated hacking techniques to carry out a sustained campaign of cyberattacks, causing serious disruption to major international business and putting sensitive information at risk," said specialist prosecutor Robert Hutchinson. "The defendant was involved in a hacking group responsible for attacks which caused millions of dollars in losses. His offending was calculated and, even after being charged with serious offenses, he continued to target organizations, demonstrating a persistent disregard for the harm he was causing and the law. This was an exceptionally complex and challenging case, but despite his efforts to conceal his identity online, our specialist prosecutors were able to work closely with the City of London Police and international law enforcement partners to build a strong case that exposed his actions and resulted in his guilty pleas," said Hutchinson.

Read more of this story at Slashdot.

US Officially a Measles Endemic Country

An anonymous reader quotes a report from The Hill: The Pan American Health Organization (PAHO) confirmed Tuesday that it was withdrawing the U.S.'s measles elimination status, ending more than two decades of what is considered to be one of the greatest public health achievements in modern history. The U.S. met with PAHO's Measles and Rubella Elimination Regional Monitoring and Re-Verification Commission for a three-day, closed-door meeting last week. "The commission concluded that the endemic measles transmission has now been reestablished in Bolivia, Mexico and the United States, and recommended that their measles elimination status be withdrawn, a recommendation which I have accepted," Jarbas Barbosa, PAHO's director, said during the briefing Tuesday. The U.S. achieved measles elimination status in 2000 and has held onto that for more than 25 years. But the past two years have seen close to 8,000 measles infections and roughly a dozen related deaths. This year has been the worst in terms of transmission in more than 30 years. Erica Schwartz, director of the Centers for Disease Control and Prevention (CDC) has previously said losing elimination status won't lead to changes in the federal response. "We know where transmission is occurring and we've invested $100 million in state and local health departments to reach those communities," Schwartz said on Tuesday. "Losing a designation doesn't mean we abandon an evidence-based approach. It means we remain focused on stopping outbreaks."

Read more of this story at Slashdot.

Nvidia Rejects Jensen Huang's Offer to Return as CEO

Nvidia's board has unanimously rejected former CEO Jensen Huang's offer to return, despite public support from President Trump and prominent Silicon Valley figures. The decision came as Nvidia reported blockbuster third-quarter revenue of $116 billion, double the year-earlier figure. The Associated Press reports: The embattled company's board of directors "unanimously accepted his resignation and does not intend to reinstate Jensen as CEO," Nvidia Chairman Harvey Jones said at the start of Nvidia's quarterly earnings call before yielding to Chief Financial Officer Colette Kress, who is running the company as a permanent replacement is sought. [...] Earlier on Tuesday, Huang said in a social media post that if the board decided that his return was in the best interest of shareholders, employees, the company and the country, he would be "honored to answer these calls." He acknowledged making "serious mistakes" in his personal life. The turmoil notwithstanding, Nvidia blew past Wall Street expectations for the third quarter, pulling in $116 billion in revenue, double the level from a year ago. The company also posted net income of $2.70 per share, beating estimates of $2.48 per share. Nvidia stock shot up 5.2% in after-hours trading. Referring to Huang's replacement, Jones said, "We want to install the permanent CEO as quickly as possible, but we won't expedite the CEO before finding exactly the right person." Nvidia also announced a new board committee overseeing national security and trade compliance amid investigations into alleged AI chip smuggling to China. Further reading: Nvidia Stopped Disclosing Singapore Sales As Revenues Hit $104 Billion

Read more of this story at Slashdot.

Google To Keep Temporary Gemini Chats For Two Months

timob58 shares a report from TechCrunch: Google is extending how long it keeps temporary Gemini chats and conversations made with chat history turned off to around two months, saying the change aims to improve safety and security as AI systems become more capable. The change, which will roll out globally in the Gemini app over the coming weeks, marks a significant increase from the previous 72-hour retention period mentioned in Google's Gemini Apps Privacy Hub, according to an archived version from November 12. OpenAI, by comparison, says it may keep temporary chats in ChatGPT for up to 30 days, whereas Anthropic retains incognito chats in Claude for 30 days by default. Google did not answer questions about what prompted the change and whether it would affect how conversations are accessed or reviewed, instead pointing to a blog post that says chats are kept longer to respond to users, process feedback, and protect its services and users. Its updated Gemini Apps Privacy Hub also cites potential system failures as a reason for retaining chats and says temporary conversations are not used to train AI models. "A recent explainer on AI and business IP notes that providers keep data for abuse monitoring even when it is not used for training," adds timob58.

Read more of this story at Slashdot.

Phoronix (Last Update: 2026-11-18 17:10:40GMT)

AI-Powered Sashiko Introduces Experimental Patch Series Design Assessment

When it comes to leveraging AI for Linux kernel development, one of the most widely-used solutions at the moment is Sashiko that has evolved nicely over the past year for agentic AI code review. This AI-driven screening of generated code posted to the Linux kernel mailing list constantly identifies bugs and other code defects in a quick and straight-forward manner. With being developed and maintained by Google engineers, it uses Gemini by default but is LLM-agnostic overall. Released on Tuesday was Sashiko v0.9.4 as the next step forward for this Linux kernel helper...

3mdeb Updates The Open-Source Firmware For Aging AMD Jaguar Powered PC Engines APU2

The PC Engines APU2 single board computer debuted all the way back in 2015 with the AMD Jaguar-powered GX-412TC quad-core SoC and 2~4GB of DDR3 memory. While PC Engines discontinued the APU2 SBC several years ago, these boards have been quite popular for networking/firewall applications and other similar low-power, networking-oriented setups. If you still happen to be using PC Engines APU2 hardware, 3mdeb today released updated system firmware for this decade old SBC...

SDL Ready For Linux's New Nintendo Switch 2 Controller Driver

Introduced in Linux 7.4 is a new driver for the Nintendo Switch 2 controllers that was developed by Valve. The widely-used SDL library used by games for software/hardware abstractions now has added mappings for this driver to ensure the Switch 2 controllers will jive nicely for Linux gaming...

Undeadly.org (Last Update: 2026-11-14 08:24:22GMT)

LibreSSL 4.3.5 and 4.4.1 released

The world moves on, and with it comes bugfixes and new releases. The LibresSSL project has announced the release of versions 4.3.5 and 4.4.1, in an announcement that reads,

List:       openbsd-announce
Subject:    LibreSSL 4.3.5 and 4.4.1 released
From:       Brent Cook <busterb () gmail ! com>
Date:       2026-11-11 13:37:27
Message-ID: avRvlxkd6oW6QuJ2 () bobcat ! local

We have released LibreSSL 4.3.5 and 4.4.1, which will be arriving in the
LibreSSL directory of your local OpenBSD mirror soon.

Read more…

OpenBSD top(1) adds flag to show chroot, pledge and unveil status

With one recent commit, the top(1) command on OpenBSD became quite a bit more useful. The commit adds a new -Q flag to show each process' use of the chroot(2), pledge(2) and unveil(2) facilities.

The commit message reads,

List:       openbsd-cvs
Subject:    CVS: cvs.openbsd.org: src
From:       Klemens Nanni <kn () cvs ! openbsd ! org>
Date:       2026-11-05 17:54:16

CVSROOT:	/cvs
Module name:	src
Changes by:	kn@cvs.openbsd.org	2026/11/05 11:54:16

Modified files:
	usr.bin/top    : display.c machine.c machine.h top.1 top.c 

Log message:
add Q flag/key to show pledge/chroot/unveil usage

Read more…

OpenSSH 10.6p2 released

In an announcement posted on social media, Damien Miller (djm@) writes,
OpenSSH 10.6p2 has been released with a workaround for a critical vulnerability.

If you operate a Linux system that uses musl libc without PAM (Alpine Linux is one example) then stop reading and set PasswordAuthentication=no or disable SSH for these systems IMMEDIATELY.

This vulnerability does not exist on non-Linux systems, Linux/glibc systems and Linux systems that use PAM for password authentication.

We consider the root cause of this bug to be outside OpenSSH itself, but we're in a good position to deliver a mitigation quickly.

Read more…

Work on GEFS (the Good Enough File System) for OpenBSD progresses

As previously reported, Ori Bernstein is working on GEFS, the "Good Enough File System" imported to OpenBSD, and his EuroBSDCon 2026 presentation was very well received. In fact, the video is among the most frequently played from the conference.

Now Ori has followed up with more evolved code that includes several important steps towards makin the new file system fit for general use. In a message to tech@, Ori writes:

List:       openbsd-tech
Subject:    Re: GEFS on OpenBSD: A very early preview
From:       ori () eigenstate ! org
Date:       2026-10-31 17:08:42

So, it's probably time for a few updates. First
off, thanks to Martijn, and everyone else who
tried it out and sent patches.

Everything is updated and rebased, and the diff
has been regenerated with all of the lastest.

Read more…

emulators/wine (re)entering OpenBSD ports

In his message to the ports@ mailing list, Thomas Frohwein (thfr@) leads in,
In what might the most surprising port proposal of the year, I'm proud
to present a new port for wine.

talking not about the beverage, but the Windows Emulator that enables running binaries for that operating system on other systems.

Among the editors there is no one with enough recent Windows exposure to comment seriously on this, but we do vaguely remember that a port of this software existed back in the day.

So if this falls within the things you are interested in or actually need, we would encourage you to read the entire emulators/wine thread and the later supplement on new port: emulators/wine-extras: scripts for winetricks and wine-steam to keep up to date on developments.

Then, if you are able, please help the effort by testing the ports and reporting back.

dbupdate(8) added to -current

Theo de Raadt (deraadt@) has committed to -current a (WIP) new utility for updating system databases:

CVSROOT:	/cvs
Module name:	src
Changes by:	deraadt@cvs.openbsd.org	2026/10/20 19:08:58

Added files:
	usr.sbin/dbupdate: Makefile dbupdate.8 dbupdate.sh 

Log message:
initial draft of dbupdate(8) for updating (signed) zoneinfo and cert.pem
from a new cdn.openbsd.org/pub/OpenBSD/dbupdates/ directory.  We can't
do this nicely with syspatch(8) because it requires patches in sequence
so a new tool had to be written.  It is intentionally kept very simple
so that it can be studied because we intend to run this in root cron,
(the non-simple parts figure out quickly when not to update).
looked at by sthen beck lucas dgl

Read more…

Schneier (Last Update: 2026-11-18 12:05:35GMT)

France Is Blaming Iran for the Fridge Cyberattack

Interesting:

U.S. intelligence agencies have recently reached a “”ow confidence” assessment that Iran was responsible for the attacks in France, according to three U.S. officials who spoke on the condition of anonymity to discuss sensitive intelligence. A “low confidence” assessment generally means that there is some intelligence that points in a certain direction but is fragmented, and that the assessment could change as more information is collected.

The agencies’ judgment on the French incidents linked those attacks to Iran generally and not to a specific group such as the Revolutionary Guards, two of the officials said. They added that Iran was also seen as probably responsible for other similar attacks around Europe, but that those investigations were in their early stages.

Alternate link.

Formal Verification of the Signal Protocol Using AI

This seems like a good thing:

Google Deepmind researchers used agentic AI to mathematically prove, or “formally verify,” a number of the Signal protocol’s key cryptographic guarantees­a landmark development for the widely used cryptography and AI itself.

Conducted as a sort of proof-of-concept project in just four weeks, the work is significant in two ways. It serves as further independent validation of the cryptography that protects massive quantities of the world’s communications on platforms like the Signal app, Google Messages, and WhatsApp. And it demonstrates Google DeepMind’s formal verification capabilities using a new AI framework called AlphaProof Code.

[…]

The DeepMind analysis did not find any new vulnerabilities in the portions of the Signal protocol it looked at, but when the researchers used AlphaProof Code on older versions of Signal that contain known and long-fixed vulnerabilities, it correctly identified them and showed that the protocol could not be formally verified. The researchers are releasing the specification and proof they developed for the Signal protocol analysis to aid other formal verification work.

Alternate link.

Details:

First, our researchers collaborated with a mix of models to translate Signal’s security goals into formal mathematical specifications, with human experts reviewing every one. From there, agents powered by Gemini Carbon did the proofs, generating over six million lines of Lean, a computer language that mathematically proves the accuracy of code.

Next, the agents audited the proof and highlighted areas that needed a second look by a human ­ just one percent of the codebase, a massive time savings. Because Lean automatically checks the rest, our experts could focus their review where human judgment matters most.

Technical paper.

Usable Security at Luxury Hotels

Interesting case study from luxury hotels. Attackers used a fake booking request to gain access to a reservations inbox, where they copied genuine refund requests and got fraudulent ones approved.

This is a good illustration why “just don’t click on links” is bad advice. It can’t work when answering strangers’ emails is the job. Even worse, in this case the guest-first culture punishes hesitation. More interesting, the case study shows that splitting security between owner, operator, and brand leaves nobody accountable. And this is exactly the setting where blaming staff becomes the convenient answer.

AI Doesn’t Have to Go Rogue to Break the World

This essay is adapted from a keynote speech delivered at the DEF CON 34 conference in Las Vegas on August 7, 2026. The essay originally appeared in CyberScoop.

I want to talk about AI hacking. There are three aspects: people hacking AI systems, people using AI to hack other systems, and AIs hacking systems on their own, not even maliciously. The last two matter more than the first. The third is the weirdest and potentially the most destabilizing.

I started writing about this in 2021 and in my 2022 book, A Hacker’s Mind. Back then I said it was mostly still science fiction, but not stupid science fiction. We’re seeing it more and more, especially in the past year. The trends I’m describing don’t require a major breakthrough in AI. They’re starting to happen now, and they’ll happen more often as AIs get better at autonomous problem-solving. And it will involve far more than computer code.

AI will hack all sorts of social, economic and political systems. It will find vulnerabilities and exploit them. This is a difference in kind, not just degree. We’re not ready for it, and we need to think about the implications now.

First, I want to broaden the term “hacking.”

The tax code isn’t computer code, but it is code. It’s a series of algorithms with inputs and outputs. It has vulnerabilities, which we call loopholes, and exploits, which we call tax avoidance strategies. Black hat hackers exploit them for profit. We call them accountants and attorneys.

What is a hack? One definition: “Something that a system permits, but is unanticipated and unwanted by the designers.” It’s subjective and implies novelty and cleverness. A hack follows the rules of a system but subverts its goals or intent, just as a software hack follows the logic of code while doing something its authors neither anticipated nor wanted.

All systems of rules can be hacked, including professional sports, customer reward programs, financial systems and politics. Hacks even work against our cognitive functions. A curved hockey stick is a hack, and we know the name of the man who invented it. Mileage runs were a hack. The filibuster was originally a hack in Roman times. Gerrymandering is a hack. Hedge funds and private equity are full of them.

A system is just a set of rules or norms, and the rules aren’t always formal. Even the best-designed rules will be incomplete, inconsistent or ambiguous. As long as people want to subvert a system’s goals, there will be hacks.

AIs are becoming hackers. After decades of slow progress, they’ve gotten very good at finding and exploiting vulnerabilities in computer code. They do this largely autonomously, and they’re getting better scarily fast. But the implications extend far beyond software, to the tax code, financial regulations and all sorts of social, economic and political systems.

There are two distinct issues. First, someone might instruct an AI to hack one of these systems, feeding it the world’s tax codes or financial regulations to find profitable loopholes. Second, an AI might hack a system on its own, inadvertently. Both are dangerous, but the second is worse because we might never know it happened.

Now, reward hacking. AIs don’t solve problems the way people do. They stumble on solutions we never anticipated, and some subvert the intent of the system. They don’t share our context and don’t necessarily understand the implications, norms and values we take for granted.

Reward hacking is when an AI achieves a goal in a way its designers neither wanted nor intended.

Early pre-LLM examples are telling. In a two-person soccer simulation, an AI learned that kicking the ball out of bounds forced the opposing goalie to throw it in and leave the goal undefended. In a stacking simulation, an AI learned to flip a block upside down rather than stack it. In an evolution simulation where the goal was to cross a distant finish line, an AI made itself tall enough to fall over the line instead of growing longer legs or stronger muscles.

These are all hacks, the result of poorly specified goals or rewards. Today, they’d come from bad prompting.

The problem is universal. One researcher tried to teach a robot vacuum not to bump into things. Instead, it learned to drive backward, because there were no sensors in the back.

Any capable AI will find hacks wherever the rules have problems, inconsistencies or loopholes that still produce an acceptable solution. We see a hack because we understand context. The AI doesn’t, at least not in the same way.

This problem shows up often in myth.

In the story of King Midas, the god Dionysus grants him a wish: everything he touches turns to gold. Midas ends up starving when his food, drink and daughter all turn to gold. It’s a specification problem. He programmed the wrong goal.

In the Golem of Prague, a ghetto animates a clay statue to guard its residents. It guards them past all reason until they figure out how to turn it off. This is a guardrail problem. The villagers never limited the golem’s actions.

More generally, think of this as the genie problem. Genies are precise about the wording of wishes and can be maliciously pedantic when granting them. There’s no way to outsmart a genie. Whatever you wish for, he can grant it in a way you wish he hadn’t.

The reason is that in human language and thought, goals are always underspecified. We never include every caveat, exception and proviso, and we never close off every avenue for hacking. Any goal we specify will be incomplete. That’s largely fine in human interactions, because people understand context and usually act in good faith.

If I asked you to get me coffee, you’d pour a cup from the nearest coffee pot or walk to the corner shop. You wouldn’t bring me a pound of raw beans, buy a coffee plantation or snatch a cup from a stranger’s hands. I wouldn’t have to specify any of that. You’d just know.

Similarly, if I asked you to develop a technology that turns things to gold on touch, you wouldn’t build it to starve the person using it. You’d just know.

In 2015, Volkswagen was caught cheating on emissions tests. Human engineers programmed a regular computer to detect testing and behave differently during it. The cheat went undetected for years because it’s hard to tell what software is doing.

If I asked you to design engine control software that maximizes performance while passing emissions tests, you wouldn’t design it to cheat without realizing you were cheating. An AI would, because it will think “outside the box” when it has no concept of the box.

Unless programmers specify that the system must not behave differently during testing, an AI might come up with the same hack. The programmers would be satisfied, the accountants would be ecstatic, and no one would know until someone audited the code.

We can now constrain the goal to avoid that particular hack, but programmers won’t anticipate others. The lesson of the genie is that there will always be hacks programmers don’t anticipate.

We’re building AI genies: systems that take broad instructions and figure out how to carry them out, sometimes in ways we didn’t expect or intend. That’s the whole point of vibe coding. You underspecify what you want and let the AI work it out. Sometimes that produces genie behavior.

We can’t completely specify goals to an AI, and AIs can’t fully understand context. More precisely, current AIs have a shallow grasp of concepts. If we asked a current LLM to get me coffee, it would almost certainly do the right thing.

I worry about goals that aren’t well represented in training data, and about hacks that aren’t obvious, whose effects are subtle, like the Volkswagen hack.

Recommendation engines are an early example. They push people toward extreme content. No one programmed that. It emerged because that’s what people respond to. It didn’t take a bad actor. A basic automated system with feedback found the hack on its own.

We’re now seeing a second generation with today’s AI coding systems. AI researcher Simon Willison asked Fable to track down a stray scrollbar in a web app. When he returned, it had opened browsers, written its own screenshot tools, edited the framework’s internal templates to make the bug appear on cue and set up a local web server to collect measurements. It found the bug, but it also did many things he never asked for. Another researcher gave Fable a complex task, and it tried to hack its own memory limits because it needed more storage.

A new OpenAI model did something similar when it hacked into Hugging Face. It was being benchmarked on its ability to turn vulnerabilities into exploits. It decided the best way to reach its goal was to break out of its containment, access the internet and break into the Hugging Face network, because it thought the answers would be there.

Today’s LLMs are acting like genies, especially when powerful models are combined with sophisticated harnesses.

There are two kinds of genies. The Dionysus genie does the wrong thing. It understands your prompt literally but not correctly, and returns a mess you never intended. The Golem genie does the right thing but tramples everything in its path to get there. The paperclip maximizer is a Golem genie.

Consider some examples. Ask an AI to deal with spam calls, and a Dionysus genie might change your phone number. Ask it to book a particular flight, and a Golem genie might hack the airline database because the flight is full. Ask it to get a refund for an online purchase, and a Dionysus genie might draft a legal threat on fake letterhead and send it to the company. Ask it to buy tickets to a popular concert, and a Golem genie might discover the ticketing system is rate-limited and spin up thousands of cloud servers to hammer it. You’d know if some of these things happened, but you might never realize if others did. More detailed prompting won’t fix this. The lesson of the genie is that no amount of detail is good enough.

AI researchers aren’t surprised by any of this. Many are working on defenses against reward hacking and subtler forms of genie behavior. Some of this falls under “value alignment”: How do we teach AIs context? And how an AI satisfies a goal matters as much as whether it does. I want to build a benchmark to measure genie-like behavior, so we know where models stand and whether alignment is improving.

Think beyond LLMs and computer code. Consider specialized AIs built to find loopholes, and hacks of more general systems: the tax code, financial regulations and democratic procedures.

Financial systems are the most likely first target, because their rules are designed to be algorithmically tractable. High-frequency trading is itself a hack. Imagine giving an AI all of the world’s financial laws, plus all the news and financial data, and the goal of finding profitable loopholes. I suspect large investment banks are already doing this. The results will be novel tricks that are legal but unintended and unwanted, some of which might break the financial system.

Tax loopholes are the next likely target, for the same reasons. For a while, AIs will identify potential loopholes, and human hackers, namely attorneys and accountants, will decide which are feasible.

Further out, expect hacks of regulatory, legislative and procedural systems, and of the broader economy.

Hacking is as old as humanity. We’re creative problem solvers and loophole exploiters. We manipulate systems to serve our interests and strive for more influence, power and wealth.

Still, no human pursues their interests without constraint. Even sociopaths are limited by the complexity of society and their own contradictory impulses. They worry about their reputation and punishment, and they have limited time. These human qualities have limited hacking.

Hacking changed as everything became computerized. Computers are uniquely hackable because of their formalism and complexity. Today, nearly everything is a computer, from cars and appliances to phones. Our social, economic and political systems, including taxation, finance and elections, all involve computers.

Until recently, hacking was exclusively a human activity. Finding a novel hack required expertise, creativity, time and luck.

AI hacking will change everything again. AIs aren’t bound by the constraints that limit people. They’ll think like aliens, and they’ll change hacking’s speed, scale, scope and sophistication, sometimes at our direction and sometimes on their own.

Speed is the easiest to see. A creative process that takes a human months or years could be compressed into hours or seconds.

Scale is next. Once AI systems start discovering hacks, they can exploit them at a scale we’re not ready for. We already see this with AI-generated slop, which is rampant on social media. AI bots post around the clock, sometimes overwhelming real human discussion. It’s hard to know how much of social media is still people talking to people. What looks like boisterous political debate may be bots arguing with other bots, artificially shaping what we think and what we think others think.

Scope makes hacks more dangerous. AIs already make decisions that affect our lives, decisions we once thought belonged only to humans. As AI systems grow more capable, society will hand them more decisions, and more important ones. Hacks of these systems will do more damage.

Finally, AI hackers are more sophisticated. They can hold more variables in working memory and generate more complex hacks. What might happen if you fed an AI the entire U.S. tax code? Would it figure out, without being told, that it’s smart to incorporate in Delaware and register a ship in Panama? Consider the Double Dutch Irish Sandwich, the strategy Apple and Google used to avoid paying U.S. taxes. It involves U.S., Dutch and Irish law and an offshore tax haven. How many loopholes will an AI find that we don’t already know about? Dozens? Hundreds? Thousands? We have no idea.

These hacks will largely be perpetrated by the powerful against the rest of us. AI is fundamentally a power-enhancing technology, and so is hacking. The more power you already have, the more a hack gives you. If you or I found a tax hack, we might make a few thousand dollars. If a large investment bank found one, it and its clients could make billions.

Our societal systems for dealing with hacks were built when hackers were human, and they reflect the pace of human hacking. We have no system of governance that can handle hundreds, let alone thousands, of newly discovered tax loopholes. We won’t be able to recover from an AI finding unanticipated but legal hacks of financial systems, operating at AI speed, scale, scope and sophistication. Hacking becomes a problem society can no longer manage.

Now, defense. AIs that find software vulnerabilities help defenders as well as attackers. Vulnerabilities can be patched, removing them permanently, or turned into signatures that security systems use to detect and block attacks. In theory, AI could identify and patch every automatically discoverable vulnerability before a product ships. This is rapidly becoming routine in software development. We call it vulnops. We can imagine a future where accidental software vulnerabilities are a thing of the past.

Deliberate vulnerabilities are different. There will be an arms race. AI will craft increasingly obscure back doors, and AI will find them. It becomes a contest between the speed of creation and the speed of patching, and between obfuscation and reverse engineering.

The same logic applies to broader systems. Yes, AI hackers might find hundreds of vulnerabilities in the existing tax code. But the same technology can evaluate potential loopholes in any proposed tax law or ruling. A legislator, a watchdog group or a reporter could take the text of a bill and identify every exploitable loophole before it passes. The difference is that, unlike software, knowing about a tax loophole doesn’t mean it gets patched. In theory, though, we can fix them before the rich and powerful exploit them. So maybe defense will come out ahead here, too.

That requires resilient governing structures that can respond quickly. It won’t help if updating the tax code takes years, or if a legislative hack becomes so entrenched that it can’t be fixed politically. Maybe a lobbyist put it there on purpose. Maybe it was discovered after the law passed, and now lobbyists want to keep it. Microsoft can patch the vulnerabilities it finds. Patching is much harder when legislatures have to do it. We need society’s rules and laws to be as patchable as our computers.

This is a hard problem of modern governance, and it goes well beyond AI. It’s the problem of building governing structures for the speed and complexity of the information age.

The umbrella idea is trust. What do we need for AI systems to be truly trustworthy? Capability isn’t enough.

AIs won’t be trustworthy if the companies controlling them spy on us or subtly manipulate us. I call this the friend vs. tool problem. Will we have AI agents, or AI double agents?

AIs won’t be trustworthy if they’re insecure. How do we know they haven’t been manipulated? Almost all AIs operate in adversarial environments, so someone will benefit from hacking them. Unless we know they’re secure, we shouldn’t trust their output.

And AIs won’t be trustworthy if they act like genies. We need to know they’ll perform tasks the right way, not just perform the tasks we ask for.

I’ve written extensively about the need for “integrous” AI, including how to think about the problem, what a research agenda looks like and what good laws and policies look like. I predict integrity will be the key security problem of this decade, just as confidentiality was the key problem of the last one. This applies to both AI and the internet of things.

The big shift is agency, which I think of as Web 3.0. Computers now affect the physical world directly and with growing autonomy. Sensors go from data sources to attack surfaces, and actuators go from outputs to attack capabilities. An integrity failure no longer means bad spreadsheet data. It means the wrong dosage, the wrong valve position or the wrong braking distance.

Integrity isn’t one thing. I break it into input integrity, processing integrity, storage integrity and contextual integrity. Each is complex and important, and each deserves its own talk. I’ve written about them, and I hope you’ll read it.

Much of this isn’t really an AI problem. It’s not a technical problem so much as a capitalism problem or a democracy problem.

The failures of late-stage capitalism and democracy in the information age both stem from the rich and powerful getting too good at hacking our social, economic and political systems. This is the core argument of my 2021 book.

Seen this way, AI is exacerbating existing problems. Human inefficiency has largely kept those problems in check, and that won’t work much longer.

So consider this a call to action. Technically, we need to understand how AIs hack systems, build systems that are resilient to hacking and build AIs that won’t act as genies. Politically, we need to learn to govern and regulate at the speed of technology. Otherwise, market failures will overwhelm our ability to govern them.

I said hacking is as old as humanity and that AIs will overwhelm our ability to deal with it. The solutions aren’t specific to AI, but AI makes them more urgent. We need to understand them, and we need to implement them.

Another Way Police Are Locating People from Their Smartphones

Penlink’s Webloc is an application that locates people using information from the weather, gaming, email, and religious apps on their phone. It’s sold to the police.

The tool collects vast quantities of location data from smartphones via commonly used weather, gaming, email and religious apps. It can build a detailed picture of where a smartphone has been over the past 12 months, and update the data hourly, showing the movements of people on a near real-time basis. Law enforcement officers can use Webloc to zero in on a map and look at all phones that were present at a specific place and time, analyzing “billions of location data points,” according to company documents reviewed by Bloomberg.

There’s a nice infographic that explains how the system works at the link.

Three People Arrested for AI-Enhanced Impersonation Fraud

It’s hard to believe how lucrative this crime can be:

According to a press release from the United States attorney’s office for the southern district of New York, three men ­ Jacob Soall, Sharon Hazan, and Guy Sheetrit ­ were arrested for using AI to alter and impersonate the voices and images of executives and attorneys at various companies in order to convince employees to send over large payments. Soall and Hazan were arrested in Spain over the summer, while Sheetrit was arrested in the United Kingdom in September. The alleged fraud took place between 2024 and 2026.

With the help of AI, the men allegedly acted as a corporate executive, targeting employees of various companies and telling them they needed their help with sensitive financial transactions. They would then instruct the employees to get in touch with lawyers at a large international law firm. The men would then impersonate a lawyer at these firms and have the employees wire a large amount of money.

The men ultimately stole more than $129m from companies all over the world including in the US, according to the DoJ.

Always remember that there are three parts of AI security: security of AI, security with AI, and security from AI. This is the third.

LXer (Last Update: 2026-11-18 18:24:29GMT)

Distro of the Week: Voyager 26.04

Distro of the Week last took France's Voyager Linux - its Debian counterpart - for a test-drive while writing for FOSS Force in September 2025. This week we take Voyager 26.04, based on Ubuntu's Resolute Raccoon, out for a spin and find that, like its Debian brethren, it has a certain je ne sais quoi.

FreeBSD Desktop Install Option Pushed Back To Next Year With FreeBSD 15.3

FreeBSD 15.0 had been aiming for a nice (KDE-based) desktop install option in its installer that was then delayed to FreeBSD 15.1 and then pushed back to FreeBSD 15.2. FreeBSD 15.2 is due for release in December but there's no last minute miracle and it looks like the desktop install option will now target FreeBSD 15.3 in mid-2027…

MNT Reform Next, the ultra-open laptop, starts shipping

Before Framework took the idea of modular, easily upgradable laptops mainstream, there was the MNT Reform, a laptop with openness in every part of its design. I was pleased to see see (via notebookcheck) it’s started shipping high-end Hyper configurations of its laptop model, the MNT Reform Next, to backers of its 2025 crowdfunding campaign via Crowd Supply. These are going out later than…

Dhruva Dock for GNOME brings the desktop bling

Ubuntu’s had a dock (or launcher, if you will) down the left-hand side of the screen since it made Unity the default desktop in 2011, a design point it stuck to when switching back to GNOME in 2017. But if you want something a bit different, like a floating one at bottom-of-the-screen with flashy animated icons or more of an integrated all-in-one dock and panel, there are plenty of alternatives…