Stay informed with free updates<\/p>\n
Simply sign up to the Artificial intelligence myFT Digest — delivered directly to your inbox.<\/p>\n
A new OpenAI model arrived this month with a glossy livestream, group watch parties and a lingering sense of disappointment. The YouTube comment section was underwhelmed. \u201cI think they are all starting to realize this isn\u2019t going to change the world like they thought it would,\u201d wrote one viewer. \u201cI can see it on their faces.\u201d But if the casual user was unimpressed, the AI model\u2019s saving grace may be code. <\/p>\n
Coding is generative AI\u2019s newest battleground. With big bills to pay, high valuations to live up to and a market wobble to erase, the sector needs to prove its corporate productivity chops. Coding is loudly promoted as a business use case that already works.\u00a0<\/p>\n
For one thing, AI-generated code holds the promise of replacing programmers \u2014 a profession of very well paid people. For another, the work can be quantified. In April, Microsoft chief executive Satya Nadella said that up to 30 per cent of the company\u2019s code was now being written by AI. Google chief executive Sundar Pichai has said the same thing. Salesforce has paused engineering hires and Mark Zuckerberg told podcaster Joe Rogan that Meta would use AI as a \u201cmid-level engineer\u201d that writes code<\/a>.<\/p>\n Meanwhile, start-ups such as Replit and Cursor\u2019s Anysphere are trying to persuade people that with AI, anyone can code. In theory, every employee can become a software engineer.\u00a0<\/p>\n So why aren\u2019t we? One possibility is that it\u2019s all still too unfamiliar. But when I ask people who write code for a living they offer an alternative suggestion: unpredictability. As programmer Simon Willison put it: \u201cA lot of people are missing how weird and funny this space is. I\u2019ve been a computer programmer for 30 years and [AI models] don\u2019t behave like normal computers.\u201d\u00a0<\/p>\n Willison is well known in the software engineering community for his AI experiments. He\u2019s an enthusiastic vibe coder \u2014 using LLMs to generate code using natural language prompts. OpenAI\u2019s latest model GPT-5 is, he says, his new favourite. Still, he predicts that a vibe coding crash is due if it is used to produce glitchy software. <\/p>\n It makes sense that programmers \u2014 people who are interested in finding new ways to solve problems \u2014 would be early adopters of LLMs. Code is a language, albeit an abstract one. And generative AI is trained in nearly all of them, including older ones like Cobol.<\/p>\n That doesn\u2019t mean they accept all of its suggestions. Willison thinks the best way to see what a new model can do is to ask for something unusual. He likes to request an svg (an image made out of lines described with code) of a pelican on a bike and asks it to remember the chickens in his garden by name. Results can be bizarre. One model ignored his prompts in favour of composing a poem. <\/p>\n Still, his adventures in vibe coding sound like an advert for the sector. He used Anthropic\u2019s Claude Code, the favoured model for developers, to make an OCR (optical character recognition \u2014 software loves acronyms) tool that will copy and paste text from a screenshot. He wrote software that summarises blog comments and has plans to build a custom tool that will alert him when a whale is visible from his Pacific coast home. All this by typing prompts in English. It\u2019s sounds like the sort of thing Bill Gates might have had in mind when he wrote that natural language AI agents would bring about \u201cthe biggest revolution in computing<\/a> since we went from typing commands to tapping on icons\u201d.\u00a0\u00a0<\/p>\n But watching code appear and knowing how it works are two different things. My efforts to make my own comment summary tool produced something unworkable that gave overly long answers and then congratulated itself as a success.<\/p>\n Willison says he wouldn\u2019t use AI-generated code for projects he planned to ship out unless he had reviewed each line. Not only is there the risk of hallucination but the chatbot\u2019s desire to be agreeable means it may say an unusable idea works. That is a particular issue for those of us who don\u2019t know how to edit the code. We risk creating software with inbuilt problems. <\/p>\n It may not save time either. A study published in July by the non-profit Model Evaluation and Threat Research assessed work done by 16 developers \u2014 some with AI tools, some without. Those using AI assumed it had made them faster. In fact it took them nearly a fifth longer<\/a>.\u00a0\u00a0<\/p>\n Several developers I spoke to said AI was best used as a way to talk through coding problems. It\u2019s a version of something they call rubber ducking (after their habit of talking to the toys on their desk) \u2014 only this rubber duck can talk back. As one put it, code shouldn\u2019t be judged by volume but success in what you\u2019re trying to achieve. <\/p>\n Progress in AI coding is tangible. But measuring productivity gains is not quite as neat as a simple percentage calculation.<\/p>\n