Pushes never come from the LLM, which can be easily seen by feeding the output of two LLMs into each other. The conversation collapses completely.
Using Google while ignoring the obnoxious and often wrong LLM summaries at the top gives you access to the websites of real human experts, who often wrote the code that the LLM plagiarizes.
Then they'll change their mind to their original answer when you tell them "I wasn't disagreeing with you". Honestly, it's amusing, but draining at the same time.
It's surprisingly good at reading my entire code, reading my assumptions of the code, and explaining what I'm getting wrong and how to fix it.
So no, they are not using the same version of Google.
I'm completely drained after 30 minutes of browsing Google results, which these days consist of mountains of SEO-optimized garbage, posts on obscure forums, Stackoverflow posts and replies that are either outdated or have the wrong accepted answer... the list goes on.
Second, it doesn't do well at all if you give it negative instructions, for example if you tell it to: "Don't use let! in Rspec" , it will create a test with "let!" all over the place.
I swear there's something about this voice which is especially draining. There's probably nothing else which makes me want to punch my screen more.
PS: Both humans and llms are hard to align. But I do have to discuss with humans and I find that exhausting. llms I just nudge or tell what to do
I find myself often discussing with an LLM when trying to find the root cause of an issue I'm debugging. For example, when trying to track down a race condition I'll give it a bunch of relevant logs and source code, and the investigation tends to be pretty interactive. For example, it'll pose a number of possible explanations/causes, and I'll tell it which one to investigate further, or recommendations for what new logging would help.
Often I find it easier to just do it myself rather than list out a bunch of changes. I'll give the LLM a vague task, it does it and then I go through it. If it's completely off I give it new instructions, if it's almost right I just fix the details myself.
So we are close to an AI president.
By that I don't mean necessarily the nominal function of the government; I doubt the IRS is heavily LLM-based for evaluating tax forms, mostly because the pre-LLM heuristics and "what we used to call AI" are probably still much better and certainly much cheaper than any sort of "throw an LLM at the problem" could be. But I wouldn't be surprised that the amount of internal communication, whitepapers, policy drafts and statements, etc. by mass is probably already at least 1/3rd LLM-generated.
(Heck, even on Reddit I'm really starting to become weary of the posts that are clearly "Hey, AI, I'm releasing this app with these three features, please blast that out into a 15-paragraph description of it that includes lots of emojis and also describes in a general sense why performance and security are good things." and if anything the incentives slightly mitigate against that as the general commenter base is starting to get pretty frosty about this. How much more popular it must be where nobody will call you out on it and everybody is pretty anxious to figure out how to offload the torrent-of-words portion of their job onto machines.)
As in, copied it with a prompt in.
Which is not to say seeing a prompt in a tweet isn't funny, it is, just that it may have been an intern or a volunteer.
"I went to work early that day and noticed my monitor was on, and code was being written without anyone pressing any keys. Something had logged into my machine and was writting code. I ran to my boss and told him my computer had been hacked. He looked at me, concerned, and said I was hallucinating. It's not a hacker, he said. It's our new agent. While you were sleeping, it built the app we needed. Remember that promotion you always wanted? Well, good news buddy! I'm promoting you to Prompt Manager. It's half the money, but you get to watch TikTok videos all day long!'"
Hard to find any real reassurance in that story.
Prompt engineering is like singing: sure thing everyone can physically sing… now whether it’s pleasant listening to them is another topic.
It can bounce back over time and maybe leave us better off than before but the short term will not be pretty. Think industrial revolution where we had to stop companies by law from working children to literal death.
Whether the working man or the capital class profits from the rise of productivity is a questions of political power.
We have seen that productivity rises do not increase work compensation anymore: https://substack.com/home/post/p-165655726
Especially we as software engineers are not prepared for this fight as unions barely exist in our field.
We already saw mass layoffs by the big tech leaders and we will see it in smaller companies as well.
Sure there will always be need for experienced devs in some fields that a security critical or that need to scale but that simple CRUD app that serves 4 consecutive users? Yeah, Greg from marketing will be able to prompt that.
It doesn't need be the case that prompt engineers are paid less money, true. But with us being so disorganized the corporations will take the opportunity to cut cost.
You can fight without unions. Tell the truth about LLMs: They are crutches for power users that do not really work but are used as excuses for firing people.
You can refuse to work with anyone writing vapid pro-LLM blog posts. You can blacklist them in hiring.
This addresses the union part. It is true that software engineers tend to be conflict averse and not very socially aware, so many of them follow the current industry opinion like lemmings.
If you want to know how to fight these fights, look at the permanent government bureaucracies. They prevail in the face of "new" ideas every 4 years.
Search youtube for "yes minister" :)
-----
On topic, I think it's a fair point that fighting is borderline useless. Companies that don't embrace new tech will go out of business.
That said, it's entirely unclear what the implications will be. Often new capabilities doesn't mean the industry will shrink. The industry haven't shrunk as a result of 100x increase in compute and storage, or decrease in size and power usage.
Computers just became more useful.
I don't think we should be too excited about AI writing code. We should be more excited about the kinds of program we can write now. There is going to be a new paradigm of computer interaction.
And you can fly without wings--just very poorly.
Unions are extremely important in the fight of preserving worker rights, compensation, and benefits.
You can fight without an army too, but it's a lot less effective. There is strength in numbers. Corporations know this and they leverage that strength against their employees. You all alone vs. them is exactly how they like it.
This works only if everyone is on with this. If they're not, you're shooting yourself in the foot while doing job hunting.
lol, good luck with that.
you thinking that one or two people doing non organized _boycott_ is the same thing as an union tell a lot about you.
Didn’t Greg-from-marketing’s life just get a lot better at the same time?
This all assumes that such revolutions are built on resiliency and don't actually destroy the underpinning requirements of organized society. Its heavily skewed towards survivor bias.
Our greatest strength as a species is our ability to communicate knowledge, experience, and culture, and act as one large overarching organism when threats appear.
Take away communication, and the entire colony dies. No organization can occur, no signaling. There are two ways to take away communication, you prevent it from happening, or you saturate the channel to the Shannon Limit. The latter is enabled by AI.
Its like an ant hill or a bee hive where a chemical has been used to actively and continually destroy the pheromones the ants rely upon for signalling. What happens? The workers can't work, food can't be gathered, the hive dies. The organism is unable to react or adapt. Collapse syndrome.
Our society is not unlike the ant-hill or bee hive. We depend on a fine balance of factors doing productive work and in exchange for that work they get food, or more precisely money which they use to buy food. Economy runs because of the circulation of money from producer to factor to producer. When it sieves into fewer hands and stays there, distortions occur, these self-sustain and then eventually we are at the point where no production can occur because monetary properties are lost under fiat money printing. There is a narrow working range where outside the range on each side everything catastrophically fails. Hyper-inflation/Deflation
AI on the other hand eliminates capital formation of the individual. The time value of labor is driven to zero. There is a great need for competent workers for jobs, but no demand because no match can occur; communication is jammed. (ghost jobs/ghost candidates)
So you have failures on each end, which self-sustain towards socio-economic collapse. No money circulation going in means you can't borrow from the future through money printing. Debasement then becomes time limited and uncontrollable through debt traps, narrow working price range caused by consistent starvation of capital through wage suppression opens the door to food insecurity, which drives violence.
Resource extraction processes have destroyed the self-sustaining flows such that food in a collapse wouldn't even support half our current population, potentially even a quarter globally. 3 out of 4 people would die. (Malthus/Catton)
These things happen incredibly slowly and gradually, but there is a critical point we're about 5 years away from it if things remain unchanged, there is the potential that we have already passed this point too. Objective visibility has never been worse.
This point of no return where the dynamics are beyond any individual person, and after that point everyone involved in that system is dead but they just don't know it yet.
Mutually Assured Destruction would mean the environment becomes uninhabitable if chaos occurs and order is lost in such a breakdown.
We each have significant bias to not consider the unthinkable. A runaway positive feedback system eventually destroys itself, and like a dam that has broken with the waters rushing towards individuals; no individual can hold back those forces.
Every time things turn bad a lot of people jump out and yell it is the end of the tech. They have so far been wrong. Only time will tell if they are right this time, though I personally doubt it.
Software development has a huge barrier to entry which keeps the labor pool relatively small, which keeps wages relatively high. There's going to be a way larger pool of people capable of 'prompt engineering' which is going to send wages proportionally way down.
My wife knows how to prompt chatgpt, but she wouldn't be able to create an app just by putting together what the llm throws at her. Same could be said about my junior engineer colleague; he knows way more than my wife, sure, but he doesn't know what he doesn't know, and it would take a lot of resources and effort for him to put together a distributed system just by following what an llm throws at him.
So, I see the pool of potential prompters just as the pool of potential software engineers: some are good, some are bad, there will be scarcity of the good ones (as in any other profession), and so wages don't necessarily have to go down.
The size of the pie is nowhere near fixed, IMO. There are many things which would be valuable to program/automate, but are simply unaffordable to address with traditional software engineering at the current cost per unit of functionality.
If AI can create a significant increase in productivity, I can see a path to AI-powered programming being just as valuable as (and a lot less tedious than) today.
For a more realistic example - the software side at many companies essentially is the company. They bring products all the way from inception to launch. Yet they tend to get paid less, often much less, than the legal side. The reason is simply that the labor pool for lawyers is much smaller than for software engineers.
If there's not significant barriers to entry for prompt engineering, wages will naturally be low.
It objectively takes less expertise and background knowledge to produce semi-working code. That lowers the barrier to entry, allowing more people to enter the market, which drives down salaries for everyone.
But jobs that look easy or approachable are in a much tighter spot. Regardless of how difficult they actually are, people are far less willing to give them large amounts of money. Pretty much all the more artistic jobs fall into this camp. Just because any idiot can open up Photoshop and start scribbling, it doesn't follow that competent graphic design is easy.
Right now, software development is incidentally in the "looks hard is hard" category, because the reason it "looks hard" is entirely divorced from the reason it is hard. Most of the non-tech population is under the obviously (to us) incorrect impression that the hard part of programming is understanding code. We know that that's silly, and that any competent programmer can pick up a new programming language in a trivial amount of time, but you still see lots of job postings looking for "Java Developers" or "Python Developers" as opposed to actual domain specific stuff because non-technical folk look at a thing they know is complicated (software development) see the first thing that they don't understand (source code) and assume that all the complexity in the space is tied up in that one thing. This is the same instinct that drives people to buy visual programming systems and argue that jargon needs to be stripped out of research papers.
The shift over to plain-language prompt engineering won't solve the underlying difficulty of software development (requirement discovery, abstract problem solving), but it does pose the threat of making it look easy. Which will make people less prone to giving us massive stacks of money to write the magic runes that make the golems obey their commands.
I think that the spread of capability and effectiveness between the best and mediocre will continue to be several factors and might even increase as compared to today.
I can’t see any way it would be less than 2x.
i think you got the analogy wrong. Not everyone can sing professionally, but most people can type text into a text-to-speech synthesis system to produce a workable song.
I supposed because every new job title that has come out in the last 20+ years has followed the same approach of initially the same or slightly more money, followed by significant reductions in workforce activities shortly thereafter, followed by coordinated mass layoffs and no work after that.
When 70% of the economy is taken over by a machine that can work without needing food, where can anyone go to find jobs to feed themselves let alone their children.
The underlying issues have been purposefully ignored by the people who are pushing these changes because these are problems for next quarter, and money printing through non-fraction reserve banking decouples the need to act.
Its all a problem for next quarter, which just gets kicked repeatedly until food security becomes a national security issue.
Politician's already don't listen to what people have to say, what makes you think they'll be able to do anything once organized violence starts happening because food is no longer available, because jobs are no longer available.
The idiots and political violence we see right now is nothing compared to what comes when people can't get food, when their mindset changes from we can work within the system to there is no out only through. When existential survival depends on removing the people responsible by any means, these things happen, and when the environment is ripe for it; they have friends everywhere.
UBI doesn't work because non-market socialism fails. You basically have a raging fire that will eventually reach every single person and burn them all alive, and it was started by evil blind idiots that wanted to replace human agency.
it would have been funnier if the story then took a turn and ended with it was the AI complaining about a human writing code instead of it.
I fear this will be more and more of a problem with the TikTok/instant gratification/attention is only good for less than 10 seconds -generation. Deep thinking has great value in many situations.
"Funnily" enough, I see management more and more reward this behavior. Speed is treated as vastly more important than driving in the right direction, long-term thinking. Quarterly reports, etc etc.
Yes, it's supportive and helps you stay locked in. But it also serves as a great frustration lightning rod. I enjoy being an unsavory person to the LLM when it behaves like a buffoon.
Sometimes you need a pressure release valve. Better an LLM than a person.
P.S: Skynet will not be kind to me.
Don't people realize it's a machine "pretending" to be human?
I’ll stick to human emotional support.
With LLM it’s speed - seconds rather than the minutes or hours as per stack overflow which is main benefit.
There have been several personal projects that have been on the back-burner for a few years now that I would implement about 20% of, get stuck and frustrated, and give up on because I'm not being paid for it anyway.
With ChatGPT, being able to bounce back and forth with it is enough to unblock me a lot of the time, and I have gotten all my projects over the finish line. Am I learning as much as I would if I had powered through it without AI? Probably not, but I'm almost certainly learning more than I would had I given up on the project like I usually do.
To me, I view ChatGPT as an "intelligent rubber duck". It's not perfect, in fact a lot of the time time the suggestions are flatout wrong, but just being able to communicate with something that gives some input seems to really help me progress.