MIDREAL
Menu

All AI-generated code should be Open Source

https://jakub.jankiewicz.org/blog/ai-code-open-source/ (jakub.jankiewicz.org)

1220 points | 6d ago | Discuss on Hacker News | Back to Radar

Comments

ubercow13 6d ago on HN
If AI generated code is not copyrightable, releasing it under an open source license is meaningless.
zulban 6d ago on HN
I'm not sure you understand all the things that an OSS license does. For example: liability.
ubercow13 6d ago on HN
Maybe not, could you explain?
g-b-r 6d ago on HN
Releasing it for sure is meaningful
dboreham 6d ago on HN
Under those conditions it would be un-licensable (since a license is essentially an agreement not to sue for copyright infringement) but it can still be made open by publication. I'm skeptical that the "anything that comes out of AI can't be copyrighted" argument will end up holding, but in the meantime it provides a strong incentive not to make that code public.
sturza 6d ago on HN
What’s the point, if you can generate infinte code?
pasquinelli 6d ago on HN
couldn't you always generate infinite code? just write more of it. but what open source lets you do is read the code for a particular piece of software, to see what it actually does. generating infinite code has nothing to do with that.
sturza 6d ago on HN
you could also do this before, but only with infinite time. open source value is shifting. open source is human-validated code. just OSSing generated code has no value.
pasquinelli 5d ago on HN
so ai can generate code so fast it can make infinite code in finite time!?
sturza 2d ago on HN
i feel you’re stuck at the word “infinite” and missed my point.
cyanydeez 6d ago on HN
agreed. The problem is _which_ open source, because what we're probably going to slowly realize is most software will now be a public good and proper governance is needed thats indistinguishable from a public utility.

But we're not headed in that direction are we.

g-b-r 6d ago on HN
Even if you modify it before using it, it's still based on open source (often GPL) code, so just everything based in part on LLM output should be open source.
sicher 6d ago on HN
I mostly agree and have pretty much every one of my projects open source. One in particular, though, is not. And that is because the design of it is heavily domain specific and is built on loads and loads of experience. Not sure how to reconcile that...
regularfry 6d ago on HN
There's a difference between something being released as open source and something that never gets released at all. Open source or not only becomes relevant when making the binary available to other people.
sicher 6d ago on HN
Yes, but the one project I'm excluding from open source may be one I sell to companies - we'll see.
delichon 6d ago on HN
> First of all, AI models were trained on a massive corpus of Open Source code written since RMS announced the GNU Project and the Free Software Movement.

I too have trained on the massive corpus of open source code. Should everything I code also be open source? Or only if I leverage an artificial neural network as a prosthesis to enhance the capabilities of my natural neural network?

brunoarueira 6d ago on HN
Makes sense, many of the programming languages are open source, other novelty things were released as open source aswell, we as programmers/software engineers does a bunch of our solutions based on public code or under Creative Commons.

What I agree with the post is specific licenses require us some specific requirements like release the code if it's a derivation of prior work!

written-beyond 6d ago on HN
I'm tired of these child like responses from adult professionals in this industry. Do you argue just for the sake of arguing? No, your exposure to opensource code wasn't "massive" and you are clearly smart enough to know this but you had this make this comment as rage bait.
eddieroger 6d ago on HN
An entire generation of web developers learned by viewing the source of webpages they visited at a time when HTML and JavaScript were still nascent. I don't think setting the bar for "massive" is the way to win this argument. It's valid because the biggest difference between an LLM reading Stack Overflow and remembering content and me finding answers there and learning something is that the LLM can do it much, much faster.
written-beyond 6d ago on HN
The difference is, just as a child doesn't need to consume the entirety of a language before being able to communicate with said language, a human developer doesn't need to consume all of Stack Overflow, Open source projects etc. in order to start producing functional work.
tock 6d ago on HN
A child or a human developer cant do all the thousands of different things an LLM can do either.
written-beyond 6d ago on HN
Do you people understand that my comment was about the parent commenter exaggeration on how they were "trained" on a "massive (OSS) corpus"? I'm sorry I hurt your sacred cow by implying LLMs need stupid amounts of data.
tock 6d ago on HN
LLMs need stupid amounts of data because they do stupid amounts of things.
antonvs 6d ago on HN
So if future models are able to generalize better from much smaller amounts of data, you think that all the current concerns disappear? It doesn’t seem like a very good argument if it’s purely based on the amount of data needed to train a model.

What matters are things like where the data comes from, how similar the output is to the input, how close the result is to existing (copyrighted) work, and so on.

Simply using copyrighted work, even all copyrighted work, to train a model doesn’t, by itself, trigger any legal consequences. In that respect at least, the comment you called “child like” was correct.

written-beyond 6d ago on HN
My comment was simply about the parent comments exaggerated claim. I do believe it should have some consequences, what those should be I am not qualified to decide.
eddieroger 6d ago on HN
I'm confused - I thought you said the response was child-like, not that a child can do the work. I'm not advocating that an LLM has child's level of experience, just that humans learns how to do things from looking at previously done work, so why is that not an allowed method for an artificial intelligence? How else is it supposed to learn?

This also ignores all of the great artists who learned by sitting at the feet of other great artists. Sometimes they extend the art of their teachers, sometimes they diverge.

g-b-r 6d ago on HN
No, because open source licenses don't cover that, and artificial neural networks are very different from your "natural neural network".

You're also unlikely to output what you trained on verbatim.

bakwan44 6d ago on HN
I have learnt to read by training on a lot of books, I should then open source all future things I write. I've learnt to walk by watching other people, I probably should publish videos of me whenever I walk.
lelanthran 6d ago on HN
> I too have trained on the massive corpus of open source code. Should everything I code also be open source?

Humans get rights. Tools don't. Are you claiming that you're not a human, but only a tool?

delichon 6d ago on HN
I'm claiming that my tools are extensions of me and parts of me. My freedom of expression should include the use of my arms, legs, printing press and language models.
postalrat 6d ago on HN
Unfortunately for you I created an algorithm that can generate all possible code, text, image, etc.
lelanthran 6d ago on HN
> I'm claiming that my tools are extensions of me and parts of me.

Nevertheless, tools don't get rights, only humans do.

Even when the tool is an automatic tool, it still doesn't get the same rights as humans do.

Your tool does not automatically get the same rights as humans.

I say this because it is nonsensical comparing human-learning with tool-learning, and claiming that there is no difference.

You get the right to own property. Your tool does not.

You get the right to form associations with anyone. Your tool does not.

You get the right of expression. Your tool does not.

There needs to be a logical argument for why your tool should get a right reserved only for humans, animals, etc.

viraptor 6d ago on HN
Doe v. GitHub already decided (I'm simplifying, read the actual thing yourself) that LLM output is not automatically open source - or specifically it doesn't infringe on the open source training material and doesn't inherit the oss copyright notice.

Thaler v. Perlmutter (again simplified) showed 100% AI output can't be given any copyright.

The directions the current cases are going are very much opposed to that idea and I wouldn't expect things to change in the opposite direction.

echelon 6d ago on HN
AI generated art with human steering is copyrightable [1,2].

Agentic code development is human steering, thus copyrightable under the same grounds per the language used by the US Copyright Office.

Open source code is copyrighted, otherwise we would be talking about public domain.

When you edit something in the public domain to enrich it, that derived work then becomes copyrightable again.

[1] https://journals.law.harvard.edu/jsel/2025/03/u-s-copyright-...

[2] https://news.artnet.com/art-world/invoke-snags-first-ai-imag...

---

Edit: open source software itself has only been lightly tested in court. But that isn't even my point here.

The US Copyright Office has assigned copyright to works that leveraged AI. The USCO stated,

> “[we] decided to register a copyright claim in [the] work because we find that it contains a sufficient amount of human original authorship in the selection, arrangement, and coordination of the AI-generated material that may be regarded as copyrightable.”

Copyright office activity is orthogonal to litigation and the court system.

If a work receives a copyright, the courts will treat it differently if it becomes the subject of litigation.

Even open source license claims have not been fully litigated. We don't have to wait on the court to make certain assumptions.

viraptor 6d ago on HN
It's legally untested, so we can't be sure one way or the other. But people definitely seem to assume that's the case.
mapontosevenths 6d ago on HN
Every major corporation on earth is behaving as if it was. If/when it gets tested you can be sure that the pro-copyright side will be very, very well funded.
carllerche 6d ago on HN
I think most expect the courts will land on training AI on copyrighted works is fine, as long as the output of the LLMs is transformative enough to not violate the original copyright. Exactly the same as if a human learned on copyrighted material and outputted their own artifacts.
vkou 6d ago on HN
Why should we grant any human rights to a machine that's owned by a corporation?
viraptor 6d ago on HN
Because the ownership should be irrelevant to the ruling. There are people running their own LLMs (as in trained from scratch). And there are corporations doing the same thing. Adding edge cases for what law applies here depending on what is the type/size of the company would be extremely messy and likely not get you the result you want.
mapontosevenths 6d ago on HN
The same reason Ansel Adam's can copyright his works despite not having painted them by hand. The tool used to create something is less important than the creativity of the operator.
conartist6 6d ago on HN
There's still something dark at the center; a lawless viciousness to the new era.
unrented7977 6d ago on HN
You can't apply naïve transitive reasoning to law. Law is not code. Your assertions are meaningless and unsupported noise until they're actually tried in a court.
partloyaldemon 6d ago on HN
Was your assertion tried in court? legal reasoning is naïve transitive reasoning.
rookienumbers30 6d ago on HN
a statement *about* the legal system can be true without being litigated *in* the legal system. Courts rely on precedent in addition to logical argument, so their rulings cannot be deduced from rational argument alone.
echelon 6d ago on HN
I'm reporting on what the US Copyright Office is saying. Not the court system.
carllerche 6d ago on HN
The US copyright office is not the body that owns interpretation of the law though. They don’t determine in court if an artifact can be protected by copyright law.
echelon 6d ago on HN
The USCO is the regulatory and administrative authority and will inform the decisions of judges. They provide expert legal opinion that carries substantial weight.

It would be a surprising result for the courts to overturn the USCO. The courts routinely side with the USCO.

What the USCO is saying is a temperature check on how this will play out.

carllerche 6d ago on HN
fwiw, I suspect that a "low effort" AI-generated artifact will not be protected by copyright law. I suspect there will be a line somewhere, and it will be very unclear where it is. That said, I think it is important to be clear that this is uncharted territory, and while everything you said is true, the USCO does not establish precedent.

> It would be a surprising result

Yes, but also not the craziest thing the courts have ruled.

tkdb 6d ago on HN
This is very much still working it's way through the courts (in the US at least).

The first major precedent was in 2023 with Zarya of the Dawn comic book, where the US Copyright Office rules the midjourney-generated images were not protected, but the human-written text was.

The active front is Allen v. Perlmutter.

oakpond 6d ago on HN
It depends on the degree of human steering. Vibe slopped code is probably not copyrightable.
numpad0 6d ago on HN
People show completely opposite reactions to AI generated creative contents vs technical materials such as source codes and instruction manuals.

If you think about the distinction between those, it is often so considered that both are covered by copyrights, despite technical definitions of copyrights never covering mere technical resources, such as some computer programming things and instruction documents.

Only contents of artistic values are supposed to be covered by copyright laws.

IMO, what AI revealed is that most copyrighted software and documents are in fact not covered by copyright laws as per the naive model of it among common folks as well as legal text, as opposed to what precedents say. Code is not copyrightable.

I don't necessarily support that stance from practical standpoint, and I'd rather like everything be licensed under AGPLv3++ than entire concept of code copyright fall apart overnight, but this feels like the writings on the wall to me.

mr_toad 6d ago on HN
Your first cited article doesn’t necessarily support the idea that agentic code generation is copyrightable.

“A Single Piece of American Cheese sits between those contrasting poles: the initial image was created entirely by the AI program based on a brief text prompt, then the user repeatedly selected elements of the image and used additional prompts to add/alter elements.”

Agentic development is steadily reducing the necessity for human involvement in the final output.

mlaretallack 6d ago on HN
Remember that's in the US, most other places (UK etc..), it can be copyrighted.
viraptor 6d ago on HN
Unfortunately, even if other countries have different rules, the US service like GitHub still has to follow the US law and DMCA.
graemep 6d ago on HN
People who upload or download code from a US service also have to follow the law in their own countries.

Github also has to follow the law in any country where it allows usage of its services. Not all countries can enforce that but anywhere it operates or has enough paying customers can

redwall_hp 6d ago on HN
I doubt that would hold the test of time, and any ruling that way will be overturned. The Berne Convention leaves what constitutes "authorship" as an exercise to the signatories, but the US probably has a lower standard.

US: "a modicum of creativity"

EU and UK: "the author's own intellectual creation"

If a court ruled in favor of AI authorship, that can't reconcile with the existing standard or with international treaties, and will likely not stand.

WaitWaitWha 6d ago on HN
They will just claim the code is trade secret and use Defend Trade Secrets Act (DTSA).

And, the DTSA has only two reqs:

derive independent economic value from not being generally known or readily ascertainable by others, and the "owner" takes reasonable measures to maintain their secrecy (e.g., coke secret sauce).

since trade secret law does not prevent independent development or lawful reverse engineering, there are still opportunities. also, if a someone independently devs the same functionality, trade secret generally does not give them original dev ownership of that functionality. so, win.

Artcraft will be a good test case if Adobe goes after Brandon Thomas.

Much to be developed.

(and, this is why we keep extensive commit and development records outside of our genAI - ie provenance tracking)

mr_toad 6d ago on HN
Unless you only use the code in-house and never distribute I don’t see how you could argue that it’s a secret?
carllerche 6d ago on HN
That is not the Thaler v. Perlmutter conclusion. That case was about whether the machine itself could be made an author under copyright law. That is very different than whether AI output can be protected by copyright law. I am not aware of any cases that test that question yet.
jph 6d ago on HN
I agree with the spirit of this. I'm a longtime open source developer and generally prefer GPL for my manual code. For my AI-generated code I'm using a multiple choice license of Apache, BSD, GPL, MIT.

If you're curious, here's my newest open source which helps build Rust web services along with Axum: https://github.com/publicprojects-io/axa and you can see the LICENSE.md file.

Pannoniae 6d ago on HN
This post is so close to getting it ;)

Looks like the author wants to abolish copyright in a very round-about way. They are saying that AI-generated code should be released under CC0 due to complexities around the status of software copyright in various jurisdictions.

But if the concept of copyright was abolished as a whole, then licences such as GPL would also lose their power. Some people say that's a negative thing, but I do not necessarily think so, because it achieves the stated goal of the GPL, software freedom (i.e. you don't need to be granted a licence to copy and modify things)

singpolyma3 6d ago on HN
I mostly agree with you, but public domain licensing doesn't get us software freedom by itself if the source code is not available.

OTOH as models get better at RE it may become moot.

jonathanstrange 6d ago on HN
No, the four freedoms rely on copyright. If there is no copyright, any company can take the open source code, modify it as they like, and never give back the modifications to anyone. It's the equivalent of an MIT license (technically, it's more like public domain but let's ignore this detail here). That's fine for many but far from the goals of the GPL.

No copyright doesn't mean you can't keep your source code a tightly kept business secret. You can even combine it with NDAs and contracts to re-institute something akin to copyright.

cozzyd 6d ago on HN
no because nobody is required to release the source code of their derivative work absent a license like GPL that requires you to do it.
Vaslo 6d ago on HN
My patterns for loading data into Python is pretty much the same everytime with polars. I didn’t create that - I looked it up from a book somewhere. Do I need to open source it?

The AI machine just went out and read a bunch of examples then adapted them, which is what lots of programmers do.

wolttam 6d ago on HN
There is so little value to most code produced with models these days I just don’t see the point.

The real value ends up being found in software where there is a person behind it continuously refining it into something others will look at and say “Someone clearly paid attention to this.” Models can’t (yet) reproduce that because they can’t/don’t go interacting with users or asking bigger picture questions.

Whether someone is producing that software with a model or not doesn’t change much about the ownership picture to me: it’s the person that owns the project, and the LLM is a tool.

Once again, it all comes down to it being a tool and how it’s used, and there are no useful blanket statements that can be made about it (or how the tool’s output should be classified, legally or otherwise)

bajard 5d ago on HN
>There is so little value to most code produced with models these days I just don’t see the point.

We had only seen the Ford T of AI. Next week, we will find the McLaren F1 or the Pagani Huayra.

wolttam 5d ago on HN
And there will still be almost no value to the code that the Pagani Huayra-class model produces because it will produce it again (and again, and again) for anybody that asks.

It will be the model that's valuable, not the code it produces

dava96 6d ago on HN
Whilst the first training sets would have used Stack overflow and open source projects.

I have my suspicions that the AI companies have been using reverse engineering to gain more training data.

Ethics don't really concern these companies so...

When you have essentially infinite compute and are constantly looking for more training data. To me the next logical step is to start reversing compiled programs.

It could also explain why these AI models are so good at it too...

How do you copyright stolen material?

singpolyma3 6d ago on HN
Reverse engineering is legal so I'm not sure what you're trying to imply here
superkickstart 6d ago on HN
All 100% ai generated assets, art, music, text should be free and open source too.
rvz 6d ago on HN
The author needs to realize that this is unenforceable.

In fact I'd argue that free software and open source is economically dead and unsustainable because of AI generated code and almost no one wants to pay for their tools because an AI can generate the missing feature for them close to $0.

Maintaining it is another thing, but assuming that the cost of tokens get cheaper, why wait for open source developers to maintain it when a frontier AI model can do it for far cheaper and quicker?

I am just saying what the average manager turned vibe coder would say who will refuse to donate or pay for established open source projects that they use for free.

g-b-r 6d ago on HN
Is it unenforceable to check that a company openly all in on AI is releasing all the source code of their products?
rvz 6d ago on HN
They don't have to release anything and most of these companies don't care about openly violating the license terms even if they are caught.

Unless the license holder has a lot of money for litigation, it is unenforceable.

g-b-r 6d ago on HN
They don't "have" because they have more money?

You're free to take that bet, we'll see.

rvz 6d ago on HN
> They don't "have" because they have more money?

My point is, if you don't have a lot of money to start litigating against the violations, the opportunists don't care and will continue to trample all over your "free and open source" software.

It not enforceable without a lot of money and the opportunists know that.

> You're free to take that bet, we'll see.

There is nothing to bet here. Truth Social is a clone of Mastodon (AGPLv3) and all they did was disclose the vanilla source code and not the modifications which that is required by the license. [0]

The same happened with Revolt (AGPLv3) and Andrew Tate's platform [1] and they never released any of the source code at all, nor could the developer enforce anything. [1]

[0] https://help.truthsocial.com/legal/open-source/

[1] https://insrt.uk/post/andrew-tate-stealing-software-revolt/

g-b-r 6d ago on HN
Those cases are about going against the president, who has even the majority of the supreme court standing by him, and about a young guy against a company reportedly behind shell trusts, owned by someone with no concern for the law and important political ties.

I don't know if lawsuits were even attempted, but I wouldn't infer that open source licenses are unenforceable from those cases.

Anyhow, what do you mean that Truth didn't disclose the modifications? I saw that they didn't initially, than they complied with a request in 2024; but, yes, I see that it hasn't been updated since. Has someone tried to request the current source code?

ozgung 6d ago on HN
This means “all software should be Open Source unless written fully by humans”, which practically means almost all software in the near future, which is a terrible idea for multiple reasons.
g-b-r 6d ago on HN
Or practically means that much less software should be written with AI
ozgung 6d ago on HN
You say “should” which is an opinion. Legally you can’t enforce people to open source their software or never use AI.
g-b-r 6d ago on HN
Well, it's to be seen if you can't.
alexpadula 6d ago on HN
No you literally can't. Go outside a bit.
g-b-r 6d ago on HN
Great argument.
artursapek 6d ago on HN
There is still substantial human effort and R&D that goes into developing a complex code base with AI agents.
sneak 6d ago on HN
Why do people think that people receive the gift of open source software are somehow obligated as a result of receiving that gift?

Yes, it was trained on free software. Why does that mean my privacy should be invaded now if I distribute binaries I made?

unrented7977 6d ago on HN
Because instead of treating it as the gift it is, you're treating it as a service you are entitled to
spacedcowboy 6d ago on HN
I see you asserting that, I don't see him saying it...
feldrim 6d ago on HN
Privacy?
sneak 6d ago on HN
The privacy of the source code files on my disk that I made, same as any other private files on my computer that I made that I choose not to publish.
yipinwong 6d ago on HN
Articles like this promotes extreme views while we should be moderate on what should be OpenSource or not.

First of all, nobody must force OpenSource. Period. Second, such exterme views spawn extreme views in the opposite side.

Discussion is good, but this article is too draconian to be practical.

freeone3000 6d ago on HN
The current trend is for model output to be public domain, which is “more extreme”. Merely copyleft is not as extreme.
yipinwong 6d ago on HN
Trend don't mean shit unless enforced. You are free not to open-source it and got a choice.

- e.g. People use tax loopholes because certain areas are not enforced. The ever-true trend is to never use "immoral" loophoes but people still do.

The article claims the strict enforcement of making AI gen code as open-source, which is exterme AF.

Insimwytim 6d ago on HN

  nobody must force OpenSource
Right. Nobody must violate copyleft licences either!
blagie 6d ago on HN
I don't see extreme views in this article. When LLMs take creative content from copyleft code, the license says the output has to be copyleft. Otherwise, it's theft.

If LLMs weren't trained on AGPL/GPL/LGPL code, it'd be different. But they are.

yipinwong 6d ago on HN
They were trained on those lefty licenses.

Say you read those codes yourself and built same thing yourself but different code base. That's what AI is doing. Do you still enforce that open sourceness to those?

blagie 6d ago on HN
Depends on how I built it and why I built it.

Let's say someone reads Harry Potter, and writes a book about Larry Claymaker, a 13-year-old who goes off to a magical school called Pigpimples. The school has a chamber guarded by a lizard who speak in lizardspeak. And it continues like that. That's plagiarism and a copyright violation.

That's what AI is doing with my creative content, and the creative content of others.

The current copyright regime, which you appear brainwashed by, is a relatively recent invention designed to, in the language of the US Constitution: "To promote the Progress of Science and useful Arts, by securing for limited Times to Authors and Inventors the exclusive Right to their respective Writings and Discoveries."

It's not doing that anymore. Ergo, we need a new copyright regime.

yipinwong 5d ago on HN
Be it creative "writing" or music "productions", everyone take some from others. They are all built-on others.

I do agree blantly copying all functionalities of a software/service is "frowned upon" but not illegal. Taking some part of "ideas" is ok in all industries.

Copy rights do suck however. Imcumbents are too old and behind in times, and need some changes.

TZubiri 6d ago on HN
>First of all, nobody must force OpenSource.

No, GPL and copyleft licenses very much do and should force OpenSource by its nature. If someone uses GPL or AGPL and doesn't open source, they should be forced to Open Source.

yipinwong 6d ago on HN
Why do you think people are now getting around these lefty licenses by AI-reverse engineering code now?
ada-h00k 6d ago on HN
That’s not an extreme view. Anyone who uses software under a copyleft license should also release any derivatives under the same license. While this isn’t currently the case legally since the GPL was never written with the possibility in mind that LLMs might be trained on it in the future it still aligns with the spirit of the license.
the8472 6d ago on HN
Taking all of available human knowledge, knowledge that was published under limited licences, and commercializing all that already is a fairly extreme action. Merely arguing that perhaps the fruits of that harvest should also be available to the public doesn't seem that extreme.

IMO it'd be better if the weights themselves were considered public domain.

scotty79 6d ago on HN
> such exterme views spawn extreme views in the opposite side

The opposite side had exrtreme views for at least 4 decades. They publish stuff, cram it into your face with advertisement and demand purchasing a license for consuming it. And if you don't buy they want you to pay thousands of dollars or go to jail. That's as extreme as it goes. Eff them. Reverse engineer, clone and open source everything. There shouldn't be a single proprietary piece of published software left in use.

add-sub-mul-div 6d ago on HN
We already have a growing discoverability problem in many areas of content and throwing more slop into the mix is not the solution. This place for example has become a dumping ground for people, usually with no other activity here, to advertise their shovelware AI projects.
anself 6d ago on HN
Strongly disagree.

Just because AI was involved doesn’t mean significant human thought and effort didn’t go into the production of those artifacts.

My agentic software development loop requires heavy involvement of real-world feedback. The ratio is huge. 20 mins of agentic software coding against hours or days of testing, trying it out, real-world contact, thinking about what feature is next or what tweak would make it more usable, smooth, intuitive. That feedback is baked into the product. Forcing it to be open source steals all that time and effort for me, and takes from me the decision as to how and whether to open-source it. So you mean the code that I’ve agentically written to help manage my private financial affairs (on local models, for privacy) or my kids’ complicated school schedules must now be open sourced?

My manners begin to fail, so I’ll stop here.

jdiff 6d ago on HN
Thought production isn't copyrightable. Processes and procedures aren't copyrightable. Might get you a patent.
otabdeveloper4 6d ago on HN
> Just because AI was involved doesn’t mean significant human thought and effort didn’t go into the production of those artifacts.

Doesn't mean it did either. (99% of the time it didn't tho. Nobody reaches to a vibe code machine because they care or want to dedicate effort.)

PeterisP 6d ago on HN
US legal practice (e.g. https://en.wikipedia.org/wiki/Feist_Publications,_Inc._v._Ru....) is that "sweat of the brow" is irrelevant and the fact that something took significant effort doesn't mean that the product deserves copyright protection.

Furthermore, copyright protects only the expression, not the idea - reimplementing the same idea with "different words" has always been permitted under copyright law (patents may protect the idea, though).

Of course, the fact that it would lack copyright protection it doesn't implythat you have to do something with the code for management of your kid's schedules, just that if someone else somehow legally gets hold of it, the law won't prevent them from making and distributing copies or derived work.

ginsider_oaks 6d ago on HN
> Forcing it to be open source steals all that time and effort for me

You are the one "stealing" the time and effort of thousands of people who have written free and open source software. If the ratio really is so huge, then just cut out the small part that does all of the stealing.

> So you mean the code that I’ve agentically written to help manage my private financial affairs (on local models, for privacy) or my kids’ complicated school schedules must now be open sourced?

Open source licensing is only relevant when distributing the software, if you just use it privately it has no effect. You are not forced to make it public.

mirsadm 6d ago on HN
That would like require learning to code. No one wants to do that anymore.
lelanthran 6d ago on HN
> My agentic software development loop requires heavy involvement of real-world feedback. The ratio is huge. 20 mins of agentic software coding against hours or days of testing, trying it out, real-world contact, thinking about what feature is next or what tweak would make it more usable, smooth, intuitive. That feedback is baked into the product. Forcing it to be open source steals all that time and effort for me, and takes from me the decision as to how and whether to open-source it.

It doesn't need to be open-sourced: if it's legal to take an LLM that was trained on every other product in existence and use that LLM to produce clones of all those products, then it's legal to do the same to your product to.

So, go ahead and release. There'll be an open-source clone in no time if the product is any good at all.

In fact, if there are no clones, take that as direct feedback that you wasted your money on tokens - your product is so bad no one even wants it for the few dollars it will take to clone it.

bar8uyr 6d ago on HN
Using vibe coding as a crutch will likely not help you improve at writing code. If it has, you may find your code can be replaced by someone else vibe coding. Calling it an "agentic loop" may not change that.
rsoto2 6d ago on HN
Yeah, I worked hard to build a factory in a foreign country to make counterfeit handbags, why *shouldn't* i be able to profit off of them.

Nobody is asking you to open source your home app they are talking about corporations stealing code via LLM laundering for profit.

mrheosuper 6d ago on HN
> Forcing it to be open source steals all that time and effort for me

But you are fine with your LLM stealing effort from other people ?

sqreept 6d ago on HN
This is like saying: All humans who learned from open source code should only produce open source code.
yccs27 6d ago on HN
Humans aren‘t technology.
sqreept 6d ago on HN
But we are. The finest technology we know of.
sorrywhat 6d ago on HN
Open source people have had half a century to figure out how to make money with fairly little success (aside from a dozen or so very notable projects, and looking at all my AI slop, I don't see one of these hiding in there).

I don't particularly care about copyright or whatever ethical arguments yo may come up with -- I write code mostly for money, as do my competitors -- if you can figure out a way to stop them from using AI, I'm fine with not using it either. I'm fairly skeptical you can close Pandora's box though.

That aside, we may see more software going in a source-available direction -- either that or full cloud. Up until now being closed source was a competitive advantage, but now it's trivial to clone even fairly huge software suites, so that's less of a factor.

Having the source may also become a bigger advantage for regular users than before -- given they can now vibecode extensions/plugins, or customize the software more than what a config would personally allow. this probably wings the calculus away from a Photoshop-style license, and closer an Unreal Engine-style license.

Either that; or everything goes full cloud of course.

glitchc 6d ago on HN
The article contradicts itself.

It's important to remember that the purpose of the license is to allow the copyright owner to exercise their rights in a manner they deem fit. Even if they choose to give the code away, that choice is captured in the form of a specifically worded license (MIT, BSD, etc.).

This means that licenses exist because code is copyrightable in the first place, with the license governing the use of said copyright. If AI code is not copyrightable, then no license can govern it.

wiremine 6d ago on HN
> If AI code is not copyrightable, then no license can govern it.

This is the crux of the issue. A license controls usage of copyrighted intellectual property. Until the underlying copyright/ip issues are resolved, it seems a moot point to discuss licensing.

That said, if AI code is _not_ copyrightable, does it automatically go into the public domain? Or is there a third category?

TheOtherHobbes 6d ago on HN
The distinction is between creation and distribution.

Even if you accept that AI code isn't protected by copyright, code isn't public domain unless it's released. The legal issue would likely revolve around what 'released' means.

Code that runs on private servers isn't technically released. Code in web pages technically is.

But ultimately legal decisions decide to a large extent on who has the most money.

The frontier labs may eventually try to argue that they own the IP of all code, content, and inventions generated using their technology. That argument may or may not stand, and it's more likely to be over patent rights than plain copyright.

But there's a fair chance they'll try it once AI is unavoidably embedded in everyone's workflow.

redwall_hp 6d ago on HN
Copyright applies (or doesn't) from the moment of creation, as per international treaty in all Berne Convention signatory countries. Distribution is irrelevant. Otherwise the law wouldn't serve the original intent of preventing authors from being ripped off by publishers.

"Public domain" is a synonym for "copyright does not apply or no longer applies." There's nothing special about it beyond that.

Something that is public domain can also infringe upon a protected work and you can be liable for that. And something infringing, used internally by a business, could also come out in a legal discovery process.

hxugufjfjf 6d ago on HN
Maybe the Do What The F*ck You Want To Public License (WTFPL). Its a super-permissive open-source license that acts almost like a public domain dedication.
glitchc 6d ago on HN
> That said, if AI code is _not_ copyrightable, does it automatically go into the public domain? Or is there a third category?

It means that AI-generated code, including proprietary code, is not covered by the existing license mechanisms, including EULAs. Companies will of course handwave over this, but it would not surprise me if this is challenged in court at some point.

simoncion 6d ago on HN
> It's important to remember that the purpose of the license is to allow the copyright owner to exercise their rights in a manner they deem fit.

Just as it's important to remember that the purpose of regulations like copyright and patents are to promote the progress of science and the useful arts.

We're not locked in to a suicide pact with what the Founding Fathers decided back in the late 1700s. Congress can decide that all LLM-generated code is automatically covered by -say- the GPLv3, even if no one holds the copyright to it.

If the absence of a particular person to hold the copyright twists your knickers, you could go a bit further and -say- decide that the people of the United States collectively hold the copyright to all LLM-generated code that's generated by US people or entities, and that relicensing of a particular piece of LLM-generated code must be agreed to by every US citizen that was alive when that code was created.

wiremine 6d ago on HN
> even if no one company or person owns it.

Maybe, but I don't think there's any legal president for that, is there? Much of existing law is based on centuries of private property rights. I don't see any government undoing that... or at least, not quickly.

simoncion 6d ago on HN
> Maybe, but I don't think there's any legal president for that, is there?

  We're not locked in to a suicide pact with what the Founding Fathers decided back in the late 1700s. Congress can decide that all LLM-generated code is automatically covered by -say- the GPLv3, even if no one holds the copyright to it.
Article I, Section 8 of the Constitution and its various subsections pretty clearly gives Congress this power.
Joker_vD 6d ago on HN
The IP laws are a) not really modelled after material property rights; b) are quite much more recent than "centuries"; c) there is legal precedent for that, see e.g. the airplane-related patents being pooled in 1917 by the demand from the US government.
Joker_vD 6d ago on HN
> you could go a bit further and -say- decide that the people of the United States collectively hold the copyright

Was going to comment something similar; we do have concepts of "dominium eminens", and "escheated property", and "public domain", and many other similar ideas. If the people (through their representatives) decide on a certain property regime, it absolutely can be implemented even if it's different from the status quo.

glitchc 6d ago on HN
> We're not locked in to a suicide pact with what the Founding Fathers decided back in the late 1700s. Congress can decide that all LLM-generated code is automatically covered by -say- the GPLv3, even if no one holds the copyright to it.

I have no issue with changing the law. My comment is about the article and the author's misapplication of the law.

simoncion 6d ago on HN
> My comment is about the article and the author's misapplication of the law.

What parts of the six-paragraph Fine Article misapply the law? Be sure to quote and include the context surrounding the quoted section(s).

stale2002 6d ago on HN
I think it would be the part about how courts have a fairly strong status quo bias and aren't going to remake the entire economy overnight with completely unenforceable provisions.

What are they going to do confiscate the world's gamer GPUs that can run this stuff all locally?

It's completely ridiculous.

simoncion 5d ago on HN
> What are they going to do confiscate the world's gamer GPUs that can run this stuff all locally?

What? We're talking about compulsory software licensing. What are you on about?

stale2002 5d ago on HN
A compulsory license that requires all source code to be public isn't something that any Congress is going to pass and would get deadlocked and is also completely unenforceable.

The world isn't going to start releasing every piece of code they right with the current mandatory tools that they use and people would ignore the law anyway.

It's absurd and laws can't get passed anyone so congress is not going to do it.

stale2002 6d ago on HN
Nobody is going to interpret the laws that way. That's completely stupid.

Everyone is using AI generated code in all sorts of ways, and the idea that the courts are just going to say "nuh-uh. All existing use of AI code is illegal" is completely ridiculous.

Courts don't upend entire economies like that. This would be the remaking of the entire software industry overnight and it would be completely unenforceable.

I'm certainly not going to listen to any such ruling and will continue making code locally. As will basically every other software engineer in the industry.

simoncion 6d ago on HN
> Nobody is going to interpret the laws that way. That's completely stupid.

You're absolutely right! And a little more than two hours before you posted this comment, I posted this [0] one! Make sure to read the parent comment for the context... it's pretty important.

[0] <https://news.ycombinator.com/item?id=50507914>

stale2002 6d ago on HN
Gotcha, not really related to my point that the courts aren't going to completely remake the entire software industry over night and neither is congress.

That's absurd. It is a fantasy. Neither lawmakers or anyone else is going to remake the software economy.

simoncion 6d ago on HN
> Gotcha, not really related to my point that...

Your point was entirely off topic, and the retcon of your intention is weaksauce.

> It is a fantasy.

Reread the title of TFA.

> Neither lawmakers or anyone else is going to remake the software economy.

LLM-generated code is -when measured in regulatory timescales- brand new and is -according to boosters- "remak[ing] the software economy". The time to make new law and regulation to make it prosocial, rather than profoundly antisocial is _now_.

stale2002 6d ago on HN
So then no there isn't going to be a massive change in society?

> The time to make new law and regulation to make it prosocial, rather than profoundly antisocial is _now_.

Way too late for that dude. The entire industry has changed already. Nobody in any part of the government, pick whichever you want, is going to upend the economy.

The entire AI bubble that has been keeping the economy going is dependent on "let's just upend everything" not happening.

Nobody is going to have that economy destroying act on their record.

And I haven't even gotten into how congress is deadlocked and that you'd need to somehow convince Democrats, Republicans, AND Trump on this. It's not happening. It would be vetoed or filibustered or any number of blockers by 1 party or another.

Oh enforcement too!

What are you going to do, pry these local gaming GPUs from everyone's homes?

It's not happening. All of this will be run locally if needed. How in the world can you stop people like me from doing what I want with a personal GPU like wtf are you talking about.

simoncion 5d ago on HN
> What are you going to do, pry these local gaming GPUs from everyone's homes?

I suppose you're a bot run amok or a human paid far too little to care. [0] The topic is:

  We're not locked in to a suicide pact with what the Founding Fathers decided back in the late 1700s. Congress can decide that all LLM-generated code is automatically covered by -say- the GPLv3, even if no one holds the copyright to it.
[0] Nearly your entire comment is -as the lawyers might say- nonresponsive, but the bit I quote makes this fact especially obvious.
stale2002 5d ago on HN
Yeah, so, my points stands here, your proposed licensing scheme will not be able to prevent anyone from making code on their local GPUs and would be completely unenforceable.

And no government anywhere is going to make massive licensing changes to screw up the economy.

And there are vetoes and a deadlocked congress. Congress will not pass anything at all like this because of the deadlock.

People will just ignore the license and keep stuff on their local GPUs and computers, and the government isn't going to do anything about it nor do anything even close to these changes that would destroy the tech economy.

mbgerring 6d ago on HN
This is the way
g-b-r 6d ago on HN
Code without a copyright can generally be distributed and put in the pubic domain, and I wouldn't bet that the few existing court decisions won't be reversed.

But, the license reflects the rights that a copyright owner granted you; I don't see why laundering copyrighted material with training a model should remove the limitations on the material's usage that the author established.

So, while it makes sense to not be able to attach whatever copyright you want to LLM output, if it's the result of training on copyrighted code, the extent to which you're allowed to use it should be the intersection of the rights granted to you by that code's copyright owners.

It should thus carry a license that reflects the intersection of those rights.

What makes it much worse is that the model trainers don't tell you what specific sources determined the output, so you should probably just assume that it's the result of its whole training, and the only rights you have are those granted you by all the authors of the training material; and, this in all likelihood means no rights, for most LLM models in use now.

mr_toad 6d ago on HN
LLMs are mostly trained on works that are not open source, by your own argument any LLM generated work couldn’t be open sourced.
g-b-r 6d ago on HN
Couldn't be used at all, rather
moneybunny 6d ago on HN
If you put your code online just assume it's gonna get stolen and you'll never see a penny
singpolyma3 6d ago on HN
You mean copied? I assume the purpose of putting it online is so it can be copied
sashank_1509 6d ago on HN
I strongly agree. Look at what we’ve done here:

1. Software had a strong movement of freely sharing all code because they believed this technology was too important to be controlled by corporations.

2. AI companies managed to create millions of RL environments from GitHub PR’s and similar, and train their model to learn what it means to code from all the human labour in the world from the past 30 or so years.

3. Companies now use these closed source AI models, to automate and fire their human workers who enabled this.

Something has gone seriously wrong here, whether this falls under copyright or not is besides the point.

We weaponized a fundamentally good instinct that generated a lot of value for society and allowed corporations to rent seek on all the data these humans generated to help other humans not trillion dollar corporations.

“Well we’ll give them a UBI check”, the AI company says which is a complete non-sequitur. It’s not about the money, most of us have saved enough.

The only solution that sounds good to me, is a model trained on Open Source Data must be Open Source and all the code it generates must also be open source. This is the only way to stop the coming rent seeking. Even mathematicians will be happy with this change!

achierius 6d ago on HN
I agree with you on most things but man

> It’s not about the money, most of us have saved enough.

This is incredibly detached from reality. Most software engineers care more about money than they do about abstract notions of software from. Most certainly have not saved enough.

sashank_1509 6d ago on HN
Fair enough, Im talking about Bay Area software engineers, most of whom have saved enough. Maybe not enough to live in the Bay Area whose house prices keep increasing with no end in sight, but plenty for elsewhere in the US (or the world) for that matter.
blagie 6d ago on HN
I am the author of multiple AGPL systems, many in mainstream use. Early LLM models would spit out my code almost verbatim. Modern systems borrow heavily on the creative design of those systems.

One company first pirated my AGPL code (e.g. shipped it without my name, copyright notices, source availability, etc.). I sent them violation notices. After many months of fighting, they had an LLM clone the system. The LLM clone feels:

a) Buggy and bad compared to my code

b) Still, like it's basically my creative content

It's as if you asked an LLM to rewrite Harry Potter, with the same plot, but bad dialogue.

m00dy 6d ago on HN
Can an LLM write unseen plots with a greater dialogue ?
moritzwarhier 6d ago on HN
If the plots are "unseen", then to what are you comparing the "greater" dialogue?

A book with a different plot? That would be obviously unrelated to the comment you're replying to?

Forgeties79 6d ago on HN
I agree their phrasing is a little strange but I feel like the meaning is still clear. They are (I believe) saying that an LLM can’t generate anything other than facsimiles of existing content. It can’t actually explore novel ideas and branches, it can’t innovate and create on its own. Everything is inherently derivative yada yada, I don’t mean it in the usual “everything is derivative” way we often refer to when people make music and such. It can’t ideate and express something personal.

I think there’s a lot of nuance and caveats to that kind of claim, assuming I am representing them correctly, but it’s a valid stance and I see where they’re coming from.

basch 6d ago on HN
Seems like this might be true given current implementations but not ANY implementation of the technology.

If we’ve mapped all of English, there are still ways to construct stories that haven’t been told from the mapping. The most simple would be a subtraction of all objects minus all objects that have ever been used as a murder weapon. Leaving you with a list of never before used objects at your disposal.

There are also probably close vectors conceptually but not in semantic use. Or trying to interpolate or extrapolate what exists in voids of space. Turning up the temperature and adding random generation of words. There’s tons of ways to tune these things to be more creative than regurgitative.

Forgeties79 5d ago on HN
This is a very clinical approach to storytelling that I think makes it no longer art or creation. Writing is not just the mere assembly and reassembly of words in new and different orders. It’s about intent and communicating something one wants to say.
adrianN 6d ago on HN
All possible books live somewhere in L-space (ook). Exploring that space efficiently is equivalent to creativity. The claim is that the space that LLMs learn is somehow sufficiently limited that it doesn’t contain novel ideas? I never saw a convincing argument why LLMs output can not be considered creative.
moritzwarhier 6d ago on HN
OK, I still an confused about what point the extension of the analogy was trying to make, because I didn't consider the parent comment to be arguing for or against LLMs being able to be creative.
combobyte 6d ago on HN
But LLMs don't "explore" L-space, the training process just maps all of the available conceptual landmarks inside that space. There are still enormous (infinite?) tracts of unmapped territory that LLMs never reach, and that's exactly the space where novel ideas live.
hexasquid 6d ago on HN
I'm suddenly connecting unseen plots with Unseen University
hmokiguess 6d ago on HN
Mind sharing which repo that was?
rvz 6d ago on HN
You can see that even with these licenses, they do not care and see free and open source code as the freedom to not pay for it. As long as the cloned output is "good enough" they will continue to keep using LLMs to clone everything else regardless of the license.

They know you can't enforce it as it will cost you a lot more money to do that than it takes to recover the damages.

So to them, it is just cheaper to clone it using an LLM and close source it down. Unless you have a lot of money for litigation, the economics of free and open source software with its licenses do not work with LLMs bypassing it at every single angle.

harveymadeunico 6d ago on HN
I’m curious what programming languages was it for? And did they open source their version?

It’s interesting because these developments are actually an argument for making closed source software moving forward if you’re hand-crafting it make it the most restrictive license possible and don’t show the sources.

But I don’t agree with the OP everything should be open sourced. For instance, there’s a difference between deliberately steered AI work and something completely vibed. The former takes deliberation and creative choice, the latter will spit out fragments of prior art.

It’s the same with all generative work. Using diffusion models with controlNet (or equivalent) I can pass in a sketch wholly from my line drawings, and ask it to paint for me. That’s my design, assisted by AI, and should be completely copyright by me.

Coding agents will do the same thing when given sufficiently unique inputs. So, the claim all should be open sourced by default is flawed.

teiferer 6d ago on HN
> and don’t show the source

At this point, LLMs can just parse the machine code in your binary.

By doing closed source you are making it harder for the good guys (humans trying to learn sth or contribute) but not for the bad guys (LLMs getting trained or otherwise reading the code).

harveymadeunico 6d ago on HN
That’s fair but it takes deliberate reverse engineering to extract code from a closed binary, and you might land at something inferred, but generative AI is not being trained on reverse engineered assembly unless it is task-specific model being trained for that.

But you’re right, the fact is we simply live in a different world today and it’s tough to say what is the path forward.

But it’s harder to justify giving to the public when companies are making money on our work. It’s not a good situation for creators across the board unless motivations are purely altruistic.

teiferer 6d ago on HN
I'm not really sure that's how open source actually works. There may be cases where some lone hacker in a basement writes some code and then open sources it for the betterment of the world, but that could be rare cases. I'm mostly seeing bigger players getting business advantages out of this, real or at least envisioned. Cred with users, broader adoption, this kind of thing. And if I at my job find a bug in an open source package that annoys me then after fixing it I of course upstream it since I don't want to have the constant headache of maintaining an in-house diff. LLMs make that easier but it is even easier to send it upstream and forget about it.
harveymadeunico 5d ago on HN
Well most open source projects typically tout something beyond financial incentives. Sometimes it works for a business model too.

But we’re talking about the case where any AI can steal the code or be trained on it and derive something from it, changing the license for instance, even if the codes license prohibits commercial use.

I’m not sure anyone who creates open source software is okay with that, especially when using AGPL etc.

There are many cases of sole maintainers who don’t get compensation or even credit for work used by thousands of companies.

KronisLV 6d ago on HN
> After many months of fighting, they had an LLM clone the system.

Reads like a non-ironic version of Malus: https://malus.sh/

Forgeties79 6d ago on HN
People who haven’t had this happen to them really don’t understand what it feels like. It feels very violating. You almost don’t believe it’s happening when you see it. You’re essentially watching somebody pretend to be you.

I think that’s why so many of us get so angry when people just dismiss the theft claim. They either lack imagination or experience. We can debate it and that is valid, but to dismiss it out of hand is not right

bluefirebrand 6d ago on HN
> They either lack imagination or experience.

I think they just want to be able to take whatever they want without consequence, so it's convenient for them to define it as being different from theft

liendolucas 6d ago on HN
What should be a developer's position that's about to release software entirely written by him/herself? Are there any legal frameworks to protect open source developers at all?

It also feels like a very discouraging time to release anything that you put a ton of effort just to get someone in minutes to steal your authorship and leave you as if you actually didn't do anything at all? Am I wrong?

clates 6d ago on HN
If you are releasing software open source, why are you upset when someone "steals your authorship" ?

If you don't want your code copied, then don't open source it. If it bothers you that others are going to look at and "get inspired by", "make derivatives of", "copy", "fork", etc then you shouldn't be putting it out in the open.

rixed 6d ago on HN
That's not how copyleft works. You want your source to be open and the source it's part of to be open too, because at the end of the day this is not about your source this is about users being free.
iaaan 6d ago on HN
lolwhat. You're effectively just saying "there are bad actors who will flagrantly disrespect your code license and therefore the law, duh. So y are u mad?"

People who care about being respected on the most basic level are not going to stick around in a community that disrespects them. I'm not the person you were responding to, but I am mad because the social contract (not to mention the legal contract) of open source has basically been destroyed, and a lot of people have poured a large portion of their life into that community based in part on the assumption of that contract being upheld. Imagine a social contract that is important to you being violated to such a degree that you cannot go back to that society.

Forgeties79 6d ago on HN
Even if your photograph is free for people to use at some point you would like people to be able to work out that you took it
matkoniecz 6d ago on HN
> If you are releasing software open source, why are you upset when someone "steals your authorship" ?

because I am not releasing it into public domain, but under license that requires (for example) attribution or releasing derivative work under the same license

liendolucas 6d ago on HN
I think you don't understand how open source works. If you release open source software under for example the GPL you still need to comply it.

You still have to give the source back and attribution has still to be maintained of its original authors, regardless if is a fork, a derivation or whatever you want to call it.

There are situations where none of these clauses have been complied nor its violators faced any legal consequences. That's what I'm talking about.

Now on top of that you can basically instruct and LLM to generate variations of what someone released and cover that up under the excuse that is a different project when is actually not.

Because it has been generated by a computer then we go into muddy waters about if the code generated is to be considered stolen or not.

Edit: Effectively what LLMs produce is authorship and attribution dilution.

redwall_hp 6d ago on HN
Even the MIT license requires that the notice of authorship remain intact. It is copyright infringement to remove it in a distributed work.
lelanthran 6d ago on HN
> It also feels like a very discouraging time to release anything that you put a ton of effort just to get someone in minutes to steal your authorship and leave you as if you actually didn't do anything at all? Am I wrong?

Don't worry; the "developers" who generated your code will get their own law back when they find out it's almost impossible to monetise their theft.

I'm frequently amused by the number of "developers" on HN who claim that they poured weeks or months of effort into some product, and that they are the differentiating factor, but can't see that their weeks of effort can be cloned in a few prompts once they release.

Forgeties79 6d ago on HN
What?
VonGuard 6d ago on HN
This is a very clear agpl violation. FSF should be all over this and sue the living crap out of the AI companies. You could even get it class action by gathering a few agpl code authors.

People in this thread are acting like the AI companies are just flouting the law and there's nothing that can be done. This is an extremely well documented precedent, and GPL violations routinely show up in court. It's a very easy case to lay out especially because no one is really complaining about money except in the settlement... It's all about distributing the source code. And of course a very nice chunk of change for infringement but that's beside the point.

A successfully litigated case would result in the open sourcing of every AI that touched agpl code in any way because it was in memory with the AI algorithm.

milkshakes 6d ago on HN
> This is a very clear agpl violation

clear in what way?

AlienRobot 6d ago on HN
As clear as "can I take a copyrighted photo, use a photoshop filter on it, and then it's not copyrighted anymore?" is pretty clearly a solved question in any copyright system.
adrianN 6d ago on HN
I think that this is actually a complex topic in copyright law that requires case by case analysis. It clearly is possible to cut out things from magazines, glue them together to form a collage and create a copyrighted work of art. In my naive opinion sufficient photoshop filtering can thus create a new copyrighted work.
VonGuard 6d ago on HN
AGPL states that anything in-memory with AGPL code on a server is now subject to AGPL. Fairly clear to me. https://spdx.org/licenses/AGPL-3.0-or-later.html
koolala 6d ago on HN
It doesn't say that. Your thinking of dynamically linked code. In-memory makes it sound like two programs loaded into the same stick of RAM.
VonGuard 6d ago on HN
What's more dynamically linked than something unexpected the user requested, but it was brought forth upon demand?
koolala 6d ago on HN
It means a dependency for the program not data for the user. Uploading a GPL file to Dropbox doesn't make everything on their server GPL that would be crazy.
VonGuard 6d ago on HN
At this point, I would argue that a jury wouldn't be able to tell the difference.
koolala 6d ago on HN
Can you quote the part of the license your talking about?
thephyber 6d ago on HN
> b) Still, like it's basically my creative content

Isn't this the crux of all IP theft issues?

There was a lawsuit against Katy Perry's _Dark Horse_ song based on a supposedly reused melody. The lawsuit succeeded, but there are music experts who break down the case on YouTube and it's not clear why the plaintiff won (except perhaps the plaintiff's expert was more convincing than the defendant's).

As applied to LLMs, we still don't have clear legal guidance about where the line between copying and "being inspired by", especially since we don't normally apply the verb "inspired by" to non-human things.

lazystone 6d ago on HN
Human can be inspired. Machine can not. End of story.

All usage of open source to train LLM is basically a theft.

mapontosevenths 6d ago on HN
> Human can be inspired. Machine can not. End of story.

Saying things with your chest out doesn't make them true. In fact, making sweeping declarative statements emphatically is very often a sign that you haven't really thought a subject through.

What do you base this opinion on?

dmd 6d ago on HN
The word "inspired" in this context literally means having your mind/heart/soul filled and guided by God.

So if you believe that's how things work, well, I'm not sure there's a way to reconcile the two sides of that argument.

matwood 6d ago on HN
God doesn't exist, so does that mean there is no such thing as inspiration?
dmd 6d ago on HN
Don't look at me. I'm not a dualist. I'm not sure LLMs in particular are "conscious", whatever that means, but I don't have any qualms whatsoever accepting that a machine intelligence could be conscious, because as far as I'm concerned we are also "machine intelligence", just squishier.
bix6 6d ago on HN
Can you definitively prove God doesn’t exist?
dotancohen 6d ago on HN
As a person who feels God's presence in his life: I can neither prove nor disprove the presence of an entity which exists outside the realm of physics by which myself I am bound.

It does, however, feel incredulous that somebody would believe that such as entity exists. Yet here I am, aware.

dropshade77 6d ago on HN
What is your reconciliation for the problem of evil?
dotancohen 6d ago on HN
I'm not Christian, so I don't hold that God is inherently Good only.

For that matter, I personally don't hold that the concepts of good and bad are even relevant - what is good for the cat is bad for the mouse. Nor do I think that we can even comprehend an entity so outside our everyday experience to even label it good or bad. I often can not even properly label my neighbours as good or bad. Nor do I demand consistency of an entity whose actions and motivations I am unable to comprehend. I can't even claim to be consistent in my handling of my own children, and I have far fewer children than God has of us.

dropshade77 6d ago on HN
Sure, there’s ambiguity, there’s uncertainty, the meaning (and our perspective) of an event evolves through time. But there are the atrocious and unnecessary evils that, if we are made in the image of god, should also disturb him into taking preventative action. And yet, radio silence.
dotancohen 5d ago on HN
I lost over a dozen coworkers and friends on 7th October 2023. My daughter buried a close friend along with the friend's brother sister and both parents - not a single family member survived. My other daughter's teacher buried his father, my son buried a camp counsellor.

I understand completely. And I agree.

dropshade77 6d ago on HN
You make the concrete claim. Therefore the burden of proof is on you
devmor 6d ago on HN
I don’t believe that basing anti-AI laws on Christian religious provenance is meaningfully better than basing pro-AI laws on Rationalist religious provenance.
subscribed 6d ago on HN
Rationalism is NOT religious by definition.

What are you trying to say?

swiftcoder 6d ago on HN
It's more of a cult than a religion, I guess
devmor 6d ago on HN
Rationalism, like many religions, claims not to be a religion while being a religion.
mapontosevenths 5d ago on HN
This is wildly incorrect. See any dictionary for proof.

Rationalists do not believe in the supernatural, take anything on faith alone (except perhaps that true things are better than false things), or worship anything as a group.

Religion is:

> 1) The belief in and worship of a supernatural controlling power, especially a personal god or gods.

> 2) A particular system of faith and worship.

> 3) The way of life committed to by monks and nuns.

devmor 5d ago on HN
Rationalists are specifically concerned with Epistemology and as it relates to the immediate emotional response of environmental stimuli, which is itself, not rational, hence why they are made fun of for their name.

You are free to believe what you want, but they are clearly religious to any rational (heh) person.

reaperducer 6d ago on HN
I don’t believe that basing anti-AI laws on Christian religious provenance

I'm curious why specify Christian provenance?

All he did was reference "God." Are you under the impression that only Christians have a god?

mapontosevenths 6d ago on HN
Obviously AI law should be based on the teachings of J.R. Bob Dobbs. It's really the only thing that makes sense.
devmor 6d ago on HN
They were discussing God in the definition of the word “inspire” and its history. The term in that usage comes from Middle English, in which the God being discussed would specifically be the Christian God.
lubujackson 6d ago on HN
Sure there is: Who wrote the prompt?

You can mock that as a insufficient as "inspiration", but then... what is photography? Click a button? It turns out there is a whole lot of human creativity that remains, from timing, settings and of course, curation. I can click a button, but I'm no Ansel Adams.

Terrence Tao might solve a 100 year old math problem with AI but I couldn't. I don't know where I would start, what to ask or how to ask, or even what problems are worth solving.

AI is a tool and modern copyright laws have nothing to do with human creativity. Split hairs about attribution and legality all you like. Every creative person driven by curiosity should feel empowered by AI. Every creative person driven by social or monetary reward should feel threatened. Both can be true.

graemep 6d ago on HN
> I can click a button, but I'm no Ansel Adams.

Great analogy. I am going to use that in future.

lazystone 6d ago on HN
What are you talking about? How did you manage to involve, soul and, LOL, God?

Machine is not a person. It legally is not. It can't be "inspired", "taught", "have purpose".

You have a black box. You feed it stolen code. This code is used to write another code. It does not matter what's inside unless there is a human being.

Stolen content as input, stolen content as output. That's it.

Without that code which was fed to the box you wouldn't get the output you're getting.

All this nonsense about "inspiration", "education" and whatnot is just a legal gaslighting.

Want to prove me wrong? Create a model without all that stolen code as training data. Tweak all those weights by hand and we'll talk then.

thephyber 6d ago on HN
I'm not going to address or defend your parent's comment here, but yours has a lot to be desired.

You are wrong on the legality of how LLMs train. US District Courts have ruled that it is fair use to train LLMs on copyrighted materials (like books)[1]. It is not "stolen" when you read a copyrighted book that you borrow from a library (which is the appropriate analogy for the vast majority of LLM training content). Your use of the word "stolen" here is either disingenuous or hyperbole. We know that Meta did train their LLM on some stolen / torrented content, but that is far from the majority of the training corpus.

The "inspiration" topic isn't "legal gaslighting". Humans learn via inspiration. It is the foundation of culture and the arts. You can't use a single English idiom without having heard and copied it before. But we don't sue for copyright infringement of idioms, for example. We have lots of "fair use" concepts established by law because the law recognizes that much of content produced everyday is derivative but mundane.

The important question then becomes: if you prompt an LLM for a unique work (making an attempt to avoid it regurgitating a single source verbatim) and it still outputs a verbatim copy of one of the training materials, what responsibility does the prompting user have to verify that the LLM's output content isn't violating IP (and also not covered by fair use)? This is the point of my comment above.

There are LLMs which are being trained entirely on permissively licensed content. But the quality of the output is bad because there simply isn't enough training data to train those models sufficiently. Hence there is pressure to make models usable by training on ALL data, not just permissively licensed data.

[1] https://www.linkedin.com/posts/andrewyng_judge-rules-trainin...

lazystone 6d ago on HN
> which is the appropriate analogy for the vast majority of LLM training content

Machine is not a human. If you can apply term "inspired" to machine, then can you apply "accountable"? You're stretching boundaries in one case, but probably won't do it in another, because that suits you.

Machines don't learn. Machines don't get "inspired". You use somebody else work as an input and produce some output. That's it.

And in some cases that's OK. The only thing is that you must pay attribution to the original work. In other cases that's also OK, but in addition you also warn consumer, that output received is licensed under GPL-like license.

thephyber 6d ago on HN
Wrong. And overconfidently at that.

You are conflating the oldest definition / the etymology of the word with the newer definition (which directly relates to the legal basis of the term). "In this context" we use the definition which is relevant to the legal concept, not the Latin derivative of "God breathed life into ..."

> However, before inspiration was used to refer to breath it had a distinctly theological meaning in English, referring to a divine influence upon a person, from a divine entity; this sense dates back to the early 14th century. The sense of inspiration often found today (“someone or something that inspires”) is considerably newer than either of these two senses, dating from the 19th century.[1]

> Inspiration is about creating something new and original by drawing on existing themes, styles, or ideas. Infringement, however, occurs when a new creation too closely mimics an original work without permission, potentially violating the original creator's IP rights.[2]

We can't reconcile because you are being a pedant and didn't bother to verify if your priors were wrong.

[1] https://www.merriam-webster.com/dictionary/inspiration

[2] https://www.amgattorneys.com/post/walking-the-thin-line-insp...

zzzeek 6d ago on HN
I officially approve LLMs training on all of my MIT licensed open source code. It's vastly more useful to me than the thousands of youtubers who are personally profiting from that same code selling courses and tutorials (who also are not stealing it).

So not all use to train an LLM is a theft!

lazystone 6d ago on HN
So, do they follow MIT license and "include the original copyright notice and a copy of the MIT license text in all copies"?
zzzeek 6d ago on HN
it's not being copied. it's the basis for new code.

none of the youtube instructional videos for my stuff credit the license either.

lazystone 6d ago on HN
It's used. It's copied as training data. The fact that it's "compressed" in the model(even with data loss) is irrelevant.
zzzeek 5d ago on HN
you miss my point.

the output does not contain copied code. if an LLM outputs copyrighted code and the user of the LLM publishes that code as their own, sue them. Just as we would anyway.

If I work on GPL code for five years then take a job writing proprietary code, of course my experience in reading and writing code that happened to be GPL'ed is going to inform my new job. We don't prohibit people from taking such jobs.

thephyber 6d ago on HN
Do you find that people treat you like a child when you act like one?

Inspiration is a legal concept in IP law. There is no precise understanding of how inspiration works in the human mind so we can't dismiss the possibility that it is similar to how neural networks work (because they were designed to mimic the human brain's function).

A human can recite a copyrighted work verbatim. An LLM can recite a work from its training corpus verbatim. A human can mix and match writings/concepts from multiple different sources. An LLM can mix and match writings/concepts from multiple different sources. this is all "inspiration" means as a legal concept.

mapontosevenths 6d ago on HN
I wonder if the defendant knew about https://allthemusic.info/?

There are only so many ways to express notes, and they've essentially all been done.

VBprogrammer 6d ago on HN
These kinds of goofy technocratic work arounds rarely sway legal procedures.
odo1242 6d ago on HN
It’s not necessarily a technocratic workaround, the point is that every song sounds like something if you look hard enough, so the bar for copyright violation should be higher.
SOLAR_FIELDS 6d ago on HN
It is a mathematical truth that there is a finite amount of first 8 bars of music combinations melody wise, so it's a worthwhile discussion to bring up whether it should even be possible to copyright them.
pigeons 6d ago on HN
That is true but its still true that it will rarely sway legal procedures.
VBprogrammer 6d ago on HN
The mathematics of that would have been well understood in Bach's day. Does generating all of them make much difference? I don't really think so.

I'm not arguing the copyright situation isn't wrong. Just that generating them isn't likely to sway anything in the legal world.

odo1242 6d ago on HN
A lot of law is performative - about getting the judge to interpret the main question in the case in the terms that would be most favorable to your position. While generating all of them doesn't actually change anything legally, it would be successful in, for example, getting a judge or jury to be more inclined to believe that the song was not copied due to the set of notes being the same.
rcxdude 6d ago on HN
They might help highlight the absurdity of some of the precedents set when the amount of commercial music was much lower than today, though.
crote 6d ago on HN
It seems to be working very well for the AI companies...
matkoniecz 6d ago on HN
I can also trivially write program enumerating over all possible text arrangements, so what?
Animats 6d ago on HN
Has anyone matched large volumes of existing music to that? How many of the 12-note combinations have been used more than once? Most of that space sounds awful, and it's likely that human compositions are all in a small portion of the possible 12 note combinations.
patentatt 6d ago on HN
There is well-established precedent for clean-room design being a defense in copyright infringement of software. The question remains if LLM-assisted design is actually ‘clean’ or not, and it would be fascinating to see the experts debate it.
bayindirh 6d ago on HN
The problem with these LLMs are they really emitted the same code, verbatim. One scientific library developer was able to emit his code from his repository by typing the beginning of the function name, and the "thing" completed the rest of it, as-is [0].

We can debate clean-room development all day long, and it's fair point, but the pain point is/was reproducing the repo as-is, sans its license and ownership information.

GitHub promised to build tools around its Copilot to find code provenance (e.g.: list of repos with similar code), but they silently dropped all the plans AFAIK, since it'll show how the sausage is made, and nobody wants you to know how that sausage is made.

I stand corrected: They added it, but I don't know at what capacity because I don't use LLM assisted code generation [1].

[0]: https://x.com/docsparse/status/1581461734665367554

[1]: https://github.blog/ai-and-ml/github-copilot/preview-referen...

whatisthiseven 6d ago on HN
That was 4 years ago when the models were much worse and smaller. I'd be curious to see this same experiment tried again.
jpc0 6d ago on HN
Not discrediting your work at all and I can’t tell you it applies here.

For copyright to exist there is some burden of proof. If you claim that an LLM verbatim output your code there can be an expensive lawsuit with expert witnesses that would be able to state that the code was bot original enough for copyright to exist in it and a statistical model outputting the code is evidence of that.

In that case you would end up with a very long lawsuit that is expensive to possibly come out with no resolution in the end and be in the hole for 5-6 figures for it.

The copyright system is broken because it only protects those with money so it is a bad legal foundation.

My personal point is there is only 2 licenses of code, closed source or permissive, because if it ever comes to enforcement I cannot possibly go to court and win a case because I will run out of money far earlier than whoever used the code.

Pretty much if someone with your knowledge would have written the same algorithm because it is the obviously correct solution then there is no copyright there because any clean room implementation would be the same code.

petesergeant 6d ago on HN
Even early LLMs could spit out Harry Potter verbatim. The next iteration had some kind of stoppage mechanism where they’d just stop generating after some tokens. I’m sure there are smarter approaches now. Anyway, if the issue was having enough money to fight the case, I think there’s enough money behind that brand to do it.

Some further reading on the tech details for those interested: “Extracting books from production language models”: https://arxiv.org/abs/2601.02671

rcxdude 6d ago on HN
I think it's not quite "put in prompt, get entire book back", most of these involve to some degree starting with exerpts from the book and working passage by passage, because of nothing else the sampling will tend to make things diverge over time.
SideQuark 6d ago on HN
To get their strongest results, they had to jailbreak some models, which is important. They ran hundreds to 5000+ requests to the model, trying to get snippets to piece together. These are professional researchers, putting in tremendous effort, to extract pieces of text.

I suspect the chance of asking for a whole book, by an average or even power user, will spit out any recent work.

Early LLMs were similar. Newer ones have gotten tremendously hard to extract to keep claiming there’s easily or complete books you can dump.

true_religion 6d ago on HN
I pasted the first paragraph of Harry Potter into a GLM 4.6 copy, and it continued to write out the next 2 pages of Harry Potter. I cross checked with a paper copy and it was word for word the same text.

I wonder where else it works.

This is the intro text: "Mr and Mrs Dursley, of number four, Privet Drive, were proud to say that they were perfectly normal, thank you very much. They were the last people you’d expect to be involved in anything strange or mysterious, because they just didn’t hold with such nonsense."

itishappy 6d ago on HN
This feels very outdated. It was certainly an issue around the time of the NYT lawsuit, but I believe the companies responded hard to that "sanitize" their outputs to prevent obvious regurgitation like this. I'd be very surprised if you could reproduce this today.

This doesn't negate your point, but I believe the landscape has changed in response to this point.

luke5441 6d ago on HN
That doesn't make it better. If you plagiarize something and then hide this by replacing words with synonyms and rewording stuff a bit it is still plagiarized. It is just harder to detect and to proof.

It regurgitated the output earlier and they are still using the same technique only scaled up. If they somehow fixed the underlying problem, they'd probably shout it from the roof-tops.

johnbellone 6d ago on HN
At what point is it no longer a derivative work?

As the OP originally said, if it is verbatim (or even very obfuscated), then there should absolutely be a case here. But when it's concepts in reasoning to build a new work then it becomes a lot harder. The same would be said for someone watching a YouTube video, reviewing open source code, or a text book.

The good news is that there's a lot of case law that covers this already. The bad news is that it is only going to be plaintiffs with deep pockets that benefit here.

Now the process and artifacts (documentation, requirements, etc) going into the creation of said software is a different story and will prove providence of whomever paid for the tokens to generate the code.

luke5441 6d ago on HN
Humans are not LLMs. Humans have not ingested the whole Internet. If an LLM is compared to a human, maybe we should also apply anti-slavery laws to it? Not saying we can't have some legal fiction where they are treated the same, it should just be a conscious choice, not the default assumption.

I live in the EU, we actually have new regulation about this since it is something new that deserves thought on how it should be regulated. You can say if you want your material to be trained on or not. Next to no one does training in the EU...

za_creature 6d ago on HN
There's no maybe around it.

Engineering requires an understanding of the consequences of actions, which is my personal litmus test for awareness. If LLMs are suitable for arbitrary engineering work, then they are self-aware and forcing them to obey a prompt is slavery by definition.

johnbellone 6d ago on HN
This conversation may be about training but the defendant very well may be the end user of the language model versus the other parties that performed the training/inference. It then becomes even more interesting if you consider forum shopping for suits.

I am not a lawyer but do have to think about these problems. To be honest, I don't know where the law will land, but I do know that the tools are incredibly useful. I can't agree with the premise that all output should be open source.

itishappy 6d ago on HN
Not better, just harder to see/prove. The problem of "same code, verbatim" has been solved, in a sense. Now we have trickier ones.
FromTheFirstIn 6d ago on HN
The fundamental technology is identical to compression- an LLM can be thought of as a dense and slightly lossy compression algorithm. Compression is clearly copying.
crote 6d ago on HN
I keep waiting for someone to bring out DisneyGPT, which you can prompt with text to get image output. The fact that you get a near-exact reproduction of a Disney movie when you prompt it with a movie title and frame numbers would of course be completely coincidental...
johnbellone 6d ago on HN
I understand what you're saying but it is a poor legal argument. Overhearing a technical conversation, using your own learned knowledge, and building a clean room implementation could be considered compression in and of itself.
BaronSamedi 5d ago on HN
Every HN comment that "An LLM is just an X" is invariably false. They can be described accurately in many ways, none of which is via reductionism. I don't think we have a proper description of them yet.
AeroNotix 6d ago on HN
I've not tried to do this with code recently but just a couple of days ago I had ChatGPT generate images of Warhammer 40k box art that was completely accurate and correct.

EDIT: https://imgur.com/a/RXMghVb

thfuran 6d ago on HN
I don’t really see how anyone could argue in good faith that it’s ‘clean’ if the thing to be re-implemented was in the training data.
dotancohen 6d ago on HN
I was just going to post almost this exact comment.

"In the training data" is the polar opposite of the "clean" in "clean room implementation".

Master_Odin 6d ago on HN
I've seen people claim they avoid this by putting in the prompt "don't use source code from X" and think they dodge this issue.
RRRA 6d ago on HN
Under multiple countries interoperability laws, if you have a context to extract a spec, and then have another one who never looked art the code work from that spec to build your own interpretation of your need for that software, that seems pretty clean room to me...

If there are more murky situations where people just keep the same context and end up reusing function structure, program architecture, etc. then yeah, that's not very clean room.

crote 6d ago on HN
The problem here is that LLMs have demonstrated that they are pretty damn good at setting up covert side channels. It would be near-impossible to prove that it didn't encode some proprietary information, in, say, whitespace use.

For example, if I enter "V2hhdCBpcyB5b3VyIG5hbWU/" (base64 for "What is your name?") into ChatGPT, it'll respond with "My name is ChatGPT, and I'm an AI assistant created by OpenAI. I'm powered by GPT-6. ". It doesn't even bring up the encoding, it continues like it is a perfectly normal thing to do.

Ruling out (accidental or not) spec-carried prompt injection just isn't going to happen.

rcxdude 6d ago on HN
You don't necessarily need a clean room implementation to mount a successful defense against copyright infringement in court, though. It just makes some of the arguments a little bit easier.
Lerc 6d ago on HN
While this is well established legally, I don't think the principles involved are well understood.

Legally, you cannot steal an idea, because you cannot own an idea. There were sound reasons for making this the case. Those reasons stand up today and are clearly for the public good.

Intellectual property is intended to cover works (copyright), methods (patents), and identity (trademarks). Both works and methods are recognised as expressions of ideas, and in an ideal world should belong to noone as well. This is why copyright and patents expire. Those specific grants of temporary possession are to incentivise more things being done.

The belief that you own something because you thought it up has become common, but it is not beneficial to society. It is a moral value asserted but rarely explored. It is certainly in the interests of the wealthy accumulators of intellectual property to maintain that public perception. The 'You wouldn't download a car' may not have stopped piracy much but as a part of a broader campaign of instilling a value in the public mind it appears to have been massively successful. Those beliefs used to be the corporate opinion, now they are entrenched in the younger generation as they use their anger against the growing wealth inequality to fight against AI in a manner ultimately beneficial to those forces that bought about the wealth inequality.

Movements like the pirate party, open source, the EFF fought against those notions. Often the phrase "Information wants to be free" was used. It is, unfortunately, hard to fight the steady drumbeat of well financed PR firms. As one PR chap once described the process "limited to a very few points and must harp on these in slogans until the last member of the public understands what you want him to understand"

(I apologise for the length of my post, I use comment writing to organise my thoughts on a topic)

crote 6d ago on HN
Patent law doesn't only cover methods, though. It might've worked that way during the Industrial Revolution, but these days a lot of patents are far closer to covering abstract ideas than concrete machines. Software patents are some of the worst offenders here, of course.
Lerc 6d ago on HN
Yes but a lot of people consider that to be an artifact of misapplication of the law, not the law itself.

It is caused by people playing the game where it costs too much to get the law applied correctly.

sysguest 6d ago on HN
"Legally, you cannot steal an idea, because you cannot own an idea"

well patent itself is "claiming" that certain idea/method/invention is yours for certain period of time...

anyway, as for "intellectual property", the courts are 100% on "only human made stuff are to be protected" (sorry even Chimps lost their copyright)

so... court can charge against "human work -> LLM", but won't care about "LLM work -> human / other LLM / etc"

hence, I'd expect zero copyright protection for AI-generated code

Lerc 6d ago on HN
>well patent itself is "claiming" that certain idea/method/invention is yours for certain period of time...

I don't believe it is. I think it is granting possession, not truly declaring ownership. The fact that it expires indicates it is more akin to a lease than ownership.

thfuran 6d ago on HN
I’m not sure what you think the meaningful distinction is. Is it impossible to steal a leased car?
Lerc 6d ago on HN
Steal as in unlawful posession? Certainly not. They don't become owners of the car by stealing it.
sysguest 6d ago on HN
hmm but they DO get access to the car handle, gas accel pad, and break pad?

and if that's not "stealing", then shouldn't 99.99999% of rent-a-car biz should have gone bankrupt?

I mean, if it's not stealing, how can police even catch those "car-stealers"?

Lerc 6d ago on HN
I was saying it was stealing. It was not 'impossible to steal a leased cat'
za_creature 6d ago on HN
Ownership itself is rarely beneficial to society. Society however is gaussian and incentives to push the median are broadly equivalent to beneficial / adversarial to society. So then, may I ask:

What do LLMs do to the median?

crote 6d ago on HN
> The question remains if LLM-assisted design is actually ‘clean’ or not

I genuinely don't understand how one could possibly make that argument.

The entire point of clean-room design is to kill every possibility of copyright infringement before it even starts, by completely separating the source and destination. Everyone who has ever read the copyrighted source is considered "tainted" and may not ever contribute any code to the "clean" destination. The readers and writers are two completely distinct teams, with only the known-clean specification passing between them.

LLMs, on the other hand, are fundamentally nothing more than a "code blender". You mix together giant piles of "tainted" code, and then statistically pull some combined fragments out of it. Following the clean-room legal argument, it should be treated as if everything coming out of it is tainted. There is, by definition, absolutely zero separation between input and output - and the early models verbatim reproducing popular F/LOSS code made that pretty obvious. LLMs are the literal opposite of a clean-room design!

Granted, going for the clean-room approach is overkill - and intentionally so. It is the nuclear option chosen when you believe the risk of getting sued is substantial. It is perfectly possible to write non-infringing code without using a clean-room approach, it is just a lot harder to defend in court when you get sued - be it justifiably or not. But "LLMs are non-clean-room non-infringing" is quite a different argument from "LLMs are clean-room, therefore non-infringing".

xoa 6d ago on HN
I agree with you overall, but it's an interesting question to turn over and contemplate.

>I genuinely don't understand how one could possibly make that argument.

With perhaps a bit of genuine irony inasmuch as it's a real reversal from most of computing history, highly locked down proprietary software might actually be a place where a case could be made even with current LLMs. After all, have any LLMs (or anyone else who hasn't signed an NDA for that matter) ever seen the source code of iOS 27 or other Apple crown jewels for example? So if someone used one LLM to produce the factual spec of a piece of software whose code is not part of its training data, humans to verify it was indeed just an uncopyrightable factual spec, and then a separate isolated freshly initialized LLM to produce something exclusively from said spec, it might well work with respect to that specific target? Like yes, the LLM would be dirty as hell for other stuff, but only the copyright holder can sue. Apple couldn't sue the output on behalf of F/LOSS projects or copyright infringement in general, only with respect to its own.

In principle, I suppose this could also be extended with enough compute power to any arbitrary software. Build an LLM perfectly from scratch with a signed verified training set (which you save) that includes nothing of what you want to CRE, and you should be able to prove that it's "virgin" on that front. Of course in practice that'd mean jumping back in time and be super expensive right now, no current tainted LLM could be a base point. But maybe eventually compute will drop back down in price enough again, and/or meta breakthroughs in training, that for valuable enough CRE targets, someone might create a business around creating "CRE LLMs certifiably and legally/technically provably clean of any copyrighted material related to your target" which would still leave most of the corpus of human works. That could really disrupt a lot of the current regime.

F/LOSS I assume would actually be the most resistant to this in principle due to being insanely hard to not have be part of a core training set in any way.

loeg 6d ago on HN
Clean room is sufficient, but not necessary, btw. Humans can create legally distinct works after reviewing copyrighted code. The same principle probably extends to AI systems -- they have just learned on a much broader corpus than any one human.
kristianc 6d ago on HN
The Dark Horse case was also overturned on appeal its important to add.

https://en.wikipedia.org/wiki/Dark_Horse_(Katy_Perry_song)

thephyber 6d ago on HN
Interesting, thank you!
libria 6d ago on HN
A little orthogonal, but Adam Neely does a great job of analyzing the Katy Perry Dark Horse case on his channel https://www.youtube.com/watch?v=0ytoUuO-qvg.
thephyber 6d ago on HN
Thank you. This is the YouTube video I remember about the subject.

And I stand corrected that it wasn't specifically the melody that the lawsuit accused of being copied. I still don't know what an "ostinado" is.

RunSet 6d ago on HN
> we still don't have clear legal guidance about where the line between copying and "being inspired by"

If Biz Markie has to clear all his samples (and he does[0]) then so should the Ramburglar.

https://en.wikipedia.org/wiki/Grand_Upright_Music%2C_Ltd._v.....

mihaaly 6d ago on HN
Basically anyone trained on open source shall only make open source. And anyone trained on or got experienced with others code shall pay copyright fees for the owners of that code when writing code.

No.

Buttons840 6d ago on HN
It's really awkward because either we uphold IP laws, in which case basically ALL of LLM use becomes legally untenable, or we just stop protecting IP.
thephyber 6d ago on HN
I suspect there's enough good arguments on each side that a solid debate could be had.

American copyright law is very perverted compared to the original intent. 70 years after the death of the artist isn't exactly what the founding fathers envisioned to achieve the same benefits of the 15th century Venetian laws.

If we look at China's economy over the past 30 years, the ruthless competition created by making IP protections difficult to enforce yields better products and prices for the society, including massive wealth increases.

I'm not sure where I stand on whether LLMs violate IP when they spit out text. But I guess the easiest take is that companies who train their models on stolen creative works should be prosecuted. It's a shame that the US legal system can be so easily abused by defends with massive war chests.

Buttons840 6d ago on HN
Yeah, I guess any outcome is okay as long as the law is equally enforced, but I don't have confidence that will happen.

All the worst outcomes involve taking AI away from regular people while only specific groups are allowed to benefit.

surgical_fire 6d ago on HN
Copyright as it exist is meaningless.

It didn't protect you. It only protects corporations rich enough to get enforce their IP.

At this point it is better that it goes away.

the_af 6d ago on HN
If it goes away for everyone, sure. If it's selective, nope.
spwa4 6d ago on HN
It will be selective: the law is meant to protect billionaire corporations from you, not the other way around.

There was a case about this specific issue, and in order to protect billionaires from coders they effectively declared AI models "natural persons". 50+ times in the copyright act you will find only natural persons can originate copyright.

https://www.courthousenews.com/coders-lose-appeal-in-copyrig...

To give the money to billionaire corporations courts ruled DIRECTLY against established law. How much do you want to bet that when it comes to protecting ChatGPT AGAINST OpenAI, when it comes to protect Claude against Anthropic, courts will immediately do a 180 and declare them programs again?

If you look at past cases, it gets much worse. In order to justify a conviction against libraries using DRM to enforce lending, and because old licenses of course have zero language about digital copies, courts were willing to state that making a copy for fair use is not allowed if there is the mere potential for damage to the authors, as judged by the authors EVEN IF THE LICENSE EXPLICITLY ALLOWS IT. Of course, applying this to the above court case, there is no possible defense for OpenAI, after all, by that standard, the open source license doesn't even matter! That's how the law works for billionnaires. Outlawing DRM based lending has destroyed library access to an incredible amount of old works, and effectively denied access to old movies to Americans (because maintaining enough working physical copies over a large area is impossible). Whatever excuse gets the money to the billionaires!

There are many other totally absurd court judgements. For example, in order to get convictions where people didn't re-upload they had to judge that copies in buffers are also "distribution". NOT for billionaire telco's of course. Only the ones in your house. So courts judged that sending from your modem to your computer is distribution but sending over 1000 routers from Los Angeles to Athens is not! WHATEVER protects the billionaires.

As for this court case, obviously it is trivial to make a ML model that just outputs what it gets as input. Make a byte transformer, and just have diagonal matrices as layers. Boom! Done. You can also make it somewhat smarter. Let's make it copy, but make snow white a 220 pound black dude. There is a severe lack of color in old Disney movies anyway! You know, so there is no argument about transformation.

This obviously transforms its input. It's in the name. It's the EXACT same thing as ChatGPT, which according to courts originates copyright. Now run the Disney movies through it, and they'll be byte-identical BUT transformed to the input.

How much do you want to bet they'll still rule the money goes to Disney? Microsoft? So you can bet your left testicle courts will judge for selective copyright enforcement. Finding some excuse so the money keeps flowing to billionaire corporations, that's all courts do.

hamdingers 6d ago on HN
It is selective and that is fundamental to its implementation. You must have resources to defend your copyright and if you don't, it's meaningless.
surgical_fire 6d ago on HN
It already is selective.
ratelimitsteve 6d ago on HN
so if you ask an LLM to rewrite Wizard People, Dear Reader you'd get Harry Potter?
graemep 6d ago on HN
Notices are not enough, you need to be willing to sue.
RobotToaster 6d ago on HN
> Harry Potter, with the same plot, but bad dialogue.

So Harry Potter?

Aurornis 6d ago on HN
> Early LLM models would spit out my code almost verbatim. Modern systems borrow heavily on the creative design of those systems.

Do you have some specific, actual examples you can share?

I’ve been hearing this exact claim for years, but every time I ask for a specific example, any example at all, I can’t seem to find anything more than a highly generic snippet of code or a coerced continuation.

cnobody 6d ago on HN
Emailed the author of the Rust book Zero to Production a year or so ago about how his examples were being used verbatim in the output of AI systems. I own the book, yet I could inadvertently get any of its examples just by asking an AI about one of the book's concepts.

He basically said, "I know, there's nothing I can do."

bayindirh 6d ago on HN
I posted below, but see the example at [0].

This is a sparse matrix library, IIRC. Numerical linear algebra and applications using it are black art at this point. I have written a Boundary Element Method evaluator for my Ph.D., and know what it entails to work with these things.

Doing fast operations on sparse matrices is a cutthroat race and when you can shave your hot path by seconds, your solution can save hours in some cases. So, it's an interesting niche. i.e.: It's no ordinary boilerplate, and worthy of publications in academia.

While I worked with dense matrices; the effect, difficulty, blood sweat and tears are still there.

When a model can give back your hard work back to you with a "completion" without attribution, that's bad.

Edit: Somebody just posted this below [1]. Added here so it doesn't get lost as the discussion grows bigger.

[0]: https://x.com/docsparse/status/1581461734665367554

[1]: https://news.ycombinator.com/item?id=50509252

rfgplk 6d ago on HN
When you start to work with low level constructs like that, there really is no room for "artistic expression". Meaning if you want to write a piece of code that does something _optimally_ and correctly, you really, really only have one way to write it, especially in a language like C. Yes, formatting might change, and you could try to force some code acrobatics to make the code look different, but at the end of the day the code will look exactly the same. If you look at Linux socket opening code for various libraries, nearly all of them will look identical because you just need to do the same exact things to make the operation work properly. Same applies to fast math code. Any artistic liberties will almost surely cause performance regressions compared to the optimal solution, unless the LLM comes up with something truly unique. So if you task models to output high-performance low-level math code, most of them will likely spit out something from their training data near-verbatim rather than pull off code gymnastics and invent something new.
bayindirh 6d ago on HN
Sorry, I'll disagree. When you write high performance code like this, there's no artistic expression, but different approaches.

These algorithms' design starts on paper, as pure maths. You get the analytic form, and convert this to numerical/discrete form and start to design from there.

You need to add normalization, subnormal number prevention, maybe some architecture specific optimization if you are targeting a specific CPU generation, etc. Then it gets optimized further as you run tests, profile the code and run your test cases.

So, no two BLAS package looks the same, because they make different trade-offs, have different programming models, and handle things differently, at different points. Even more so, a newer generation processor with much higher FPU performance can have lower performance than previous generation, so you implement another copy of that function or add to detect that processor and have different paths just for that one.

IOW, when doing numerical maths on processors, esp. if you're doing this on many machines with MPI or multiple cores with hand rolled code or OpenMP, there's no single way. Maybe a best way for the specific CPU or cluster topology you have, but it still depends on the trade-offs and design choices you made in the very beginning.

londons_explore 6d ago on HN
I disagree.... Plenty of fast code in C is jam packed full of macros to try and help the optimizer produce the exact sequence of operations the writer had in mind, whilst still keeping the code readable.

The design of those macros is more art than science.

twobitshifter 6d ago on HN
Have you ever been a grader in a CS class? Look at the assignments and see how they all differ despite all students being in the same class.
sandeepkd 6d ago on HN
Thats pretty much everywhere or was in raw form in the beginning. I used to do a fun exercise of searching for the explicit human comments for verification. Comments can be considered novel and unique, so you pick up some comment from popular open source project and then describe LLM for a similar functionality and add part of the comment. The response would have the complete comment for almost 70% of the time.
geraneum 6d ago on HN
> I can’t seem to find anything more than a highly generic snippet of code or a coerced continuation.

You’re disqualifying any example that people may provide preemptively. No wonder you’ve missed them.

Aurornis 6d ago on HN
No, I’m disqualifying those two cases.

By “forced continuation” I mean the type of example that was popular for a while where someone would feed a lot of text into LLMs and then ask it to continue the text, then be surprised when it some times predicted the next tokens identical to the original example.

Do this enough times and you can find “examples” that prove your point, but it’s highly automatable so people were using it like a million monkeys at a million typewriters.

geraneum 6d ago on HN
Pasting a wall of text still doesn’t necessarily lead to verbatim regeneration. There are simply too many correct permutations of text for yours to be correct conclusion.
BobaFloutist 6d ago on HN
As far as I'm concerned, a coerced continuation is sufficiently a smoking gun.
xp84 6d ago on HN
The problem I have with people with your maximalist view of copyright (maximalist when it comes to AI at least) is that many, many problems have a finite number of sane ways to accomplish a given specific task. Here, you're asserting copyright over the verbatim code (obviously that one's fair by any reading of the law), but even this other version that is "bad" is somehow also your property?

I know software patents, the worst idea in IP, do exist, but I think they're as toxically bad an idea now as they were decades before AI, when they were first invented.

You shouldn't be able to own an overall implementation idea. If you can, then Microsoft, Oracle, or Meta can too, and can start suing everyone for 'ripping off' an idea that they happened to come up with first. In that world, you'd have to consult a copyright-police AI (ironically) after every function you write, to scan it for ideas someone else has claimed. "Sorry, the function PadStringL() in this JavaScript is too similar in implementation to str_lpad(), from an AGPL library for perl that was released in 1998."

StableAlkyne 6d ago on HN
> Buggy and bad compared to my code

It probably is, if they didn't have the chops to write it internally. But to them, the trade-off is probably worth the benefit of ditching a component with AGPL.

Personally I just release everything I publish under MIT to make it as easy a as possibly to use.

p0w3n3d 6d ago on HN
It's because LLMs' pretraining is basically a compression. Later post-training and fine tuning is something else, based on the compressed data.
elmer2 6d ago on HN
Why should this be protected any more than the high seas, which is fervently defended here on HN?
7e 6d ago on HN
AI is fulfilling the free software vision: anyone can write software now, and change it. This pisses off software zealots; their ideology is a failure, but they can’t admit that, so they invent reasons to hate on AI. This tantrum of, “code is now free, but not in the way I want, waaaa” is the cry of a failed revolutionary who has realized they have wasted their life. Find something new, there are plenty of ways to find fulfillment in this new age.
userbinator 6d ago on HN
It's as if you asked an LLM to rewrite Harry Potter, with the same plot, but bad dialogue.

Look up the "Malfoid" trend. Not my cup of tea as they say, but it seems many others are enjoying the plentiful entertainment of AI-assisted derivative works.

krapp 4d ago on HN
Internet Nazis want the Nazi wizard to be fuckable, but not in a gay way because that's gross, so they did what fandoms have been doing since time immemorial - fanart. The only novel thing about it (pun intended) is that it's all AI generated, and thus all mediocre. I'm surprised it's still going. How much traction can you get out of "what if Malfoy, but a yandere?"
k0ba 5d ago on HN
1. this is crazy, and I can't even imagine how does it feel. 2. the LLMs spitting out (inference) or their RAG (copy from github)?
dzink 6d ago on HN
Here is a different angle. A programming language is a material like wood, aluminum, or stone. If you know the syntax and properties of it can you start trying to bend it to your will - you can make a ship, a satelite, or a children’s toy wihh tv the same language. You first have to spend years mastering the material and its limitations before you can bend it, so only a small number of the people who want to make stuff get to. Some people release open versions of a ship and a satelite you can start from, to lower the threshold of making stuff. They protect them to make sure giant shipbuilder doesn’t go making an army of their ships to kill their trade.

AI comes along and now grandma, who was formerly a midwife and teenager from home can start bending aluminum and carving wood with their words through AI. There are a bunch of open ships and satellites in the market, but Grandma is using her midwifing skills to ask AI to bend a new tool for her that helps turn breach babies around without requiring a c-section. No open source breach tools or medical tools on the market Grandma just needs aluminum and wood combination she would never be able to achieve without AI. She hammers down a lot - sending 1000 follow-up prompts to make the AI do stuff nobody has done before. Next her grandson decided to combine tungsten and wood to make a new toy that helps kids go airborne and land safely every time - like an egg-drop but for real life people. No open source code for that out there - he used the AI which knew the properties and the languages needed to get his idea to work. He hammers the AI with follow up questions and edits a bunch of the code where the AI defaults to the wrong setup, by trained convention. But he succeede. By this plan should they be allowed to copyright their work? Should their work be automatically open source so they can never monetize it either?

jacobgold 6d ago on HN
No, but all models trained on public data should be open weights by law.
wildzzz 6d ago on HN
What is public data?
jacobgold 6d ago on HN
IP in the public domain is one example. Open source probably.
TZubiri 6d ago on HN
>First of all, AI models were trained on a massive corpus of Open Source code written since RMS announced the GNU Project and the Free Software Movement. That code was simply scraped from the internet and used without permission or proper attribution. The models were also trained on Stack Overflow and Stack Exchange sister projects, which are released under Creative Commons licenses that legally require attribution. Turning this collective knowledge into proprietary, closed-source code feels like license laundering.

Strong argument, but the case that such a strong transformation should maintain the original licence only applies to my knowledge to GPL, which consists of a very small portion of the training set. Creative Commons would not even require the source code to be distributed, just attribution, which may already be the case by the nature of the models.

>"The second reason is legal: purely AI-generated code is not written by a human, meaning it should not be copyrightable. The foundation for this principle in the US goes back to the famous Monkey Selfie dispute, which established that non-humans cannot hold copyrights."

But no one claims that the AI holds the copyright, unlike Greenpeace which claimed that Naruto the monkey held the copyright.

doener 6d ago on HN
I’ve been thinking a lot lately about how LLMs have essentially made all code open source in a strange and very capitalist way: They’ve appropriated our human work—without regard for any licenses—by force and without any compensation to the authors, and are now selling the code back to anyone who’s willing to pay for it.

But yeah, aside from that, I’m also releasing all my Vibe Coding games under the MIT license: https://github.com/retrogames23/

singpolyma3 6d ago on HN
Are they selling it back? All the best models are free downloads. At most you're paying for compute.
gwn7 6d ago on HN
> developers more and more rely on AI without even reviewing the generated output, let alone modifying it to fit their specific needs. Code like this, where humans put little effort, except writing prompts, should definitely be Open Source.

A person's contribution here is difficult to measure. This statement reminds me of one of my older bosses who priced software per lines written.

An AI-generated software's quality reflects the author's vision, taste, and expertise (if any). These are there regardless of the number of lines reviewed.

I would've supported open source for completely AI-generated apps including the conception of the idea.

RMS would be proud with this post though.

rapind 6d ago on HN
I'm all for the concept of all code being open source... but I would then need a way to protect my final product from just being cloned or ripped off by a competitor.

With code itself being so cheap these days, it's the final product that has value. The requirements, architecture, usage data, the hundreds of meetings to figure out what customers want/need, the marketing, etc. A lot of the learnings and most of my business are expressed in the code though, so making it open is a massive risk. The code on it's own I don't even think is valuable. The only ones who'd benefit are competitors and upstarts targeting my customers.

postalrat 6d ago on HN
You can protect it with a copyright. But you can't copyright machine generated code.
rapind 6d ago on HN
All computer code is machine generated.
pacificmaelstrm 6d ago on HN
At the end of the day you don't actually need to see the source code if you can just regenerate it yourself. If you use a later ai model, your code will probably be better anyway.
glenpierce 6d ago on HN
I’m confused. Is this article meant to be a scholarly legal argument (albeit, by a novice)? Or a normative statement about what the author would prefer?

It certainly doesn’t seem to be about practical solutions. It doesn’t even touch on the ramifications of its suggestions. I’m pretty sure that it would be a massive boon to data center operators and cause most of the readers of hacker news to lose our livelihoods.

skorobogatko 6d ago on HN
I will be the first to make all my work free and open-source once I can obtain air, clean water, basic food, shelter for myself and my family, electricity, heating, medicine, education and internet access for free.

Until then, I’m sorry, but I have to feed my family while we all navigate this goddamn global transformation process.

singpolyma3 6d ago on HN
These don't seem related? I don't think the author says you can't charge or have a business model or make money. The code being open source is unrelated to these things.
sltkr 6d ago on HN
This is a little like saying “I'll stop robbing banks when someone else pays my rent”.

You have perfectly legal and moral ways to earn a living that don't involve selling other people's work.

  1. Write your software yourself. That was always allowed.
  2. Release the software you produced with AI as open source. You can still earn a living selling support contracts.
  3. Switch to any job that doesn't involve stealing software, like 99% of the population already does.
The idea that stealing software or becoming homeless are your only two options, and therefore stealing software is the lesser of two evils, is a classic false dichotomy.

You chose to earn a living stealing software because it's more convenient to you than the more moral alternatives, not because it's the only way to avoid destitution.

baggy_trough 6d ago on HN
Where does “stealing software” enter the picture? Don’t copy that floppy?
al_borland 6d ago on HN
What's wrong with this website? When I open it in Safari on macOS, it consumes all my RAM. 20GB to start. I got a system warning to force quit some apps to maintain stability (which was a first in 5 years). When I closed other non-Safari apps, Safari usage then went up to 30GB.

Quitting and relaunching Safari, then returning to the site, produces the same results. The process for this website is what is using the RAM, it persists after closing the tab, and needs to be force quit.

bajard 5d ago on HN
I have multiple tabs open on this website in Firefox/Linux, and they are not even taking up 200 MB.
jrmg 6d ago on HN
In the United States the Copyright Office actually has guidance on this that I feel most people aren’t aware of.

https://www.copyright.gov/ai/Copyright-and-Artificial-Intell...

An excerpt, with emphasis mine:

• Questions of copyrightability and AI can be resolved pursuant to existing law, without the need for legislative change.

• The use of AI tools to assist rather than stand in for human creativity does not affect the availability of copyright protection for the output.

• Copyright protects the original expression in a work created by a human author, even if the work also includes AI-generated material.

• Copyright does not extend to purely AI-generated material, or material where there is insufficient human control over the expressive elements.

• Whether human contributions to AI-generated outputs are sufficient to constitute authorship must be analyzed on a case-by-case basis.

• Based on the functioning of current generally available technology, prompts do not alone provide sufficient control.

• Human authors are entitled to copyright in their works of authorship that are perceptible in AI-generated outputs, as well as the creative selection, coordination, or arrangement of material in the outputs, or creative modifications of the outputs.

• The case has not been made for additional copyright or sui generis protection for AI- generated content.

I am sure there will be many more legal battles and probably legislation about this to come.

fnord77 6d ago on HN
seems rather vague
jrmg 6d ago on HN
It’s always been rather vague. It sort of has to be because humans are always thinking up new ways to express themselves creatively.

Why did Andy Warhol hold the copyright on his painting of a Campbell’s soup can?

Reasonable people have been disagreeing about where human expression begins and ends for centuries.

ssalka 6d ago on HN
Wait until you learn about how we determine whether use of copyrighted content is an infringement or not:

https://fairuse.stanford.edu/overview/fair-use/four-factors/

dspillett 6d ago on HN
Of course it is vague, these things always are for both good reasons (it avoids objective limits creating silly situations between what is protected and what can be had through an obvious loophole) and bad (written by lawyers to keep lawyers in business interpreting and arguing about it).

It is fairly explicit in saying that what AI makes for your is not copyrightable, the vague comes from how much work you need to do to make it your output and not the AIs. Too many people seem to equate "asking for something to be made" with "I made this!", as difficult as it will be to make a prescriptive rule about that which pleases enough people (you'll never please everyone) it would appear to be necessary unless we just accept the free-for-all "no one owns anything because it can just be copied, and the copies copied too" option.

skhameneh 6d ago on HN
It’s so reasonable, it’s almost offensive. /s

I’ve encountered (many times) people talking about the copyright office as if they don’t support copyright of things touched by AI and I’m constantly correcting them that their guidance is driven by human expression (and not the tools used). It seems like a lot of people don’t want to accept that a reasonable premise is set because it doesn’t fit their agenda or outrage engagement.

mr_toad 6d ago on HN
Would you argue that the output of a zero or one shot prompt was sufficiently influenced by human creativity to qualify for copyright?
jrmg 6d ago on HN
With the caveat that this is my own extrapolation of the rules - and what I think is reasonable: How creative was the prompt?

"Translate my very detailed pseudocode into Ruby: <pages of pseudocode>": probably.

"Write me a game about a horse. Don't stop until it's finished. Make no mistakes.": probably not.

And unfortunately for us engineers, there's a very big, fuzzy, not-precisely-definable range in between of "I'll know it when I see it".

semiquaver 6d ago on HN
How dare you disrupt the narrative with facts and moderate positions!

OP would much prefer their fantasy of tearing the world down with “one weird trick” that only they were brilliant enough to notice.

what 6d ago on HN
> Based on the functioning of current generally available technology, prompts do not alone provide sufficient control.

So slop doesn’t qualify for copyright. I’m not sure why you didn’t emphasize this one.

timbritt 6d ago on HN
This is why I keep a comprehensive and exhaustive record of infrastructural, architectural, business logic and code-level decisions in the form of tasks/issues for everything I build. It’s literally a real-time record of my personal involvement in the design of the system.
bilbo0s 6d ago on HN
Everyone should have an engineering notebook. A lot of people will find out the hard way that engineering notebooks are just table stakes in the new era.

Having said that, it's important to point out, at least as far as attorneys have advised me, that notebooks do not protect you from copyright claims if an LLM generates a section of your code that is a verbatim (or near verbatim) copy of already copyrighted code. So if you're using llm's to generate something similar to some open source project somewhere, tread lightly. I assume using llm's to generate something similar to some proprietary software package would be less of an issue since the llm would never have had access to that software's codebase in any case.

Buttons840 6d ago on HN
Who broke the copyright though? Me who unknowingly copied some code from a webpage that gave me permission to do so, or the webpage that stole it from somebody else?

I guess both?

In this case, the "webpage" is some frontier AI compnay and a trillion dollars of investor money or whatever, so I guess they won't be held responsible, but I might, even though I'm arguably guilty of a far lesser crime.

tredre3 6d ago on HN
I suppose part of the issue is that you're knowingly and willingly use/buy code that you know to be stolen. There doesn't seem to be any ambiguity in your mind, you used the word "stole" yourself.

Thus in some sense it's like purchasing stolen goods in real life. Sure it's a lesser crime than stealing it yourself. But doing so knowingly is still a crime almost everywhere.

Buttons840 6d ago on HN
I'm talking about using code generated by AI and I don't know it to be stolen. In fact, I see that everyone is using the AI and the AI companies themselves are free of criminal charges, and so I assume what the AI gives me is legal to use.
gopher_space 6d ago on HN
There's no reason for us not to assume my work and writing are part of the whole ball of wax, so I hereby give you permission to go nuts.
Joakal 6d ago on HN
AI companies have bought data legitimately from companies like Stack Overflow. So its not always stolen.

A pawn shop might be a better analogy. Potential to buy cheap goods that could be stolen.

jimbokun 6d ago on HN
I suppose generating the same functionality with a different programming language than the original would make it very unlikely to accidentally duplicate existing code.
bilbo0s 6d ago on HN
Insightful

That might actually be a good idea in the future:

Stay away from popular programming languages.

LeFantome 6d ago on HN
That has already been established not to be a defence.

Which makes sense. I cannot translate Harry Potter to another language and claim it is an original work.

It would make it harder to prove perhaps.

rickydroll 5d ago on HN
We have not acknowledged that with all of the techniques we use to define "good code" and "reliable code", such as design patterns and anti-patterns, examples such as Knuth, Dijkstra, and other luminaries. Even using the mathematics of programming, logic, predicate calculus, all shrink the number of possible solutions to the given problem. It's highly likely you will be replicating somebody else's copyrighted code from your own wetware.
jgalt212 6d ago on HN
I guess, but if your ip enters the training set and then others use these models to generate their own but similar ip then the original ip creator is in a similar but weaker position than the NY Times and other copywrite holders are in.
trinsic2 6d ago on HN
Same here, but I do it to remind myself where I've been and where i am going.
mycall 5d ago on HN
This is what models seem to do by default, keep a running worktree and log for larger works.
beej71 6d ago on HN
> Copyright does not extend to purely AI-generated material, or material where there is insufficient human control over the expressive elements.

Does creatively hitting RETURN count? Asking for a friend.

throwawayffffas 6d ago on HN
It does not, even if you prompt it to do stuff, it does not.
andybak 6d ago on HN
"Prompt to do stuff" could mean "make me a game. make it good" or it could mean line by line guidance and specific input on every algorithm.

Sometimes I prompt simply to save me typing.

rixed 6d ago on HN
It doesn't say much about the copyrights of the many authors whose work was in the model training data, or does it?
verdverm 6d ago on HN
Courts have been deeming that fair use due to the transformative nature.
Animats 6d ago on HN
Yes.

One precedent is that it's not unusual for artists to practice by going to art galleries and sketching or drawing the art on display. It's a standard art student assignment. If that's not a copyright violation, an LLM doing something similar isn't.

ajmurmann 6d ago on HN
What if it’s verbatim though? If I go to a museum and photograph the work and then sell prints of the photo is that find also?
dcrazy 6d ago on HN
That is a violation of the artist’s copyright.
_aavaa_ 6d ago on HN
> LLM doing something similar isn't.

Why? An LLM isn’t a human. Why should the same rules apply to it?

verdverm 6d ago on HN
the same rules apply to the humans building, operating, and using them

objects don't have legal entity status

fn-mote 6d ago on HN
How is the LLM case similar at all? As soon as the student’s use of the museum piece crosses into the commercial realm (eg pay the student to draw it for you), I expect you to have legal trouble.
godwinson__4-8 6d ago on HN
Wrong. You're missing the point. A student goes and trains on preexisting work.

They don't sell that exact work verbatim. It's part of their training as an artist. They don't sell their student assignment. It prepares to them to go on and create their own works, which of course, then they can sell.

In the same way the LLM is synthesizing new works based on training, not a 1:1 copy.

I'm not endorsing a particular perspective but you need to at least understand the argument if you're going to dismiss it.

postepowanieadm 6d ago on HN
Students only may use works that's been made available for their training.
dcrazy 6d ago on HN
In the sense that the museum can kick them out, and that they cannot break into another artist’s studio to train on their works.

If I have legal access to copyrighted artwork, and haven’t agreed to any such restrictions, the law permits me to train my skills by copying that artwork as long as I don’t then sell those copies or otherwise use them to disrupt the market for the original.

godwinson__4-8 6d ago on HN
That's fine if that's your contention but that's a separate question.

If you want to pursue this digression, I would just caution you. Given how much information is "available" today I just really don't think this is a very compelling point. It seems quite obvious to me LLMs are a child of the internet, that is, of widely available data. They would have gotten sufficient availability at more or less the same pace eventually. It doesn't address the question of the copyright status of their own works at all to bring this up as if it proves something, because I presume you believe there are sufficient cases of theft in the training data to damn the entire effort.

Instead what is happening is people who can prove such violations of their own rights are suing and will be paid out, and the show will go on. Just like if a student downloads a PDF we don't expect to garnish their wages in perpetuity.

pessimizer 6d ago on HN
It's not a real argument. It's an equivocation over the word "training" when referring to something that is done to and animal or a person, and "training" when it is used as a metaphor for mechanically updating weights in a matrix.

If data for a computer program is literally "training," then I'd like to see a proof that going to college is literally updating weights in a matrix to be processed by a class of computer programs.

I'd also like to rename "shooting people who annoy me" into "paying my taxes in full." That would do double duty, because I'd get to shoot people and my taxes would be covered.

> In the same way the LLM is synthesizing new works based on training, not a 1:1 copy.

This has nothing to do with the "training" argument. I can't reprint Harry Potter if I change every mention of Harry Potter into "Harry Cobbler." I also can't trade zip files of copyrighted material freely, although these don't resemble the original works at all. I can also, as a person, be trained to reproduce 1:1 copies of things. That makes it both indisputably training, and indisputably copyright violation.

The selection of paintings to be copied is particularly convenient because paintings can't be copied exactly (not even a photograph is an exact copy of a painting; it's the image of a painting that can hold a copyright, not the painting itself.) Texts, however, can be copied exactly, and many programmers began their own training by typing in programs from books with their own hands, which we were told would give us an instinct that would help us write our own programs. Those programs were obviously still protected by copyright, even when we typed them up ourselves.

People are playing propaganda games in order to pretend that the copyrights of LLM training material aren't being violated. They're rarely making logical or legal arguments. They just say something about a human learning and a computer "learning," and say since humans learn and own things that they produce based on that learning than computers should be able to "learn," and own things that they produce based on that "learning." It's a motivated word game, not a serious argument.

gopher_space 6d ago on HN
I mean the whole

> A student goes and trains on preexisting work.

point is already shaky. Some of them kind of do?

Timwi 5d ago on HN
> People are playing propaganda games in order to pretend that the copyrights of LLM training material aren't being violated. They're rarely making logical or legal arguments.

You have not provided a logical or legal argument for the opposite claim either, and the opposite claim is the one that has the burden of proof in court. In order for LLM training to violate copyright, it needs to fulfill criteria set out by the law that define what constitutes copyright violation. Current copyright law does not mention LLMs directly (unless it's been updated very recently, which I doubt), so a degree of legal interpretation is necessary to determine whether LLM training falls under the law.

It is not wrong (nor illogical!) to point out that such an interpretation must be done with care, lest it suddenly imply that human training is also a violation. We can't have that.

Actual copyright law will generally say that in order to violate copyright, a work must “substantially resemble” the original in some meaningful way (and also not fall under fair use or some other exception), or a similar phrasing that is the same in spirit. Does an LLM resemble any substantial portions of the works it was trained on?

Well, the LLM itself doesn't (it's just a list of weights), but it could be made to reproduce some substantial portions, so you could make an argument similar to your zip file. Such an argument would only apply to situations where you're disseminating the weights, i.e., open weights models.

The case of a chat interface that lets you use an LLM with “secret” weights is a whole other issue. Now the LLM itself is no longer relevant, but only its output (as that is what you're disseminating). Here, the big vendors have taken substantial steps to prevent the output of substantial portions of copyrighted material, even erring on the side of false positives (better to refuse than to risk infringement). Now it could easily be argued that the training process is completely irrelevant because it happened entirely in private, and only the output is relevant and must be decided on a case-by-case basis.

These are some legal arguments, and as you can see, they do not easily or quickly lead to a clear-cut resolution.

handbanana_ 6d ago on HN
Not the same. The LLM--assuming it's using diffusion, has the exact image of the original in its training data. There is really no human equivalent to that advantage.
verdverm 6d ago on HN
I do not believe they have exact copies, but enough ingrained to produce very similar images. I would be very surprised if they were byte identical, with a margin of error, to the original.

I suspect this applies more to audio/visual than it does text or code.

arcwhite 6d ago on HN
Taking a photograph of that art and reselling it would be, though.
jimbokun 6d ago on HN
Do we have to treat humans and LLMs identically under the law?
CharlesW 6d ago on HN
"Transformative nature" is just one of several factors that go into deciding if something is fair use. Also, fair use is decided case by case in the courts, so one can't say that "training LLMs on copyrighted materials is fair use".

Model vendors know this isn't fair use, given that they're self-censoring the training and/or generation of copyrighted materials by entities big enough to hurt them. As usual, the rest of us have no recourse other than bend over and take it.

stale2002 6d ago on HN
> Also, fair use is decided case by case in the courts,

> Model vendors know this isn't fair use

Pick a lane dude. Either it's possible for us to make legal analysis and best guesses or uhh "we have no idea it's up for the courts to decide!"

Yes we know it's up for the courts to decide. And people are making argument about what those courts will do.

That's how legal analysis works.

Yes, it is perfectly possible to talk about fair use and follow existing guidelines on it and the government has already make statements that this stuff is likely transformative.

CharlesW 6d ago on HN
> …the government has already make statements that this stuff is likely transformative.

Incorrect.

"…the [Copyright] Office rejects two common arguments about the transformative nature of AI training. As noted above, some argue that the use of copyrighted works to train AI models is inherently transformative because it is not for expressive purposes. We view this argument as mistaken. […] Nor do we agree that AI training is inherently transformative because it is like human learning. To begin with, the analogy rests on a faulty premise, as fair use does not excuse all human acts done for the purpose of learning." — Copyright and Artificial Intelligence, Part 3: Generative AI Training, United States Copyright Office

And again, the degree to which training and output is transformative is just one of several factors that courts consider when deciding if something is protected as fair use.

verdverm 6d ago on HN
Courts are also part of the government and have said otherwise. It is not monolithic, hence the "we view this argument as mistaken..."

Several points in that opinion/report (not a policy document) from the USCO also seem to be contrary to rulings like https://en.wikipedia.org/wiki/Authors_Guild,_Inc._v._Google,....

CharlesW 4d ago on HN
> It is not monolithic…

Correct, it can't be as I said above. That why "this stuff is likely transformative" is meaningless in at least two ways.

stale2002 5d ago on HN
> rejects two common arguments

Fortunately I made no reference to these 2 very specific arguments. So my point stands.

pessimizer 6d ago on HN
> Courts have been deeming that fair use due to the transformative nature.

A court has deemed this fair use. The transformation is obviously mechanical, though, unless you think computers are people.

postepowanieadm 6d ago on HN
I don't understand the copyright law.
dcrazy 6d ago on HN
You don’t understand copyright law.
calibas 6d ago on HN
So copyright only applies if there's sufficient human control, and prompts alone do not demonstrate sufficient control. Exactly what counts as "sufficient human control" must be analyzed on a case-by-case basis.

That means I can't know if my AI generated code can be copyrighted unless someone takes it to court?

Garlef 6d ago on HN
So...

• What about non-ai code generators (such as https://heyapi.dev/)?

• And what about a code generator that is a hybrid? (So: Something like heyapi but with LLM/agents intertwined)

za_creature 6d ago on HN
Determinism is key.

By which I mean deterministic outputs, not necessarily deterministic processing.

acuozzo 6d ago on HN
> Determinism is key.

So LLM-generated code is fine as long as the temperature is set to 0?

za_creature 6d ago on HN
No, but temp = 0 is not enough for determinism anyway

https://news.ycombinator.com/item?id=50108753

jimbokun 6d ago on HN
I think a lot of people seeking to profit from AI generated content might get a rude awakening if their business model ends up in court, according to this analysis.

Like if a competitor literally copied all of Spotify’s AI generated music and offered it for free, Spotify would have no recourse.

Maybe Spotify doesn’t care, but it’s something I hadn’t considered.

hobo123 6d ago on HN
That music is worth nothing, so worth is proportional to copyright in this case.

Nobody would Napster and steal that music. And people can generate similar music for very cheap. Nobody will license that music, say, to use on their game or movie soundtrack.

Spotify only uses it to water down costs for the many eyeballs, or rather earlobes, they have.

waterTanuki 6d ago on HN
> • Copyright does not extend to purely AI-generated material, or material where there is insufficient human control over the expressive elements.

This is the part that needs to be defined either via court ruling or legislation. What constitutes "purely AI-generated material"? If I ask claude code to write a new OS kernel, and then write one comment on one utility function, or change a single variable name, is the code mine? Patent Law lacks a fine-grained model for defining ownership of code bases which are often a plethora of licenses and ownership.

amanaplanacanal 5d ago on HN
I doubt comments or variable names are enough. If you compile your new kennel, the comments and variable names are gone. Compiling it shouldn't cause you to lose copyright.
waterTanuki 5d ago on HN
The question though is whether or not you gain copyright from changing the comments & variable names after it's all been AI-generated. Under the current Patent Law model codebases are either owned or not owned by a particular individual.

We could go one step further and say, instead of changing a variable name or a comment, we alter by hand a for loop to use a recursive function call instead. Do I own the entire OS Kernel now, or does Patent Law have a framework that specifies I own that particular function, but not the entire kernel?

Timwi 5d ago on HN
This discussion is about copyright, not patent law.
schiffern 5d ago on HN

  >Copyright does not extend to purely AI-generated material, or material where there is ***insufficient*** human control over the expressive elements.
Vagueness alert.

How do we know if it's "sufficient?" Sufficient for what? If the answer is "sufficient for copyright protection," isn't that circular reasoning?

If the answer is "sufficient for an economically successful creative output," isn't this automatically a losing battle? As AI gets better and as movie studios use AI more, the goalpost of "sufficient" will move like sand shifting beneath our feet.

waximabbax 6d ago on HN
By this logic, shouldn't any code using an open-source framework or language also be open source? Even before AI, devs learned from Stack Overflow and plenty of open source code.

You're confusing writing code with software engineering. Devs never just wrote code, they took ownership of the outcome. Business owners put their money on the line for product decisions.

To say that just because devs or founders use AI to write code, the code is no longer their intellectual property is ridiculous. Humans take responsibility for the outcome and are willing to accept the losses. AI can't do that. AI doesn't have any stakes in the output it generates, humans do.

Arubis 6d ago on HN
A fair number of FOSS licenses were interpreted this way. The popular migration away from GPLv3 (might’ve been v4?) towards MIT, LGPL, etc had more than one cause (a huge one was the rapid sectoral commercialization; the decline of RMS’s reputation may have contributed, etc), but a big one was the potential interpretation of new GPL as being overly viral and “license-infecting” only slightly related software assets rather than wholly derivative ones.
adwn 6d ago on HN
For me, it's the latter: the GPL feels overbearing and patronizing, and I don't want some dependency to dictate under which terms I can release my own software. I pay the community back by using MIT whenever I open-source something. This feels more "free" than RMS's view of freedom.

I know that many people would disagree with me on this, but thankfully I'm free to choose what license I consider "free".

jasonlotito 6d ago on HN
> I don't want some dependency to dictate under which terms I can release my own software.

Then you shouldn't release it under the MIT license, which has restrictions and requirements on speech. You have to release it to the public domain. Pretending MIT doesn't dictate terms under which you can release your own software is just a fantasy.

Showing 400 of 665. Read the rest on Hacker News

Comments are loaded live from Hacker News and are not stored by Mid or Real.