-
Notifications
You must be signed in to change notification settings - Fork 75
enh(blog): Add blog post on generative AI peer review policy #734
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
|
@all-contributors please add @elliesch for review, blog |
|
I've put up a pull request to add @elliesch! 🎉 |
|
@all-contributors please add @elliesch for blog, review |
|
cc @willingc in case you are interested in this blog post!! no pressure!! |
This blog post outlines pyOpenSci's new peer review policy regarding the use of generative AI tools in scientific software, emphasizing transparency, ethical considerations, and the importance of human oversight in the review process.
Co-authored-by: Jed Brown <[email protected]>
Co-authored-by: Jed Brown <[email protected]>
Co-authored-by: Jed Brown <[email protected]>
Co-authored-by: Jed Brown <[email protected]>
Co-authored-by: Jed Brown <[email protected]>
Co-authored-by: Jed Brown <[email protected]>
willingc
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Love this! A few grammar suggestions.
| * Using LLM output verbatim could violate the original code's license | ||
| * You might accidentally commit plagiarism or copyright infringement by using that output verbatim in your code | ||
| * Due diligence is nearly impossible since you can't trace what the LLM "learned from" (most LLM's are black boxes) | ||
|
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
| * Using LLM output verbatim could violate the original code's license | |
| * You might accidentally commit plagiarism or copyright infringement by using that output verbatim in your code | |
| * Due diligence is nearly impossible since you can't trace what the LLM "learned from" (most LLM's are black boxes) | |
| * Using LLM output verbatim could violate the original code's license | |
| * You might accidentally commit plagiarism or copyright infringement by using that output verbatim in your code | |
| * Due diligence is nearly impossible since you can't trace what the LLM "learned from" (most LLMs are black boxes) | |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think "verbatim" is being leaned on too much here. An LLM can produce verbatim copies of its corpus, but the standard in copyright law is not limited to verbatim copies. If the process involved copying at any stage, refactoring can only obfuscate. The "substantial similarity" standards in copyright law are used as circumstantial evidence of process. Modifying the result by paraphrasing/refactoring is concealing the evidence (and thus reduces the likelihood of being caught), but does not make the process legal. I think we should be careful to not spread that misconception to readers.
Co-authored-by: Carol Willing <[email protected]>
Co-authored-by: Carol Willing <[email protected]>
Co-authored-by: Carol Willing <[email protected]>
Co-authored-by: Carol Willing <[email protected]>
Co-authored-by: Carol Willing <[email protected]>
Co-authored-by: Carol Willing <[email protected]>
| LLMs are trained on large amounts of open source code; most of that code has licenses that require attribution. | ||
| The problem? LLMs sometimes spit out near-exact copies of that training data, but without any attribution or copyright notices. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
| LLMs are trained on large amounts of open source code; most of that code has licenses that require attribution. | |
| The problem? LLMs sometimes spit out near-exact copies of that training data, but without any attribution or copyright notices. | |
| LLMs are trained on large amounts of open source code that is bound by various licenses, many of which require attribution. When an LLM generates code, it may reproduce verbatim output or patterns or structures from that training data—but without attribution or copyright notices. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Trying to include more than just verbatim ... that fundamentally, the patterns as well are licensed.
Also wondering here - let's say that i produce some code totally on my own that happens to match a pattern of some code with a license that requires attribution. What happens there? (if my production code is legitimately developed on my own and the pattern just happens to be a great one that others use too, and maybe I've even seen it before, but I'm not intentionally copying).
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
As far as copyright law is concerned, that's exactly the scenario where the substantial similarity standard would be applied. The more substantial the copying and the more closely in time that you would have observed the original, the more likely your work would be found to have substantial similarity and to be infringing. Protecting against that ambiguity is why clean-room design exists.
This blog post outlines pyOpenSci's new peer review policy regarding the use of generative AI tools in scientific software, emphasizing transparency, ethical considerations, and the importance of human oversight in the review process.
It is codeveloped by the pyOpenSci community and relates to a discussion here:
pyOpenSci/software-peer-review#331