Daniel Stenberg has banned AI-edited bug reports from cURL because they were exclusively nonsense and just wasted their time. Just because it gets a hit once doesn’t mean it’s good at this either.
It does show that it can be a useful tool, though.
Here, the security researcher was evaluating it and stumbled upon a previously undiscovered security bug. Obviously, they didn’t let the AI create the bug report without understanding it. They verified the answer and took action themselves, presumably analyzing, verifying, and reporting in a professional and respectful way.
The cURL AI spam is an issue at the opposite side of that. But doesn’t really tell us anything about capabilities. It tells us more about people. In my eyes, at least.
Yeah, that’s fair. When verified beforehand, and what it discovered is an actual issue, why not. It does overwhelmingly attract people who have no idea what they’re doing and then submit bogus reports because it looks good to them though.
@2xsaiko That is a poorly made AI model, then. Whoever put that system in place didn’t train the model properly. In fact, I’m going to guess that you chose a random model like ChatGPT or llama or Gemini.
Or you might not even realize that you need a model specifically trained to handle the kind of thing you are asking.
That isn’t a limitation of AI, that is human error. Do you think people are just pretending it works or something?
Daniel Stenberg has banned AI-edited bug reports from cURL because they were exclusively nonsense and just wasted their time. Just because it gets a hit once doesn’t mean it’s good at this either.
It does show that it can be a useful tool, though.
Here, the security researcher was evaluating it and stumbled upon a previously undiscovered security bug. Obviously, they didn’t let the AI create the bug report without understanding it. They verified the answer and took action themselves, presumably analyzing, verifying, and reporting in a professional and respectful way.
The cURL AI spam is an issue at the opposite side of that. But doesn’t really tell us anything about capabilities. It tells us more about people. In my eyes, at least.
Yeah, that’s fair. When verified beforehand, and what it discovered is an actual issue, why not. It does overwhelmingly attract people who have no idea what they’re doing and then submit bogus reports because it looks good to them though.
@2xsaiko That is a poorly made AI model, then. Whoever put that system in place didn’t train the model properly. In fact, I’m going to guess that you chose a random model like ChatGPT or llama or Gemini.
Or you might not even realize that you need a model specifically trained to handle the kind of thing you are asking.
That isn’t a limitation of AI, that is human error. Do you think people are just pretending it works or something?
That is the problem they get promoted as the one-size-fits-all solution on everything. And people are using it as it’s promoted