GitHub

News from IT House on June 6, according to Business Insider.Anthropic Through a project involving about 1,000 human software engineers, Claude. Code's performance.

The project, known as “Marlin” within the data label company Snorkel AI, is centred on fine-tuning Claude Code's answers to bring it closer to the real work environment of the developers.

AI companies such as Anthropic typically outsource data work to third-party companies such as Snorkel, which hire outsourcing personnel to teach AI disciplines in various fields of specialization and perform other tasks to improve models.

The two outsourcers involved in the Anthropic project disclosed that they were paid $280 per assignment for preparing the hint and reviewing the code (IT House Note: the current exchange rate is approximately RMB 1902). They indicated that each task would take approximately an hour, although some submissions would require multiple rounds of communication with the Snorkel approval level.

In the Marlin project, outsourced personnel with a software engineering background were required to perform an A/B test of codes produced by two different models. They compare two sets of outputs, choose their own preferred results and judge whether the model actually meets the level of detail required by the hint.

One of the outsourced personnel indicated that the project was aimed at ensuring that the model would be able to meet the level of detail desired in the hints and that, in essence, it was training Claude Code to produce simpler, more maintenance-friendly codes.

It is understood that the project is still ongoing. Outsourcing personnel do not know which version of the model they assess.

Advertising statements: The external jump links (including not limited to hyperlinks, 2D codes, passwords, etc.) contained in the text are used to convey more information and save time for selection purposes only for reference purposes, which are included in all IT House articles.