|
🔏 OpenAI watermarks some ChatGPT text
LINK
|
- OpenAI has started a limited rollout of text watermarking and detection to comply with the EU AI Act, which requires generative providers to make AI-generated text identifiable in a machine-readable way.
- API customers globally can opt into watermarking for select models starting today, though it stays off by default, while invisible watermarks land on eligible ChatGPT and Codex output in the EU over the coming weeks.
- OpenAI is opening applications for its detector to approved researchers only, cautioning that a watermark shows an OpenAI system touched a passage but not authorship, accuracy, or how much human editing was involved.
|
🧮 Claude aces test 12 CPAs flunked
LINK
|
- Claude Opus 5 scored a perfect 100% across all 20 solo attempts on Mercor's real-world accounting tasks, while 12 licensed CPAs averaging 5.4 years of experience managed only about 37%.
- Drawn from Mercor's APEX-Accounting benchmark, the four month-end close scenarios required searching company files, finding figures, and formatting results; Claude finished each run in under 10 minutes versus 30 minutes to three hours for humans, at roughly 49x lower cost per rubric criterion.
- The sharper signal is the climb: GPT-4o scored near zero 18 months ago, o3 passed the human average by spring 2025, and GPT-5 hit about 69% before frontier models reached perfect scores, though Mercor stresses the test strips away client communication, judgment, and the longer workflows where model performance still drops.
|
🌍 New AI world model spans many fields
LINK
|
- PhAI Labs, with researchers from Stanford, Oxford and Princeton, released JEPA-Anything, a version of Yann LeCun's Joint-Embedding Predictive Architecture that predicts abstract summaries of future states instead of reconstructing raw data, and tested it across physics, robotics, medicine, weather, fluid dynamics, molecular simulation and biology.
- The key change: instead of a single prediction module, the model splits the predicted state into several parts, each with its own predictor constrained to capture a different aspect; prediction error fell 35% in a simplified Pong environment and by nearly half on the Burgers fluid equation, and on orbital mechanics it recovered Kepler's third law with an exponent of -1.4991 versus the theoretical -1.5.
- Code and models are on GitHub and Hugging Face, but the authors caution that cleanly separated parts don't prove the model has learned real cause-and-effect, so how far it can be trusted to guide experiments remains open.
|
🔎 New benchmark tests AI code reviewers
LINK
|
- GitHub released ReviewBench, an offline benchmark that scores AI code review agents on real pull requests, measuring what each system catches, misses, and the precision-recall tradeoffs it makes, with a research preview available today.
- The corpus holds 219 pull requests from 187 open-source repos across 19 languages, drawn to match the distribution of 103.9M GitHub pull requests, with every finding labeled by severity and category against a multi-source golden set and a Claude Sonnet 5 grader.
- Six metrics split into grounded scores against known labels and augmented scores crediting newly discovered issues, with senior engineers independently matching ReviewBench's true-positive judgments 96.6% of the time, though augmented recall shifts its denominator per agent, so grounded recall stays the headline cross-system number.
|
🤖 Reflection unveils its first open model Beam
LINK
|
- Reflection has unveiled Beam, its first open-weight model, built to match leading Chinese open models from Deepseek and Qwen on compute-efficient coding, reasoning, and agentic tasks rather than topping raw performance.
- The mixture-of-experts model activates 23B of 501B parameters per token, matches GLM 5.2 on reasoning using three to four times less compute, and offers a tunable knob to trade thinking time against cost.
- Weights ship under Apache 2.0 "later this month" alongside a technical report and docs, though Beam is still in final safety testing with only an early version open to select users, and stronger open models like Kimi K3 still beat it on raw performance.
|
|
