How do you benchmark a web search API when the thing being tested can read the answer key? A search agent has a fetch tool. If the gold labels sit in a…
Category: AI
Facilitating AI integration with simplicity at scale
As companies scale, the technology supporting operations can become a liability just as quickly as it becomes an asset. Disconnected systems,…
SymFold: Synergizing Evolutionary and Structural Priors for Accurate Protein Inverse Folding
arXiv:2609.01353v1 Announce Type: new Abstract: Protein inverse folding aims to recover amino acid sequences for a given 3D protein structure,…
Apple shares ‘shocking evidence’ against former employee accused of stealing company data for OpenAI
Apple says it has evidence that a former employee destroyed evidence of data theft after learning he was under investigation.
LEAP: Likelihood Elicitation and Aggregation for LLM-based Probabilistic Forecasting
arXiv:2609.01337v1 Announce Type: new Abstract: LLM-based forecasting systems have improved on real-world tasks such as financial markets and sports…
Gradium AI Releases New Default TTS Model: 81.0% Hard-Case Pass Rate at 216 ms Time-to-First-Audio
Speed and accuracy usually pull against each other in text-to-speech. Gradium AI’s new default model reports both: an 81.0% human-rated pass rate on 500…
Cheap Verifiers, Large Blind Spots: Measuring the Reliability Cost of Cost-Saving Cascades
arXiv:2609.01345v1 Announce Type: new Abstract: Inference cascades cut cost by answering most queries with a cheap model and escalating a hard tail to a…
PSA: Amazon’s shopping AI can now tell you if that message is a scam
Amazon is adding a scam-detection feature to Alexa for Shopping that can verify whether suspicious emails, texts, and other messages actually came from…
A Composable Evaluation System for Reproducible Omni-Modal Foundation Model Evaluation
arXiv:2609.01315v1 Announce Type: new Abstract: Building an omni-modal foundation model means evaluating it across text, image, video, and audio.…
Making Prospective Memory SLM-Shaped: Typed Intention Stores for Small-Model Agents
arXiv:2609.01272v1 Announce Type: new Abstract: Prospective memory means carrying out a deferred intention at the right future cue while other work…