AI Briefing#arxiv
The latest AI and developer news about #arxiv, with the original source and a short summary.
The latest AI and developer news about #arxiv, with the original source and a short summary.
The Causal Grassmann layer achieves validation perplexities within 10-15% of size-matched Transformers on Wikitext-2 and slightly outperforms DistilBERT on SNLI.
The study found byte-level models required about 6x less text to reach parity with token-based models during initial training.
A new framework identifies scientifically plausible research directions that existing communities are unlikely to propose, recovering 2025 combinations at 35.9 times chance.
The paper demonstrates that N individuals acting as parallel environment rollouts create an effective per-sample step size of alpha = 1/N.
The method uses pair-norm analysis to allocate precision to salient channel pairs, maintaining accuracy down to 1.5 bits where baselines degrade sharply.
Cross-layer shared Meta Experts reduce parameter redundancy and improve downstream task accuracy compared to hierarchical Local Experts.
PACE uses periodic rounding and channel-aligned scaling to maintain accuracy at four bits, matching 8-bit performance on models up to 35B parameters.
Combining block-level Flow generation with AR verification increased throughput by 2.54x.
A frozen 16 MB vocabulary table matches or exceeds learned embeddings on key benchmarks while reducing model size to 46 MB and boosting CPU inference speed by five to six times.
A drop-in component for transformers that reduces peak memory by 1.5-3.4x while maintaining accuracy.
The system uses a lightweight quantized draft model to predict expert usage, reducing PCIe I/O bottlenecks on commodity hardware.
Analysis of 6,309 public skills reveals that while only 5.4% are malicious, 70% possess capabilities like shell access or credential theft that pose significant security risks.
The method stores precomputed n-gram counts on host memory to improve validation loss and enable domain adaptation without training.
The framework reuses target model hidden states to avoid maintaining historical KV caches, outperforming DSpark by up to 70%.
Trace-and-memory inspection reaches 86.67% on GAIA, and evolved architectures improve xBench and ALFWorld results with a 4.4% median code-change ratio.
The new HybridAgents framework dynamically switches between latent and text reasoning, improving performance by 10.4% across 11 benchmarks while cutting costs by 2.7x-3.7x.
The framework now supports serving LLMs via OpenAI, Anthropic, and Ollama protocols simultaneously using a unified .flm file format.
Qwen3.5-4B achieves 81.4% on JevBench without training, while fine-tuning proves effective for small models
Architecture and performance data released for serving 79 model rows, from text to robot actions, within a single runtime
The new MA-BC method pools demonstrations only when expert actions agree, providing upper and lower bounds on sample complexity.
Analysis of 1,250 arXiv papers establishes a taxonomy for self-improvement loops at deployment and training time.
A tool that performs parallel translation based on LaTeX source to prevent formulas and tables from breaking
Effective October 1, 2026, arXiv limits authors to two submissions per calendar month and three active submissions at any time to manage moderator workload.
Context Language Models (CLMs) outperform state-of-the-art context management strategies by treating context as a file the model updates autonomously, achieving up to 11.4% higher accuracy with 21.5% fewer FLOPs on BrowseComp-Plus.