#machine-learning-research
The latest AI and developer news about #machine-learning-research, with the original source and a short summary.
The latest AI and developer news about #machine-learning-research, with the original source and a short summary.
The new MA-BC method pools demonstrations only when expert actions agree, providing upper and lower bounds on sample complexity.
The paper demonstrates that a piecewise affine map with a single parameter and a context selector can reproduce major dynamical regimes and outperform larger foundation models in zero-shot settings.
An analysis of 94 papers on AI value alignment reveals that the majority do not explicitly define 'value,' relying instead on preference and utility maximization.
A Python tool has been released that pre-verifies the causal structure of an environment to prevent distortion of training results when training agents.
PoLar, a technology that dynamically skips or repeats layers in LLMs to optimize inference performance and speed, has been proposed.
An open model with 386M parameters has been released that implements memory through a trained vector bank instead of a long context window.
A new study finds that LLM alignment goes beyond simple filtering, actually restructuring the model's representational space itself.
The paper proposes MBD-LM, a Multi-Block approach designed to improve the parallel decoding performance of Block Diffusion Language Models (BD-LMs).
We propose a new training objective to address the embedding condensation phenomenon that occurs in small language models.
A technique called CDD has been announced that recovers the exact original text of LLM fine-tuning data using only the difference in Logit values, without requiring access to weights.
A study has found that 'Rosetta Neurons,' which are commonly found across different neural networks, become more specialized as model scale increases.
A study quantitatively analyzed how much symmetry reduces sample complexity in geometric deep learning.
A study was published that improves compositional generalization performance by recursively leveraging the model's depth instead of increasing computation time.