Page 115 of 130 • 1560 Total Articles

createLiveAI

Continue exploring the latest AI breakthroughs, technology insights, and industry analysis. Page 115 of our comprehensive AI news collection.

📰 Latest Intelligence

Showing 12 articles on page 115 of 130

Live feed
Research
📄 arXiv Machine Learning

The Panaceas for Improving Low-Rank Decomposition in Communication-Efficient Federated Learning

The paper proposes three innovative techniquesModel Update Decomposition (MUD), Block-wise Kronecker Decomposition (BKD), and Aggregation-Aware Decomposition (AAD)to enhance low-rank decomposition methods in federated learning, addressing key issues of what to decompose, how to decompose, and how to aggregate. Experimental results demonstrate that these methods lead to faster convergence and higher accuracy, supported by a theoretical analysis confirming the convergence of MUD.

Research
📄 arXiv Machine Learning

Two Is Better Than One: Rotations Scale LoRAs

A new gating method called RadarGate enhances the scalability and generalization of LoRA-based Mixture-of-Experts in large language models by introducing rotational operations among LoRA representations, enabling richer feature interactions. Extensive experiments across multiple benchmarks demonstrate its effectiveness in addressing underfitting and poor generalization issues as the number of LoRAs increases.

research machine-learning
Read More
Research
📄 arXiv Machine Learning

VERINA: Benchmarking Verifiable Code Generation

A new benchmark called Verina has been introduced to evaluate the ability of large language models (LLMs) to generate verifiable code, including code, specifications, and proofs, across 189 curated tasks in Lean. The evaluation reveals significant challenges, with the best model achieving only 61.4% correct code and minimal success in proof generation, highlighting the need for advancements in LLM-based verification methods.

Research
📄 arXiv Machine Learning

Weight Spectra Induced Efficient Model Adaptation

This research investigates how fine-tuning large models alters their weight matrices, revealing that it mainly amplifies top singular values and reorients dominant singular vectors, indicating task-specific knowledge is embedded in low-dimensional subspaces. Building on these findings, the authors propose a method that modulates top singular directions through learnable rescaling, improving performance across tasks while maintaining the model's global structure.

Research
📄 arXiv Machine Learning

X-Factor: Quality Is a Dataset-Intrinsic Property

Research indicates that dataset quality is an intrinsic property, independent of size, class balance, and model architecture, and significantly influences machine learning performance. The study finds that dataset quality emerges from the quality of its constituent classes, making it a key factor alongside size, class balance, and architecture for optimizing classifiers.

Machine Learning
Read More

Page 115 of 130 • Showing articles 1369-1380 of 1560