Analyze the Convergence Bounds of Federated Learning with Closer-to-Practice Constraints
Implementing Organization
Indian Institute of Technology (IIT), Varanasi, Uttar Pradesh
Principal Investigator
Dr. Hari Prabhat Gupta
Indian Institute of Technology (IIT)
About
Federated Learning (FL) is a popular technique for training machine learning models on decentralized data. However, analyzing convergence bounds while considering practical constraints like heterogeneity of clients, non-i.i.d. data distribution, noisy datasets, and without-replacement sampling method is challenging. This work analyzes the convergence bounds of FL for $L$-smooth functions satisfying the $\mu$-Polyak-Łojasiewicz condition with practical constraints. High probability bounds are obtained, and incorporating practice constraints into FL increases communication rounds but leads to faster convergence when the number of epochs is sufficiently large. The upper bound obtained is more precise when subjected to constraints like smoothness, strong convexity, and fixed noise ratio. The study also proposes a modification to the analyzed convergence bounds by integrating the partially-with-replacement sampling method.
Source
Source
Anusandhan National Research Foundation/Science and Engineering Research Board (SERB), DST 2023-24
Science and Engineering Research Board (SERB), New Delhi
Anusandhan National Research Foundation (ANRF)
Quick Information
Area of Research
Computer Sciences and Information Technology
Focus Area
Machine Learning and Optimization
Start Year
2024
End Year
2027
Sanction Amount
₹ 6.60 L
Status
Ongoing
Contact
venkat_palleti.che@iipe.ac.in
Output
No. of Research Paper
00
Technologies (If Any)
00
No. of PhD Produced
00
No. of Patents
Filed :00
Grant :00
Disclaimer:
Information available on this portal is sourced from various organizations and is provided for informational purposes only. Users are advised to verify details from the respective official sources.
Please enter your details
Please provide your name and email to continue. Your details are saved in this browser for future use.
Latest Updates
Loading…
⚠️
You are leaving this website
You are about to be redirected to an external website that is not operated by
India Science, Technology & Innovation (ISTI) Portal.