In our recent paper published in IEEE Transactions on Communications (https://arxiv.org/abs/2105.11028… — In our recent paper published in IEEE Transactions on Communications (https://arxiv.org/abs/2105.11028, https://ieeexplore.ieee.org/document/9439935), we studied the problem of communication-efficiency of Federated Learning (FL) which has recently received a lot of attention for large-scale privacy-preserving machine learning. We discussed that high communication overheads due to frequent gradient transmissions decelerate FL for which…

I want to share an interesting puzzle that I encountered and finally was able to figure it out. Here is how it goes. Having the gradient… — I want to share an interesting puzzle that I encountered and finally was able to figure it out. Here is how it goes. Having the gradient of a two-variable function f(x, y) at point (x0, y0) to be equal (2, 1); What is the best direction to go in order…

As early as I remember I was an overthinking machine; my mind was the highway of thoughts coming and going constantly. Some of these… — As early as I remember I was an overthinking machine; my mind was the highway of thoughts coming and going constantly. Some of these thoughts were positive, some funny while others were negative and depressing. Sometimes I smiled secretly as a result of these thoughts. Some other times I scowled…