Yani: Commit codes. Local weight update.
Jackson: NN accuracy (bias terms and -1 in dscore)
Common: New hyperparameter at the server side : localUpdateNum Perform local weight update : w <- w - naught/sqrt(t)*g as many as localUpdateNum
Learning rates are local to each client.
ADMM - "Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers"
"Stochastic Alternating Direction Method of Multipliers"
Also search GITHUB for ADMM
Apache spark instead of firebase.io ?
, SDCA
Write test scripts for unit testing
Reduce data dim using PCA.
HogWild