Coded computation of multiple functions

• Main Authors: Kim, Wilton, Kruglik, Stanislav, Kiah, Han Mao
• Other Authors: School of Physical and Mathematical Sciences
• Format: Conference or Workshop Item
• Language: English
• Published: 2023
• Subjects: Science::Mathematics; Engineering::Computer science and engineering; Computational Efficiency; Algebraic Codes
• Online Access: https://hdl.handle.net/10356/165833
• Institution: Nanyang Technological University

We consider the problem of evaluating arbitrary multivariate polynomials over several massive datasets in a distributed computing system with a single master node and multiple worker nodes. We focus on the general case when each multivariate polynomial is evaluated over its dataset and propose a generalization of the Lagrange Coded Computing framework (Yu et al. 2019) to provide robustness against stragglers who do not respond in time, adversarial workers who respond with wrong computation and information-theoretic security of dataset against colluding workers. Our scheme introduces a small computation overhead which results in a reduction in download cost and also offers comparable resistance to stragglers over existing solutions.