 |
For each DNN task, we measure both the transmission cost and the computation cost of tasks.
The transmission cost of task i is the sum of the transmission costs of all subtasks. The transmission cost of subtask j includes the offloading cost of transmitting subtask j to the offloaded node and the tensor cost of transmitting tensor from all predecessor subtasks to subtask j.
The offloading cost depends on the amount of data and the distance between the initial node of task i and the offloaded node.The tensor cost depends on the tensor size from predecessor subtasks and the distance between predecessor subtasks and subtask j.
The computation cost of task i is the sum of the computation costs of all subtasks. We define SLAV as service level agreement violation, which describes the service level of node k offloading subtask j in task i. The computation cost of task i is the sum of the computation costs of all subtasks. The computation cost of subtask j depends on the amount of data and the service level of offloaded node k. |
IEEE/ICACT20230136 Slide.07
[Big Slide]