國立虎尾科技大學 |

Demystifying Tail Latency Through Benchmark and Hardware-Software Codesign.

Record Type:	Language materials, manuscript : Monograph/item
Title/Author:	Demystifying Tail Latency Through Benchmark and Hardware-Software Codesign./
Author:	Zhuo, Heng.
Description:	1 online resource (166 pages)
Notes:	Source: Dissertations Abstracts International, Volume: 84-12, Section: B.
Contained By:	Dissertations Abstracts International84-12B.
Subject:	Computer engineering. -
Online resource:	click for full text (PQDT)
ISBN:	9798379726232

Demystifying Tail Latency Through Benchmark and Hardware-Software Codesign.
Zhuo, Heng.

Demystifying Tail Latency Through Benchmark and Hardware-Software Codesign. - 1 online resource (166 pages)

Source: Dissertations Abstracts International, Volume: 84-12, Section: B.

Thesis (Ph.D.)--The University of Wisconsin - Madison, 2023.

Includes bibliographical references

Server performance has always been an active field of research, spanning topics including databases, network applications, and cloud computing. Tail latency is one of the most important performance metrics for server performance, next to mean latency and throughput. More recently, energy and power consumption also attracts attention for better efficiency. There are many factors that can have an impact on system performance, including software service design and hardware environments.In the first part of this work, we study how different timing components affect server workload performance, including thread contention and interrupt handling. We introduce a workload analysis and generation tool: TailWAG. TailWAG relies on measured timing components from applications to generate a synthetic workload that mimics the original behavior. TailWAG can help server designers and application developers explore performance bottlenecks and optimization opportunities at early stages.Then in the next part, we described how interrupt handling and its interaction with synchronization is one of the root causes of tail latency. In addition, we evaluate a recent feature addition to Linux kernel 5.12: threaded NAPI, which improves classic network interrupt handling with controllable scheduling, reducing the asynchronous penalty from the bottom half of network interrupt handling.Based on the implication from the interaction, we take a further step by proposing a pair of tightly coupled accelerators: one for targeting the top half of the interrupt, and one for managing spin lock timeouts. In combination, these accelerators can prevent cascading timing disturbances for multi-threaded server workloads and save CPU energy consumption.

Electronic reproduction.
Ann Arbor, Mich. :
ProQuest,
2024

Mode of access: World Wide Web

ISBN: 9798379726232Subjects--Topical Terms:

569006
Computer engineering.
Subjects--Index Terms:

Hardware acceleratorIndex Terms--Genre/Form:

554714
Electronic books.

Demystifying Tail Latency Through Benchmark and Hardware-Software Codesign.
LDR:03127ntm a22003977 4500 001 1143804
005 20240517104957.5
006 m o d
007 cr mn ---uuuuu
008 250605s2023 xx obm 000 0 eng d
020 $a 9798379726232
035 $a (MiAaPQ)AAI30528917
035 $a AAI30528917
040 $a MiAaPQ $b eng $c MiAaPQ $d NTU
100 1 $a Zhuo, Heng. $3 1468596
245 1 0 $a Demystifying Tail Latency Through Benchmark and Hardware-Software Codesign.
264 0 $c 2023
300 $a 1 online resource (166 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Dissertations Abstracts International, Volume: 84-12, Section: B.
500 $a Advisor: Lipasti, Mikko.
502 $a Thesis (Ph.D.)--The University of Wisconsin - Madison, 2023.
504 $a Includes bibliographical references
520 $a Server performance has always been an active field of research, spanning topics including databases, network applications, and cloud computing. Tail latency is one of the most important performance metrics for server performance, next to mean latency and throughput. More recently, energy and power consumption also attracts attention for better efficiency. There are many factors that can have an impact on system performance, including software service design and hardware environments.In the first part of this work, we study how different timing components affect server workload performance, including thread contention and interrupt handling. We introduce a workload analysis and generation tool: TailWAG. TailWAG relies on measured timing components from applications to generate a synthetic workload that mimics the original behavior. TailWAG can help server designers and application developers explore performance bottlenecks and optimization opportunities at early stages.Then in the next part, we described how interrupt handling and its interaction with synchronization is one of the root causes of tail latency. In addition, we evaluate a recent feature addition to Linux kernel 5.12: threaded NAPI, which improves classic network interrupt handling with controllable scheduling, reducing the asynchronous penalty from the bottom half of network interrupt handling.Based on the implication from the interaction, we take a further step by proposing a pair of tightly coupled accelerators: one for targeting the top half of the interrupt, and one for managing spin lock timeouts. In combination, these accelerators can prevent cascading timing disturbances for multi-threaded server workloads and save CPU energy consumption.
533 $a Electronic reproduction. $b Ann Arbor, Mich. : $c ProQuest, $d 2024
538 $a Mode of access: World Wide Web
650 4 $a Computer engineering. $3 569006
650 4 $a Computer science. $3 573171
650 4 $a Electrical engineering. $3 596380
653 $a Hardware accelerator
653 $a Interrupt handling
653 $a Server system
653 $a Tail latency
653 $a Workload generation
655 7 $a Electronic books. $2 local $3 554714
690 $a 0464
690 $a 0984
690 $a 0544
710 2 $a ProQuest Information and Learning Co. $3 1178819
710 2 $a The University of Wisconsin - Madison. $b Electrical Engineering. $3 1178889
773 0 $t Dissertations Abstracts International $g 84-12B.
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=30528917 $z click for full text (PQDT)