國立虎尾科技大學 |

Utilizing Concurrent Data Accesses for Data-Driven and AI Applications /

Record Type:	Language materials, printed : Monograph/item
Title/Author:	Utilizing Concurrent Data Accesses for Data-Driven and AI Applications // Xiaoyang Lu.
Author:	Lu, Xiaoyang,
Description:	1 electronic resource (210 pages)
Notes:	Source: Dissertations Abstracts International, Volume: 85-11, Section: B.
Contained By:	Dissertations Abstracts International85-11B.
Subject:	Computer science. -
Online resource:	http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=31235597
ISBN:	9798382595368

Utilizing Concurrent Data Accesses for Data-Driven and AI Applications /
Lu, Xiaoyang,

Utilizing Concurrent Data Accesses for Data-Driven and AI Applications /Xiaoyang Lu. - 1 electronic resource (210 pages)

Source: Dissertations Abstracts International, Volume: 85-11, Section: B.

In the evolving landscape of data-driven and AI applications, the imperative for reducing data access delay has never been more critical, especially as these applications increasingly underpin modern daily life. Traditionally, architectural optimizations in computing systems have concentrated on data locality, utilizing temporal and spatial locality to enhance data access performance by maximizing data and data block reuse. However, as poor locality is a common characteristic of data-driven and AI applications, utilizing data access concurrency emerges as a promising avenue to optimize the performance of evolving data-driven and AI application workloads.This dissertation advocates utilizing concurrent data accesses to enhance performance in data-driven and AI applications, addressing a significant research gap in the integration of data concurrency for performance improvement. It introduces a suite of innovative case studies, including a prefetching framework that dynamically adjusts aggressiveness based on data concurrency, a cache partitioning framework that balances application demands with concurrency, a concurrency-aware cache management framework to reduce costly cache misses, a holistic cache management framework that considers both data locality and concurrency to fine-tune decisions, and an accelerator design for sparse matrix multiplication that optimizes adaptive execution flow and incorporates concurrency-aware cache optimizations.Our comprehensive evaluations demonstrate that the implemented concurrency-aware frameworks significantly enhance the performance of data-driven and AI applications by leveraging data access concurrency. Specifically, our prefetch framework boosts performance by 17.3%, our cache partitioning framework surpasses locality-based approaches by 15.5%, and our cache management framework achieves a 10.3% performance increase over prior works. Furthermore, our holistic cache management framework enhances performance further, achieving a 13.7% speedup. Additionally, our sparse matrix multiplication accelerator outperforms existing accelerators by a factor of 2.1.As optimizing data locality in data-driven and AI applications becomes increasingly challenging, this dissertation demonstrates that utilizing concurrency can still yield significant performance enhancements, offering new insights and actionable examples for the field. This dissertation not only bridges the identified research gap but also establishes a foundation for further exploration of the full potential of concurrency in data-driven and AI applications and architectures, aiming at fulfilling the evolving performance demands of modern and future computing systems.

English

ISBN: 9798382595368Subjects--Topical Terms:

573171
Computer science.
Subjects--Index Terms:

Computer architecture

Utilizing Concurrent Data Accesses for Data-Driven and AI Applications /
LDR:04192nam a22004453i 4500 001 1157768
005 20250603111412.5
006 m o d
007 cr|nu||||||||
008 250804s2024 miu||||||m |||||||eng d
020 $a 9798382595368
035 $a (MiAaPQD)AAI31235597
035 $a AAI31235597
040 $a MiAaPQD $b eng $c MiAaPQD $e rda
100 1 $a Lu, Xiaoyang, $e author. $3 1484037
245 1 0 $a Utilizing Concurrent Data Accesses for Data-Driven and AI Applications / $c Xiaoyang Lu.
264 1 $a Ann Arbor : $b ProQuest Dissertations & Theses, $c 2024
300 $a 1 electronic resource (210 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Dissertations Abstracts International, Volume: 85-11, Section: B.
500 $a Advisors: Sun, Xian-He Committee members: Hale, Kyle C.; Yan, Yan; Wang, Jia.
502 $b Ph.D. $c Illinois Institute of Technology $d 2024.
520 $a In the evolving landscape of data-driven and AI applications, the imperative for reducing data access delay has never been more critical, especially as these applications increasingly underpin modern daily life. Traditionally, architectural optimizations in computing systems have concentrated on data locality, utilizing temporal and spatial locality to enhance data access performance by maximizing data and data block reuse. However, as poor locality is a common characteristic of data-driven and AI applications, utilizing data access concurrency emerges as a promising avenue to optimize the performance of evolving data-driven and AI application workloads.This dissertation advocates utilizing concurrent data accesses to enhance performance in data-driven and AI applications, addressing a significant research gap in the integration of data concurrency for performance improvement. It introduces a suite of innovative case studies, including a prefetching framework that dynamically adjusts aggressiveness based on data concurrency, a cache partitioning framework that balances application demands with concurrency, a concurrency-aware cache management framework to reduce costly cache misses, a holistic cache management framework that considers both data locality and concurrency to fine-tune decisions, and an accelerator design for sparse matrix multiplication that optimizes adaptive execution flow and incorporates concurrency-aware cache optimizations.Our comprehensive evaluations demonstrate that the implemented concurrency-aware frameworks significantly enhance the performance of data-driven and AI applications by leveraging data access concurrency. Specifically, our prefetch framework boosts performance by 17.3%, our cache partitioning framework surpasses locality-based approaches by 15.5%, and our cache management framework achieves a 10.3% performance increase over prior works. Furthermore, our holistic cache management framework enhances performance further, achieving a 13.7% speedup. Additionally, our sparse matrix multiplication accelerator outperforms existing accelerators by a factor of 2.1.As optimizing data locality in data-driven and AI applications becomes increasingly challenging, this dissertation demonstrates that utilizing concurrency can still yield significant performance enhancements, offering new insights and actionable examples for the field. This dissertation not only bridges the identified research gap but also establishes a foundation for further exploration of the full potential of concurrency in data-driven and AI applications and architectures, aiming at fulfilling the evolving performance demands of modern and future computing systems.
546 $a English
590 $a School code: 0091
650 4 $a Computer science. $3 573171
650 4 $a Computer engineering. $3 569006
653 $a Computer architecture
653 $a Concurrency
653 $a Data access
653 $a Machine learning
653 $a Memory system
653 $a Memory optimization
690 $a 0984
690 $a 0800
690 $a 0464
710 2 $a Illinois Institute of Technology. $b Computer Science. $3 1184432
720 1 $a Sun, Xian-He $e degree supervisor.
773 0 $t Dissertations Abstracts International $g 85-11B.
790 $a 0091
791 $a Ph.D.
792 $a 2024
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=31235597