國立虎尾科技大學 |

Causal Robot Learning for Manipulation.

紀錄類型:	書目-語言資料,手稿 : Monograph/item
正題名/作者:	Causal Robot Learning for Manipulation./
作者:	Lee, Tabitha Edith.
面頁冊數:	1 online resource (278 pages)
附註:	Source: Dissertations Abstracts International, Volume: 86-01, Section: B.
Contained By:	Dissertations Abstracts International86-01B.
標題:	Robotics. -
電子資源:	click for full text (PQDT)
ISBN:	9798383572634

Causal Robot Learning for Manipulation.
Lee, Tabitha Edith.

Causal Robot Learning for Manipulation. - 1 online resource (278 pages)

Source: Dissertations Abstracts International, Volume: 86-01, Section: B.

Thesis (Ph.D.)--Carnegie Mellon University, 2024.

Includes bibliographical references

Two decades into the third age of artificial intelligence, the rise of deep learning has yielded two seemingly disparate realities. In one, massive accomplishments have been achieved in deep reinforcement learning, protein folding, and large language models. Yet, in the other, the promises of deep learning to empower robots that operate robustly in real-world environments have yet remained unfulfilled. Vast diversity of objects, distribution shifts, long-tailed phenomena: outside of laboratories, real-world environments challenge modern statistical learning assumptions of the data.Although such environments have generally been referred to as "unstructured," this terminology belies their nature. Real-world environments are not "unstructured," but arise because of structure: the underlying causal processes that generate the observed data. In this view, robots should not only reason and learn with respect to data, but also the data generating processes. Such processes can be formalized by the language of causality. Therefore, to learn and leverage the structure of these "open-world" environments, new causal-based robot learning algorithms are needed.Towards this goal, this thesis explores a diversity of robot learning problems, from perception to control. First, we explore how perception models can be learned using sim-to-real transfer from synthetic data (DREAM, FormNet). In these works, relevant features were learned through domain randomization, leading to insights into how structure can be learned more directly using causality. To this end, we introduce structural sim-to-real transfer, where simulation can serve as a causal reasoning engine for the robot to select the relevant features for a control policy (CREST) or skill (SCALE). By construction, these policies are robust to irrelevant distribution shifts that would otherwise stymie correlation-based deep learning. Next, the rich interplay between control, dynamical systems, and causality is explored through the Learning By Doing (LBD) competition and LMeshNet, a methodology for constructing hybrid causal world models that integrate both latent and semantic information. Lastly, we examine curriculum learning. In ACL, we explore the commonalities and differences between human and agent curriculum learning. Then, we employ these lessons learned for CURATE: how agents can manipulate the sequencing of training data to efficiently learn a control policy to solve a desired, difficult task.The advantages of adopting the principles of causal inference have been witnessed to date in fields such as biomedical sciences, economics, and genomics. In the machine learning community, it has recently been argued that such principles should be integrated to harness deep learning, towards causal learning of representations. Analogously, this thesis forwards that the robot learning community stands to gain by leveraging the principles of causality. In so doing, this new paradigm holds promise for robots to learn and leverage structure within the open world through causal robot learning for manipulation.

Electronic reproduction.
Ann Arbor, Mich. :
ProQuest,
2024

Mode of access: World Wide Web

ISBN: 9798383572634Subjects--Topical Terms:

561941
Robotics.
Subjects--Index Terms:

CausalityIndex Terms--Genre/Form:

554714
Electronic books.

Causal Robot Learning for Manipulation.
LDR:04389ntm a22003857 4500 001 1151299
005 20241104055850.5
006 m o d
007 cr bn ---uuuuu
008 250605s2024 xx obm 000 0 eng d
020 $a 9798383572634
035 $a (MiAaPQ)AAI31485190
035 $a AAI31485190
040 $a MiAaPQ $b eng $c MiAaPQ $d NTU
100 1 $a Lee, Tabitha Edith. $3 1478035
245 1 0 $a Causal Robot Learning for Manipulation.
264 0 $c 2024
300 $a 1 online resource (278 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Dissertations Abstracts International, Volume: 86-01, Section: B.
500 $a Advisor: Kroemer, Oliver.
502 $a Thesis (Ph.D.)--Carnegie Mellon University, 2024.
504 $a Includes bibliographical references
520 $a Two decades into the third age of artificial intelligence, the rise of deep learning has yielded two seemingly disparate realities. In one, massive accomplishments have been achieved in deep reinforcement learning, protein folding, and large language models. Yet, in the other, the promises of deep learning to empower robots that operate robustly in real-world environments have yet remained unfulfilled. Vast diversity of objects, distribution shifts, long-tailed phenomena: outside of laboratories, real-world environments challenge modern statistical learning assumptions of the data.Although such environments have generally been referred to as "unstructured," this terminology belies their nature. Real-world environments are not "unstructured," but arise because of structure: the underlying causal processes that generate the observed data. In this view, robots should not only reason and learn with respect to data, but also the data generating processes. Such processes can be formalized by the language of causality. Therefore, to learn and leverage the structure of these "open-world" environments, new causal-based robot learning algorithms are needed.Towards this goal, this thesis explores a diversity of robot learning problems, from perception to control. First, we explore how perception models can be learned using sim-to-real transfer from synthetic data (DREAM, FormNet). In these works, relevant features were learned through domain randomization, leading to insights into how structure can be learned more directly using causality. To this end, we introduce structural sim-to-real transfer, where simulation can serve as a causal reasoning engine for the robot to select the relevant features for a control policy (CREST) or skill (SCALE). By construction, these policies are robust to irrelevant distribution shifts that would otherwise stymie correlation-based deep learning. Next, the rich interplay between control, dynamical systems, and causality is explored through the Learning By Doing (LBD) competition and LMeshNet, a methodology for constructing hybrid causal world models that integrate both latent and semantic information. Lastly, we examine curriculum learning. In ACL, we explore the commonalities and differences between human and agent curriculum learning. Then, we employ these lessons learned for CURATE: how agents can manipulate the sequencing of training data to efficiently learn a control policy to solve a desired, difficult task.The advantages of adopting the principles of causal inference have been witnessed to date in fields such as biomedical sciences, economics, and genomics. In the machine learning community, it has recently been argued that such principles should be integrated to harness deep learning, towards causal learning of representations. Analogously, this thesis forwards that the robot learning community stands to gain by leveraging the principles of causality. In so doing, this new paradigm holds promise for robots to learn and leverage structure within the open world through causal robot learning for manipulation.
533 $a Electronic reproduction. $b Ann Arbor, Mich. : $c ProQuest, $d 2024
538 $a Mode of access: World Wide Web
650 4 $a Robotics. $3 561941
650 4 $a Computer science. $3 573171
653 $a Causality
653 $a Manipulation
653 $a Robot learning
653 $a Learning By Doing
655 7 $a Electronic books. $2 local $3 554714
690 $a 0771
690 $a 0984
690 $a 0800
710 2 $a ProQuest Information and Learning Co. $3 1178819
710 2 $a Carnegie Mellon University. $b Robotics Institute. $3 1475917
773 0 $t Dissertations Abstracts International $g 86-01B.
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=31485190 $z click for full text (PQDT)