國立虎尾科技大學 |

Tropical Geometry, Neural Networks, and Low-Coherence Frames.

Record Type:	Language materials, manuscript : Monograph/item
Title/Author:	Tropical Geometry, Neural Networks, and Low-Coherence Frames./
Author:	Zhang, Liwen.
Description:	1 online resource (135 pages)
Notes:	Source: Dissertation Abstracts International, Volume: 79-11(E), Section: B.
Contained By:	Dissertation Abstracts International79-11B(E).
Subject:	Computer science. -
Online resource:	click for full text (PQDT)
ISBN:	9780438084094

Tropical Geometry, Neural Networks, and Low-Coherence Frames.
Zhang, Liwen.

Tropical Geometry, Neural Networks, and Low-Coherence Frames. - 1 online resource (135 pages)

Source: Dissertation Abstracts International, Volume: 79-11(E), Section: B.

Thesis (Ph.D.)--The University of Chicago, 2018.

Includes bibliographical references

This dissertation consists of three pieces of work. The first work aims to set up the connection between tropical geometry and feedforward neural networks. We discovered that, mathematically, a feedforward neural network equipped with rectified linear units (ReLU) is a tropical rational function. This connection provides a new approach to understand and analyze deep neural networks. Among other things, we show that the decision boundary derived from an ReLU neural network is contained by a tropical hypersurface of a tropical polynomial in companion with the network. Moreover, we associate functions represented by feedforward neural networks with polytopes and show that a two layer network can be fully characterized by zonotopes which also serve as the building blocks for deeper networks. Also, the number of vertices on the polytopes provides an upper bound on the number of linear regions of the function expressed by the network. We show that this upper bound grows exponentially with the number of layers but only polynomially with respect to number of hidden nodes in each layer.

Electronic reproduction.
Ann Arbor, Mich. :
ProQuest,
2018

Mode of access: World Wide Web

ISBN: 9780438084094Subjects--Topical Terms:

573171
Computer science.
Index Terms--Genre/Form:

554714
Electronic books.

Tropical Geometry, Neural Networks, and Low-Coherence Frames.
LDR:03903ntm a2200361Ki 4500 001 919176
005 20181116131021.5
006 m o u
007 cr mn||||a|a||
008 190606s2018 xx obm 000 0 eng d
020 $a 9780438084094
035 $a (MiAaPQ)AAI10791713
035 $a (MiAaPQ)uchicago:14288
035 $a AAI10791713
040 $a MiAaPQ $b eng $c MiAaPQ $d NTU
100 1 $a Zhang, Liwen. $3 1193686
245 1 0 $a Tropical Geometry, Neural Networks, and Low-Coherence Frames.
264 0 $c 2018
300 $a 1 online resource (135 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Dissertation Abstracts International, Volume: 79-11(E), Section: B.
500 $a Advisers: Lek-Heng Lim; Risi Kondor.
502 $a Thesis (Ph.D.)--The University of Chicago, 2018.
504 $a Includes bibliographical references
520 $a This dissertation consists of three pieces of work. The first work aims to set up the connection between tropical geometry and feedforward neural networks. We discovered that, mathematically, a feedforward neural network equipped with rectified linear units (ReLU) is a tropical rational function. This connection provides a new approach to understand and analyze deep neural networks. Among other things, we show that the decision boundary derived from an ReLU neural network is contained by a tropical hypersurface of a tropical polynomial in companion with the network. Moreover, we associate functions represented by feedforward neural networks with polytopes and show that a two layer network can be fully characterized by zonotopes which also serve as the building blocks for deeper networks. Also, the number of vertices on the polytopes provides an upper bound on the number of linear regions of the function expressed by the network. We show that this upper bound grows exponentially with the number of layers but only polynomially with respect to number of hidden nodes in each layer.
520 $a In the second work, we propose an attention model in continuous vector space for content-based neural memory access. Our model represents knowledge graph entities as low-dimensional vectors while expressing context-dependent attention as a Gaussian scoring function over the vector space. We apply such a model to perform tasks such as knowledge graph completion and complex question answering. The proposed attention model can handle both the propagation of the uncertainty when following a series of relations and also the conjunction of conditions in a natural way. On a dataset of soccer players who participated in the FIFA World Cup 2014, we demonstrate that our model can handle both path queries and conjunctive queries well.
520 $a The third work focus on building finite complex frames generated by cyclic vectors under the action of non-commutative groups. We inspect group frames in the space of operators associated with the group's von Neumann algebra. The searching for a proper cyclic vector is then transformed to finding the intersection of a convex set that prescribes the coherence constraints and a subset of Hermitian rank-one operators. An alternating projection algorithm is employed to search for their intersection and an heuristic extrapolation technique is adapted to accelerate the computation. In the experiments, we applied our model to Heisenberg groups and finite affine groups. In the case of Heisenberg group, our method is able to find cyclic vectors that generate equiangular tight frames up to numerical precision.
533 $a Electronic reproduction. $b Ann Arbor, Mich. : $c ProQuest, $d 2018
538 $a Mode of access: World Wide Web
650 4 $a Computer science. $3 573171
650 4 $a Mathematics. $3 527692
655 7 $a Electronic books. $2 local $3 554714
690 $a 0984
690 $a 0405
710 2 $a ProQuest Information and Learning Co. $3 1178819
710 2 $a The University of Chicago. $b Computer Science. $3 845504
773 0 $t Dissertation Abstracts International $g 79-11B(E).
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=10791713 $z click for full text (PQDT)