skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Deeper and sparser nets are optimal

Conference ·
OSTI ID:645481

The starting points of this paper are two size-optimal solutions: (1) one for implementing arbitrary Boolean functions (Home and Hush, 1994); and (2) another one for implementing certain sub-classes of Boolean functions (Red`kin, 1970). Because VLSI implementations do not cope well with highly interconnected nets--the area of a chip grows with the cube of the fan-in (Hammerstrom, 1988)--this paper will analyze the influence of limited fan-in on the size optimality for the two solutions mentioned. First, the authors will extend a result from Home and Hush (1994) valid for fan-in {Delta} = 2 to arbitrary fan-in. Second, they will prove that size-optimal solutions are obtained for small constant fan-in for both constructions, while relative minimum size solutions can be obtained for fan-ins strictly lower that linear. These results are in agreement with similar ones proving that for small constant fan-ins ({Delta} = 6...9) there exist VLSI-optimal (i.e., minimizing AT{sup 2}) solutions (Beiu, 1997a), while there are similar small constants relating to the capacity of processing information (Miller 1956).

Research Organization:
Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
Sponsoring Organization:
USDOE Assistant Secretary for Management and Administration, Washington, DC (United States)
DOE Contract Number:
W-7405-ENG-36
OSTI ID:
645481
Report Number(s):
LA-UR-97-4359; CONF-980216-; ON: DE98003447; TRN: AHC2DT03%%22
Resource Relation:
Conference: EIS `97: international symposium on engineering of intelligent systems, Tenerife (Spain), 11-13 Feb 1998; Other Information: PBD: Mar 1998
Country of Publication:
United States
Language:
English

Similar Records

Deeper sparsely nets are size-optimal
Conference · Mon Dec 01 00:00:00 EST 1997 · OSTI ID:645481

Small fan-in is beautiful
Conference · Mon Sep 01 00:00:00 EDT 1997 · OSTI ID:645481

On limited fan-in optimal neural networks
Conference · Sun Mar 01 00:00:00 EST 1998 · OSTI ID:645481