Learning efficient linear codes for natural images: the roles of sparseness, overcompleteness, and statistical independence

Bruno A. Olshausen; David J. Field

doi:10.1117/12.238708

22 April 1996 Learning efficient linear codes for natural images: the roles of sparseness, overcompleteness, and statistical independence

Bruno A. Olshausen, David J. Field

Author Affiliations +

Proceedings Volume 2657, Human Vision and Electronic Imaging; (1996) https://doi.org/10.1117/12.238708
Event: Electronic Imaging: Science and Technology, 1996, San Jose, CA, United States

Abstract

An algorithm is described which allows for the learning of sparse, overcomplete image representations. Images are modeled as a linear superposition of basis functions, and a set of basis functions is sought which maximizes the sparseness of the representation (fewest number of active units per image). When applied to natural scenes, the basis functions converge to localized, oriented, bandpass functions that bear a strong resemblance to the receptive fields of neurons in the primate striate cortex. Importantly, the code can be made overcomplete, which allows for an increased degree of sparseness in which the basis functions can become more specialized. The learned basis functions constitute an efficient representation of natural images because sparseness forces a form of reduced entropy representation that minimizes statistical dependencies among outputs.

Citation Download Citation

Bruno A. Olshausen and David J. Field "Learning efficient linear codes for natural images: the roles of sparseness, overcompleteness, and statistical independence", Proc. SPIE 2657, Human Vision and Electronic Imaging, (22 April 1996); https://doi.org/10.1117/12.238708

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available