CROSS-REFERENCE TO RELATED APPLICATION This application claims the benefit of U.S. Provisional Patent Application No. 60/361,849, filed Mar. 5, 2002, which is herein incorporated by reference in its entirety.
BACKGROUND OF THE INVENTION This invention relates to systems and methods of recognizing what page a book is opened to (e.g, what page a user is reading from a book). More particularly, this invention relates to recognizing the page of a book that a user is reading and subsequently playing an audio segment associated to the recognized page.
Talking books have been developed that employ mechanical schemes in order to recognize the particular page that a user is reading from a book. One example of such a mechanical talking book is present in Haas et al. U.S. Pat. No. 5,954,514 that is assigned to Eastman Kodak Company of Rochester, N.Y.
Such mechanical talking books employ thick pages, usually made out of cardboard, that are placed in a binder. These binder-pages are moved along binder rings and contain magnets that interact with stationary Hall effect sensors as the pages are turned. After a sensor recognizes a page turning, a prerecorded message is played that is associated to the Hall effect sensor for that page. Such prior art mechanical talking books are deficient for many reasons. First, these books require large, thick, and rigid pages which ultimately limit the number of pages that can be efficiently realized in the talking book. As the number of pages increase in such books so does the complexity of the book's design. For example, numerous magnets may be required to be placed in specific locations on a page so that when a page is turned, a specific magnet passes over a specific Hall effect sensor. The number of pages, therefore, are limited to the number of Hall effect sensors that can be placed on the binder.
Furthermore, magnets have to extend from each page, thereby increasing the book's size. Moreover, these magnets only interact with the Hall effect sensors as the pages are turned. If a user opens such a book to a random page, by opening one bulk of pages to the left of the book's spine and one bulk of pages to the right of the book's spine, the book has no way to distinguish what page the book is opened to. Such conventional talking books do not have autonomous page recognition because these books sense when a page is turned to, not when a page is viewable to the user.
Talking books have also been developed that use infrared detection schemes to recognize when a page is turned. One example of an infrared talking book can be found in Brefka et al. U.S. Pat. No. 4,636,881 that is assigned to James T. Shaw of Sagaponack of New York.
Infrared talking books are at a disadvantage because they have to keep track of the number of pages that have been turned. As a result, if a user would like to begin reading from page50 then that user would have to begin onpage1 and turn each page individually, making sure that each page was recognized, until page50 was reached. If the first 50 pages were simply turned at the same time in a group, the talking book would only recognize a single page as being turned and, as a result, the wrong audio-segment would be played.
Other non-autonomous talking books have also been developed that rely on user-interactions with the book or desired page to output the desired audio segment. One example of such a non-autonomous talking book can be seen in Tabachnik et al. U.S. Pat. No. 6,330,427. Here, varying valued resistors are located on each page so that when a user touches an audio device to a resistor having a particular resistance, an audio segment associated to that particular resistance is played.
Non-autonomous talking books are deficient because they require the user to interact with the book, such as turning the book's pages or interacting with a page's resistive sensor, in order to hear an audio segment for a particular page or portion of a page.
It is therefore desirable to provide systems and methods for improved talking and interactive books. More particularly, is therefore desirable to realize an autonomous talking book that does not require any specific actions by the user (e.g., touching an audio device to the pages or specifically turning the pages). Such an autonomous talking book would be capable of recognizing which page, or pair of pages, is in an open position without any special handling of the book.
SUMMARY OF THE INVENTION It is an object of the present invention to provide systems and methods for realizing autonomous page-recognition in books. More particularly, it is an object of the present invention to employ light sensors, such as photoresistors or photodiodes, in books such that a page is autonomously recognized as being open to when light shines on that page.
In preferred embodiments, the present invention employs light sensors on the pages of a talking book. Audio segments are associated to every page, or pair of pages, such that if light shines on a page, an audio segment associated to that page plays. In this manner, a user can open a talking book of the present invention to any page by using any opening method and still have the appropriate audio segment played. Thus, autonomous page recognition is realized. Because light sensors are employed on or in the pages, a page of the present invention is preferably thinner than a page of traditional talking books. In preferred embodiments, a page is approximately as thick as the employed light sensing component. Currently, the active area of light sensing components can be fabricated to the thickness of a standard piece of paper.
One or more light sensors may be placed on any one page or pair of pages. A delay may be incorporated into the book's functionality such that a sensor, or array of sensors, has to recognize the most light for a period of time (e.g., 1-5 seconds) before an audio segment associated to that sensor, or array of sensors, is played. Such a delay would allow a user to turn to a particular page without having to listen to the audio segments associated to the recently turned pages.
The electronics that operate the book are preferably stored in either the book's binding or covers. In doing so, a talking book constructed in accordance with the principles of the present invention can have both the size and the appearance of any non-talking book.
The audio associated to a page can take a variety of forms and, depending on the audio segment's format, can achieve a variety of different talking books. For example, the talking book can output an audio version of the text located on a particular page or set of pages. In this manner, the present invention could be utilized to teach young children to read. Such a book could also be utilized, for example, to read to people that have difficulty in seeing the text of a book. Additionally, some books, such as user manuals, usually are read while the user is performing some act. For example, a cook book contains pages with recipes. A reader of a cookbook occasionally attempts to do two things at once, read the book and carry out the recipe. A talking book of the present invention that employs text-associated audio segments can relieve one of the burdens that a cookbook user has; the necessity to physically read and re-read the instructions. Thus, an audio segment may be repeated if the playing of the audio segment completes and the user is still recognized as reading the same page.
Furthermore, if the audio segments are associated to the text of a book's pages then the text of the pages may be removed altogether. Thus, a book's whimsical and festive nature could be noticeably increased as a result of this alteration. For example, people buy traditional art books in a museum so that they can see the paintings in the museum at any time. However, such traditional art books usually have only small representations of the paintings because descriptive text is required for each painting. Yet, an art talking book of the present invention may eliminate text entirely. Thus, a talking book of the present invention may contain page-size representations of the paintings. If the amount of memory in which the media segments (e.g., a segmented audio version of the tour of the museum's collection contained in the book) associated to each page is large enough, the amount of description that can be stored in audio can easily surpass the amount of description that can be provided as text in a traditional art book.
Additional photo-electronic components may be employed in a talking book of the present invention to create an interactive talking book. For example, interactive light sensors may be placed on a page so that if a user “presses” a light sensor (e.g., covers the light sensor so that it does not recognize any light) an audio-segment associated with this action may be played. Additionally, the duration of how long a sensor is covered may be utilized to control what audio segment is played. The principles of the present invention can be migrated to other mediums such as, for example, magazines, newspapers, pamphlets, puzzles, maps, and binders.
As in another embodiment, the electronics of a talking book of the present invention may be removable from and insertable into other talking books. In such embodiments, a user would only need a single electronic binding that is compatible with a variety of light sensing books and associated memory components.
BRIEF DESCRIPTION OF THE DRAWING The above-mentioned objects and features of the present invention can be more clearly understood from the following detailed description considered in conjunction with the following drawings, in which the same reference numerals denote the same structural elements throughout, and in which:
FIG. 1 is an illustration of a talking book employing photo sensors constructed in accordance with the principles of the present invention;
FIG. 2 is an illustration of a book binding for a talking book constructed in accordance with the principles of the present invention;
FIG. 3 is an electronic architecture for a talking book utilizing photo sensor readings as controller inputs constructed in accordance with the principles of the present invention;
FIG. 4 is an electronic architecture for a talking book utilizing photo sensor readings as memory enabling signals constructed in accordance with the principles of the present invention;
FIG. 5 is a talking book depicting illustrating various photo sensor locations and increased page image size constructed in accordance with the principles of the present invention;
FIG. 6 is a talking book employing light sensing buttons constructed in accordance with the principles of the present invention;
FIG. 7 is a flow chart of an autonomous page recognition process constructed in accordance with the principles of the present invention;
FIG. 8 is a flow chart of an autonomous page recognition process constructed in accordance with the principles of the present invention;
FIG. 9 is a flow chart of a light sensor button recognition process constructed in accordance with the principles of the present invention; and
FIG. 10 is an illustration of one embodiment of how a light sensor may be affixed to a page constructed in accordance with the principles of the present invention.
DETAILED DESCRIPTION OF THE INVENTIONFIG. 1 depicts talkingbook100 that employs any number oflight sensors161 and162 on any number of pages (e.g.,pages110 and120) to determine which page, or pair of pages, is being read by a user. Persons skilled in the art will appreciate that any type of light sensing or light sensitive component or material may be used to sense the amount of light that is exposed to the pages of talkingbook100.Light sensors161 and162 may be, for example, photodiodes, photoresistors, phototransistors, solar cells, photomultiplier tubes, or any other type of light sensor.
In preferred embodiments, talkingbook100 recognizes what page is opened to (e.g, what page is being read by a user) by sensing what page is exposed to the most amount of light. Talkingbook100 may also be configured to recognize an OPEN page by determining which page or pages are receiving any light past a particular threshold. After the particular page, or pair of pages, is recognized as being OPEN, talkingbook100 may perform an action associated to that page. For example, talkingbook100 may play an audio or media clip associated to that page. Electronics and other components needed for the operation of talkingbook100 may be stored in either book binding150,front cover140,back cover130, or any other area of talkingbook100.
Persons skilled in the art will appreciate that whenbook100 is opened, two pages may be exposed to light. For example, ifpage120 is being read by a user, the reverse side of page110 (not shown) may also be exposed. Yet, one page may be exposed if talkingbook100 is folded so onlypage120 faces the user and thus, preferably, receives the most light. As per another example,front cover140 may not contain light sensors or text. Thus, only one page, the front ofpage110 would be visible to a user whenfront cover140 is first opened.Light sensors161 and162 may, therefore, be located on multiple pages, multiple sides of pages, between pages on binding150,front cover140,back cover130, or any other area of talkingbook150 in order to better recognize what pages ofbook100 are being read by a user.
Light sensors161 and162 may also be employed in multiple configurations on a page ofbook100 in order to take a more accurate reading of light falling onto the page, capturing the way a user is holding and operating the book, and recognizing whatpage talking book100 is opened to. In this manner, if multiple light sensors are present on a page, the average light from this array may be used to determine if the page, or pair of pages, is being read by a user.
As previously mentioned, audio clips may be associated tolight sensors161 and162. For example, audio corresponding topage110 may be associated tolight sensor161. Audio corresponding topage120 may be associated tolight sensor162. Thus, whenpage110 is opened to, talkingbook100 will preferably play the audio segment associated tolight sensor161. Whenpage120 is opened to, talkingbook100 will preferably play the audio segment associated tolight sensor162.
Audio may correspond to multiple pages through a single light sensor. For example, an audio clip that contains a vocal representation of the text located on the reverse side ofpage110 and front ofpage120 may be associated tolight sensor162. Persons skilled in the art will appreciate that any number of pages may be included in talkingbook100. Audio clips may be associated to, for example, text, images, pictures or other indicia located on the pages of talkingbook100. Audio clips may be in the form of, for example, songs, readings of the text, descriptions of images, soundtracks, or oral instructions.
Multiple light sensing procedures may be utilized in talkingbook100. One light sensing procedure recognizes iflight sensor161 or162 is ON (e.g., light is hitting the sensor) and, if a light sensor is ON, plays the audio clip associated to the ON light sensor.Light sensors161 and162 may have tolerances or thresholds, so that at least a specific amount of light needs to be sensed in order forlight sensors161 and162 to, for example, turn ON, conduct an appropriate amount of current to be determined as being ON, or provide a an appropriate amount of potential to be determined as being ON.
Persons skilled in the art will appreciate that multiple types of light recognizing techniques may, be utilized in accordance with the principles of the present invention. For example, light readings may be taken from alllight sensors161 and162 that are ON or just alllight sensors161 and162 regardless of their state. The intensity or magnitude of light from these readings may then be compared and an audio segment corresponding to the light sensor or array of sensors that has sensed the brightest light may be played. As per another technique, the amount of light that is read by a light sensor or array of sensors may be averaged over a period of time (e.g., 1-5 seconds). After the sampling period ends, the averages of all sensors, or array of sensors, may be compared.
A user may sometimes turn the pages of a book in order to find a particular page. Therefore, a delay also may be integrated into talkingbook100 such that undesired audio segments are not played to a user while that user turns the pages of talking book lob. This delay may take many forms. In one embodiment, the delay may be configured so that a light sensor, or an array of light sensors, has to read the most light for a given period of time (e.g., 1-5 seconds).
Persons skilled in the art will appreciate that control, audio playing devices, and memory are also preferably included in talking book100 (e.g., in binding150). Generally, the audio segments will be stored in memory and played through an audio playing device when the control circuitry chooses, by comparing the measurements from the light sensors, what page or pair of pages is OPEN to a user. A button may also be included on talking book100 (shown inFIG. 2) to toggle between pages when a pair of pages is being recognized as being OPEN. This toggle button would toggle the audio being played to a user between the audio segments associated to the two OPEN pages. The operation of the control circuitry, memory, and audio playing devices (e.g., speakers) will be discussed further below in more detail.
Persons skilled in the art will also appreciate that one light sensor may be used for a pair of pages. Additionally, multiple light sensors may be incorporated on each page where some of these light sensors face one side of the page (e.g., measures light from the front of the page) while the rest of the light sensors face the reverse side of the page (e.g., measures light from the back of the page).
FIG. 2 depicts book binding200 that may be employed in a talking book constructed in accordance with the principles of the present invention. Binding200 may be utilized to house, for example, the control circuitry, memory, audio circuitry, and speakers of a talking book.
ON/OFF switch270 may be included on book binding200 in order to turn a talking book ON or OFF. For example, ON/OFFswitch270 may be used to determine if power is being supplied to the talking book. ON/OFF switch270 may slide between two positions (e.g., positions272 and273) ontrack271. Each one ofpositions272 or272 may correspond to either an ON or OFF functionality. Persons skilled in the art will appreciate that talkingbook200 does not need ON/OFF switch270 to turn ON and OFF. Instead, talkingbook200 may be configured to automatically turn on when an interior light sensor (e.g. a light sensor on a page) measures a meaningful amount of light. Similarly, talkingbook200 may be automatically be turned OFF if none of the interior light sensors measure any meaningful amount of light for a period of time.
Volume control221 may be included on book binding200 and may be used by a user to control the volume of the audio played. Similarly,speed control222 may be included on binding200 and may be used by a user to control the speed of the audio being played. Other buttons also may be included to manipulate the presentation of audio of a talking book. For example, one child user may appreciate the audio book to be in a fatherly voice while another may appreciate a motherly voice. In this example, binding200 would allow a user to change the voice to that of a mother, father, baby, teen, male, female. Additionally, dials may be included to allow a user to change the pitch and tone of a voice manually.
If binding200 holds circuitry or electrical components, binding200 may include any number of wires or communication lines such as input lines261-264. Input lines261-264 are preferably coupled to the light sensors of the present invention and communicate the state of, or electrical readings from, the light sensors to the control circuitry contained in binding200. The control circuitry may then determine which audio segment associated to a light sensor, array of light sensors, page, or pair of pages should, if any, be played to the user throughspeakers251 and252.
Persons skilled in the art will appreciate that additional communication lines or wires may extend from binding200 and that multiple wires may be needed to operate, or read, a single light sensor. For example, if the light sensor was a photodiode, one embodiment may require that a terminal of the photodiode be suppled a voltage or grounded while a different terminal to be sensed for current. As per another example, light emitting diodes (LEDs) may be incorporated on a page and power control lines may be extended from book binding200 to these LEDs. In this manner, inputs261-264 may also take the form of output lines.
Toggle button223 may also be included onbinder200.Toggle button223 may be utilized to control which audio segment to play if a page, or plurality of pages, is associated to multiple audio segments. For example, a pair of pages may have two audio segments associated to the pair. Each audio segment, however, may only correspond to a single page. Thus, a user may utilizetoggle button223 to toggle between these two audio segments. Iftoggle button223 is not utilized by a user, binding200 would preferably play the audio segment associated to the earlier page in the book and then automatically play the audio segment associated to the later page in the book.
Speakers251 and252 may be included on binding200. Speakers may be included anywhere on binding200 and in some embodiments may be extendable from binding200 throughextendable speaker segment210. Persons skilled in the art will appreciate that any number of speakers may be employed in a talking book of the present invention. Furthermore, the functionality of binding200 may be included into other areas of a talking book, such as the book covers of a talking book constructed in accordance with the principles of the present invention.
Persons skilled in the art will appreciate that a majority of the electronics of talkingbook200 may be stored outside of the talking book. For example, the memory, control, and speaker circuitry may be stored in an external housing (e.g., a teddy bear). In this example, some control circuitry may still be included in the talking book to distinguish what page that a book is turned to. The book may include a transmission circuit that can send information about which page is OPEN to the external circuitry housing (which would have a receiver circuit to receive the information). The circuitry in the external housing would then be able to determine which media segment to play in memory and play that media segment (e.g., an audio segment) to the user.
FIG. 3 depictselectronic architecture300 that may be utilized to construct a talking book in accordance with the principles of the present invention.Architecture300 may include two separate segments,circuitry housing301 and any number ofpages350.Page350 may contain any number of light sensors or output devices whilecircuitry housing301 contains the circuitry necessary to control and utilize the devices onpage350.Communication lines340 are included to electrically couple these two segments together. Generally,communication lines340 may be input wires that accept light readings from the light sensors (e.g. photodiode360,phototransistor370, and photoresistor380) onpage350 orcommunication lines340 may be output wires that provide control signals to electrical components (e.g., LED390) onpage350. As a result ofcommunication lines340,control circuitry310 may know, for example, what light sensors are exposed to light and how much light each sensor is exposed to.
Persons skilled in the art will appreciate that light sensors may also be included on a binding of a talking book. Such light sensors may preferably be placed between the pages of the talking book and facing the direction from which a user would read the talking book. When a light sensor senses the most amount of light in this embodiment then the pages that this light sensor lies between are OPEN.
Control circuitry310 may perform any function that is necessary for a talking book constructed in accordance with the principles of the present invention to operate. For example,control circuitry310 may determine what page, or pair of pages, that light is being exposed to by comparing the readings from any number of light sensors and, as a result, determine what page, or pair of pages, is OPEN.Control circuitry310 may then, for example, choose an audio clip frommemory330, by enabling a block ofmemory330 that is associated to the OPEN page, or pair of pages, and enablingaudio circuitry320 to play the clip.
Persons skilled in the art will appreciate that timing functions can be performed bycontrol circuitry310. For example, light sensors may only be utilized bycontrol circuitry310 at a specific time interval in order to sense if a page has been turned, the talking book has been closed, or to continue playing or to repeat the audio segment being played if the same page is still being read by the user.
Audio circuitry320 may be included inhousing301. In one embodiments,audio circuitry320 may only be a circuitry. In more complicated embodiments,audio circuitry320 may also include an amplifier or other sound manipulation devices. User controls that a user can utilize to manipulate sound (e.g., change the pitch, tone, or volume) of an audio segment may be included inaudio circuitry320.
Persons skilled in the art will appreciate thataudio circuitry320 is not limited to just presenting audio to a user. Moreover,audio circuitry320 may not present audio to the user at all.Audio circuitry320 may, instead, provide any type of media. For example, instead of speakers,audio circuitry320 may include a display console. In this manner, additional text, video, or pictures may be displayed to a user. Such media would preferably be associated to a page, or light sensor, in the same was a an audio segment has been herein described.
Memory330 may be included inhousing340 to store any number of media segments (e.g., audio segments or movie segments).Memory330 may be accessed using any known technique.Memory330 may be partitioned in blocks such that each block is associated to a light sensor, array of light sensor, page, or pair of pages. Variably,control circuitry310 may contain references to where a media segment for a particular page is located onmemory330.Memory330 may be played bycontrol circuitry310, for example, by simply enabling the desired portion of memory to be read, converted into an appropriate signals, and streamed intoaudio circuitry320 at an appropriate rate.
As mentioned above,page360 may contain any number of light sensors or other electrical components. For example,page360 may contain any number ofphotodiodes360,phototransistor370,photoresistor380, orLED390. Persons skilled in the art will appreciate thatphotodiode360 may also be a solar cell, or photocell, andphotodiode360 may be configured in either a photovoltaic or photoconductive configuration.
Photodiode360 may be included onpage360 to determine the amount of light onpage350 or a portion ofpage350. In one embodiment,photodiode360 may be given a power voltage atterminal362 bycontrol circuitry310.Control circuitry310 may then read the amount of current fromterminal361. The amount of current fromterminal361 is dependent upon the amount of light impinging the active region ofphotodiode360. In this manner,control circuitry310 can determine which photodiode, or groups of photodiodes, are being inflicted with the most light.
Phototransistor370 may be included onpage350 to determine the amount of light onpage350 or a portion ofpage350. In oneembodiment phototransistor370 may be supplied a power voltage toterminal372 bycontrol circuitry310. The amount of current provided to controlcircuitry310 byterminal373 would then be dependent on the intensity oflight371.
Photoresistor380 may be included onpage350 to determine the amount of light onpage350 or a portion ofpage350.Terminal382 ofphotoresistor380 may be supplied, for example, by a voltage signal fromcontrol circuitry310. The resistance ofphotoresistor380 is dependent upon the amount of light that photoresistor380 is exposed to. In this manner, the amount of current supplied to controlcircuitry310 byterminal381 will be dependent upon the amount of light that photoresistor380 is exposed to.
LED390 may also be powered bycontrol circuitry310 atterminals391 and392 such output devices could enhance the whimsical and festive nature of a talking book. For example, if light buttons (as discussed inbook600 ofFIG. 6) were incorporated intopage350 then an LED could light up depending on which light button was pressed (e.g., covered up). For example, suppose thatpage350 contained a question with four answers and that each answer had a corresponding light button. Now, twoLEDs390 may be incorporated ontopage350 where one was green and one was read. If the user presses the right light button (i.e., answers the question correctly) then an appropriate LED may light up on page350 (e.g., the green LED).
Persons skilled in the art will appreciate that the light sensors and electrical components that may be placed onpage350 may be electrically coupled, and utilized bycontrol circuitry310, in many different configurations and may employ a variety of other sensing techniques. As per one example, a resistor may electrically coupled toterminal361 ofphotodiode360.Terminal361 may be coupled to controlcircuitry310. The opposite terminal of this resistor may then be coupled to ground. Thus,control circuitry310 is provided a voltage signal frompage350 instead of a current signal.
Turning now toFIG. 4,electronic architecture400 is depicted that utilizes light sensor readings as direct memory enabling signals. Light readings from the light sensors of the talking book may be directly used to enable specific memory blocks so that media may be played fromaudio circuitry420 through, if necessary, controllingcircuitry410. One advantage ofelectronic architecture400 is thatcontrol circuitry410 may not be needed, thus decreasing the cost of manufacturing a talking book.
More particularly,memory430 may be configured such that when a block of memory receives an appropriate signal (e.g., a light reading of a desired intensity) from a light sensor, that block ofmemory430 is streamed, at an appropriate rate, tomedia circuitry420. In this embodiment, light sensors may be coupled tomemory430 instead ofcontrol circuitry410.
FIG. 5 depicts talkingbook500 that includes various light sensor locations and increased page image size. Talkingbook500 depicts a few of the locations that light sensors may be placed. More particularly, An array of light sensors522-525 may, for example, be included on each page or set of pages in order to obtain a better reading of the light falling on a particular page of a talking book. More particularly, light readings from all of the light sensors included in an array may be averaged together (e.g. bycontrol circuitry310 ofFIG. 3) to obtain a more accurate reading of the amount of light falling on that page.
Variably, as described above, a singlelight sensor521 may be located on a page. As depicted aslight sensor521, a single light sensor is preferably close to the spine and in the middle of the page. This location is a preferred location because the page thatlight sensor521 is located on would have to be substantially open in order forlight sensor521 to read any significant amount of light. Additionally, if the control circuitry is located in the spine ofbook500,cover501, or cover502, a minimum amount of wiring would be needed to interconnectlight sensor521 to the control circuitry.
Talkingbook500 may have increased functionality if talkingbook500 is properly configured to take advantage of the light sensing attributes described above. For example, no text is needed in talkingbook500 as long as the information contained in the text is also contained in an associated audio segment. Furthering this example, if the text is removed from the page, the pages may take on additional functionality by incorporating additional information. As shown in talkingbook500, text is removed frompage503 to be replaced bypicture510 that substantially fillspage503.
The above technique may be especially advantageous in art books where conventional art books have small images due to large descriptions. As a result, one embodiment of the present invention could be an art book with full-page illustrations. Information about such illustrations would preferably be communicated through the audio automatically played when a user is reading a page (e.g., a page is OPEN). In doing so, a larger amount information than could be placed onpage503 as text may be included in this audio segment.
Furthering the above example, the book could be an art book for a specific museum painting collection where each page has a single painting on it. The audio could be associated to the museum's tour of that collection. Therefore, if a user turns to the last page of the book and that page depicts the last picture of the collection, the last page will autonomous be recognized as being open and the tour audio segment associated to that painting may be played to the user. This would be beneficial over art collection tour videos in which you can't control the duration, magnification, or angle that you view a painting.
Talkingbook500 also includesspeakers550 and560.Speakers550 and560 may be extendable from book covers501 and502, respectively. If more than one speaker is utilized on a talking book, the speaker may be associated to different audio segments or present audio segments differently. For example, if the talking book is a play and the text is that of a two person conversation each speaker may be designated to play the speech from one of these persons. As per another example, leftspeaker550 may output the left channel of an segment file whileright speaker560 may output the right channel of the same audio file. Persons skilled in the art will appreciate that other speaker configurations may be employed in talkingbook500.
Looking now atFIG. 6,interactive talking book600 is depicted that employs light sensing buttons which allow a user to interact with a page ofbook 600. Particularly, light sensors may be utilized for other functions in addition to autonomous page sensing. In some embodiments, light buttons may be incorporated onto a page such that an audio clip, or other type of media, is triggered when no light is sensed in those instances when light is supposed to be sensed.
More particularly, light buttons621-624 may be utilized to sense light afterlight sensor610 has determine thatpage604 is OPEN. Light buttons621-624 may then act provide the same functionality as mechanical buttons such that if a child covers a light button, an associated action may occur. For example, suppose that a cow is associated tolight button622. In this example, if a child coverslight button622 andlight button622 is not exposed to light, then an associated action may occur. As associated action may be that the sound of a cow is played throughspeakers650 and660 ortext631 appears ondisplay630. In this manner,interactive talking book600 may be utilized as an educational and learning toy. Light buttons621-624 may be electrically coupled to control circuitry in the same manner as a light sensor is coupled to the control circuitry. For example, a light button may be similar tophotodiode360,phototransistor370, orphotoresistor380 ofFIG. 3 and coupled to controlcircuitry310 ofFIG. 3.Control circuitry310 may be configured to distinguish which light sensors are being utilized as light buttons and which light sensors are being utilized to determine which page, or pair of pages, is OPEN.
Persons skilled in the art will appreciate that additional components may be included onpage604. For example, temperature sensor may be placed onpage604 instead of light buttons621-624.
As mentioned,display screen630 may be included on talkingbook600 and may be utilized to display video signals in addition to or instead of audio signals for each page.Display screen630 may include speakers and control buttons to manipulate the display of the media played (e.g., contrast, brightness, speed).
As per one example, suppose that talkingbook600 pertains to the best100 films of all time where each opened page or pages is associated to one of these 100 best films. If the movie “Treasure Hunters” is turned to, a trailer, or video segment, from “Treasure Hunters” may be displayed ondisplay screen630. Preferablydisplay screen630 is extendable from eitherbook cover601 or602 or the binding of talkingbook100.
As yet another example, suppose a talking book pertains to the best100 video games of all time where each opened page or pages is associated to one of these 100 best video games. Controls may be included on or extend from talkingbook600 so that a level or segment of each video game may be played when the page associated to that game is turned to.
FIG. 7 depictsprocess700 utilized in an autonomous page recognition system constructed in accordance with the principles of the present invention.Process700 may initiate withstep710 when a talking book is turned ON. Step220 then compares the light on the light sensors located throughout the talking book. Step730 determines what light sensor is reading the most light and determines if this signal has been approximately consistent (e.g., reading the most light) for a particular amount of time (e.g., approximately 3 seconds). If the light sensor, or the average light reading from an array of light sensors, reading the most light is not consistent for the particular amount of time then step720 is repeated.
Persons skilled in the art will recognize that for a signal to be consistent it may only need to be reading light while the other light sensing signals are not reading light. If the signal remains constant then step740 occurs and the audio, or media, associated with the light sensor sensing the most light is played. Step750 checks to see if the audio is complete and, if so, returns to step720 to check for a new page, else step730 (or750) may be repeated so that the audio may continue playing.
Additionally, a step may be included to delay utilizing the amount of light sensed by light sensors after audio play has been determined as completed bystep750 in order to give the user time to turn the page. Such a step would be especially useful in a talking book that can be read, or requires the book to be read, by reading the pages non-consecutively.
FIG. 8 depictsprocess800 that may be utilized in an autonomous page recognition system constructed in accordance with the principles of the present invention.Process800 is initiated by step81 that senses to see if a page is opened (e.g., a page is exposed to light). If so,step820 commences and plays media associated to the page, or pair of pages, sensed instep810.
FIG. 9 depictsprocess900 that may be employed in a system with light sensing buttons.Process900 is initiated bystep910 that senses to see if a page is opened (e.g., a page is exposed to light). If so,step920 commences to see if a light button is pressed. If so,step920 occurs and media associated to that light button is presented to the user. Otherwise,step920 is repeated.
Persons skilled in the art will appreciate that additional steps may be included inprocesses700,800, and900 ofFIGS. 700, 800, and900, respectively. For example inprocess900 ofFIG. 9, media may, in addition to being associated with a light button, be associated to a page. Therefore, media associate with the page sensing the most light may be played instep910, during or after which media may be played associated to the activation of a light button.
Turning now toFIG. 10,page layout1000 is shown.Page layout1000 includes one embodiment of howlight sensor1040 may be attached topage1020. In the illustrated embodiment, hole1025 is cut inpage1020 that is the same size asactive region1042 oflight sensor1040.Light sensor1040 has, in the depicted embodiment, aphysical housing1041 from whichactive region1042 extends from.Light sensor1040 may be attached topage1020 by placingactive region1042 through hole1025 and using an adhesive (e.g., a glue) on the side ofphysical housing1041 facing page1025.
Page1030 may be used to better securelight sensor1040 to page1025. An adhesive may be used to affixpage1030 to page1025.Page1030 may also provides insulation forwires1043 and1044.
Page1010 may also be affixed to the top ofpage1020 to support the weight oflight sensor1040 onpage1020. In such an embodiment,light sensor1040 would preferably be able to sense light throughpage1010 and any adhesive used that may be placed betweenactive region1042 andpage1010. Additionally, a hole, similar to hole1025, may be included onpage1010. Such an embodiment would be advantageous ifactive region1042 extends beyondphysical housing1041 by a thickness greater thanpage1020. In this manner,page1030 may include a hole that is approximately the size ofphysical housing1041 such that abook containing page1020 may be fully closed.
Persons skilled in the art will appreciate thatlight sensor1040 may be attached topage1020 in many ways. For example,light sensor1040 may be constructed withoutphysical housing1041 andwires1043 and1044.Active region1042 may then be embedded intopage1020 and metallic ink may be printed onpage1020 and appropriately connected toactive region1042 so thatactive region1042 may be utilized.
Components of one of the talking book of the present invention may be removable and insertable into other talking books constructed with the principles of the present invention. For example, the memory of the talking book may be removable and insertable into other talking books. The information, media, or audio associated to the pages of a talking book may be stored in such a memory device. Removable memory may be used to decrease the price of multiple talking books since only one memory unit needs to be purchased. In this manner, a user could connect to the internet and download the appropriate media for a particular talking book.
Similarly, most of the electronic components of a talking book constructed in accordance with the principles of the present invention may be removable. If all the electronics, other than page light sensing, are located in the binding of the talking book then a portion of the binding may be removable. Such a binding portion could be compatible with a variety of similar talking books such that the talking book electronics (e.g., control and audio circuitry) are reused. Extending upon this feature of the present invention, a separate removable memory device may included with each talking book of the present invention and insertable into the removable electronic binding. Examples of memory that may be employed in the talking book of the present invention include, for example, flash, ROM, RAM, SRAM, DRAM, PROM EPROM, and EEPROM memory devices or other suitable volatile or non-volatile memories. Smart cards may also be utilized as memory devices by the present invention.
The interior of each cover may also include pressure pads. Once a page is determined to be OPEN the pressure pads could be configured to sense when a person presses down on a particular section of a page. As a result an interactive talking book could be realized, employing functions similar to that of talkingbook500 ofFIG. 5.
For talking books that take the form of novels, audio other than audio directly representative of the text of the book may be utilized. For example, in a novel of “Treasure Hunters”, the soundtrack of “Treasure Hunters” may be selectively played according to the theme of the text contained on the pages (or chapters) that are currently being read by a user. Thus, when a fast-chase sequence is being read by a user, an associated fast paced audio segment will be played to the user. Thus, persons skilled in the art will appreciate that the benefit provided to a user of a talking book of the present invention may be different depending on the type of audio or media segment provided to that user.
Methods may be employed to decrease the memory needed for audio or media segments to be stored. For example, music compression may be utilized. As per another example, text may be stored in the memory of a talking book that is directly associated to the text of a page or a portion of a page. A voice synthesizer may then be included in the talking book that can translate digital text into speech. In doing so, the amount of memory needed to store speech will be decreased.
Persons skilled in the art will also appreciate that the apparatus of the present invention may be implemented using other control methods, comparison techniques, sensing components (e.g., touch buttons and thermal buttons), and configurations. All such modifications are within the scope of the present invention, which is limited only by the claims that follow.