US20170235986A1 - Imaging and peripheral enhancements for mobile devices - Google Patents

Abstract

An image enhancer device for use with an associated mobile electronic device having a digital camera. The image enhancer device includes an image manipulator coupled to a first region of a housing and configured to modify an optical path of the digital camera; an aimer having an aiming element configured to direct at least one aiming light beam towards an object of interest; an illuminator having an illumination element configured to direct at least one illumination light beam from the housing towards the object of interest; and electronics allowing for communication between the image enhancer device and the associated mobile electronic device. The image enhancer device forms a scan angle relative to a field of view of the digital camera of the mobile electronic device and allows for bar code imaging and/or native image processing with the digital camera of the associated mobile electronic device.

Description

CROSS-REFERENCE TO PRIORITY APPLICATION
• The present application is a continuation of co-pending U.S. application Ser. No. 14/794,667, filed Jul. 8, 2015, which claims the benefit of priority to U.S. Provisional Patent Application Ser. No. 62/021,964, filed Jul. 8, 2014, entitled “Imaging and Peripheral Enhancements for Mobile Devices,” the full disclosures of which are incorporated herein by reference.
FIELD
• The subject matter described herein relates to imaging and peripheral enhancements for mobile devices.
BACKGROUND
• Point of sale (POS) terminals, price scanners, and handheld devices used by sales associates in places like retail establishments often incorporate dedicated bar code readers (or bar code scanners) to optically sense a bar code image and produce an electronic signal corresponding to the sensed image. A variety of dedicated bar code readers exist. Dedicated bar code readers typically include one or more illuminating light sources, an aiming light source, an imaging sensor, and electronics to process and interpret the data received. Generally, these readers can operate quickly and reliably for scanning bar codes on merchandise, but have limited interactive and communication capabilities and can be expensive, particularly when they are of the 2D variety.
SUMMARY
• In some aspects there are provided systems, devices, and methods for scanning.
• In some aspects, there is provided an image enhancer device for use with an associated mobile electronic device having a digital camera, the image enhancer device including a housing; an image manipulator coupled to a first region of the housing configured to modify an optical path of the digital camera; an aimer having an aiming element configured to direct at least one aiming light beam towards an object of interest; an illuminator having an illumination element configured to direct at least one illumination light beam from the housing towards the object of interest; and electronics allowing for communication between the image enhancer device and the associated mobile electronic device. The image enhancer device forms a scan angle relative to a field of view of the digital camera of the mobile electronic device and allows for bar code imaging and/or native image processing with the digital camera of the associated mobile electronic device.
• The aiming element can include a first LED light source, the illuminator element includes a second LED light source, and the image manipulator has a first mirrored surface. The electronics can allow for communication from the associated mobile electronic device through a native port on the associated mobile electronic device, the native port being an audio port, a lightning port, or a USB port. The electronics can further allow for harvesting of energy through the native port. The harvested energy can be stored in a super capacitor of the device. The electronics can further receive power from an external source, and further distribute it to the mobile device. The communication can be bi-directional over an audio port on the associated mobile electronic device.
• The image manipulator can receive light directed towards the first region of the housing from the object of interest and reflects the light towards a second region of the housing. The first region and the second region of the housing can be arranged at an angle to one another. The aimer can direct the at least one aiming light beam from the first region of the housing through an aperture in the housing. Incoming light can be directed toward the image manipulator and reflect at an angle relative to the incoming light into a lens or image sensor of the digital camera of the associated mobile electronic device between the aimer and the illuminator. The image manipulator can reside between the aimer and the illuminator. The first region of the housing can allow incoming light to reflect onto the image manipulator and allow outgoing light from the aimer and the illuminator to exit the housing and toward the object of interest. The second region of the housing can be a generally planar surface configured to be positioned flush, adjacent, angled relative to, or otherwise aligned with a chassis of the associated mobile electronic device. The planar surface of the second region can be positionable relative to the chassis of the associated mobile electronic device such that the image manipulator is generally centered and aligned over the lens or image sensor of the digital camera of the associated mobile electronic device and the first region faces at an angle to the chassis such that the at least one aiming light beam and the at least one illuminating light beam are directed away from the device and toward the object of interest. When the second region of the housing is positioned against the chassis of the mobile device and optically aligned with the camera, the first region of the housing can be oriented such that incoming light directed towards the image enhancer device reflects onto the image manipulator and is redirected towards the digital camera of the associated mobile electronic device.
• The at least one aiming light beam can be emitted through an aimer aperture extending through a wall in the housing of the device on the first region of the housing. The at least one illumination light beam can be emitted through an illuminator aperture extending through the wall of the housing. The illuminator aperture and the aimer aperture can be the same or different apertures. A plane of the aimer aperture and a plane of the illuminator aperture can be the same plane, parallel planes, or non-parallel planes. An angle can be formed between a plane of the second region of the housing and the planes of the aimer aperture and the illuminator aperture. The angle can be at least about 15°, 20°, 25°, 30°, 35°, 40°, 45°, 50°, 55°, 60°, 65°, 70°, 75°, 80°, 85°, 90°, 95°, or greater degrees. The angle can be fixed or mechanically adjustable. Incoming light can be redirected by the image manipulator at an angle that is about 15°, 20°, 25°, 30°, 35°, 40°, 45°, 50°, 55°, 60°, 65°, 70°, 75°, 80°, 85°, 90°, 95° degree angle from an original direction. The scan angle can be 90 degrees from a direction that the digital camera is facing.
• The aimer can be housed within an interior volume of the housing and the aiming element can include a lens, a pinhole element defining a pinhole, and an aiming light source coupled to a printed circuit board. The lens can be oriented near a first region of the housing a distance away from the pinhole element. The pinhole element can be coupled to or integrated with an inner surface of the housing between the lens and the aiming light source. The aiming element can further include a diffuser positioned between the pinhole element and the aiming light source. The lens can be placed at its focal point relative to the aiming light source, which is a distance away from the pinhole and has a measured spread of the beam of light produced by the aiming element. The distance can be about 1 mm to about 4 mm and the spread can be about 1 mm to about 40 mm measured between 0 mm and 200 mm from a distal-most point on a surface of the lens. The lens can be placed with its focal point at the pinhole, which is a distance away from the light source and has a measured spread of the beam of light produced by the aiming element. The distance can be about 1 mm to about 5 mm and the spread can be about 1 mm to about 40 mm measured between 0 mm and 200 mm from a distal-most point on a surface of the lens. The lens can be placed with its focal point at an emissive surface of the light source or at an offset relative to the light source. The lens can be a collimating lens, which upon leaving the collimating lens causes the light rays to converge and then diverge. The lens can be placed offset from its focal point relative to the aiming light source which is a distance away from the pinhole and has a measured spread of the beam of light produced by the aiming element. The distance can be about 1 mm to about 5 mm and the spread can be about 1 mm to about 30 mm measured between 0 mm and 200 mm from a distal-most point on a surface of the lens. The light beam can be relatively uniform and obscures individual characteristics of the aiming light source.
• The aimer can be housed within an interior volume of the housing and the aiming element can include a lens, a pinhole element defining a pinhole, a light pipe, and an aiming light source coupled to a printed circuit board. The lens can be oriented near a first region of the housing a distance away from the pinhole element. The pinhole element can be coupled to or integrated with an inner surface of the housing between the lens and the aiming light source. The light pipe can be optionally positioned through at least a portion of the pinhole and direct light from the aiming light source through the pinhole of the pinhole element towards the lens. The aiming element can further include a diffuser positioned between the light pipe and the aiming light source. The lens can be placed with its focal point at the pinhole a distance away from the light source with a light pipe in the path of the light rays between the light source and the pinhole. The light pipe can be shaped such that the light rays having a measured spread pass through the focal point of the lens approximating a point source and the lens is a collimating lens such that projected light rays are approximately parallel to each other.
• The illuminator can be housed within an interior volume of the housing and the illumination element can include an illumination light source coupled to a printed circuit board and optionally a light pipe and/or a diffusing element. The diffusing element, if present, can cover the illumination light source. The light pipe, if present, can be positioned between the illumination light source and the diffusing element. The image manipulator can be coupled to the first region of the housing positioned between the aimer and the illuminator.
• The electronics can allow for communication of data and/or power with electronics of the associated mobile electronic device. The image enhancer device can harvest power from a native port on the associated mobile electronic device. The native port can be a universal audio port and power can be harvested using signals exiting the associated mobile electronic device through the universal audio port from any of the audio channels. The power harvesting can occur simultaneously with unidirectional or bidirectional communication through the native port or through an alternative port. The data protocol or the communication can include one or more of FSK, PSK, QAM, RS-232. The image enhancer device can further include a connector member configured to engage the audio port upon association of the device with the mobile electronic device.
• A speed of scanning can be improved and allow for fast processing of the object of interest. The speed of scanning and/or fast processing of the object of interest can be aided by image processing optimizations being run on the associated mobile electronic device. The speed of scanning can be increased by one or more of pixel selection, image cropping, pixel averaging, field of view framing, exposure time, focal distance, focal depth, zoom, frame rate, color and brightness control, or a combination thereof. The device can control settings of the camera of the associated mobile electronic device to optimize pixel selection, image cropping, pixel averaging, field of view framing, exposure time, focal distance, focal depth, zoom, frame rate, color and brightness control, or a combination thereof. The device can limit a focal range over which autofocus of the digital camera on the associated mobile device operates. The device can incorporate field of view cropping or affects image processing features on the digital camera on the associated mobile device. The device can reduce a field of view such that fewer pixels are processed to improve system responsiveness and increase performance. One or more speed and quality optimizations can be incorporated in either or both the device and the associated mobile electronic device. The one or more speed and quality optimizations can include one or more of pixel skipping, pixel averaging, interpolating, and upscaling. The device can be scaled for use with multiple digital cameras. Scaling the device for use with multiple digital cameras can improve resolution in a scan area and provide a broader focal range. The illuminator light source and/or the aimer light source can be an on-axis design having a small point source and diffused. The illuminator light source and/or the aimer light source can be an off-axis design. The device can further include a dedicated battery. The device can harvests energy and have no need for an external power source. The energy can be harvested from an audio port. The energy harvested can be thermal, electromagnetic, solar, and/or mechanical energy. The device can further include a proximity sensor used to provide distance information to the camera to support focusing. The proximity sensor can be dedicated hardware. The device can leverage sensing features of the digital camera of the associated mobile electronic device. The device can further include motion detection.
• In an interrelated aspect, described is an image enhancer device for use with an associated mobile electronic device having a digital camera that includes an aimer having an aiming element configured to direct at least one aiming light beam towards an object of interest.
• The device can be used for bar code imaging and/or native image processing. The object of interest can include a 2D bar code, a 3D bar code, a QR code, an image-based scanning code, or and optically-readable code. The object of interest can code general product or item information. The associated mobile electronic device can be a mobile phone, smartphone, tablet computer, personal digital assistant (PDA), enterprise digital assistant (EDA), laptop computer, voice over IP (VoIP) handset, wireless device, Bluetooth device, handheld or portable computer, netbook, notebook, or smart book.
• The aimer can provide illumination of the object of interest. The at least one aiming light beam generated by the aiming element can project a visual cue on the object of interest. The visual cue can include one or more dots, boxes, dashed lines, cross-hairs, or other visual cue. The visual cue can be a static visual cue or a dynamic visual cue including a pulse, strobe, continuous flash, semi-continuous flash, or combination thereof. The aiming element can be an optical element including one or more of an aiming light source coupled to a printed circuit board and, a lens, a pinhole element, a light pipe, a concentrator element, a diffusing element, a light guide, an obstructing element, and a light collimator. The aiming light source can be an LED, OLED, or laser diode. The lens can be a plano-convex lens, aspheric lens, Fresnel lens, or concave lens. The pinhole element can define a pinhole extending through the pinhole element sized to block light emanating from the aiming light source that is not usable by the lens. The light pipe can capture and concentrate a broader angle of light emitted by the light source and emit captured and concentrated light through an aperture minimizing divergence without trading off light throughput. The light pipe can be tubular or conical and have an inner surface that reflects light. The diffusing element can be a sheet or section of material with surface properties that causes light to diffuse through its volume. The material can include LEXAN or acrylic with surface textures, internal voids, or cast-in reflective materials designed to scatter light. The light collimator can cause light rays to be approximately parallel. The light guide can guide light using refraction and/or reflection. The lens can be of aspherical shape and distally offset from its focal point causing light rays extending through the lens to cross and mix.
• The device can further include an illuminator having an illumination element configured to direct at least one illumination light beam towards the object of interest. The illuminator can be bounded by an aperture to provide clear aiming direction. The at least one illumination light beam can overlap the at least one aiming light beam. The illumination element can further include a diffusing element and/or a light pipe to control the at least one illumination light beam. The illumination element can be an illumination light source coupled to a printed circuit board and including one or more of a light emitting diode (LED), an organic light emitting diode (OLED), and a laser diode. The illumination light source can be of a color or spectrum of colors. The illuminator can further include an occluding element configured to generate a beam pattern with the at least one illumination light beam forming an aiming beam. An illumination light source of the mobile electronic device can provide an illumination light beam towards the object of interest.
• The device can further include a light pipe to shape the illumination light beam emanating from the mobile electronic device illumination light source. The device can further include an image manipulator configured to modify an optical path of the digital camera. The image manipulator can be an optical element configured to shape and/or redirect an angle of a path of the beam of light impinging upon the image manipulator into the digital camera of the associated mobile electronic device. The optical element can be a planar element having one or more of a curved reflective surface, a curved mirror, a flat reflective surface, a straight mirror, a lens, a prism, and a fiber. The image manipulator can include one, two, three, or more optical surfaces.
• The device can further include electronics allowing for communication of data and/or power with the electronics of the associated mobile electronic device. The device can further include a connector member configured to engage a native port on the associated mobile electronic device including an audio port, a USB port, USB mini, USB-C, USB micro, or other port on the associated mobile device. Communication can be provided via an audio port of the associated mobile electronic device. The communication can be two-way communication. The communication can harvest power from a native port on the associated mobile electronic device, wherein the native port is a universal audio port and power is harvested using a signal exiting the associated mobile device via through the audio port of the associated mobile device from any of the audio channels. Power harvesting can occur simultaneously with unidirectional or bidirectional communication through the native port or through an alternative port. The communication can have a data protocol including one or more of FSK, PSK, QAM, and RS-232.
• The device can further include one or more proximity sensors configured to sense when the object of interest is in proximity to the image enhancer device, is within a field of view of the image manipulator, within an illuminated region emanating from the illuminator, within a beam of the aimer, and/or within proximity of a scan window of the device. Information can be provided by the one or more proximity sensors to electronics of the device and can be used to start, influence, or send an input regarding a scan. The one or more proximity sensors can be an IR/photodiode, radar, LIDAR, stereo camera, motion sensing sensor, structured light sensor, acoustic sensor, dedicated sensor, or image-based sensor. The device can include one or more touch sensors or capacitive sensors. The device can include one or more inputs for user control and/or operational status of the device. The one or more inputs can allow direct control of the device.
• The device can include one or more attachment elements configured to reversibly couple the device to the associated mobile electronic device in an orientation relative to the digital camera on the associated mobile electronic device. The one or more attachment elements can be integrated with a housing of the device or are separate from the image enhancer device and the mobile electronic device. The one or more attachment elements can include a scan window. The scan window can optically isolate light emitted by the illuminator and light emitted by the aimer from incoming light. The aimer, the illuminator, and the image manipulator can be independently housed or grouped together in a singular housing of the image enhancer device.
• In an interrelated aspect, described is an image enhancer device for use with an associated mobile electronic device having a digital camera including an illuminator having an illumination element configured to direct at least one illumination light beam towards the object of interest and a light pipe. The image enhancer device forms a scan angle relative to a field of view of the digital camera of the mobile electronic device and allows for bar code imaging and/or native image processing with the digital camera of the mobile electronic device.
• In an interrelated aspect, described is an image enhancer device for use with an associated mobile electronic device having a digital camera including an image manipulator configured to modify an optical path of the digital camera. The image enhancer device forms a scan angle relative to a field of view of the digital camera of the mobile electronic device and allows for bar code imaging and/or native image processing with the digital camera of the mobile electronic device.
• In an interrelated aspect, described is an image enhancer device for use with an associated mobile electronic device having a digital camera including electronics allowing for communication of data and/or power between the electronics and the associated mobile electronic device. The image enhancer device forms a scan angle relative to a field of view of the digital camera of the mobile electronic device and allows for bar code imaging and/or native image processing with the digital camera of the mobile electronic device.
• The above-noted aspects and features may be implemented in systems, apparatus, methods, and/or articles depending on the desired configuration. The details of one or more variations of the subject matter described herein are set forth in the accompanying drawings and the description below. Features and advantages of the subject matter described herein will be apparent from the description and drawings, and from the claims.
BRIEF DESCRIPTION OF THE DRAWINGS
• In the drawings,
• FIG. 1A shows a box diagram of an implementation of an imaging enhancement system;
• FIG. 1B shows a box diagram of another implementation of an imaging enhancement system;
• FIG. 2A shows a perspective view of an implementation of an image enhancer device;
• FIG. 2B shows a front view of the device ofFIG. 2A;
• FIG. 2C shows a cross-sectional view of the device ofFIG. 2B taken along line C-C;
• FIGS. 3A and 3B show cross-sectional, schematic views of implementations of an aimer;
• FIGS. 3C-3D show cross-sectional, schematic views of implementations of an aimer having a light pipe;
• FIG. 4A shows a schematic view of an implementation of an aiming element and tracing of light rays;
• FIG. 4B shows a detailed view of the aiming element ofFIG. 4A taken at circle B;
• FIG. 4C shows a schematic view of another implementation of an aiming element;
• FIG. 5A shows a schematic view of an implementation of an aiming element and tracing of light rays;
• FIG. 5B shows a detailed view of the aiming element ofFIG. 5A taken at circle B;
• FIG. 5C shows a schematic view of another implementation of an aiming element;
• FIG. 6A shows a cross-sectional, schematic view of an implementation of an illuminator;
• FIG. 6B shows a cross-sectional, schematic view of an implementation of an illuminator;
• FIGS. 7A-7E show various views of an implementation of an attachment element for associating the device ofFIG. 2A to a mobile device.
DETAILED DESCRIPTION
• Dedicated bar code scanners house optics, imaging sensors, and electronics to process images and extract the bar code string. 2D bar code scanners in particular can be expensive, driven by the costs and complexities of the individual components and their overall integration. There is a need for mobile devices, such as tablet computers and smartphones, to provide extended capabilities such as bar code scanning and payment processing such that they can be used for interactions between sales associates and customers, or for customer self-service, in commercial and/or public settings. Further, there is a need for devices that provide these extended capabilities across a range of operating systems (e.g., Android, iOS, Windows, Chrome, etc.) with provisions for mechanical packaging and protection, power and data connectivity, and an application programming interface (API) and software development kit (SDK) to allow native applications to interface with the device. There is a need for devices that provide a high degree of mobility, ease of operation, and low cost.
• The subject matter described herein may in some implementations provide one or more advantages, as well as others. The devices described herein may be configured to be used in association with a mobile device having light sensing and/or imaging capability, such as a digital camera, in order to enhance, alter, add, and/or otherwise improve the imaging capabilities of the mobile device such that the mobile device can be used as a dedicated bar code scanner. The described devices may provide for a scanning experience that is optimized for 1D and 2D bar codes, QR codes, or other image-based scanning or optically readable codes to collect general product or item information, process payments, facilitate interactions, and support operations in commercial and public settings. The described devices can transform a mobile device into a commercial point of sale system. The described devices can allow for bar code imaging and/or native image processing with the digital camera of the associated mobile electronic device.
• Speed and accuracy of bar code processing in commercial settings may be considered primary factors for user satisfaction. Mobile devices with a camera and bar code scanning applications have been shown to perform much slower versus dedicated devices, which can scan bar codes in less than 100 milliseconds. As will be described in more detail below, the devices described herein may improve scanning speed and/or allow for fast processing of the bar codes, and improve accuracy of bar code scanning. The scanning speed and/or fast processing can be via image processing optimizations being run on the mobile device. The devices described herein can incorporate software based image processing such as pixel selection, pixel averaging, field of view framing, and image cropping to improve scan processing efficiency. The devices described herein can control the camera of the associated mobile electronic device to manage exposure time, iso sensitivity, focal distance, focal depth, zoom, frame rate, color and brightness control, or a combination thereof to speed up processing. For example, thesystem100 can limit the focal range over which autofocus of the camera on the associated mobile device operates. Further, thesystem100 can incorporate field of view cropping or affect these features on the mobile device camera. For example, reducing the field of view, fewer pixels are processed and system responsiveness improved therein increasing performance at the expense of field of view. Other speed and quality optimizations can be incorporated in either or both thesystem100 and the associated mobile device such as pixel skipping, averaging, interpolating, upscaling. Reducing pixel count while staying above minimum resolution thresholds (as dictated by the size of the item being scanned), performance may be preserved without the field of view tradeoff mentioned above. The devices can incorporate or be used in association with a printer, for example, to provide the system with the ability to print receipts. It should be appreciated that any of a variety of peripherals can be used in association with the devices described herein including CC, Magnetic stripe readers, barcode scanners, 3D sensors (leap motion), CC, EMV Smart Card readers, printers, etc.
• The ergonomics of the devices described herein may allow for the user to position the device more quickly and more accurately than would be possible for a native mobile device camera. The devices described herein can incorporate an intuitive grip and scan angle, for example 90 degrees from the standard direction that the camera is facing, allowing for quicker and more accurate positioning of the scan. In addition, the devices described herein can include an aimer that provides a visual cue to aid the user in performing a faster scan. The devices described herein may include illumination to provide superior lighting to improve image quality and delivery faster and more accurate scans.
• Traditionally, dedicated scan engines have been added to mobile devices to allow for scanning. Due to the power requirements, doing so typically requires the addition of a dedicated battery. Combined, these add size, weight, and cost which are all problematic for devices that are designed for mobility. The devices described herein require considerably less dedicated energy, and may eliminate the battery and use a super capacitor in its place. Furthermore, the dedicated scan engine can be replaced with smaller, lighter, and lower cost components.
• It should be appreciated that although the devices, systems and methods described herein are often described in terms of their use with a “mobile device,” this is not intended to be limiting. The devices, systems and methods described herein can be used in conjunction with any number of computing devices, including but not limited to mobile phone, smartphone, tablet computer, personal digital assistant (PDA), enterprise digital assistant (EDA), laptop computer, voice over IP (VoIP) handsets, wireless devices, Bluetooth devices, handheld or portable computers, netbooks, notebooks, smart books, and/or any other wireless device including stationary wireless devices. Further, it should be appreciated that use of the term “camera” is also not intended to be limiting and can include a variety of light sensing and/or digital imaging technologies such as a digital camera, digital video camera, light sensing element, image sensor such as a complementary metal-oxide-semiconductor (CMOS) image sensor or charge-coupled device (CCD) type image sensor, and the like. Further, it should be appreciated that the devices and systems described herein can be scaled for use with multiple cameras, for example, in order to improve resolution in the scan area as well as broader focal range (e.g. using the multiple cameras to bracket).
• The devices described herein can be used for a variety of applications. The devices and systems described herein can be used by a sales associate, for example at a department store in conjunction with a tablet computer to scan a bar code and get information about a product in the store. It should also be appreciated that although the devices, systems and methods are described herein as being useful for commercial retail purposes, their use is not intended to be limited to only this purpose. For example, the devices described herein can be used in other settings where a bar code scan might be useful such as in healthcare, warehousing, hospitality settings or for personal private use.
• FIGS. 1A-1B show box diagrams of implementations of animaging enhancement system100 configured to be used with or coupled to amobile device10 such as a tablet or smartphone or other computing device. Theimaging enhancement system100 can include animage enhancer device105 having anaimer110, anilluminator115, and/or animage manipulator120, each of which will be described in greater detail below. Theaimer110, theilluminator115, and/or theimage manipulator120, can be included in the image enhancement device collectively, individually, or in any combination. Theaimer110 can direct at least one aiming light beam away from a first region of the device towards an object of interest. Theaimer110 can generate a very narrow beam onto the object to be scanned, such as a bar code, to visually guide a user towards the appropriate portion of the object to be scanned. The beam generated by theaimer110 can provide a variety of visual cues, including one or more dot(s), box(es), dashed lines, cross-hairs or other configuration of visual cue. The visual cue can be static, dynamic, or responsive. For example, the visual cue can pulse, strobe, flash continuously or semi-continuously, change brightness, or a combination thereof. Additionally, the visual cue can change modes to provide feedback to the user, such as to indicate a successful scan. Appropriate positioning of the object to be scanned into the field of view can allow for faster, more efficient and more desirable outcomes for a successful bar code scan. Theilluminator115 can direct at least one illumination light beam away from the first region of the device towards the object of interest. Theilluminator115 can create sufficient illumination of the object to be scanned. Theimage manipulator120 can be configured to receive light directed towards the first region of the device from the object of interest and reflect the light towards a second region of the device, wherein the first region and the second region of the device are arranged at an angle.
• In some implementations, theaimer110 can be coupled to ahousing102 such that it directs the at least one aiming light beam from thehousing102, such as through anaperture111, along the direction of arrow A (seeFIG. 2A). Theilluminator115 also can be coupled to thehousing102 such that it directs the at least one illumination light beam from thehousing102, such as through anaperture113, along the direction of arrow B. Theimage manipulator120 can be coupled to thehousing102 such that it modifies the optical path of the camera on themobile device10 with which theimage enhancer device105 is used such that themobile device10 can be used in a more intuitive and ergonomic way as a bar code scanner. The configuration of theaimer110 relative to theilluminator115 relative to theimage manipulator120 as well as all the three relative to thehousing102 can vary. In some implementations, theaimer110 is positioned on a first side of theimage manipulator120 and theilluminator115 is positioned on a second, opposite side of theimage manipulator120 such that the aiming beam along arrow A and illumination beam along arrow B can be on either side of theimage manipulator120 and toward an object to be scanned.Incoming light122 as shown inFIG. 2C can refer to the light rays impinging on thedevice105 and/or theimage manipulator120 that compose the visual view of the outside world. Theincoming light122 can be directed toward theimage manipulator120 and reflect at an angle relative to the incoming light into the camera of themobile device10 between theaimer110 andilluminator115. Theaimer110,illuminator115, andimage manipulator120 may or may not be contained within thesame housing102.
• Again with respect toFIGS. 2A-2C, theimage enhancer device105 can include a first region or ascan side107 configured to allow forincoming light122 to reflect onto theimage manipulator120 and to allow for outgoing light from theaimer110 and theilluminator115 to exit theimage enhancer device105 and be directed toward the object to be scanned. In some implementations, thescan side107 of theimage enhancer device105 can include a clear, protective covering or scanwindow174 such that theimage manipulator120 and the components of theaimer110 and theilluminator115 are protected from damage, debris, and dirt. Thescan side107 of theimage enhancer device105 can mate to, be offset from, parallel to, or at angles up to45 degrees from thescan window174. Thescan window174 can be any of a variety of appropriate materials suitable for optics, such as PMMA, polycarbonate, or glass. Thescan window174 can additionally include one or more anti-reflective coatings, color filters, high-pass, low-pass, neutral density filters, anti-glare, polarizing, enhancement films (such as quantum dot films) or any combination thereof. Thescan window174 can be flush with a distal edge ofaperture111, and/or a distal edge ofaperture113, and/or thescan side107 of the device to optically isolate the light emitted by theilluminator115, theaimer110, and the incoming light122 from one another. This arrangement can minimize internal reflections that pollute theincoming light122 due to light emitted by theilluminator115 or theaimer110 impinging on thescan window174. Additionally, these internal reflections can illuminate the device internals, which can in turn cause a secondary internal reflection on thescan window174 further polluting theincoming light122.
• Theimage enhancer device105 can also have a second region orcamera side109 that can be a generally planar surface configured to be positioned flush, adjacent, or otherwise aligned with the chassis of the associatedmobile device10. Thecamera side109 of theimage enhancer device105 can be positioned parallel to the chassis of themobile device10 and aligned with the camera of themobile device10 such that at least one ormore portions104,106 of thecamera side109 lies adjacent the camera such that theimage manipulator120 is generally centered and aligned over the camera of themobile device10. Theimage manipulator120 can reflect incoming light122 from thescan side107 and redirect it to thecamera side109 and into the camera. When thecamera side109 is positioned against the chassis of themobile device10, thescan side107 can be disposed so as to face in a direction relative to the plane of the chassis that can be generally parallel, generally orthogonal, or at an angle to the plane of the chassis as will be described in more detail below.
• When thecamera side109 of theimage enhancer device105 is positioned against the chassis of themobile device10 and optically aligned with the camera, thescan side107 of theimage enhancer device105 can be oriented such that the aiming and illuminating light beams directed away from theimage enhancer device105 can be aimed at an object to be scanned or read. Further, when thecamera side109 of theimage enhancer device105 is positioned against the chassis of themobile device10 and optically aligned with the camera, thescan side107 of theimage enhancer device105 can be oriented such thatincoming light122 directed towards theimage enhancer device105 can reflect onto theimage manipulator120 and be redirected towards the camera of themobile device10. Still further, when thecamera side109 of theimage enhancer device105 is positioned against the chassis of the mobile device and optically aligned with the camera, thescan side107 of theimage enhancer device105 can be oriented such that light can enter and exit theimage enhancer device105 while still allowing a user to easily hold and operate themobile device10. The user can also easily read the screen of themobile device10, if desired. It should also be appreciated that the user need not necessarily view the screen of themobile device10 to operateimage enhancer device105.
• As shown inFIG. 2A, thecamera side109 of theimage enhancer device105 can be optically aligned with the camera/sensor and can have a plane that lies parallel to a plane of the chassis. Thecamera side109 of theimage enhancer device105 can be configured to be positioned against the chassis of themobile device10. Theaimer110 emits light throughaperture111.Aperture111, which extends through a wall of thehousing102 on thescan side107 of the device, has a plane. Theilluminator115 emits light throughaperture113.Aperture113, which extends through a wall of thehousing102 on thescan side107 of the device, also has a plane. The plane of theaimer aperture111 and the plane of theilluminator aperture113 can be the same plane, parallel planes, or non-parallel planes. An angle a between the plane of thecamera side109 and the planes of theaimer aperture111 and theilluminator aperture113 can be formed (seeFIG. 2A). The angle a can vary including at least about 15°, 20°, 25°, 30°, 35°, 40°, 45°, 50°, 55°, 60°, 65°, 70°, 75°, 80°, 85°, 90°, 95° or greater degrees. It should be appreciated that the angle a can be greater than, less than, or between any of these listed angles. This angle a can be fixed or in some implementations it can be adjustable, such as by the user rotating a portion of thedevice105 relative to another. The adjustment can be made using a variety of mechanisms including, but not limited to a pivot, hinge, living hinge, 4-bar mechanism or other mechanism or combination thereof. The adjustment mechanism can include one or more of detents, friction locking, and/or snaps to hold the selected angle. The angle a allows a user to easily operate and/or read information on the screen of themobile device10 while using theimage enhancer device105 to scan a bar code. It should also be appreciated that the user need not necessarily view the screen of themobile device10 to operateimage enhancer device105.
• As mentioned above, theimage manipulator120 can be accessed from thescan side107 of theimage enhancer device105 and oriented such thatincoming light122 can reflect off of theimage manipulator120. Theimage manipulator120 can be coupled to thehousing102 at a variety of angles and orientations such that upon associating thesystem100 with amobile device10, theimage manipulator120 can reflect or redirect theincoming light122 towards the camera of themobile device10. Theimage enhancer device105 can redirect theincoming light122, for example, by about 15°, 20°, 25°, 30°, 35°, 40°, 45°, 50°, 55°, 60°, 65°, 70°, 75°, 80°, 85°, 90°, 95° or other degree angle from the original direction. In some implementations, theimage enhancer device105 can redirect theincoming light122 by at least about 20° to about 120°. It should be appreciated that the angle can be greater than, less than, or between any of these listed angles.
• Theimage manipulator120 can be oriented such that it forms an angle α′ defined by an incoming ray R directed towards theimage manipulator120 that will eventually impinge on or generally near the center C of the imaging sensor of the mobile device10 (seeFIG. 2C). In some implementations, angle α′ can be at least about 15°, 20°, 25°, 30°, 35°, 40°, 45°, 50°, 55°, 60°, 65°, 70°, 75°, 80°, 85°, 90°, 95° or other degree angle. The orientation between theimage manipulator120 and themobile device10 allows the user to hold themobile device10 at an ergonomic angle relative to the plane of the object to be scanned (e.g. bar code of interest) and optimize the device's use for commercial retail scanning applications. For example, the orientation allows a user to aim the front end or top of themobile device10 towards the object to be scanned such that the screen of themobile device10 projects toward the user during operation of thesystem100.
• It should be appreciated that use of the term “image manipulator” is not intended to be limited and that theimage manipulator120 can be any of a variety of optical elements configured to shape and/or redirect the angle of the beam of light impinging upon theimage manipulator120, including, but not limited to one or more straight or curved mirrors, lenses, prisms, fibers, or a combination thereof. In some implementations, theimage manipulator120 can be a planar element having a single reflective surface. In some implementations, theimage manipulator120 can be a mirror. In some implementations, the image manipulator can be a first surface mirror. In some implementations, theimage manipulator120 can be a curved or flat reflective surface. In some implementations, theimage manipulator120 can include one, two, three, or more optical surfaces. In some implementations, theimage manipulator120 is a planar or curved mirror having just one optical surface and may produce a higher quality image on a cost parity basis than, for example, a prism having three optical surfaces. In some implementations, theimage manipulator120 is a prism having two or three optical surfaces. The prism can be formed of glass or a plastic material and can have an index of refraction that is different from the index of refraction of air such that it can bend light. In some implementations, the prism can allow a wider field of view to be captured in a smaller space guided by lower incident angles of light rays traveling within the prism body. In other implementations, theimage manipulator120 is a lens configured to alter the angle of the path of the optics into the camera of the mobile device. The lenses can include plastic and/or glass elements or other material with a different or differing index or indices of refraction from air. The lenses can alter the field of view (FOV), focal length, depth of field and packaging form factor. In some applications of use, the entire camera field of view (FOV) can be used whereas other applications do not require the usage of the entire camera FOV. Reduction in FOV can result in a more spatially compact and ergonomic device. In applications such as bar code scanning, less than the entire FOV of the camera on themobile device10 can be used with angles typically in the range of 15-35 degrees of vertical (as shown by the angle between the outermost rays ofincoming light122 inFIG. 2C) and 25-40 degrees of horizontal FOV.
• The components of the systems and devices described herein have a generally small form factor, which can improve the ergonomics and aesthetics. For example, theimaging enhancement system100 and associatedmobile device10 can be held and operated using a single hand while the user's other hand is free to hold the object to be scanned. The user can view the screen on themobile device10 while scanning the object of interest and/or can view the object being scanned, for example, just beyond the front end or top of the associatedmobile device10. The small form factor of the device minimally increases the overall weight of the associated mobile device, which facilitates further an ergonomic and/or comfortable grip with a single hand for extended periods and allows ease of operation with a thumb or finger while holding the device.
• As mentioned above, theimage enhancer device105 can include anaimer110. Theaimer110 can allow a user to easily orient theimage enhancer device105 towards an object of interest and project, for example, a focused dot of light onto the target of interest such that a user can quickly and easily position thesystem100 relative to the object to be scanned for a proper scan of the bar code to take place. Theaimer110 can be coupled to theimage enhancer device105 such that the aiming light beam generated by theaimer110 can project away from theimage enhancer device105, for example through the aimingbeam window111 extending through the wall of thehousing102 and exit thescan side107 of the image enhancer device105 (shown inFIG. 2A).
• Again with respect toFIG. 1, theaimer110 can include an aimingelement128 coupled to a printed circuit board (PCB)126. The aimingelement128 can include any of a variety of combinations of one or more optical elements including an aiminglight source130, alens132, apinhole element134, alight pipe138, a concentrator element, with or without a diffusingelement142, a light guide, obstructing element, light collimator, etc. The aiminglight source130 of theaimer110 can include, for example, an LED, OLED, laser diode and the like configured to be electrically connected to thePCB126. In some implementations, theaimer110 is optimized for LED light sources as the aiminglight source130. For example, thelight pipe138 can concentrate, channel, and diffuse light, and may have lensed entry and exit surfaces for light shaping and power efficiency. Thelens132 can aid in light collimation and shaping of the light from thelight source130. Thelens132 can be of any of a variety of lenses, for example a plano-convex lens, aspheric lens, Fresnel lens, concave lens, and the like.
• Thepinhole element134 can be opaque other than for apinhole136 extending therethrough. Thepinhole136 can provide a profile for which thelens132 can focus on to determine the shape of the aimer beam. Furthermore, a profile size of thepinhole136 can be chosen to optimize the tradeoff between beam divergence and light transmission. Thepinhole136 can be sized smaller than the aiming light source and therefore better approximate a point source of light from the perspective of thelens132. For a given light source diameter (D, as defined by pinhole136) and lens focal length (f), the full beam divergence (Θ) in radians after collimation is: Θ=D/f. Thus, assuming thelens132 focal length is chosen to capture the light emanating from thepinhole136 and that thelight source130 has a beam profile wider than the pinhole136 (and all else equal), this guiding equation presents a trade-off between maximizing light throughput and minimizing beam divergence. Thepinhole136 can be sized to block light emanating from the light source that is not practically usable by thelens132. The larger thepinhole136, the more light will transmit, but the earlier the beam may be washed out over longer ranges due to beam divergence. It is desirable to have both high efficiency light transmission and low beam divergence. Furthermore, thelight source130 may be offset from thelens132 focal point at thepinhole136 to blur the signature in light sources such as LEDs, by way of the die surface. Further impacting efficiency, light sources such as LEDs often have wide angles of dispersion, typically 120 degrees in configurations without a built-in lens. LEDs that do have narrower angles typically include built-in lenses that can add additional signature to the light profile, which is not ideal as a uniform intensity in the beam pattern can have a more pleasing appearance. However, the light pipe138 (shown inFIGS. 3C and 3D) can capture and concentrate a broader angle of light emitted by thelight source130 for a givenpinhole136 profile, thus, increasing overall efficiency. Thelight pipe138 can capture, concentrate, and emit light from thelight source130 through a smaller aperture and minimize divergence without trading off light throughput. Thelight pipe138 can be a tubular, conical, or other volume element having an inner surface that reflects light. This reflection can occur due to total internal reflection (TIR). The diffusingelement142 can aid in light distribution. The diffusingelement142 can be a sheet of material with surface properties that cause diffusion, or a section of material that causes light to diffuse through its volume. Examples can include materials such as LEXAN or acrylic with surface textures, internal voids, or cast-in reflective materials designed to scatter light. A light guide can be any element that guides light, using techniques such as, but not limited to, refraction and/or reflection. An obstructing element can be any opaque or semi-opaque material that can block light. A light collimator can be any element that causes light to collimate, that is, causes the light rays to be approximately parallel.
• Now with respect toFIGS. 3A-3D, theaimer110 can be positioned within aregion124 of thehousing102 configured to hold thePCB126 electrically coupled to the aimingelement128. Thehousing region124 of theaimer110 can have a variety of configurations and shapes. Thehousing region124 can have afirst end144 and asecond end146 and aninterior volume148 extending between thefirst end144 and thesecond end146. In some implementations, thePCB126 can be coupled near thefirst end144 of thehousing region124 and thelens132 can be coupled near thesecond end146 of thehousing region124 such that theinterior volume148 extends between thePCB126 and thelens132 and thelens132 can be oriented nearer to thescan side107 of theimage enhancer device105. As mentioned, theaimer110 can also have a light obstructing feature such as apinhole element134 extending into theinterior volume148 of thehousing region124. Thepinhole element134 can be coupled to or integrated with an inner surface of thehousing region124 such that it extends into theinterior volume148 of thehousing region124. Thepinhole element134 can be of a variety of shapes, including but not limited to circular, square, cross, or an “X”, the profile of which the user will see projected onto a target. Thepinhole element134 can have apinhole136 extending through its thickness. In some implementations, thepinhole136 extends through thepinhole element134 near a center region of thepinhole element134 such that thepinhole136 is aligned with the center of theinterior volume148 of thehousing region124. Thepinhole element134 can be positioned in a region of thehousing region124 between thefirst end144 and thesecond end146. Thepinhole element134 can be located nearer to thefirst end144 of thehousing region124, but between thelens132 and the aiming light source130 (see, e.g.FIG. 3A). The aiminglight source130 can be coupled to thePCB126, which in turn can be coupled to thehousing region124 near thefirst end144. The aiminglight source130 can be aligned with thepinhole136 through thepinhole element134. Theaimer110 can also include a diffusingelement142 positioned between the aiminglight source130 and pinhole136 (seeFIG. 3A and 3C).
• FIG. 3B shows another implementation of anaimer110 having aPCB126 coupled near thefirst end144 of thehousing region124 and thelens132 coupled to thesecond end146 of thehousing region124. In this implementation, theaimer110 can include apinhole element134 extending into theinterior volume148 of thehousing region124 and alight pipe138 to reduce the effective light emissive surface area and/or increase the efficiency. Thelight pipe138 can be positioned such that light from the aiminglight source130 enters a first end of thelight pipe138 and exits a second end of thelight pipe138 such that the light is directed through thepinhole136 of thepinhole element134 and towards thelens132 coupled to thesecond end146 of thehousing region124. Theaimer110 can also include a diffusingelement142 positioned between the aiminglight source130 and the light pipe138 (seeFIG. 3A and 3C). Thelight pipe138 can additionally be shaped in such a way as to increase the efficiency and mix the light rays to remove signature from thelight source130. Features of thelight pipe138 may include but are not limited to a first end that is planar, curved, or shaped and may additionally be smooth or textured, intermediate surfaces that may be angled to provide total internal reflection, intermediate surfaces that may be circular, square, or polygonal in cross section, a second end that may be planar, curved, or shaped, and a second end that may additionally be smooth or textured. Texture may be applied to surfaces of thelight pipe138 and/or internal voids and/or reflective materials may be volumetrically encapsulated within thelight pipe138 to create diffusion effects. The length of thelight pipe138 and size of the first and second ends of thelight pipe138 may also be adjusted. These features and dimensions can be tuned such that the light beam exiting theaimer110 has a shape and distribution that creates an optimal beam for aiming.
• The relative or absolute placement of the components of the aiming element128 (including one or more of thelens132, thepinhole element134, thelight pipe138 and/or the aiminglight source130, etc.) can be varied such that the metrics of one or more of the image plane blur, focal length, beam diameter, beam dispersion, spot size, spot shape, number of spots, brightness, and/or efficiency can be tuned. In some implementations, thelens132 can be positioned with a focal point at the location of the LED light source or thepinhole136 to better collimate the light. When the focal point of thelens132 is positioned at the LED die, the features of the LED die can be visible. It can also be desirable to defocus the image of the LED die by changing the relative position of thelens132, thepinhole136 or any combination of the aimingelement128 so that a level of blurring and light shaping can be achieved. When thelens132 is of aspherical shape, and distally offset from a focal point at the LED die, the rays can cross and there can be better light mixing, reducing the visibility of the LED die features. This can also further concentrate the beam, creating a sharper aiming feature at some distances (seeFIG. 5A). Small changes in the offset distance can make large differences in beam sharpness and light mixing. In some cases, intentionally defocusing an aspheric lens that is shaping light through a pinhole, for example, can reduce the illuminated spot size while delivering that same total illumination, and thus, increase the brightness of the aiming beam at some distances. Alight pipe138 can be used to focus the light rays such that they are highly concentrated at the focal point of thelens132, which may be at thepinhole136. This can further reduce the visibility of LED die features through light mixing along the length of thelight pipe138, and especially so when thelight pipe138 includes diffusion elements. Alight pipe138 may also be used to focus the light rays at offset distances relative to the focal point of thelens132 in order to intentionally defocus signature resident within the aiming light source.
• FIG. 4A shows a first implementation of an aimingelement128 andFIG. 4B shows a detailed view of the aimingelement128 inFIG. 4A taken along circle B.FIG. 4C shows another implementation of an aimingelement128.FIG. 5A shows a further implementation of an aimingelement128 andFIG. 5B shows a detailed view of the aimingelement128 inFIG. 5A taken along circle B.FIG. 5C shows a further implementation of an aimingelement128. Each of the aimingelements128 can include an aiming light source130 (such as an LED light source), alens132 and apinhole136 extending through apinhole element134 positioned in between thelight source130 and thelens132. As shown inFIG. 4A-4B, thelens132 can be placed at its focal point relative to the aiminglight source130, which is a distance D away from thepinhole136. Thelens132 placed at its focal point relative to the aiminglight source130 can have a measured spread S of the beam of light produced by the aiming element128 (seeFIG. 4A). In some implementations, D is about 1 mm to about 4 mm and S is about 1 mm to about 40 mm.
• As shown inFIG. 4C, thelens132 can be placed with its focal point at thepinhole136, which is a distance D away from thelight source130. Thelens132 can also be placed with its focal point at the emissive surface of thelight source130 or at an offset relative to thelight source130. The shape of thelens132, along with the offset of the focal point relative to thelight source130 can influence the direction of the light rays after passing through thelens132. In the implementation shown inFIG. 4C, a collimating lens is placed with its focal point at a distance D from the emissive surface of thelight source130, causing the light rays exiting thelens132 to converge to a point and then diverge. The light rays can have a measured spread S of the beam of light produced by the aiming element128 (seeFIG. 4A). In some implementations, D is about 1 mm to about 5 mm and S is about 1 mm to about 40 mm as measured between 0 mm and 200 mm from the most distal point on the lens surface.
• The aimingelement128 inFIG. 5A-5B shows thelens132 placed relative to the aiming light source130 a distance D′ away from thepinhole136, which is greater than distance D and is thus, offset and unfocused. The measured spread S′ of the beam of light produced by the aimingelement128 in this implementation is smaller than the measured spread S of the beam of light produced by the aimingelement128 in the implementation ofFIG. 4A-4B. This smaller beam spread S′ can be desirable because the aiming spot produced by the aimingelement128 is sharper and brighter. In addition, the reduced focus in the “offset focal point” implementation ofFIG. 5A-5B can deliver more uniform light that obscures the individual characteristics of the aiminglight source130, which is also desirable. In some implementations, D′ is about 1 mm to about 5 mm and S′ is about 1 mm to about 30 mm.
• The aimingelement128 inFIG. 5C shows thelens132 placed with its focal point at thepinhole136, a distance D′ away from thelight source130, with alight pipe138 in the path of the light rays between thelight source130 and thepinhole136. In the implementation shown inFIG. 5C, thelight pipe138 is shaped such that the light rays pass through the focal point of thelens132 thus approximating a point source, where iflens132 is a collimating lens as shown, the projected light rays will project approximately parallel to one another. The measured spread S′ of the beam of light produced by the aimingelement128 in this implementation is smaller than the measured spread S of the beam of light produced by the aimingelement128 in the implementation ofFIG. 4C. This smaller beam spread S′ can be desirable because the aiming target produced by the aimingelement128 is smaller and brighter. In addition, the light ray mixing provided by thelight pipe138 in the implementation ofFIG. 5C can deliver more uniform light that obscures the individual characteristics of the aiminglight source130, which is also desirable. In some implementations, D′ is about 1 mm to about 5 mm and S′ is about 1 mm to about 30 mm as measured between 0 mm and 200 mm from the most distal point on the lens surface.
• The ray traces illustrated inFIGS. 4A-4C andFIGS. 5A-5C illustrate four representative light rays that demonstrate the beam spread and ray interaction. InFIGS. 4A,4B and 5A and 5B, the four rays can include: 1) Center-Straight131, which shows the straightest ray emanating from the center of the light source; 2) Center-Angle135, which shows the ray passing by the pinhole edge emanating from the center of the light source; 3) Edge-Nearside133, which shows the ray passing by the nearest edge of the pinhole emanating from the outer edge of the light source; and 4) Edge-Far side137, which shows the ray passing by the furthest edge of the pinhole emanating from the outer edge of the light source. InFIGS. 4C and 5C, the four rays are represented as emanating from an idealized point source. The implementations shown inFIGS. 4C and 5C show the ideal representation of the physics as described, but in reality many factors will affect the actual output beam of the light, including but not limited to the as-manufactured shapes of thelight pipe138,lens132 and/orpinhole136, shape of the light beam emanating from thelight source130, and manufacturing tolerances regarding the spacing between the components.
• As mentioned above, theimage enhancer device105 can include anilluminator115. Theilluminator115 can allow a user to provide adequate illumination on the object of interest such that the camera of the mobile device can recognize and process the object efficiently and accurately and without shadows or dark regions. In some implementations, the illumination source is a light source of themobile device10 such as a flash. In such implementations, a light pipe can be used to shape the light emanating from the mobile device light source. Theilluminator115 can be coupled to theimage enhancer device105 such that the illumination beam generated by theilluminator115 can project away from thescan side107 of theimage enhancer device105, for example through theillumination beam window113 extending through the wall of the scan side107 (seeFIG. 2A). In some implementations, the illumination beam generated can overlap the aiming beam from theaimer110. Again with respect toFIG. 1, theilluminator115 can include aPCB152 electrically coupled to anillumination element154. It should be appreciated that thePCB152 of theilluminator115 can be a different PCB than thePCB126 of theaimer110 or theilluminator115 andaimer110 can be incorporated into a single PCB. Theillumination element154 can include anillumination light source156, and optionally, a diffusingelement158 and alight pipe160 to control the light. Theillumination light source156 of theilluminator115 can include, for example, a light emitting diode (LED), organic light emitting diode (OLED), laser diode and the like and can be electrically connected to thePCB152. Illumination can be of a color or spectrum of colors or set of colors including, but not limited to red, white, non-visible light or the like. Theilluminator115 can also incorporate an element that can occlude regions of the beam to generate a beam pattern. In some implementations, the shape of this beam can guide the user towards the scan location, therefore serving the role of an aiming device. Qualities of this illumination include frequency of light and brightness of light can be altered in response to external factors such as ambient illumination, color of the target, orientation of the target, distance of the target, etc.
• Now with respect toFIGS. 6A-6B, theilluminator115 can be positioned within aregion150 of thehousing102 configured to hold thePCB152 that is electrically coupled to theillumination element154. Thehousing region150 of theilluminator115 can have a variety of configurations and shapes. Thehousing region150 can have afirst end162 and asecond end164 and aninterior volume166 extending between thefirst end162 and thesecond end164. In some implementations, thePCB152 can be coupled near afirst end162 of thehousing region150 and the diffusingelement158, if present, can be coupled to thesecond end164 of thehousing region150 such that theinterior volume166 extends between thePCB152 and the diffusingelement158. Theillumination light source156 can be coupled to thePCB152 coupled to thehousing region150 near thefirst end162. Theillumination light source156 can optionally be covered by the diffusingelement158 as shown inFIG. 6A and can optionally include alight pipe160 positioned between theillumination light source156 and the diffusingelement158, if present as shown inFIG. 6B. Thelight pipe160 can have a first end positioned adjacent theillumination light source156 and a second end positioned adjacent thediffusion element158. Features of thelight pipe160 may include but are not limited to a first end that is planar, curved, or shaped and may additionally be smooth or textured, intermediate surfaces that may be angled to provide total internal reflection, intermediate surfaces that may be circular, square, or polygonal in cross section, a second end that may be planar, curved, or shaped, and a second end that may additionally be smooth or textured. Texture may be applied to the surfaces of thelight pipe160 and/or internal voids and/or reflective materials may be volumetrically encapsulated within thelight pipe160 to create diffusion effects. The length of thelight pipe160 and size of the first and second ends of thelight pipe160 may also be adjusted. These features and dimensions can be tuned such that the light beam exiting theilluminator115 has a shape and distribution that creates an optimal beam for scanning. For example, shaping can allow tradeoffs between brightness and coverage to be optimized, providing either a brighter, more concentrated beam, or a broad reaching, but less intense light on the object to be scanned.
• As for distribution of light, having the light emissions balanced around the central axis ofincoming light122, as can be achieved with alight pipe160 configured to provide uniform internal light distribution and an output end that is shaped as in a ring flash, can eliminate shadows. Furthermore, having the light emit out of a larger surface area, as can be achieved with alight pipe160 configured with diffusive properties and a second end larger than the source LED, can reduce the intensity of reflections generated by the light reflected off the object to be scanned. Conversely, having the light emission concentrated to a small but intense source, as can be achieved with an LED with a small die area or with alight pipe160 shaped to act as a concentrator, can drastically minimize the size of reflected hot spots embedded in theincoming light122 and prevent image features such as those found in bar codes from being washed out. The housing material can be generally opaque and prevent light bleed such that light emitted from theaimer110 and theilluminator115 can be generally contained by thehousing102 except for that which exits theapertures111,113. It should be appreciated that theaimer110,illuminator115, andimage manipulator120 can be independently housed or grouped together in a singular housing.
• As mentioned above, the devices described herein can be used with (e.g. reversibly coupled to) a mobile device such as a tablet, smartphone or other mobile computing device having a digital camera or other imaging element. The PCB(s) of the device can communicate with the electronics of the mobile device as well as the LEDs, sensors, user inputs and other peripheral enhancements. In some implementations, the devices described herein can incorporate one or more attachment elements such that the device can be reversible coupled to the mobile device in an appropriate orientation and positioned relative to the camera on the mobile device. The one or more attachment elements can be integrated with the housing of the devices described herein or the one or more attachment elements can be separate from the housing. Whether the housing of the devices described herein has an integrated attachment element(s) or the device is coupled to the mobile device by a separate attachment element(s), the device is coupled such that the optics are appropriately oriented and positioned relative to the camera/sensor of the mobile device. Because the devices described herein can be used with a wide variety of different mobile devices having varying locations for the camera/sensor, it should be appreciated that the attachment element can couple the devices described herein accordingly and is not limited to any particular arrangement.
• In some implementations, theimage enhancer device105 is itself incorporated into an attachment element forming a case that can be attachable and/or detachable with the mobile device in an appropriate orientation and position relative to the camera. The case can be a case covering most of the mobile device or a smaller case that only covers a portion of the mobile device, such as just the corners and/or edges of the mobile device. The case can include additional features such as charging port(s), grips and/or peripherals such as one or more additional sensors, CC, magnetic strip readers, EMV smart card readers, biometric scanners. The case can include security and/or anti-theft features such as security hardware, keyed access, or electronic lock-outs. The case can also include features that provide protection of themobile device10 and/or thesystem100 from shock, vibration, and fluid ingress or egress. The case can incorporate features to improve reversible coupling such as snap-on features or be formed of a material that allows for elastic deformation of the case to create a “skin” over at least a portion of themobile device10 such as one or more corners, faces, and edges. The case can incorporate one or more features to improve grip such as a tacky or textured surface(s). It should be appreciated that the configuration of the case can vary. The case and/or thehousing102 of theimage enhancer device105 can be formed of a polycarbonate, polyurethane, acrylonitrile butadiene styrene, or a polycarbonate-acrylonitrile butadiene styrene blend material or other material or combination of materials.
• FIGS. 7A-7E illustrate an implementation of anattachment element170 configured to couple theimage enhancer device105 to amobile device10 such as a tablet or smartphone. In this implementation, theattachment element170 forms a protective case for themobile device10. Theattachment element170 can be configured to surround themobile device10 along a region of the mobile device chassis such that each side of the mobile device chassis is encased by theattachment element170. Theattachment element170 can include ascreen window172 such that the screen of themobile device10 can be viewed through theattachment element170. Theattachment element170 can include a region within which theimage enhancer device105 can be aligned with the camera of themobile device10. As shown best inFIG. 7C, theattachment element170 can be coupled to at least a portion of theimage enhancer device105 such that theimage enhancer device105, theattachment element170, and themobile device10 are all fixed relative to one another. Upon coupling theattachment element170 to themobile device10, thescan side107 of theimage enhancer device105 is aligned with ascan window174 in theattachment element170, which is configured to allow light to enter and exit thescan window174. Thescan window174 can be an aperture in theattachment element170 with or without a covering such as a piece of PMMA, polycarbonate, clear plastic, glass or other clear material. Thescan window174 can be one aperture window or multiple aperture windows. Thecamera side109 of theimage enhancer device105 can be placed into contact with or adjacent or flush to the camera of themobile device10. The arrangement between theattachment element170, theimage enhancer device105 and themobile device10 allow for theimage manipulator120 to directincoming light122 towards the camera of themobile device10 while outgoing light from the aiming light source and/or illumination light source can be directed at an angle relative to themobile device10 towards the object to be scanned or read. It should be appreciated that the configuration of theattachment element170 can vary.
• Again with respect toFIGS. 1A-1B, theimaging enhancement system100 can includeelectronics180 configured to allow for power and communication between theimage enhancer device105 and the associatedmobile device10. Theelectronics180 may have embedded processors and memory, and embedded software to perform computation tasks and provide system logic. Theelectronics180 may also have dedicated communication functions through thecommunications module192, and dedicated power distribution and management functions through the power module206 (seeFIG. 1B). In some implementations, communication and/or power can be provided by a connector member (not shown) configured to engage the audio port, USB port, or proprietary port connector (e.g. Apple's Lightning connector) on themobile device10. In some implementations, the connector member is incorporated into a region of theattachment element170 or case such that the connector member engages the mobile device port upon association of the case with the mobile device chassis.
• Communication between themobile device10 and theimage enhancement system100 may be provided by thecommunication module192 which may be resident on theelectronics180, or on a separate pcb. The audio port on themobile device10 can be a standardized ⅛ inch audio port. The audio port on most mobile devices is standard. Thecommunication module192 can provide a communication channel over the audio port, which allows the devices described herein to be generally universal and use the same core electronics across a wide range of mobile devices. Communication can be one way (mobile device talks to the device or device talks to the mobile device) or two way (mobile device may send and receive messages from the device). One or more audio channels can be used for communication in either direction between the device and the mobile computer. One or more audio channels may be dedicated to pass analog sound from the mobile device to the electronics. Communication can also occur via inaudible or audible frequencies between the mobile device speaker and/or microphone and a device speaker and/or microphone resident on theelectronics180. The devices described herein can be hardwired to themobile device10 via a native port of the mobile device, such that thecommunication interface205 can be the audio, USB, USB-C, USB mini, USB micro, Apple's 30 pin, Apple's Lightning, or mobile device specific proprietary port. Furthermore, theelectronics180 can also be configured to communicate with themobile device10 via Bluetooth, WiFi, Near Field Communication (NFC), other wireless standards, RF, or light. For light based communication, data can be sent from themobile device10 to theelectronics180 by illuminating select pixels on the tablet screen at specific on/off frequencies, brightness's and/or colors as driven by a data protocol, the emissions of which are then received by a light sensor on the device and converted to data. Further, data can be sent from theelectronics180 to themobile device10 through an additional LED connected to theelectronics180 illuminating at specific on/off frequencies, brightness and/or colors as driven by a data protocol, the emissions of which are then received by the mobile device camera and converted to data.
• Power management and distribution may be provided by thepower module206, which may be resident on theelectronics180, or on a separate pcb. For devices that have anexternal power source207 such as in fixed kiosk applications, thepower module206 can accept power coming fromexternal power source207, can condition it, and can distribute it to theelectronics180 and themobile device10 through the power interface204 (see path BB inFIG. 1B). For devices that do not have access to anexternal power source207, thepower module206 can accept power coming from thepower interface204 on themobile device10, can condition it, and can distribute it to electronics180 (see path AA inFIG. 1B). For devices using path AA, thepower interface204 can be a native port on themobile device10, such as the audio, USB, USB-C, USB mini, USB micro , Apple 30-pin Apple Lightning , or a mobile device specific proprietary port. For devices using path BB, power can be provided by AC, DC, and power over Ethernet (POE) sources. These power sources may have power preconditioned by external adapters such as AC/DC wall adapters or POE splitter, or may have power conditioned within thepower module206. Power conditioning may include ac/dc conversion, surge protection, noise filtering, voltage boosting, or stepping down of high voltage sources. When distributing power to themobile device10, thepower module206 may contain current set resistors or other such features to facilitate electronic handshakes that permit mobile devices to receive full power output.
• Thepower module206, theimage enhancer device105 and/or the entireimaging enhancement system100 can harvest power from the signal exiting themobile device10 through the audio port from any of the audio channels. This power harvesting can occur simultaneously with unidirectional or bidirectional communication. The data protocol can include one or more of FSK, PSK, QAM, RS-232 and the like. The communication and/or power transmission between themobile device10 and the devices described herein can be aided through hardware and software filters, for example high-pass, low-pass, band-pass, Butterworth, level shifting, AC coupling, RC, tuning circuit, DC bias, band-stop, and the like. Energy harvesting (e.g. from the audio port, as well as thermal, electromagnetic, solar, and mechanical) eliminates the need for an external power source or onboard power storage, such as a battery, that is sized to last the full duration between charges. The energy harvested can be used in real time, or may be contained within a super capacitor or battery. Implementations using super capacitors may simplify the power architecture and reduce size, cost, and weight for power related electronic components. It should be appreciated that thedevice105 and/orsystem100 can be configured to receive power from a dedicated battery as opposed to harvesting power from themobile device10. Additionally, configurations compatible with a variety of power peripherals such as charging stations, battery packs, inductive charging, wireless charging, etc. can be incorporated such that they are integrated into the communication and/or power architecture of theelectronics180.
• Again with respect toFIGS. 1A-1B, theimaging enhancement system100 can include one ormore sensors190, including proximity sensors, touch sensors, capacitive sensors, and the like. In some implementations, the proximity sensor can be configured to sense when an object, such as a bar code, is brought in close proximity to theimage enhancer device105. For example, the proximity sensor can sense when the object is brought within the FOV of theimage manipulator120, within the illuminated region emanating from theilluminator115 of theimage enhancer device105, or within the beam of theaimer110 of theimage enhancer device105, or within proximity to thescan window174. The information provided by the proximity sensor can be used to start, influence, or as an input to some portion of the scanning process. The type of proximity sensor can vary including, but not limited to IR/photodiode, radar, LIDAR, stereo camera, motion sensing, structured light, acoustic and the like. The proximity sensor can be a dedicated sensor such as an IR/LED—photo diode combination, or it can be image-based as in using the mobile device camera and motion detect algorithms. The external proximity sensor can be used to provide distance information to the camera to support focus. The proximity sensor can be dedicated hardware or the system may leverage sensing features of the mobile device camera as well. The system may also include informed decision making beyond focus, such as motion detection. The motion detection algorithm can preserve the camera autofocus mechanism (from life cycling) and reduce power consumption (e.g. run in a lower power state when there is no object to scan). Thus, the proximity sensor can extend beyond the hardware to include intelligence in the camera on the mobile device. Mobile device cameras can have a precise range sensing built in (e.g. “focus pixels” on iPhone 6 provide phase detect autofocus) that can be leveraged by the devices and systems described herein.
• Again with respect toFIGS. 1A-1B, theaimer110 and theilluminator115 can includecircuit boards126,152 that can electrically connect toelectronics180. Theelectronics180 can include a main circuit board (not shown) and be configured to connect to one or more of thesensors190, a transmitter/receiver192, and anyinputs194 oroutputs196 within thesystem100 as well as communicate with themobile device10. For example, the devices described herein can also include one ormore inputs194 such as an external button, key, capacitive switch, or other input for user control as well as one ormore outputs196 such as for example a light or other indicator indicating the device power and operational status, a vibrational motor for user feedback, or a piezo buzzer to sound a tone upon a successful scan. In some implementations, theimaging enhancement system100 can include aninput194 such that theimage enhancer device105 can be directly controlled to scan as opposed to controlled through themobile device10 or a software application running on themobile device10. Theinput194 can be positioned relative to theimage enhancer device105 and/or to the associatedmobile device10 such that a user can easily hold the mobile device with a single hand and operate theinput194 with a single hand in an intuitive manner that is also ergonomically correct. Theelectronics180 can further contain embedded firmware, electronics and/or dedicated IC's to provide extended capabilities in the system. Examples include IC's that provide locational awareness, NFC tags that enable interactions and payment workflows, and depth sensors that are able to understand gestures and movement.
• The devices described herein can be optimized for use in various settings including, but not limited to a commercial or public setting. For example, the devices described herein can have a ruggedized design that provides some form of protection against things such as but not limited to: mechanical shock, fluid ingress, humidity, temperature variation, static or other electrical shocks, food, grease, and/or other unwanted materials. Ruggedized design of one or more of the features of the devices described herein can prevent damage to components including but not limited to, the screen, camera, lens, buttons, connection ports or any other external or internal feature of the mobile device as well as components of the devices described herein. The devices described herein can include access or hardware to simplify or enable various types of charging methods, such as but not limited to docking stands, external battery packs, pogo pins, charging cables, charging ports, or wireless charging methods such as induction. The devices described herein can include features to improve ergonomics, such as but not limited to: grips, handles, access points, left or right handed user features, features to aid in displaying the screen from the user to another person (for example from an associate to a customer), distributed weighting to provide balance or heft. The devices described herein can provide material, color, icon or image selection to provide guidance for use. The devices described herein can provide aesthetic to match, enhance, or complement the aesthetic of the location of use. The devices described herein can provide features as appropriate for field access for things such as, but not limited to upgrades, repairs, alterations, part replacement, peripheral replacement, and peripheral changing.
• In some implementations, provided herein is an image enhancer device for use with a mobile electronic device having a digital camera, the image enhancer device includes an aimer having an aiming element configured to direct at least one aiming light beam away from a first region of the device towards the object of interest. The image enhancer device includes an illuminator having an illumination element configured to direct at least one illumination light beam away from the first region of the device towards the object of interest. The image enhancer device includes an image manipulator configured to modify an optical path of the digital camera. In some implementations, the device includes an image manipulator. In other implementations, the device includes the image manipulator and an aimer. In still other implementations, the device includes the image manipulator and the illuminator. In other implementations, the device includes the image manipulator, the aimer and the illuminator. In further implementations, the device includes the image manipulator and the aimer, wherein the aimer additionally provides illumination. In still further implementations, the device includes the image manipulator and an illuminator bounded by an aperture to provide clear aiming direction. In some implementations, the device need not include an aimer.
• While this specification contains many specifics, these should not be construed as limitations on the scope of what is claimed or of what may be claimed, but rather as descriptions of features specific to particular embodiments. Certain features that are described in this specification in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable sub-combination. Moreover, although features may be described above as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination can in some cases be excised from the combination, and the claimed combination may be directed to a sub-combination or a variation of a sub-combination. Similarly, while operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. Only a few examples and implementations are disclosed. Variations, modifications and enhancements to the described examples and implementations and other implementations may be made based on what is disclosed.
• In the descriptions above and in the claims, phrases such as “at least one of” or “one or more of” may occur followed by a conjunctive list of elements or features. The term “and/or” may also occur in a list of two or more elements or features. Unless otherwise implicitly or explicitly contradicted by the context in which it is used, such a phrase is intended to mean any of the listed elements or features individually or any of the recited elements or features in combination with any of the other recited elements or features. For example, the phrases “at least one of A and B;” “one or more of A and B;” and “A and/or B” are each intended to mean “A alone, B alone, or A and B together.” A similar interpretation is also intended for lists including three or more items. For example, the phrases “at least one of A, B, and C;” “one or more of A, B, and C;” and “A, B, and/or C” are each intended to mean “A alone, B alone, C alone, A and B together, A and C together, B and C together, or A and B and C together.”
• Use of the term “based on,” above and in the claims is intended to mean, “based at least in part on,” such that an unrecited feature or element is also permissible.

Claims (20)

What is claimed:

1. An image enhancer device for use with an associated mobile electronic device having a digital camera, the image enhancer device comprising:

a housing;

an image manipulator coupled to a first region of the housing configured to modify an optical path of the digital camera;

an aimer having an aiming element configured to direct at least one aiming light beam towards an object of interest;

an illuminator having an illumination element configured to direct at least one illumination light beam from the housing towards the object of interest; and

electronics allowing for communication between the image enhancer device and the associated mobile electronic device,

wherein the image enhancer device forms a scan angle relative to a field of view of the digital camera of the mobile electronic device and allows for bar code imaging and/or native image processing with the digital camera of the associated mobile electronic device.

2. The device ofclaim 1, wherein the aiming element includes a first LED light source, the illuminator element includes a second LED light source, and the image manipulator has a first mirrored surface.

3. The device ofclaim 1, wherein the electronics allow for communication from the associated mobile electronic device through a native port on the associated mobile electronic device, the native port being an audio port, a lightning port, or a USB port.

4. The device ofclaim 3, wherein the electronics further allow for harvesting of energy through the native port.

5. The device ofclaim 4, wherein the harvested energy is stored in a super capacitor of the device.

6. The device ofclaim 1, wherein the communication is bi-directional over an audio port on the associated mobile electronic device.

7. The device ofclaim 1, wherein the image manipulator receives light directed towards the first region of the housing from the object of interest and reflects the light towards a second region of the housing, and optionally, wherein the first region and the second region of the housing are arranged at an angle to one another.

8. The device ofclaim 1, wherein the aimer directs the at least one aiming light beam from the first region of the housing through an aperture in the housing, and optionally, wherein incoming light is directed toward the image manipulator and reflects at an angle relative to the incoming light into a lens or image sensor of the digital camera of the associated mobile electronic device.

9. The device ofclaim 1, wherein the first region of the housing allows incoming light to reflect onto the image manipulator and allowing outgoing light from the aimer and the illuminator to exit the housing and toward the object of interest.

10. The device ofclaim 9, wherein a surface of the second region is positionable relative to the chassis of the associated mobile electronic device such that the image manipulator is generally centered and aligned over the lens or image sensor of the digital camera of the associated mobile electronic device and the first region faces at an angle to the chassis such that the at least one aiming light beam and the at least one illuminating light beam are directed away from the device and toward the object of interest.

11. The device ofclaim 10, wherein when the second region of the housing is positioned relative to the chassis of the mobile device and optically aligned with the camera, the first region of the housing is oriented such that incoming light directed towards the image enhancer device reflects onto the image manipulator and is redirected towards the digital camera of the associated mobile electronic device.

12. The device ofclaim 11, wherein the at least one aiming light beam is emitted through an aimer aperture extending through a wall in the housing of the device on the first region of the housing, and optionally, wherein the at least one illumination light beam is emitted through an illuminator aperture extending through the wall of the housing, wherein the illuminator aperture and the aimer aperture can be the same or different apertures.

13. The device ofclaim 12, wherein a plane of the aimer aperture and a plane of the illuminator aperture are the same plane, parallel planes, or non-parallel planes, and wherein an angle is formed between a plane of the second region of the housing and the planes of the aimer aperture and the illuminator aperture.

14. The device ofclaim 13, wherein the angle is at least about 15°, 20°, 25°, 30°, 35°, 40°, 45°, 50°, 55°, 60°, 65°, 70°, 75°, 80°, 85°, 90°, 95° or greater degrees.

15. The device ofclaim 13, wherein the angle is fixed or mechanically adjustable.

16. The device ofclaim 1, wherein incoming light is redirected by the image manipulator at an angle that is about 15°, 20°, 25°, 30°, 35°, 40°, 45°, 50°, 55°, 60°, 65°, 70°, 75°, 80°, 85°, 90°, 95° degree angle from an original direction.

17. The device ofclaim 1, wherein the scan angle is 90 degrees from a direction that the digital camera is facing.

18. The device ofclaim 1, wherein the aimer is housed within an interior volume of the housing and the aiming element comprises a lens, a pinhole element defining a pinhole, and an aiming light source coupled to a printed circuit board, wherein the lens is oriented near a first region of the housing a distance away from the pinhole element, the pinhole element is coupled to or integrated with an inner surface of the housing between the lens and the aiming light source.

19. The device ofclaim 18, wherein the aiming element further comprises a diffuser positioned between the pinhole element and the aiming light source.

20. The device ofclaim 18, wherein the lens is placed with its focal point at the pinhole, which is a distance away from the light source and has a measured spread of the beam of light produced by the aiming element.

Images