CN116347214A - Image acquisition method, device, operation recorder and medium - Google Patents

Abstract

Translated fromChinese

本申请实施例提供了一种图像采集方法、装置、作业记录仪及介质，在该方法中，启动录像功能，控制彩色摄像头和红外摄像头上电但不出帧；若检测到当前环境为夜间场景，控制红外摄像头开始录像，并保持彩色摄像头的上电但不出帧的状态；判断当前环境下是否进行拍摄彩色照片；如果是，保持红外摄像头进行录像，以及控制彩色摄像头拍照。在该方法中，夜间场景中始终使用红外摄像头录制红外图像，同时拍照时使用彩色摄像头拍摄彩色照片，既可以保证录制内容始终清晰，也可以记录所需的色彩信息，因此能够实现夜间工作中的问题追溯，有利于安全生成。

The embodiment of the present application provides an image acquisition method, device, job recorder and medium. In this method, start the video recording function, control the color camera and the infrared camera to be powered on but not produce frames; if it is detected that the current environment is a night scene , control the infrared camera to start recording, and keep the color camera powered on but not displaying a frame; judge whether to take color photos in the current environment; if so, keep the infrared camera to record, and control the color camera to take pictures. In this method, the infrared camera is always used to record infrared images in night scenes, and the color camera is used to take color photos when taking pictures, which can not only ensure that the recording content is always clear, but also record the required color information, so it is possible to realize night work. Problem tracing is conducive to safe generation.

Description

Image acquisition method, device, operation recorder and medium

Technical Field

The present invention relates to the field of image processing technologies, and in particular, to an image acquisition method, an image acquisition device, an operation recorder, and a medium.

Background

On construction sites of departments such as railways, constructors generally wear law enforcement recorders or similar equipment to record daily work, and the construction sites can be used for problem tracing when accidents occur. Usually, the law enforcement recorder uses a color camera for video recording during daytime operation, and switches to an infrared camera for video recording during night operation.

In some night operations, a constructor may take different operations through indication of a signal lamp, wherein the signal lamp emits a signal to indicate according to the illumination of different colors. But when working at night, law enforcement record appearance adopts infrared camera to carry out the video recording, and infrared camera can only export two colours of black and white, so can't record the colour information of signal lamp. When an accident occurs, whether the accident occurs due to misoperation indicated by the signal lamp cannot be judged, problem tracing cannot be realized, and safety production is not facilitated.

Disclosure of Invention

The embodiment of the application provides an image acquisition method, an image acquisition device, an operation recorder and a medium, which are used for solving the problem that the problem tracing cannot be realized in the prior art.

In a first aspect, an embodiment of the present application provides an image capturing method applied to a job recorder, where the job recorder includes a color camera and an infrared camera, the method includes:

starting a video recording function, and controlling the color camera and the infrared camera to be electrified but not to output frames;

if the current environment is detected to be a night scene, controlling the infrared camera to start video recording, and keeping the state that the color camera is electrified but does not go out of a frame;

Judging whether a color photo is shot in the current environment;

if yes, keeping the infrared camera to record the video, and controlling the color camera to take a picture.

In a second aspect, embodiments of the present application provide an image acquisition device applied to a job recorder, the job recorder including a color camera and an infrared camera, the device including:

the first control module is used for starting a video recording function and controlling the color camera and the infrared camera to be electrified but not to output frames;

the second control module is used for controlling the infrared camera to start video recording if the current environment is detected to be a night scene, and keeping the state that the color camera is electrified but does not go out of a frame;

the judging module is used for judging whether a color photo is shot in the current environment;

and the third control module is used for keeping the infrared camera to record video and controlling the color camera to take a picture when the judging result of the judging module is yes.

In a third aspect, an embodiment of the present application provides an electronic device, where the electronic device includes at least a processor and a memory, where the processor is configured to implement the steps of the image capturing method according to any one of the preceding claims when executing a computer program stored in the memory.

In a fourth aspect, embodiments of the present application provide a computer-readable storage medium storing a computer program which, when executed by a processor, implements the steps of the image acquisition method as described in any one of the above.

In the embodiment of the application, a video recording function is started, and the color camera and the infrared camera are controlled to be electrified but not out of frames; if the current environment is detected to be a night scene, controlling the infrared camera to start video recording, and keeping the state that the color camera is electrified but does not go out of the frame; judging whether a color photo is shot in the current environment; if yes, the infrared camera is kept to record the video, and the color camera is controlled to take a picture. In the method, the infrared camera is always used for recording the infrared image in the night scene, and the color camera is used for shooting the color photo when shooting, so that the recorded content can be ensured to be clear all the time, and the required color information can be recorded, thereby realizing the problem tracing in night work and being beneficial to safe production. In addition, the method does not switch cameras during video recording, can avoid video recording interruption caused by lens switching, and can improve image acquisition effect and ensure video recording integrity.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic structural diagram of a job recorder according to some embodiments of the present application;

FIG. 2 is a block diagram of a job recorder software according to some embodiments of the present application;

FIG. 3 is a schematic diagram of an image acquisition process according to some embodiments of the present application;

fig. 4 is a schematic diagram of a display interface of an automatic photographing switch according to some embodiments of the present application;

FIG. 5 is a schematic diagram of a display interface of a night-time switch according to some embodiments of the present application;

FIG. 6 is a schematic diagram of an image acquisition process according to some embodiments of the present application;

FIG. 7 is a schematic diagram of an image acquisition process according to some embodiments of the present application;

FIG. 8 is a schematic diagram of an image acquisition process according to some embodiments of the present application;

Fig. 9 is a schematic structural diagram of an image capturing device according to some embodiments of the present application;

fig. 10 is a schematic structural diagram of a job recorder according to some embodiments of the present application.

Detailed Description

For the purposes of making the objects, technical solutions and advantages of the present application more apparent, the present application will be described in further detail below with reference to the accompanying drawings, wherein it is apparent that the described embodiments are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.

In order to realize problem tracing during construction, the embodiment of the application provides an image acquisition method, an image acquisition device, an operation recorder and a medium.

The method and the device are mainly applied to construction scenes such as railways and the like, and are used for recording daily work and tracing problems in accident. In order to implement the image capturing method provided in the embodiments of the present application, a schematic structural diagram of a possible job recorder is provided in the embodiments of the present application, as shown in fig. 1, it should be understood that thejob recorder 100 shown in fig. 1 is only an example, and thejob recorder 100 may have more or fewer components than those shown in fig. 1, may combine two or more components, or may have different component configurations. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits. In one implementation, the job recorder is a terminal device.

As shown in fig. 1, thejob recorder 100 includes: radio Frequency (RF)circuitry 110,memory 120,display unit 130,camera 140,sensor 150,audio circuitry 160, wireless fidelity (wireless fidelity, wi-Fi)module 170,processor 180,bluetooth module 181, andpower supply 190.

TheRF circuit 110 may be used for receiving and transmitting signals during the process of receiving and transmitting information or communication, and may receive downlink data of the base station and then transmit the downlink data to theprocessor 180 for processing; uplink data may be sent to the base station. Typically, RF circuitry includes, but is not limited to, antennas, at least one amplifier, transceivers, couplers, low noise amplifiers, diplexers, and the like.

Memory 120 may be used to store software programs and data. Theprocessor 180 executes various functions and data processing of thejob recorder 100 by executing software programs or data stored in thememory 120.Memory 120 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.Memory 120 stores an operating system that enablesjob recorder 100 to run. Thememory 120 in the present application may store an operating system and various application programs, and may also store program codes for executing the image capturing method in the embodiment of the present application.

Thedisplay unit 130 may be used to receive input numeric or character information, generate signal inputs related to user settings and function controls of thejob recorder 100, and in particular, thedisplay unit 130 may include atouch screen 131 provided on the front surface of thejob recorder 100, and may collect touch operations on or near the user, such as clicking buttons, dragging scroll boxes, and the like.

Thedisplay unit 130 may also be used to display information entered by the user or provided to the user as well as a graphical user interface (graphical user interface, GUI) of various menus of thejob recorder 100. Specifically,display unit 130 may include adisplay screen 132 disposed on the front ofjob recorder 100. Thedisplay 132 may be configured in the form of a liquid crystal display, light emitting diodes, or the like. Thedisplay unit 130 may be used to display video or photos, and record the working environment.

Thetouch screen 131 may cover thedisplay screen 132, or thetouch screen 131 and thedisplay screen 132 may be integrated to implement the input and output functions of thejob recorder 100, and the integrated touch screen may be simply referred to as a touch display screen. Thedisplay unit 130 may display an application program and corresponding operation steps.

Thecamera 140 may be used to capture still images or video. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transferred to theprocessor 180 for conversion into a digital image signal. In the present embodiment, thecamera 140 includes a color camera, also referred to as a visible lens, for capturing visible light images, and an infrared camera for capturing infrared images.

Thejob recorder 100 may also include at least onesensor 150, such as anacceleration sensor 151, adistance sensor 152, afingerprint sensor 153, atemperature sensor 154. Thejob recorder 100 may also be configured with other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, light sensors, motion sensors, and the like.

Audio circuitry 160,speaker 161,microphone 162 may provide an audio interface between the user andjob recorder 100. Theaudio circuit 160 may transmit the received electrical signal converted from audio data to thespeaker 161, and thespeaker 161 converts the electrical signal into a sound signal and outputs the sound signal. Thejob recorder 100 may also be configured with a volume button for adjusting the volume of the sound signal. On the other hand, themicrophone 162 converts the collected sound signal into an electrical signal, which is received by theaudio circuit 160 and converted into audio data, which is output to theRF circuit 110 for transmission to, for example, another terminal device, or to thememory 120 for further processing.Microphone 162 may capture the voice of the user in this application.

Wi-Fi belongs to a short-range wireless transmission technology, and thejob recorder 100 can help a user to send and receive e-mail, browse web pages, access streaming media and the like through the Wi-Fi module 170, so that wireless broadband internet access is provided for the user.

Processor 180 is a control center ofjob recorder 100, connects the various parts of the entire job recorder using various interfaces and lines, and performs various functions ofjob recorder 100 and processes data by running or executing software programs stored inmemory 120, and calling data stored inmemory 120. In some embodiments, theprocessor 180 may include one or more processing units; theprocessor 180 may also integrate an application processor that primarily handles operating systems, user interfaces, applications, etc., and a baseband processor that primarily handles wireless communications. It will be appreciated that the baseband processor described above may not be integrated into theprocessor 180. Theprocessor 180 may run an operating system, an application program, a user interface display, a touch response, and an image acquisition method described in the embodiments of the present application. In addition, theprocessor 180 is coupled with thedisplay unit 130.

Thebluetooth module 181 is configured to perform information interaction with other bluetooth devices having a bluetooth module through a bluetooth protocol. For example, thejob recorder 100 may establish a bluetooth connection with a wearable electronic device (e.g., a smartwatch) also provided with a bluetooth module through thebluetooth module 181, thereby performing data interaction.

Job recorder 100 also includes a power source 190 (e.g., a battery) that provides power to the various components. The power supply may be logically connected to theprocessor 180 through a power management system, so that functions of managing charge, discharge, power consumption, etc. are implemented through the power management system. Thejob recorder 100 may also be configured with power buttons for functions such as power on and off, and screen locking.

Fig. 2 is a software block diagram of ajob recorder 100 according to an embodiment of the present application.

The layered architecture divides the software into several layers, each with distinct roles and branches. The layers communicate with each other through a software interface. In some embodiments, the Android system may be divided into four layers, from top to bottom, an application layer, an application framework layer, an Zhuoyun row (Android run) and system libraries, and a kernel layer, respectively.

The application layer may include a series of application packages.

As shown in fig. 2, the application package may include applications for cameras, gallery, calendar, phone calls, maps, navigation, wireless local area network (wireless local area network, WLAN), bluetooth, music, video, short messages, etc.

The application framework layer provides an application programming interface (application programming interface, API) and programming framework for application programs of the application layer. The application framework layer includes a number of predefined functions.

As shown in FIG. 2, the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

The window manager is used for managing window programs. The window manager can acquire the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.

The content provider is used to store and retrieve data and make such data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebooks, short messages, etc.

The view system includes visual controls, such as a photograph control, a text control, a picture control, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, a display interface including an application for capturing images may include a view displaying text and a view displaying a picture.

The telephone manager is used to provide the communication function of thejob recorder 100. Such as the management of call status (including on, hung-up, etc.).

The resource manager provides various resources for the application program, such as localization strings, icons, pictures, layout files, video files, and the like.

The notification manager allows the application to display notification information (e.g., message digest of short message, message content) in a status bar, can be used to convey notification type messages, can automatically disappear after a short dwell, and does not require user interaction. Such as notification manager is used to inform that the download is complete, message alerts, etc. The notification manager may also be a notification in the form of a chart or scroll bar text that appears on the system top status bar, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, a text message is presented in a status bar, a prompt tone is given, the operation recorder vibrates, and an indicator light blinks.

Android run time includes a core library and virtual machines. Android run time is responsible for scheduling and management of the Android system.

The core library consists of two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.

The application layer and the application framework layer run in a virtual machine. The virtual machine executes java files of the application program layer and the application program framework layer as binary files. The virtual machine is used for executing the functions of object life cycle management, stack management, thread management, security and exception management, garbage collection and the like.

The system library may include a plurality of functional modules. For example: surface manager (surface manager), media Libraries (Media Libraries), three-dimensional graphics processing Libraries (e.g., openGL ES), 2D graphics engines (e.g., SGL), etc.

The surface manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.

Media libraries support a variety of commonly used audio, video format playback and recording, still image files, and the like. The media library may support a variety of audio video encoding formats, such as: dynamic picture experts group (moving pictures experts group, MPEG) 4, h.264, mp3, advanced audio coding (advanced audio coding, AAC), adaptive multi-rate (AMR), JPG, PNG, etc.

The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.

A 2D (one way of animation) graphics engine is a drawing engine for 2D drawing.

The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.

First, terms involved in embodiments of the present application will be briefly described:

1) Powering up means that the camera hardware is powered on, and is in a waiting but non-working state at the moment. Generally, powering up is the first step in the operation of the camera. This step is generally time-consuming, so in the embodiment of the present application, after the video recording function is started, before formally starting video recording/photographing, the camera is controlled to be powered on, and when the video recording/photographing requirement exists subsequently, video recording/photographing can be performed in a fast response manner, so as to improve video recording/photographing efficiency, and thus improve user experience.

2) The distribution refers to configuring parameters related to shooting effects for a camera, and the specific configuration of the parameters is different, so that the imaging effect of the final video/photo can be influenced. The method mainly comprises the steps of preparing for subsequent video/photographing, and waiting for receiving a video request/photographing request by a job recorder after the streaming is finished.

3) And outputting the frame, namely outputting frame data by the camera according to the set frame rate. The purpose of the frame is to record video or record video, or just preview on the display screen, that is, the job recorder can use the frame data output by the camera to complete operations such as recording, photographing, or previewing.

The image acquisition process will be described with reference to the following examples.

In some embodiments, an image acquisition process provided in an embodiment of the present application is shown in fig. 3, and the process includes:

s301: and (3) starting a video recording function, and controlling the color camera and the infrared camera to be electrified but not to output frames.

The image acquisition method provided by the embodiment of the application is applied to the operation recorder, and in an actual application scene, the operation recorder can also be other terminal equipment with an image acquisition function. The operation recorder comprises a color camera and an infrared camera, wherein the color camera is used for collecting visible light images, and the infrared camera is used for collecting infrared images. Wherein, the visible light image is a color image (i.e. color photograph), and the infrared image is a black-and-white image.

The recording function of the operation recorder can be started manually by a user or can be started automatically after the operation recorder is powered on.

The operation recorder starts the video recording function to indicate that the video recording requirement possibly exists in the current environment, so that the operation recorder can control the color camera and the infrared camera to be electrified simultaneously (only by way of example, the color camera and the infrared camera can be electrified in sequence in the implementation process), and the operation recorder is kept in a state of being capable of outputting frames at any time, thereby being beneficial to follow-up rapid video recording/photographing. However, because the video/photo requirements of the current environment are not determined, the color camera and the infrared camera can be powered on first but do not go out of the frame.

S302: if the current environment is detected to be a night scene, controlling the infrared camera to start video recording, and keeping the state that the color camera is powered on but does not go out of the frame.

The job recorder may detect whether the current environment is a daytime or nighttime scenario. In one implementation, a light sensor in the job recorder detects brightness of a current environment, determines that the current environment is a daytime scene if the brightness of the current environment is greater than a set first brightness threshold, and determines that the current environment is a nighttime scene if the brightness of the current environment is less than the first brightness threshold. In another implementation manner, the job recorder determines according to the current time and the sunset time of the day, if the current time reaches the sunset time, the current environment is determined to be a night scene, and if the current time does not reach the sunset time, the current environment is determined to be a daytime scene.

If the current environment is a night scene, the operation recorder can record work in the night scene through the infrared camera in the working process, so that the infrared camera can be controlled to start recording. For example, a video request may be issued to the infrared camera, the infrared camera starts to output frames and record video in response to the video request, and the color camera continues to maintain a powered-on but not output frames state. Only the infrared camera always outputs frames and records the video at night, the color camera keeps the state of powering on but not outputting frames except the moment of subsequent photographing, and the power consumption of the camera in the power-on state is very low, so that the operation recorder cannot increase too much power consumption, and the influence on the endurance time of the operation recorder is very slight. Therefore, in the process of video recording by the infrared camera, the color camera keeps a power-on state but does not go out of a frame, and the quick response to the shooting requirement can be realized on the basis of excessively increasing the power consumption of the operation recorder, so that the user experience is improved.

S303: and judging whether to take a color picture in the current environment. If so, S304 is performed.

The operation recorder can automatically detect whether the requirement of shooting the color photo exists in the current environment or not, and can trigger and judge whether the requirement of shooting the color photo exists in the current environment or not according to the operation of a user.

The job recorder can execute different steps according to different judging results. If in this step the job recorder determines that there is a need to take a color picture in the current night environment, S304 may be performed.

S304: and keeping the infrared camera to record the video, and controlling the color camera to take a picture.

If the current night environment has the requirement of taking color photos, the operation recorder can keep the infrared camera to record the video and control the color camera to take photos. Because the color camera keeps the power-on state all the time in the previous step, the color camera can respond to the frame-out photographing quickly when photographing, namely, the color camera which keeps the power-on but does not go out of the frame state is ready for frame-out at any time, when the photographing condition is met, the color camera can acquire and output the color picture quickly according to the set frame rate, so the color camera has the advantage of quick photographing response, and the infrared camera video is kept not to be switched all the time in the photographing process of the color camera, so that a user cannot perceive whether the camera for image acquisition has a change or not, and the user experience is not influenced.

The video data of the infrared camera and the photographing data of the color camera can be stored in one folder or in different folders respectively, so that the user can check conveniently.

If the current night environment does not have the requirement of taking color pictures, the operation recorder can keep the infrared camera to record the video and keep the state that the color camera is powered on but does not go out of the frame.

In this application embodiment, use infrared camera to record infrared image throughout in the night scene, use color camera to shoot the color photograph when shooing simultaneously, both can guarantee to record the content and clear throughout, also can record required color information, consequently can realize the problem retrospectively in the work of night, be favorable to safety in production. In addition, the method does not switch the cameras during video recording, can avoid video recording interruption caused by lens switching, can uninterruptedly record video by the infrared cameras, improves the image acquisition effect and ensures the video recording integrity.

The above embodiments are mainly described with respect to night scenes, and daytime scenes will be described correspondingly. If the current environment is detected to be a daytime scene, the operation recorder can record the daytime scene through the color camera in the working process, so that the color camera can be controlled to start recording. For example, a video recording request may be issued to the color camera, and the color camera starts to take frames and record video in response to the video recording request. In the process of starting frame outputting and video recording, the color camera can acquire and output color photos according to the preset frame rate corresponding to the color camera so as to ensure the smoothness of video pictures.

In some implementations, if the current environment is a daytime scene, the job recorder may also determine whether to take a color photograph in the current environment, if so, may control the color camera to take a photograph, and if not, continue to keep the color camera to record a video. The color camera can record and photograph at the same time, that is, the color camera is controlled to photograph, and the interruption of the recording process of the color camera is avoided. It can be understood that, since the color camera recording data is color recording, the job recorder can keep the color camera recording in the current daytime environment, and the user can trace back the problem by looking at the color recording data.

In still other implementations, if the current environment is a daytime scene, the infrared camera may also be controlled to remain powered on but not out of frames while the color camera is controlled to record video. Thus, when the daytime scene is switched to the nighttime scene, the infrared camera can quickly respond to the video recording request and then start video recording so as to improve the integrity of video recording. It can be appreciated that the power consumption of the infrared camera which is powered on but not in a frame state is very low, and the influence on the endurance time of the operation recorder is very slight.

Based on the above embodiment, in the embodiment of the present application, the process of S303 may include:

detecting whether to take a color picture in the current environment according to a pre-stored scene detection algorithm; and/or

And judging whether a command for shooting the color picture sent by the user is received.

In one implementation, a scene detection algorithm is stored in the job recorder, and the scene detection algorithm can detect whether a color photograph is taken in the current environment in real time. When it is determined that there is a need to take a color photograph in the current environment, the job recorder may automatically take a photograph using the color camera. Especially, under the condition that a user cannot vacate the hand operation for photographing, but photographing record demands exist on important scenes, the operation recorder automatically detects and photographs, so that the recording of the required color information is facilitated, and the problem tracing during night work is realized. By way of example, important scenes in which a need for a photo recording exists include, but are not limited to, signal light scenes and/or text scenes in which colored text content may be present.

The automatic photographing function switch can be stored in the operation recorder, a user can decide whether to use the function or not by himself or herself, if the use is determined, the user can turn on the automatic photographing function switch by himself or herself, and if the use is determined not, the user can turn off the automatic photographing function switch by himself or herself. For example, a control switch for "automatic photographing" is displayed on a User Interface (UI Interface) of the job recorder, or a key switch for "automatic photographing" is provided on a housing (e.g., a side frame) of the job recorder. Fig. 4 shows an "auto photo" switch displayed on the UI interface, the "auto photo" switch in (a) in fig. 4 being in an on state, and the "auto photo" switch in (b) in fig. 4 being in an off state. When the automatic photographing switch is in an on state, the operation recorder can detect whether to take a color picture in the current environment according to a scene detection algorithm.

In another implementation manner, the color photograph taking instruction sent by the user can be sent through a photograph key displayed on a UI interface of the job recorder, or can be sent through a photograph key or a shortcut operation set on a casing of the job recorder. When the user determines that the requirement of taking the color photos exists in the current environment, an instruction for taking the color photos can be sent out, and after the job recorder recognizes the instruction for taking the color photos, a color camera is adopted for taking the photos.

It can be understood that the sequential execution of the two processes of detecting whether the current environment takes a color picture and judging whether the color picture taking instruction sent by the user is received is not limited. For example, the job recorder may determine whether a user's instruction to take a color photograph is received while automatically detecting whether the current environment takes a color photograph. For another example, the job recorder may first detect whether a color picture is taken in the current environment, and then determine whether a user's instruction to take a color picture is received. For another example, the job recorder may first determine whether a user's instruction to take a color photograph is received, and then detect whether a color photograph is taken in the current environment.

In the embodiment of the application, the operation recorder can automatically detect the requirement of shooting the color photo in the current environment and/or shoot the color photo according to the operation of a user, thereby being beneficial to recording the required color information and realizing the problem tracing in night work. In addition, the triggering conditions of various color photographs can also improve the flexibility of image acquisition.

Taking a photographing key displayed on a UI interface of the job recorder as an example, some possible application scenarios are described.

The possible first scene, the shooting key includes a "shoot color photo" key and an optional "shoot black and white photo" key, i.e. the UI interface is directly displayed with a function key capable of shooting color photos. When the user clicks the button of 'take color photo', the job recorder determines that a command for taking color photo sent by the user is received, and then controls the color camera to take a photo in response to the command for taking color photo.

The possible second scene is that the photographing key only comprises a photographing key, namely, only a functional key capable of photographing is displayed on the UI interface, and the photographing key is not limited to the function of photographing a color photo. When a user clicks a photographing button, the job recorder determines whether a photographing instruction sent by the user is received, but whether to photograph a color picture or not, and can judge by combining other factors.

In this scenario, on the basis of the above embodiments, in the embodiment of the present application, determining whether a command for capturing a color photograph sent by a user is received may include:

judging whether a photographing instruction sent by a user is received or not, and determining that a night photographing color photo switch is in an on state.

In this embodiment, the job recorder may be further provided with a "night-shot" function switch, and the user may decide whether to use the function by himself or herself, if it is determined that the function is used, the user may turn on the "night-shot" switch by himself or herself, and if it is determined that the function is not used, the user may turn off the "night-shot" switch by himself or herself. Similar to the above-mentioned "automatic photographing", the UI interface of the job recorder may be displayed with a control switch for "photographing a color photograph at night", or the casing of the job recorder may be provided with a key switch for "photographing a color photograph at night". Fig. 5 shows a "night time illumination" switch displayed on the UI interface, the "night time illumination" switch in fig. 5 (a) being in an on state, and the "night time illumination" switch in fig. 5 (b) being in an off state.

That is, in this second scenario, the job recorder determines whether to take a color photograph in combination with the factor of whether the "night time illumination" switch is on when/after receiving the photographing instruction issued by the user. When the "night colour photograph" function switch is turned on, the job recorder always uses the colour camera to photograph colour photographs when/after the user gives a photographing instruction in a night scene. In this application embodiment, be provided with on the operation record appearance and clap the colour photograph switch night, when clap the colour photograph switch at night and open, the operation record appearance keeps the infrared camera to carry out the video recording to and control colour camera is photographed, both can guarantee to record the content and be clear all the time, also can record required color information, is favorable to problem to trace back and safety in production.

When the function switch of the night color photo taking function is turned off, the user sends a photographing instruction, namely that the user has a photographing requirement, so that the operation recorder can continuously detect the current environment in order to meet the photographing requirement of the user, and accordingly whether to take color photos or black-and-white photos is determined according to the detection result. Based on the foregoing embodiments, in an embodiment of the present application, the method further includes:

if a photographing instruction is received, the night photographing color photo switch is in a closed state; judging whether a color photo or a black-and-white photo is shot in the current environment;

if the color picture is shot in the current environment, controlling a color camera to shoot;

and if the black-and-white photo is determined to be shot in the current environment, controlling the infrared camera to shoot.

When the function switch of the night color photo taking function is turned off, the operation recorder can continuously judge whether the color photo or the black-and-white photo is taken in the current environment. In one implementation manner, when the job recorder judges whether to take a color photo or a black-and-white photo in the current environment, the job recorder can detect through the scene detection algorithm, determine whether to take the color photo according to the detection result, if the color photo is determined to be taken according to the detection result, determine that the color photo is taken in the current environment, otherwise, determine that the black-and-white photo is taken in the current environment.

If it is determined that a color photograph is taken in the current environment, the job recorder may control the color camera to take the color photograph. If it is determined that no color photographs are to be taken in the current environment, the job recorder may take black and white photographs using the infrared camera.

It can be understood that, because the video data of the infrared camera is black-and-white video, the operation recorder can keep the infrared camera to record video in the current night scene, and the user can trace back the problem by looking at the data of the black-and-white video.

One possible image acquisition process is shown with reference to fig. 6, comprising the steps of:

s601: and (3) starting a video recording function, and controlling the color camera and the infrared camera to be electrified but not to output frames.

S602: if the current environment is detected to be a night scene, controlling the infrared camera to start video recording, and keeping the state that the color camera is powered on but does not go out of the frame.

S603: judging whether a color picture is shot in the current environment or a shooting instruction of a user is received; if it is detected that a color photograph is taken in the current environment, S606 is performed; if a photographing instruction of the user is received, S604 is performed.

If the requirement of taking the color picture in the current environment is not detected, and a photographing instruction is not received, the infrared camera can be continuously controlled to record the video, and the state that the color camera is electrified but does not go out of the frame is maintained.

S604: judging whether a switch for shooting color at night is on or not; if yes, execute S606; if not, S605 is performed.

S605: judging whether a color photo or a black-and-white photo is shot in the current environment; if a color photograph is taken, S606 is performed; if a black-and-white photograph is taken, S607 is performed. S606: and keeping the infrared camera to record the video, and controlling the color camera to take a picture.

S607: and keeping the infrared camera to record the video, and controlling the infrared camera to shoot.

On the basis of the foregoing embodiments, in the embodiments of the present application, before controlling the color camera to take a picture, the method further includes:

judging whether light supplementing is carried out in the current environment;

if yes, the flash lamp is turned on to supplement light for the color camera.

Before photographing, the operation recorder can also judge whether the current environment has a light supplementing requirement, if so, the operation recorder can perform flash photographing, namely, the flash is turned on to supplement light for the color camera, and the color camera is controlled to photograph. If the light supplementing requirement does not exist, the operation recorder can directly use the color camera to shoot the color photos.

In one implementation manner, when the operation recorder judges whether the current environment has the light supplementing requirement, the light sensor can be used for detecting the brightness of the current environment, if the brightness of the current environment is greater than the set second brightness threshold value, the current environment is determined to have no light supplementing requirement, and if the brightness of the current environment is not greater than the second brightness threshold value, the current environment is determined to have the light supplementing requirement. The first luminance threshold and the second luminance threshold may be the same or may be different, such as but not limited to, the first luminance threshold and the second luminance threshold being different and the first luminance threshold being less than the second luminance threshold.

One possible image acquisition process is shown with reference to fig. 7, comprising the steps of:

s701: and (3) starting a video recording function, and controlling the color camera and the infrared camera to be electrified but not to output frames.

S702: if the current environment is detected to be a night scene, controlling the infrared camera to start video recording, and keeping the state that the color camera is powered on but does not go out of the frame.

S703: judging whether a color picture is shot in the current environment or a shooting instruction of a user is received; if it is detected that a color photograph is taken in the current environment, S706 is performed; if a photographing instruction of the user is received, S704 is performed.

S704: judging whether a switch for shooting color at night is on or not; if so, S706 is performed; if not, S705 is performed.

S705: judging whether a color photo or a black-and-white photo is shot in the current environment; if a color photograph is taken, S706 is performed; if a black-and-white photograph is taken, S709 is performed.

S706: judging whether a flash lamp is turned on in the current environment; if so, S707 is performed; if not, S708 is performed.

S707: the flash is turned on, and S708 is performed.

S708: and keeping the infrared camera to record the video, and controlling the color camera to take a picture.

S709: and keeping the infrared camera to record the video, and controlling the infrared camera to shoot.

Based on the foregoing embodiments, in an embodiment of the present application, before S304, the method further includes:

and controlling the state that the color camera is electrified but does not output frames, and distributing current for the color camera.

If it is determined that a color photo is taken in the current environment or a switch for taking the color photo at night is turned on, the operation recorder can perform flow distribution operation for the color camera in a power-on but frame-out state, and preparation is made for taking the photo, so that the color camera can quickly respond to frame-out photo.

On the basis of the above embodiments, the following describes the above embodiments with a specific embodiment, and as shown in fig. 8, includes the following steps:

s801: the job recorder starts the video recording.

S802: and opening the color camera and the infrared camera.

In the step, the color camera and the infrared camera can be powered on at the same time and kept in a state that frames can be output at any time.

S803: whether the current environment is daytime or night time is judged, if daytime, S804 is executed, and if night time is executed, S808 is executed.

S804: if the frame is in daytime, the color camera outputs the frame, and the infrared camera does not output the frame.

Specifically, in this step, a preview request may be issued to the color camera, and the color camera starts to output a frame and record a video, and the infrared camera remains in a powered-on state but does not output a frame.

S805: the color camera records the video in real time.

S806: judging whether the current environment is photographed or not; if so, S807 is performed; if not, returning to S805, the color camera real-time recording may continue to be maintained.

S807: the color camera takes the color pictures and stores the pictures.

S808: if the color camera is at night, the infrared camera outputs frames, and the color camera does not output frames.

Specifically, in this step, a video recording request may be issued to the infrared camera, and the infrared camera starts to output a frame and record a video, and the color camera remains in a state of being powered on but not outputting a frame.

S809: the infrared camera records the video in real time, and S810' are executed.

In the night scene, the infrared camera keeps video in real time, and in the video recording process, a scene detection algorithm is adopted to judge whether to take a color picture or not and judge whether a user presses a photographing key or not. When any judgment result determines to shoot a color photo, the color camera can be controlled to shoot so as to ensure that the required color information in a night scene is recorded, thereby facilitating problem tracing and improving user experience.

S810': judging whether an automatic photographing function switch is on or not; if so, S811' is performed; if not, the S810' may be repeated.

S811': starting a scene detection algorithm, and judging whether to take a color picture or not; if yes, execution S814; if not, execution may return to S810'.

After video recording starts at night, the operation recorder judges whether an automatic photographing is started, if so, a real-time scene detection algorithm is started, and whether the current environment has the requirement of photographing color pictures or not is automatically identified. The automatic photographing function switch can be used and turned on at the discretion of a user.

S810: judging whether the user presses a photographing key or not; if yes, execution S811; if not, the S810 may be repeatedly performed.

Whether the user presses the photographing key is also one of the bases for judging whether to take a color picture.

S811: judging whether a function switch of shooting color at night is on or not, if not, executing S812; if so, S814 is performed.

If the night color photo is turned on, the color camera is always used for shooting the color photo at night. If the night color photo is not opened, whether the current environment has the requirement of shooting color or not can be automatically identified through a scene detection algorithm. The night-shot function switch may be used for, but is not limited to, the following scenarios: text scenes and/or signal light scenes, etc.

S812: judging whether the current scene takes a color picture or a black-and-white picture; if a black-and-white photograph is taken, S813 is performed; if a color photograph is taken, S814 is performed;

s813: and taking black and white pictures by the infrared camera and storing the black and white pictures.

S814: the color camera is configured but does not output frames, and preparation is made for photographing, and S815 is executed.

Before photographing, the color camera always keeps in a power-on state, and can quickly respond to frame photographing during photographing, so that the color camera has the advantage of quick photographing response. In addition, the video recording process always keeps the infrared camera video recording not to be practiced with the switching, so that a user does not feel, the user experience is not affected, and the complete video data can be acquired.

S815: judging whether a flash lamp is turned on or not; if yes, execution S816; if not, S817 is performed.

Before photographing is started, the operation recorder can also judge whether the current ambient brightness has a light supplementing requirement, and if the current ambient brightness has the light supplementing requirement, a flash lamp can be turned on to supplement light.

S816: the flash is turned on, and S817 is performed.

S817: the color camera takes a color photograph, and S818 is performed.

If it is determined in step S815 that the flash is turned on, photographing is performed using the color camera in the case where the flash is light-supplemented in this step. If it is determined in step S815 that the flash is not turned on, photographing is performed using the color camera without the flash for light filling in this step.

S818: judging whether photographing is triggered by a user; if so, execute S819; if not, S820 is performed.

S819: the color photograph is saved in the existing folder, and S821 is performed.

S820: and newly creating a folder, and storing the color photos in the newly created folder, and executing S821.

When the photographing is completed and stored, if the photographing is actively triggered by a user, the color photographs can be normally stored in the existing folder, and if the photographing is not actively triggered by the user, if the photographing is automatically judged to be triggered by the system through a scene detection algorithm, the color photographs can be independently stored in one folder, so that the user can conveniently check the color photographs.

Of course, in some implementations, the collected images may be named by information such as infrared cameras/color cameras, active triggering of photographing by a user, automatic judging of triggering photographing by a system, and the like. By way of example, differentiated naming may be achieved by adding suffixes, and the like. This naming scheme may inform the user of the source of the video/photograph currently being viewed, such as by letting the user know that the camera used for taking the color photograph is different from the camera used for video recording.

S821: the color camera is restored to a powered-on state without frame out.

After the step is performed, it may continue to return to S809.

In this application embodiment, carried infrared camera and color camera on the operation record appearance, in the scene of night and keep the condition of infrared camera uninterrupted duty, can realize taking the color photograph in the video recording. Specifically, the video always keeps the output image of the infrared camera under the night scene, the camera is not switched, the image of the color camera is shot when photographing, the recorded content is always clear, the user can record the required color information, and the user can not perceive the action of the color camera when photographing.

In order to realize problem tracing during construction, based on the technical conception same as that of the method embodiment, the application also provides an image acquisition device which is applied to a job recorder, wherein the job recorder comprises a color camera and an infrared camera. Fig. 9 is a schematic structural diagram of an image capturing device 900 provided in the present application, as shown in fig. 9, the image capturing device 900 includes:

thefirst control module 901 is used for starting a video recording function and controlling the color camera and the infrared camera to be electrified but not to output frames;

thesecond control module 902 is configured to control the infrared camera to start recording if the current environment is detected to be a night scene, and maintain a state that the color camera is powered on but does not output a frame;

A judgingmodule 903, configured to judge whether a color photograph is taken in the current environment;

and thethird control module 904 is configured to keep the infrared camera to record video and control the color camera to take a picture when thejudgment result 903 of the judgment module is yes.

In one possible implementation manner, the judgingmodule 903 is specifically configured to detect whether to take a color photograph in the current environment according to a pre-stored scene detection algorithm; and/or judging whether a command for taking a color picture sent by a user is received.

In a possible implementation manner, the judgingmodule 903 is further configured to judge whether a photographing instruction sent by the user is received, and determine that the night photographing color photograph switch is in an on state.

In one possible implementation manner, the judgingmodule 903 is further configured to judge whether to take a color photograph or a black-and-white photograph in the current environment if a photographing instruction is received and the night photographing color photograph switch is in a closed state;

thethird control module 904 is further configured to control the color camera to take a picture when the judgingmodule 903 determines that the color picture is taken in the current environment; when the judgingmodule 903 determines that a black-and-white photo is taken in the current environment, the infrared camera is controlled to take a photo.

In one possible implementation manner, the determiningmodule 903 is further configured to determine whether light filling is performed in the current environment;

thethird control module 904 is further configured to, when the determiningmodule 903 determines that light is supplemented in the current environment, turn on the flash to supplement light for the color camera.

In a possible implementation manner, thethird control module 904 is further configured to maintain a state that the color camera is powered on but does not go out of a frame, and perform current distribution for the color camera.

Fig. 10 is a schematic structural diagram of a job recorder according to an embodiment of the present application. The job recorder includes one or more (including two)processors 1001 and acommunication interface 1002.

Optionally, the job recorder also includes amemory 1003, whichmemory 1003 may include read-only memory and random access memory, and provides operating instructions and data to the processor. A portion of the memory may also include non-volatile random access memory (non-volatile random access memory, NVRAM).

In some implementations, as shown in FIG. 10,memory 1003 stores elements, execution modules or data structures, or a subset thereof, or an extended set thereof.

As shown in fig. 10, in the embodiment of the present application, by calling an operation instruction stored in the memory 1003 (which may be stored in the operating system), a corresponding operation is performed.

As shown in fig. 10, aprocessor 1001 controls processing operations of the headend device, and the processor may also be referred to as a central processing unit (central processing unit, CPU).

As shown in fig. 10, thememory 1003 may include a read-only memory and a random access memory, and provides instructions and data to the processor. The in-application communication interface 1002 and thememory 1003 are coupled together by abus system 1004. The method disclosed in the embodiments of the present application may be applied to a processor or implemented by a processor. Thecommunication interface 1002 is used for communication between the job recorder and other devices described above.

On the basis of the above embodiments, the embodiments of the present application provide a computer readable storage medium having stored therein a computer program executable by a processor, which when run on the processor, causes the processor to implement any one of the embodiments described above.

Since the principle of solving the problem with the above-mentioned computer readable medium is similar to that of the image acquisition method, the steps implemented after the processor executes the computer program in the above-mentioned computer readable medium can be referred to the above-mentioned other embodiments, and the repetition is omitted.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present application without departing from the spirit or scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims and the equivalents thereof, the present application is intended to cover such modifications and variations.

Claims (10)

Translated fromChinese

1.一种图像采集方法，其特征在于，应用于作业记录仪，所述作业记录仪包括彩色摄像头和红外摄像头，所述方法包括：1. an image acquisition method, is characterized in that, is applied to job recorder, and described job recorder comprises color camera and infrared camera, and described method comprises:启动录像功能，控制所述彩色摄像头和所述红外摄像头上电但不出帧；Start the video recording function, control the color camera and the infrared camera to be powered on but not produce frames;若检测到当前环境为夜间场景，控制所述红外摄像头开始录像，并保持所述彩色摄像头的上电但不出帧的状态；If it is detected that the current environment is a night scene, the infrared camera is controlled to start recording, and the color camera is kept powered on but not in a frame state;判断所述当前环境下是否拍摄彩色照片；Judging whether to take a color photo in the current environment;如果是，保持所述红外摄像头进行录像，以及控制所述彩色摄像头拍照。If so, keep the infrared camera to record video, and control the color camera to take pictures.2.如权利要求1所述的方法，其特征在于，所述判断所述当前环境下是否拍摄彩色照片，包括：2. The method according to claim 1, wherein the judging whether to take a color photo in the current environment comprises:根据预先保存的场景检测算法，检测所述当前环境下是否拍摄彩色照片；和/或According to a pre-saved scene detection algorithm, detect whether a color photo is taken in the current environment; and/or判断是否接收到用户发出的拍摄彩色照片指令。It is judged whether an instruction to take a color photo from the user is received.3.如权利要求2所述的方法，其特征在于，所述判断是否接收到用户发出的拍摄彩色照片指令，包括：3. The method according to claim 2, wherein said judging whether an instruction to take a color photo from a user is received comprises:判断是否接收到所述用户发出的拍照指令，且确定夜间拍彩照开关处于打开状态。It is judged whether the photographing instruction sent by the user is received, and it is determined that the switch for taking color photographs at night is on.4.如权利要求3所述的方法，其特征在于，所述方法还包括：4. The method of claim 3, further comprising:如果接收到所述拍照指令，且所述夜间拍彩照开关处于关闭状态，判断所述当前环境下拍摄彩色照片还是拍摄黑白照片；If the photographing instruction is received and the switch for taking color photographs at night is in the off state, it is judged whether to photograph color photographs or black-and-white photographs in the current environment;如果确定所述当前环境下拍摄彩色照片，控制所述彩色摄像头拍照；If it is determined to take a color photo in the current environment, control the color camera to take a photo;如果确定所述当前环境下拍摄黑白照片，控制所述红外摄像头拍照。If it is determined that black-and-white photos are taken in the current environment, the infrared camera is controlled to take photos.5.如权利要求1-4任一项所述的方法，其特征在于，在所述控制所述彩色摄像头拍照之前，还包括：5. The method according to any one of claims 1-4, characterized in that, before said controlling said color camera to take pictures, further comprising:判断所述当前环境下是否进行补光；Judging whether to perform supplementary light under the current environment;如果是，打开闪光灯为所述彩色摄像头进行补光。If so, turn on the flash to supplement light for the color camera.6.如权利要求5所述的方法，其特征在于，在所述保持所述红外摄像头进行录像，以及控制所述彩色摄像头拍照之前，还包括：6. The method according to claim 5, further comprising: before maintaining the infrared camera for video recording and controlling the color camera to take pictures:保持所述彩色摄像头的上电但不出帧的状态，为所述彩色摄像头进行配流。Keep the color camera in a state of being powered on but not outputting frames, and perform distribution for the color camera.7.一种图像采集装置，其特征在于，应用于作业记录仪，所述作业记录仪包括彩色摄像头和红外摄像头，所述装置包括：7. An image acquisition device, characterized in that it is applied to a job recorder, and the job recorder includes a color camera and an infrared camera, and the device includes:第一控制模块，用于启动录像功能，控制所述彩色摄像头和所述红外摄像头上电但不出帧；The first control module is used to start the video recording function, and control the color camera and the infrared camera to be powered on but not to output frames;第二控制模块，用于若检测到当前环境为夜间场景，控制所述红外摄像头开始录像，并保持所述彩色摄像头的上电但不出帧的状态；The second control module is used to control the infrared camera to start video recording if it is detected that the current environment is a night scene, and keep the color camera in a state of being powered on but not producing frames;判断模块，用于判断所述当前环境下是否拍摄彩色照片；A judging module, configured to judge whether to take a color photo in the current environment;第三控制模块，用于在所述判断模块的判断结果为是时，保持所述红外摄像头进行录像，以及控制所述彩色摄像头拍照。The third control module is configured to keep the infrared camera for video recording and control the color camera to take pictures when the judging result of the judging module is yes.8.如权利要求7所述的装置，其特征在于，所述判断模块，具体用于根据预先保存的场景检测算法，检测所述当前环境下是否拍摄彩色照片；和/或判断是否接收到用户发出的拍摄彩色照片指令。8. The device according to claim 7, wherein the judging module is specifically configured to detect whether a color photo is taken in the current environment according to a pre-saved scene detection algorithm; and/or judge whether to receive a user A command to take a color photo was issued.9.一种作业记录仪，其特征在于，所述作业记录仪包括处理器和通信接口，所述通信接口与所述处理器耦合，所述处理器用于运行计算机程序或指令，以实现权利要求1-6中任一所述图像采集方法的步骤。9. A job recorder, characterized in that the job recorder includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run a computer program or an instruction to realize the claim The steps of any one of the image acquisition methods in 1-6.10.一种计算机可读存储介质，其特征在于，其存储有计算机程序，所述计算机程序被处理器执行时实现根据权利要求1-6中任一所述图像采集方法的步骤。10. A computer-readable storage medium, characterized in that it stores a computer program, and when the computer program is executed by a processor, the steps of the image acquisition method according to any one of claims 1-6 are realized.

Images