Seat adjusting system and method combining gesture recognition and voiceTechnical Field
The invention relates to the field of automobile supplies, in particular to a seat adjusting system combining gesture recognition and voice.
Background
Most of the existing automobile seats are adjustable, movable areas are arranged, and passengers can adjust the seats according to own requirements. The existing adjusting device is mostly manual, the seat fixing switch is pulled open, and the seat is pushed forward or backward, so that the adjustment of the seat position is achieved. This method of seat adjustment is particularly inconvenient, especially for elderly people and children, where it is difficult to adjust to a proper position.
Therefore, it is necessary to design a seat adjusting device that is convenient to use.
Disclosure of Invention
Aiming at the technical defects, the invention provides an automatic seat adjusting system combining gesture recognition and voice, which can conveniently and effectively adjust the position of a seat.
In order to achieve the above purpose, the technical scheme of the invention is as follows:
a seat adjusting system combining gesture recognition and voice comprises an automobile seat, and is characterized in that: the automobile seat comprises an automobile seat body, wherein an automobile seat body is arranged on a seat body, an automobile seat is arranged on the automobile seat body, a starting switch and a pressure sensor are arranged on an armrest of the automobile seat, and a voice prompt device is also arranged on a headrest of the automobile seat;
The automobile seat is provided with a camera shooting assembly, the camera shooting assembly comprises a camera and a background area, and the camera is arranged opposite to the background area.
By adopting the scheme, the voice prompt device plays a key role in the system, when a certain link in the adjusting system is in a problem, the effect of adjusting the seat cannot be achieved, a passenger needs to make corresponding gestures again, the passenger also needs to wait for a long time to find that the seat is not adjusted and react, and the voice prompt device can timely inform the passenger to make the gestures again and enter gesture recognition.
The starting switch is connected with the starting end of the central processing unit, the driving end of the central processing unit is connected with the pressure sensor in a bidirectional mode, the image acquisition end of the central processing unit is connected with the camera shooting assembly in a bidirectional mode, the recognition end of the central processing unit is connected with the gesture recognition mechanism in a bidirectional mode, the output end of the central processing unit is connected with the adjusting motor, and the voice output end of the central processing unit is connected with the voice prompt device.
The gesture recognition mechanism comprises a recognition chip, the input end of the recognition chip is connected with a central processing unit, the output end of the recognition chip is connected with a microprocessor, the storage end of the microprocessor is connected with a gesture memory in a bidirectional manner, and the output end of the microprocessor is connected with the central processing unit.
And a gesture library is arranged in the gesture memory, and a two-dimensional gesture graph and gesture language relation table is stored in the gesture library.
The table of the two-dimensional gesture-gesture language relationship is as follows:
a finger front hook: the backrest is adjusted in a forward tilting way;
one finger back hook: the backrest is adjusted in a backward tilting way;
two finger front hooks: the height of the cushion is adjusted to be higher;
Two finger rear hooks: the height of the cushion is adjusted down;
three finger front hooks: the headrest is adjusted and adjusted in a forward tilting way;
three finger rear hooks: the headrest is adjusted in a backward tilting way.
The adjusting motor is divided into a backrest adjusting motor, a cushion adjusting motor and a headrest adjusting motor.
The voice prompt device is provided with two voice output devices which are respectively arranged on two sides of the headrest of the automobile seat.
By adopting the scheme, the voice prompt devices are arranged on two sides of the headrest of the seat, and are just close to ears of passengers, so that the passengers can pay attention to voice prompts.
The outer surface of the background area is solid.
According to the scheme, the background plate is of the solid color, so that the misjudgment rate of gestures can be reduced, and the recognition rate is improved.
The adjusting method of the seat adjusting system combining gesture recognition and voice is characterized by comprising the following steps of:
step 1: the CPU detects whether a starting signal is generated;
Step 2: when a starting signal is detected, the central processing unit starts the pressure sensor to work and starts the voice prompt device at the same time, otherwise, the step 1 is returned;
Step3: voice prompts the passenger to place his hands on the handrail;
Step 4: the central processing unit detects whether a pressure signal exists or not;
step 5: when the pressure signal is detected, the central processing unit controls the starting of the camera to work, otherwise, the step 3 is returned;
step 6: the central processing unit controls the voice prompt device to prompt passengers to make corresponding seat adjustment gestures;
Step 7: the central processing unit detects whether an image is transmitted in;
step 8: when the image input is detected, the central processing unit transmits the image to the gesture recognition mechanism, otherwise, the step 7 is returned;
step 9: the central processing unit detects whether a gesture recognition result is transmitted back to the recognition port;
step 10: when detecting that the gesture recognition result is transmitted back, the central processing unit drives the corresponding motor to work according to the recognition result;
Otherwise, the central processing unit controls the voice prompt device to prompt passengers that the gesture is wrong and cannot be recognized, and the step 6 is returned;
step 11: the central processing unit judges whether the starting signal is interrupted or not;
Step 12: and when the starting signal is interrupted, the central processing unit turns off the pressure sensor and the camera, otherwise, the step 7 is returned.
The gesture recognition mechanism in the step 6 has the following recognition process:
step 6.1: the recognition chip separates gestures in the received images to prepare two-dimensional gesture images, and the two-dimensional gesture images are transmitted to the microprocessor;
step 6.2: the central processing unit transmits the two-dimensional gesture image to the microprocessor, and the microprocessor recalls the gesture language of the two-dimensional gesture from the gesture memory;
step 6.3: the microprocessor transmits the gesture back to the central processor.
The invention is suitable for passengers of all ages, is convenient for the passengers to adjust the seats, improves the accuracy of gesture recognition, and can timely inform the passengers when generating error signals.
Drawings
FIG. 1 is a hardware block diagram of the present invention;
FIG. 2 is a block diagram of a gesture recognition mechanism;
FIG. 3 is a schematic diagram of example 1 of the present invention;
fig. 4 is an assembly view of the armrest of embodiment 1;
FIG. 5 is a schematic diagram of embodiment 2 of the present invention;
fig. 6 is a seat assembly view of embodiment 2;
FIG. 7 is an assembly view of a voice prompt apparatus;
FIG. 8 is a workflow diagram of the present invention;
FIG. 9 is a workflow diagram of a gesture recognition mechanism.
Detailed Description
The invention is further described below with reference to the accompanying drawings and examples:
As shown in fig. 3 and 5, a seat adjusting system combining gesture recognition and voice includes a car seat, and the key point is that: the armrest of the automobile seat is provided with a starting switch 1 and a pressure sensor 2, and the headrest of the automobile seat is also provided with a voice prompt device 7; the automobile seat is provided with a camera shooting assembly 3, the camera shooting assembly 3 comprises a camera 31 and a background area 32, and a lens of the camera 31 is arranged opposite to the background area 32.
Preferably, the outer surface of the background area 32 is solid.
Example 1:
As shown in fig. 2 and 3, the background area 32 is attached to a curved surface of a corner at the front end of the armrest, the camera 31 is mounted on a vehicle top opposite to the background area 32, the background area 32 is made of an elastic material, and the pressure sensor 2 is mounted on the upper surface of the seat armrest; the light path between the camera 31 and the background area 32 is perpendicular to the armrest.
Example 2:
As shown in fig. 4 and 5, cameras 31 are mounted on both sides of the backrest of the car seat, the back plate 32 is mounted on the rear surface of the backrest of the front seat, and the pressure sensors 2 are respectively mounted on the upper surfaces of armrests on the left and right sides of the seat; the optical path between the camera 31 and the background area 32 is on the seat armrest.
As shown in fig. 1, the start switch 1 is connected to a start end of the central processing unit 6, a drive end of the central processing unit 6 is bidirectionally connected to the pressure sensor 2, an image acquisition end of the central processing unit 6 is bidirectionally connected to the camera assembly 3, a recognition end of the central processing unit 6 is bidirectionally connected to the gesture recognition mechanism 4, an output end of the central processing unit 6 is connected to the adjusting motor 5, and a voice output end of the central processing unit 6 is connected to the voice prompt device 7.
Preferably, the adjusting motor 5 is divided into a backrest adjusting motor 51, a seat cushion adjusting motor 52 and a headrest adjusting motor 52.
As shown in fig. 2, the gesture recognition mechanism 4 includes a recognition chip 41, an input end of the recognition chip 41 is connected with the central processing unit 6, an output end of the recognition chip 41 is connected with a microprocessor 42, a storage end of the microprocessor 42 is bidirectionally connected with a gesture memory 43, and an output end of the microprocessor 42 is connected with the central processing unit 6.
Preferably, a gesture library is provided in the gesture memory 43, and a two-dimensional gesture-gesture language relationship table is stored in the gesture library.
Preferably, the table of two-dimensional gesture-gesture language relationship is as follows:
a finger front hook: the backrest is adjusted in a forward tilting way;
one finger back hook: the backrest is adjusted in a backward tilting way;
two finger front hooks: the height of the cushion is adjusted to be higher;
Two finger rear hooks: the height of the cushion is adjusted down;
three finger front hooks: the headrest is adjusted and adjusted in a forward tilting way;
three finger rear hooks: the headrest is adjusted in a backward tilting way.
Preferably, as shown in fig. 7, the voice prompt apparatus 5 is provided with two voice outputters, which are respectively installed at both sides of the headrest of the car seat.
As shown in fig. 8, a method for adjusting a seat adjusting system by combining gesture recognition and voice is characterized by comprising the following steps:
step1: the CPU 6 detects whether a starting signal is generated;
Step 2: when a starting signal is detected, the central processing unit 6 starts the pressure sensor 2 to work and simultaneously starts the voice prompt device 7, otherwise, the step 1 is returned;
Step3: voice prompts the passenger to place his hands on the handrail;
step 4: the central processing unit 6 detects whether a pressure signal exists;
step 5: when the pressure signal is detected, the central processing unit 6 controls the starting camera 31 to work, otherwise, the step 3 is returned;
step 6: the central processing unit 6 controls the voice prompt device 7 to prompt passengers to make corresponding seat adjustment gestures;
step 7: the CPU 6 detects whether an image is transmitted in;
Step 8: when detecting the image input, the central processing unit 6 transmits the image to the gesture recognition mechanism 4, otherwise, the step 7 is returned;
step 9: the central processing unit 6 detects whether a gesture recognition result is transmitted back to the recognition port;
Step 10: when detecting that the gesture recognition result is transmitted back, the central processing unit 6 drives the corresponding motor to work according to the recognition result;
otherwise, the central processing unit 6 controls the voice prompt device 7 to prompt passengers that the gesture is wrong and cannot be recognized, and the step 6 is returned;
Step 11: the CPU 6 judges whether the starting signal is interrupted;
step 12: when the start signal is interrupted, the central processing unit 6 turns off the pressure sensor 2 and the camera 31, otherwise, the step 7 is returned.
As shown in fig. 9, the recognition process of the gesture recognition mechanism 4 in the step 6 is as follows:
Step 6.1: the recognition chip 41 separates gestures in the received images to prepare two-dimensional gesture images, and transmits the two-dimensional gesture images to the microprocessor 42;
step 6.2: the central processing unit 6 transmits the two-dimensional gesture image to the microprocessor 42, and the microprocessor 42 recalls the gesture language of the two-dimensional gesture from the gesture memory 43;
Step 6.3: the microprocessor 42 transmits the gesture back to the central processor 6.