Movatterモバイル変換


[0]ホーム

URL:


CN115174537A - Double-screen interaction method and system for vehicle-machine interaction - Google Patents

Double-screen interaction method and system for vehicle-machine interaction
Download PDF

Info

Publication number
CN115174537A
CN115174537ACN202210769574.XACN202210769574ACN115174537ACN 115174537 ACN115174537 ACN 115174537ACN 202210769574 ACN202210769574 ACN 202210769574ACN 115174537 ACN115174537 ACN 115174537A
Authority
CN
China
Prior art keywords
data
vehicle
communication link
video
screen
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210769574.XA
Other languages
Chinese (zh)
Other versions
CN115174537B (en
Inventor
胡海林
刘大全
张英鹏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chongqing Changan Automobile Co Ltd
Original Assignee
Chongqing Changan Automobile Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chongqing Changan Automobile Co LtdfiledCriticalChongqing Changan Automobile Co Ltd
Priority to CN202210769574.XApriorityCriticalpatent/CN115174537B/en
Publication of CN115174537ApublicationCriticalpatent/CN115174537A/en
Application grantedgrantedCritical
Publication of CN115174537BpublicationCriticalpatent/CN115174537B/en
Activelegal-statusCriticalCurrent
Anticipated expirationlegal-statusCritical

Links

Images

Classifications

Landscapes

Abstract

The application provides a vehicle-machine interactive double-screen interaction method and system, which comprise the following steps: establishing a communication link between a vehicle end and an instrument end; matching a data transmission channel according to a data type of a first screen access data source at the vehicle end, and communicating the communication link through the corresponding data transmission channel to establish connection with the instrument end, wherein the data type comprises video stream; if the data source is video data, splitting video frames in the video data into data packets with preset sizes for compression coding to obtain data code streams; and outputting the data code stream to the instrument end through the communication link for decoding the data code stream and displaying the decoded data code stream in a second screen of the instrument end. The application can greatly improve the interactive applicability of the double screens, and meet the requirements of different configuration vehicle types.

Description

Double-screen interaction method and system for vehicle-machine interaction
Technical Field
The application relates to the field of intelligent cabins, in particular to a vehicle-machine interactive double-screen interaction method and system.
Background
With the development of intelligent automobiles, the intelligent cabin display is in a 3D mode, and the multi-screen trend changes. At present, most cabin vehicle machines are combined by a digital instrument and a central control screen, wherein the central control screen comprises functions of navigation, multimedia, vehicle-mounted control and the like, and the instrument displays vehicle information and the like. The instrument screen directly faces the driver, and the central control screen does not directly face the driver, so that the navigation picture is projected onto the instrument, and the driving becomes safer. At present, most of double-screen interactive systems use two lines for data transmission, one line is a USB line for transmitting control instructions and files, and the other line is an LVDS line specially used for transmitting videos and audios.
Disclosure of Invention
In view of the problems in the prior art, the application provides a vehicle-machine interactive double-screen interaction method and system, and mainly solves the problems that the existing double-screen interaction is limited by a transmission mode, and the cost is high and the vehicle type is difficult to be compatible downwards and is low in vehicle allocation.
In order to achieve the above and other objects, the present application adopts the following technical solutions.
The application provides a vehicle-machine interactive double-screen interaction method, which comprises the following steps:
establishing a communication link between a vehicle end and an instrument end;
matching a data transmission channel according to a data type of a first screen access data source at the vehicle end, and communicating the communication link through the corresponding data transmission channel to establish connection with the instrument end, wherein the data type comprises video stream;
if the data source is video data, splitting video frames in the video data into data packets with preset sizes for compression coding to obtain data code streams;
and outputting the data code stream to the instrument end through the communication link for decoding the data code stream and displaying the decoded data code stream in a second screen of the instrument end.
In an embodiment of the present application, establishing a communication link between a control end and a meter end of a vehicle includes:
and establishing the local area network communication connection between the control end and the instrument end through a preset interface protocol, and taking a connection path formed by a corresponding interface as the communication link.
In an embodiment of the present application, matching a data transmission channel according to a data type of a first screen access data source at the vehicle end, and communicating the communication link through the corresponding data transmission channel to establish a connection with the instrument end includes:
calling a corresponding relation between a preset data type and a transmission port number according to the data type of the data source, and determining the transmission port number matched with the data source;
and calling a corresponding transmission channel according to the transmission port number to be in butt joint with the communication link, and establishing the connection between the vehicle end and the instrument end.
In an embodiment of the present application, the data type further includes a control instruction and a file;
before calling the corresponding relation between the preset data type and the transmission port number according to the data type of the data source, the method comprises the following steps:
allocating transmission port numbers for control commands, files and video streams in advance, and establishing a corresponding relation between a data type and the transmission port numbers, wherein the control commands and the files share one transmission port number.
In an embodiment of the application, if the data type of the data source is a control instruction or a file, a communication connection between the vehicle end and the instrument end is established through a socket to transmit data of the data source.
In an embodiment of the present application, splitting a video frame in the video data into data packets with a preset size for compression coding, to obtain a data code stream, includes:
and encoding the data packet into an H264 original code stream as the data code stream.
The application also provides a mutual double screen interactive system of car machine, includes:
the link construction module is used for establishing a communication link between a vehicle end and an instrument end;
the connection establishing module is used for matching a data transmission channel according to the data type of a first screen access data source at the vehicle end, and communicating the communication link through the corresponding data transmission channel to establish connection with the instrument end, wherein the data type comprises video stream;
the video coding module is used for splitting video frames in the video data into data packets with preset sizes for compression coding to obtain data code streams if the data source is video data;
and the decoding display module is used for outputting the data code stream to the instrument end through the communication link so as to decode the data code stream and display the decoded data code stream in a second screen of the instrument end.
In an embodiment of the present application, the vehicle end and the meter end establish a communication link through a USB interface.
As described above, the vehicle-machine interactive double-screen interaction method and system have the following beneficial effects.
The method comprises the steps that a communication link between a vehicle machine end and an instrument end is established; matching a data transmission channel according to a data type of a first screen access data source at the vehicle end, and communicating the communication link through the corresponding data transmission channel to establish connection with the instrument end, wherein the data type comprises video stream; if the data source is video data, splitting video frames in the video data into data packets with preset sizes for compression coding to obtain data code streams; outputting the data code stream to the instrument end through the communication link, decoding the data code stream, and displaying the decoded data code stream at a specified position in a second screen of the instrument end; the data source can be realized by the unified communication link at the vehicle end and the instrument end, the communication link is only needed to be butted through the transmission channel matched with the data type, the data source transmission of different data types can be completed, a data transmission line is not needed to be provided for the video source, and the cost can be effectively reduced.
Drawings
Fig. 1 is a schematic flow chart of a vehicle-mounted device interaction double-screen interaction method in an embodiment of the present application.
Fig. 2 is a block diagram of a video streaming architecture according to an embodiment of the present application.
Fig. 3 is a block diagram of a dual-screen interactive system for vehicle-mounted device interaction in an embodiment of the present application.
Detailed Description
The following embodiments of the present application are described by specific examples, and other advantages and effects of the present application will be readily apparent to those skilled in the art from the disclosure of the present application. The present application is capable of other and different embodiments and its several details are capable of modifications and/or changes in various respects, all without departing from the spirit of the present application. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict.
It should be noted that the drawings provided in the following embodiments are only for illustrating the basic idea of the present application, and the drawings only show the components related to the present application and are not drawn according to the number, shape and size of the components in actual implementation, and the type, number and proportion of the components in actual implementation may be changed freely, and the layout of the components may be more complicated.
Referring to fig. 1, the present application provides a vehicle-mounted device interactive dual-screen interaction method, which includes the following steps:
and S01, establishing a communication link between the vehicle end and the instrument end.
In one embodiment, establishing a communication link between a control end and a meter end of a vehicle comprises:
and establishing the local area network communication connection between the control end and the instrument end through a preset interface protocol, and taking a connection path formed by a corresponding interface as the communication link.
In one embodiment, in order to enable the vehicle end and the instrument end to complete data transmission interaction through a common communication link, the vehicle end and the instrument end can be connected through a USB interface to form a communication link based on a preset USB protocol, data transmission is performed on two ends of the communication link based on Socket, the vehicle end and the instrument end are respectively used as Socket ends, communication based on a Socket local area network is further established, data transmission is performed on the basis of the local area network, and data transmission rate is guaranteed. The communication protocol corresponding to the communication link may be configured according to the actual application requirement, which is not limited herein.
And S02, matching a data transmission channel according to the data type of a first screen access data source at the vehicle end, and communicating the communication link through the corresponding data transmission channel to establish connection with the instrument end, wherein the data type comprises video stream.
In one embodiment, the application relates to two systems, one is that a central control Android system corresponds to a vehicle end, and the other is that an instrument QNX system corresponds to an instrument end. The car machine part comprises 3 lines of control instructions, files and videos, the files and the control instructions are in the same framework, and the videos are transmitted to be independent frameworks. The file transmission mainly relates to the transmission of upgrade files and log files, the control instructions comprise dialing a call, playing songs and the like, and the video mainly displays the car navigation to an instrument end. The first screen at the vehicle end can receive data sources of different data types, such as receiving a touch screen control instruction to control multimedia playing music, answering a call, navigation control, screen capturing data and the like. Data sources at the vehicle end can be divided into three data types including control commands, files and video streams. Different transmission modes are adopted based on different data types.
In an embodiment, matching a data transmission channel according to a data type of a first screen access data source at the vehicle end, and communicating the communication link through the corresponding data transmission channel to establish a connection with the instrument end includes:
calling a corresponding relation between a preset data type and a transmission port number according to the data type of the data source, and determining the transmission port number matched with the data source;
and calling a corresponding transmission channel according to the transmission port number to be in butt joint with the communication link, and establishing the connection between the vehicle end and the instrument end.
In an embodiment, before invoking a corresponding relationship between a preset data type and a transmission port number according to a data type of the data source, the method includes:
allocating transmission port numbers for control commands, files and video streams in advance, and establishing a corresponding relation between a data type and the transmission port numbers, wherein the control commands and the files share one transmission port number.
In an embodiment, if the data type of the data source is a control instruction or a file, a communication connection between the vehicle end and the instrument end is established through a socket to transmit data of the data source.
In an embodiment, corresponding transmission port numbers can be configured for data types of different data sources which may be accessed by a vehicle end, a corresponding relationship between the transmission port numbers and the data types is established, and the corresponding relationship is stored in the vehicle end. When the first screen at the vehicle end is accessed to the data source, the data type of the accessed data source is judged firstly, and the corresponding relation is called according to the data type to obtain the transmission port number corresponding to the data type. The transmission port number is mainly used for representing a transmission channel, and the transmission channel required by the current data source can be determined based on the transmission port number. And butting the transmission channel with the communication link to establish a local area communication network for communicating the vehicle end with the instrument end.
In one embodiment, the control command and the file may share a transport port number, and the data type corresponding to the video stream may be assigned a transport port number different from the control command.
Step S03, if the data source is video data, splitting video frames in the video data into data packets with preset sizes for compression coding to obtain data code streams.
Referring to fig. 2, the vehicle end may include a video stream capturing and encoding module and a transmission module, and the meter end includes a transmission end and a decoding and displaying module. The vehicle-end video capturing and coding module and the transmission module establish local area network communication and can quickly transmit data, the Android transmission end and the instrument transmission end establish local area network communication through USB connection, and Socket connection is established by adopting port numbers different from file and control command channels so as to transmit data.
The central control system realizes real-time acquisition of navigation video stream data through an Android surface composer client technology, but the acquired data is too large, complete frame data cannot be directly transmitted, and subdivision is needed for convenient transmission, so that after the data is intercepted, the video data is compressed through MediaCodec coding, and the video data is coded into an H264 original code stream through the mode, and the code stream consists of NALUs one by one and is convenient to transmit. The video stream transmission adopts Socket local area network communication based on USB, so that the corresponding video transmission protocol can be configured for the convenience of analysis, the improvement of transmission stability and the prevention of frame loss. The specific video transmission protocol may be adapted according to application requirements, and is not limited herein.
And S04, outputting the data code stream to the instrument end through the communication link for decoding the data code stream and displaying the decoded data code stream in a second screen of the instrument end.
In an embodiment, after receiving the data, the meter-side transport layer decodes the data into video data that can be played by using a decoder according to a previously set transmission protocol, and then displays the video data at a corresponding position of the second screen.
According to the method and the device, LVDS lines in the existing double-screen interaction are removed, and the full function of the double-screen interaction is realized through a shared USB line. Corresponding to the original scheme, the Socket is adopted to realize control instruction, file and video stream transmission, and only different ports are adopted for each type to carry out communication.
In an embodiment, as shown in fig. 3, the present application provides a car-machine interactive dual-screen interactive system, including:
thelink construction module 10 is used for establishing a communication link between a vehicle end and an instrument end;
theconnection establishing module 11 is configured to match a data transmission channel according to a data type of a first screen access data source at the vehicle end, and communicate the communication link through the corresponding data transmission channel to establish connection with the instrument end, where the data type includes a video stream;
thevideo encoding module 12 is configured to, if the data source is video data, split a video frame in the video data into data packets with a preset size for compression encoding, so as to obtain a data code stream;
and thedecoding display module 13 is configured to output the data code stream to the instrument end through the communication link, decode the data code stream, and display the decoded data code stream on a second screen of the instrument end.
In one embodiment, the vehicle end and the instrument end establish a communication link through a USB interface.
In one embodiment, thelink construction module 10 includes a communication link between a control end and a meter end of the vehicle, including: and establishing the local area network communication connection between the control end and the instrument end through a preset interface protocol, and taking a connection path formed by a corresponding interface as the communication link.
In one embodiment, theconnection establishing module 11 includes: matching a data transmission channel according to the data type of a first screen access data source at the vehicle end, and communicating the communication link through the corresponding data transmission channel to establish connection with the instrument end, wherein the data transmission channel comprises the following steps: calling a corresponding relation between a preset data type and a transmission port number according to the data type of the data source, and determining the transmission port number matched with the data source; and calling a corresponding transmission channel according to the transmission port number to be in butt joint with the communication link, and establishing the connection between the vehicle end and the instrument end.
In an embodiment, the system further comprises: the port association module, before invoking a corresponding relationship between a preset data type and a transmission port number according to the data type of the data source, includes: allocating transmission port numbers for control commands, files and video streams in advance, and establishing a corresponding relation between a data type and the transmission port numbers, wherein the control commands and the files share one transmission port number.
In one embodiment, the port association module further comprises: and if the data type of the data source is a control instruction or a file, establishing communication connection between the vehicle end and the instrument end through a socket to transmit data of the data source.
In one embodiment,video encoding module 12 includes: splitting a video frame in the video data into data packets with preset sizes for compression coding to obtain a data code stream, wherein the data code stream comprises: and encoding the data packet into an H264 original code stream as the data code stream.
The above embodiments are merely illustrative of the principles and utilities of the present application and are not intended to limit the application. Any person skilled in the art can modify or change the above-described embodiments without departing from the spirit and scope of the present application. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical concepts disclosed in the present application shall be covered by the claims of the present application.

Claims (8)

CN202210769574.XA2022-06-302022-06-30Double-screen interaction method and system for vehicle-computer interactionActiveCN115174537B (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN202210769574.XACN115174537B (en)2022-06-302022-06-30Double-screen interaction method and system for vehicle-computer interaction

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN202210769574.XACN115174537B (en)2022-06-302022-06-30Double-screen interaction method and system for vehicle-computer interaction

Publications (2)

Publication NumberPublication Date
CN115174537Atrue CN115174537A (en)2022-10-11
CN115174537B CN115174537B (en)2023-07-21

Family

ID=83489747

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN202210769574.XAActiveCN115174537B (en)2022-06-302022-06-30Double-screen interaction method and system for vehicle-computer interaction

Country Status (1)

CountryLink
CN (1)CN115174537B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN116561079A (en)*2023-05-152023-08-08安徽江淮汽车集团股份有限公司Multifunctional interaction method and system for intelligent cabin of automobile

Citations (8)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN103440170A (en)*2013-08-292013-12-11惠州华阳通用电子有限公司Method for preferentially calling application program of smart mobile terminal in double-computer interactive mode
CN105141710A (en)*2010-11-152015-12-09华为终端有限公司Data transmission method, relevant device and data transmission system
US20170251181A1 (en)*2016-02-292017-08-31Microsoft Technology Licensing, LlcImmersive Interactive Telepresence
CN107168666A (en)*2017-04-212017-09-15陈景雄The system and method for USB interface-based audio video transmission and multi-screen mapping
US10497180B1 (en)*2018-07-032019-12-03Ooo “Ai-Eksp”System and method for display of augmented reality
CN211654269U (en)*2020-02-242020-10-09广州视源电子科技股份有限公司Display control circuit of double-screen LED all-in-one machine and double-screen LED all-in-one machine
CN113316027A (en)*2021-05-262021-08-27东风电子科技股份有限公司Double-screen interaction system based on video stream in vehicle-machine interaction
WO2021223453A1 (en)*2020-05-062021-11-11上海幻电信息科技有限公司Multi-screen interactive display method and apparatus

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN105141710A (en)*2010-11-152015-12-09华为终端有限公司Data transmission method, relevant device and data transmission system
CN103440170A (en)*2013-08-292013-12-11惠州华阳通用电子有限公司Method for preferentially calling application program of smart mobile terminal in double-computer interactive mode
US20170251181A1 (en)*2016-02-292017-08-31Microsoft Technology Licensing, LlcImmersive Interactive Telepresence
CN107168666A (en)*2017-04-212017-09-15陈景雄The system and method for USB interface-based audio video transmission and multi-screen mapping
US10497180B1 (en)*2018-07-032019-12-03Ooo “Ai-Eksp”System and method for display of augmented reality
CN211654269U (en)*2020-02-242020-10-09广州视源电子科技股份有限公司Display control circuit of double-screen LED all-in-one machine and double-screen LED all-in-one machine
WO2021223453A1 (en)*2020-05-062021-11-11上海幻电信息科技有限公司Multi-screen interactive display method and apparatus
CN113316027A (en)*2021-05-262021-08-27东风电子科技股份有限公司Double-screen interaction system based on video stream in vehicle-machine interaction

Cited By (1)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN116561079A (en)*2023-05-152023-08-08安徽江淮汽车集团股份有限公司Multifunctional interaction method and system for intelligent cabin of automobile

Also Published As

Publication numberPublication date
CN115174537B (en)2023-07-21

Similar Documents

PublicationPublication DateTitle
CN110874959B (en)Multi-terminal same-screen teaching system and teaching method
CN111683276B (en)Vehicle-mounted real-time multi-screen projection method based on android system
WO2019169682A1 (en)Audio-video synthesis method and system
CN102333201B (en)Telepresence caption transmission method, terminal and system
CN104994440A (en)Methods, systems and apparatus for displaying the multimedia information from wireless communication networks
WO2021168649A1 (en)Multifunctional receiving device and conference system
CN101883097A (en)Method and device for realizing that server equipment shares screen of client equipment
CN111541761A (en)Method for interconnecting and controlling smart phone and smart car machine
CN105472368A (en)Stereo video live system for clustered terminals
CN104601863A (en)IP matrix system for recording and playing
CN115174537B (en)Double-screen interaction method and system for vehicle-computer interaction
CN113596571B (en)Screen sharing method, device, system, storage medium and computer equipment
CN112583803A (en)Data processing method, device, communication node and storage medium
CN112118558A (en)Vehicle screen display method, vehicle and computer readable storage medium
CN103399722A (en)Large-screen display method and system
CN114979777B (en) Ultra-high-definition video signal processing device, method and ultra-high-definition video management system
CN115202784A (en) A kind of intelligent cockpit multi-screen interaction method and interaction system
CN111787394A (en)Method for mapping audio data of mobile phone to car machine through embedded equipment
CN117119157B (en)Multi-picture splicing retransmission method and system for optical fiber video seat
CN119342396A (en) Distributed audio processing method, device, system, electronic device and storage medium
CN114157903B (en)Redirection method, device, apparatus, storage medium and program product
CN117656829A (en)Method and system for realizing intelligent instrument by combining Android and linux through USB and screen throwing
CN111970474B (en)Intelligent screen mixing method and system for multi-channel videos
CN111385590A (en)Live broadcast data processing method and device and terminal
WO2023202152A1 (en)Audio redirection method and apparatus, and device and storage medium

Legal Events

DateCodeTitleDescription
PB01Publication
PB01Publication
SE01Entry into force of request for substantive examination
SE01Entry into force of request for substantive examination
GR01Patent grant
GR01Patent grant

[8]ページ先頭

©2009-2025 Movatter.jp