Movatterモバイル変換


[0]ホーム

URL:


CN110430441B - Cloud mobile phone video acquisition method, system, device and storage medium - Google Patents

Cloud mobile phone video acquisition method, system, device and storage medium
Download PDF

Info

Publication number
CN110430441B
CN110430441BCN201910702587.3ACN201910702587ACN110430441BCN 110430441 BCN110430441 BCN 110430441BCN 201910702587 ACN201910702587 ACN 201910702587ACN 110430441 BCN110430441 BCN 110430441B
Authority
CN
China
Prior art keywords
mobile phone
video stream
stream data
cloud mobile
cloud
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910702587.3A
Other languages
Chinese (zh)
Other versions
CN110430441A (en
Inventor
方煜逵
黄小勇
雷磊
黄坚
马日胜
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hunan Micro Computing Internet Information Technology Co ltd
Original Assignee
Hunan Micro Computing Internet Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hunan Micro Computing Internet Information Technology Co ltdfiledCriticalHunan Micro Computing Internet Information Technology Co ltd
Priority to CN201910702587.3ApriorityCriticalpatent/CN110430441B/en
Publication of CN110430441ApublicationCriticalpatent/CN110430441A/en
Application grantedgrantedCritical
Publication of CN110430441BpublicationCriticalpatent/CN110430441B/en
Activelegal-statusCriticalCurrent
Anticipated expirationlegal-statusCritical

Links

Images

Classifications

Landscapes

Abstract

The invention discloses a cloud mobile phone video acquisition method, a system, a device and a storage medium, wherein the method comprises the following steps: carrying out video acquisition through a camera of a local mobile phone to obtain video stream data; coding the video stream data to obtain coded video stream data; and transmitting the coded video stream data to the cloud mobile phone through a video stream transmission protocol. The cloud mobile phone can control the camera of the local mobile phone to acquire the video through the cloud mobile phone, so that the problems of cloud mobile phone face recognition, two-dimensional code scanning payment, login, cloud mobile phone video monitoring, cloud picture storage and the like can be solved, the cloud mobile phone can play the largest function under the hardware of the cloud mobile phone, and the user experience can be greatly improved. The invention can be widely applied to the cloud mobile phone.

Description

Cloud mobile phone video acquisition method, system, device and storage medium
Technical Field
The invention relates to the technical field of video acquisition, in particular to a cloud mobile phone video acquisition method, a cloud mobile phone video acquisition system, a cloud mobile phone video acquisition device and a storage medium.
Background
When a user uses cloud mobile phone service, the user does not need to need a camera of a local mobile phone of the user to perform real-time video streaming, and the current cloud mobile phone cannot provide service, so that the interactive functions of scanning payment, face recognition login, real-time video monitoring, photographing and the like of a remote cloud mobile phone cannot be provided, and the real experience of the cloud mobile phone of the user is reduced to a certain extent.
Disclosure of Invention
In order to solve the technical problems, the invention aims to provide a cloud mobile phone video acquisition method, a system, a device and a storage medium which can improve user experience.
The technical scheme adopted by the invention is as follows:
a cloud mobile phone video acquisition method comprises the following steps:
carrying out video acquisition through a camera of a local mobile phone to obtain video stream data;
coding the video stream data to obtain coded video stream data;
and transmitting the coded video stream data to the cloud mobile phone through a video stream transmission protocol.
As a further improvement of the cloud mobile phone video acquisition method, the encoding processing of the video stream data specifically includes:
the video stream data is subjected to H264 encoding processing.
As a further improvement of the cloud mobile phone video acquisition method, the encoding processing is performed on the video stream data to obtain encoded video stream data, and the method specifically includes:
creating an encoding session layer;
and starting to encode the video stream data according to the preset real-time encoding output, the bit rate and the frame rate to obtain the encoded video stream data.
As a further improvement of the cloud mobile phone video acquisition method, the encoding processing is performed on the video stream data to obtain encoded video stream data, and the step further includes:
when the image of the video stream data is coded, each frame of image is sent to a coder through a queue interface to be coded and recalled in real time.
As a further improvement of the cloud mobile phone video acquisition method, the video streaming protocol adopts a so transmission protocol.
As a further improvement of the cloud mobile phone video acquisition method, the method further comprises the following steps:
when the cloud mobile phone receives the coded video stream data, the camera is triggered to capture the callback, so that the local mobile phone receives the cloud mobile phone trigger time node, and the camera of the local mobile phone is synchronized with the cloud mobile phone.
The other technical scheme adopted by the invention is as follows:
a cloud cell-phone video capture system includes:
the local acquisition unit is used for carrying out video acquisition through a camera of a local mobile phone to obtain video stream data;
the encoding unit is used for encoding the video stream data to obtain encoded video stream data;
and the transmission unit is used for transmitting the coded video stream data to the cloud mobile phone through a video stream transmission protocol.
As a further improvement of the cloud mobile phone video capture system, the method further comprises:
the synchronization unit is used for triggering the camera to capture the callback when the cloud mobile phone receives the coded video stream data, so that the local mobile phone receives the cloud mobile phone trigger time node, and the camera of the local mobile phone is synchronized with the cloud mobile phone.
The invention adopts another technical scheme that:
a cloud cell-phone video capture device includes:
at least one processor;
at least one memory for storing at least one program;
when the at least one program is executed by the at least one processor, the at least one processor is enabled to implement the cloud cell phone video capture method.
The invention adopts another technical scheme that:
a computer-readable storage medium comprising a computer program which, when run on a computer, causes the cloud-phone video capture method to be performed.
The invention has the beneficial effects that:
the cloud mobile phone video acquisition method, the cloud mobile phone video acquisition system, the cloud mobile phone video acquisition device and the storage medium can control the camera of the local mobile phone to acquire videos through the cloud mobile phone, so that the problems of cloud mobile phone face recognition, two-dimension code scanning payment, login, cloud mobile phone video monitoring, cloud picture storage and the like can be solved, the cloud mobile phone can play the largest functions under the hardware of the cloud mobile phone, and the user experience can be greatly improved.
Drawings
FIG. 1 is a flow chart illustrating the steps of a video capture method for a cloud-enabled mobile phone according to the present invention;
fig. 2 is a block diagram of a cloud mobile phone video capture system according to the present invention.
Detailed Description
The following further describes embodiments of the present invention with reference to the accompanying drawings:
referring to fig. 1, an embodiment of the present invention provides a cloud mobile phone video acquisition method, including the following steps:
s1, carrying out video acquisition through a camera of the local mobile phone to obtain video stream data;
in this embodiment, data acquisition of the camera is completed by an AVCaptureSession class of an avfoundation. frame, and it is responsible for allocating data streams between audio and video input and output, and a session layer adds configuration input and output objects, which are connected to a CaptureSession through an avcapturedeviceinfput, and the output is an AVCaptureVideoDataOutput, and can take acquired video data through the AVCaptureSession class to start the AVCaptureSession. The captured video data is taken in a proxy following avcapturevideodataoutputsamplebufferdelete. The CMSampleBuffer stores a container data structure of the video image before and after encoding and decoding, the stored data is uncoded camera data, and the data before encoding the CVImageBuffer can be taken through a CMSampleBufferGetImageBuffer () interface.
S2, coding the video stream data to obtain coded video stream data;
and S3, transmitting the coded video stream data to the cloud mobile phone through a video stream transmission protocol.
In this embodiment, when the user operates the cloud mobile phone app software at the client, the user interacts with the cloud app with functions of code scanning, photographing, AR, and the like to listen to the callback, calling a VIDEO control function interface for processing through a hardware bottom INPUT/output port and a remote-play program, establishing a service link and passing through a control service penetration, triggering an EVENT _ INPUT _ VIDEO _ DATA by a so dynamic library instruction, receiving an instruction locally, initializing a camera parameter, starting a camera, encoding a VIDEO stream, writing a real-time VIDEO stream into a so dynamic library function sendInputvideo function frame, establishing the service link and passing through the control service penetration, and receiving the processing of a VIDEO control function interface at a remote-play program of a cloud mobile phone hardware driving layer, performing VIDEO decoding, driving virtual cloud mobile phone equipment on a remote side of the remote-play, acquiring VIDEO stream frames for transmission, and completing a drawing rasterization rendering stage at running opportunity runloop by a client under a callback instruction of an EVENT _ VIDEO _ UPDATE _ DATA UPDATE image of a dynamic library. And the cloud software receives a frame of video stream, and completes functions of recognizing and scanning codes and the like, so that the whole process of matching different sound code rates according to different image qualities is completed.
Further as a preferred embodiment, the encoding process performed on the video stream data specifically includes:
the video stream data is subjected to H264 encoding processing.
Further as a preferred embodiment, the encoding processing on the video stream data to obtain encoded video stream data specifically includes:
creating an encoding session layer;
and starting to encode the video stream data according to the preset real-time encoding output, the bit rate and the frame rate to obtain the encoded video stream data.
In this embodiment, a Session layer Session is created, a real-time encoding output is set, encoding delay is reduced, an appropriate bit rate and frame rate are set, encoding is started, source data (yuv type data, obtained directly from a camera) is circularly input, encoded H264 data is obtained to end encoding, in encoding a frame of image, queue is used to prevent blocking of a system camera acquisition thread, encoding is sent to an encoder encoding vtcompressionsessionencodeckle frame, real-time encoding callback is performed, whether a current frame is a key frame and sps & pps data is judged in the callback, note that an information frame only needs to be obtained once, a memory address of a start position is obtained from a CMBlockBufferRef, an image of a frame may need to be written into a plurality of NALU units, NALU data is circularly obtained, an address of a length of a H264 Headrength is copied from the start position, naluguentLength is calculated, data encoded by H264 is a big-end mode (byte order), PoNSOffset is created from a tadata, and a byte order is reset, move to write a block, convert to NALU unit, and operate in a loop.
Further as a preferred embodiment, the encoding process of the video stream data to obtain encoded video stream data further includes:
when the image of the video stream data is coded, each frame of image is sent to a coder through a queue interface to be coded and recalled in real time.
Further, as a preferred embodiment, the video streaming protocol adopts so transport protocol.
Further as a preferred embodiment, the method further comprises the following steps:
when the cloud mobile phone receives the coded video stream data, the camera is triggered to capture the callback, so that the local mobile phone receives the cloud mobile phone trigger time node, and the camera of the local mobile phone is synchronized with the cloud mobile phone.
When a frame of VIDEO stream is acquired and is subjected to frame separation and transmission through a so transport protocol control layer sendlnputvideo, the nFrameType frame type (SPS, PPS, P, I), buffer (VIDEO DATA) and len (length), as a cloud mobile phone is based on a virtual system of an arm chip, a camera capture callback is triggered in hardware abnormal interruption, and an EVENT _ INPUT _ VIDEO _ DATA instruction is newly added in an information configuration instruction and used for a local mobile phone app to receive a cloud mobile phone trigger time node, so that synchronization between the local camera and the cloud mobile phone is started.
Referring to fig. 2, the present embodiment provides a cloud mobile phone video capture system, including:
the local acquisition unit is used for carrying out video acquisition through a camera of a local mobile phone to obtain video stream data;
the encoding unit is used for encoding the video stream data to obtain encoded video stream data;
and the transmission unit is used for transmitting the coded video stream data to the cloud mobile phone through a video stream transmission protocol.
The contents in the above method embodiments are all applicable to the present system embodiment, the functions specifically implemented by the present system embodiment are the same as those in the above method embodiment, and the beneficial effects achieved by the present system embodiment are also the same as those achieved by the above method embodiment.
Further, as a preferred embodiment, the method further comprises:
the synchronization unit is used for triggering the camera to capture the callback when the cloud mobile phone receives the coded video stream data, so that the local mobile phone receives the cloud mobile phone trigger time node, and the camera of the local mobile phone is synchronized with the cloud mobile phone.
This embodiment also provides a cloud cell-phone video acquisition device, includes:
at least one processor;
at least one memory for storing at least one program;
when the at least one program is executed by the at least one processor, the at least one processor is enabled to implement the cloud cell phone video capture method.
The contents in the above method embodiments are all applicable to the present apparatus embodiment, the functions specifically implemented by the present apparatus embodiment are the same as those in the above method embodiments, and the advantageous effects achieved by the present apparatus embodiment are also the same as those achieved by the above method embodiments.
The embodiment also provides a computer-readable storage medium, which is characterized by comprising a computer program, and when the computer program runs on a computer, the cloud mobile phone video capture method is executed.
The contents in the above method embodiments are all applicable to the present storage medium embodiment, the functions specifically implemented by the present storage medium embodiment are the same as those in the above method embodiments, and the advantageous effects achieved by the present storage medium embodiment are also the same as those achieved by the above method embodiments.
In summary, the cloud mobile phone video acquisition method, system, device and storage medium provided by the invention can control the camera of the local mobile phone to acquire video through the cloud mobile phone, so that the problems of cloud mobile phone face recognition, two-dimensional code scanning payment, login, cloud mobile phone video monitoring, cloud picture storage and the like can be solved, the cloud mobile phone can exert the maximum function under the hardware of the cloud mobile phone, and the user experience can be greatly improved.
While the preferred embodiments of the present invention have been illustrated and described, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (6)

CN201910702587.3A2019-07-312019-07-31Cloud mobile phone video acquisition method, system, device and storage mediumActiveCN110430441B (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN201910702587.3ACN110430441B (en)2019-07-312019-07-31Cloud mobile phone video acquisition method, system, device and storage medium

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN201910702587.3ACN110430441B (en)2019-07-312019-07-31Cloud mobile phone video acquisition method, system, device and storage medium

Publications (2)

Publication NumberPublication Date
CN110430441A CN110430441A (en)2019-11-08
CN110430441Btrue CN110430441B (en)2021-01-12

Family

ID=68413395

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN201910702587.3AActiveCN110430441B (en)2019-07-312019-07-31Cloud mobile phone video acquisition method, system, device and storage medium

Country Status (1)

CountryLink
CN (1)CN110430441B (en)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN111405026B (en)*2020-03-112023-04-07广州微算互联信息技术有限公司Method and device for synchronously controlling volumes of android mobile phone and cloud mobile phone
CN111885252B (en)*2020-06-092024-05-31广州速启科技有限责任公司Mobile phone expansion use method
CN111917988B (en)*2020-08-282021-12-10湖南多行云计算机科技有限公司Remote camera application method, system and medium of cloud mobile phone
CN112383775A (en)*2020-11-102021-02-19福建多多云科技有限公司Video data transmission method based on cloud mobile phone
CN112492203A (en)*2020-11-262021-03-12北京指掌易科技有限公司Virtual photographing method, device, equipment and storage medium
CN112910899A (en)*2021-02-022021-06-04深圳市瑞驰信息技术有限公司Audio and video transparent transmission method under android system
CN115480928A (en)*2021-06-162022-12-16上海科企信息技术有限公司Method for realizing identification card identification in cloud mobile phone
CN113411503B (en)*2021-07-012022-09-13上海卓易科技股份有限公司Cloud mobile phone camera preview method and device, computer equipment and storage medium
CN113722378B (en)*2021-08-312024-01-05北京百度网讯科技有限公司Method, device, electronic equipment and medium for collecting information
CN113938457B (en)*2021-09-302023-11-10北京润信恒达科技有限公司Method, system and equipment for cloud mobile phone to apply remote camera
CN114025083A (en)*2021-10-282022-02-08北京百度网讯科技有限公司 Video capture method, device, electronic device and medium for cloud device
CN116489499A (en)*2023-03-192023-07-25南京阿卡亚智能科技有限公司 A method, device, computer equipment, and storage medium for displaying a preview screen of a cloud mobile phone camera in real time
CN117294925A (en)*2023-08-222023-12-26深圳华为云计算技术有限公司Method, device, equipment and storage medium for displaying cloud mobile phone video

Citations (4)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN102930661A (en)*2012-10-312013-02-13浪潮齐鲁软件产业有限公司Cloud computing-based network invoicing method by using mobile phone
CN103036674A (en)*2012-12-042013-04-10同济大学Computer permission control method based on mobile dynamic password
CN107147609A (en)*2016-03-012017-09-08中兴通讯股份有限公司A kind of method and cloud terminal, Cloud Server for lifting cloud terminal security energy-conservation
CN108833797A (en)*2018-06-062018-11-16深圳京龙睿信科技有限公司A kind of device and its application method improving vehicle-mounted binocular vision system performance

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
US9955197B2 (en)*2014-04-242018-04-24Intel CorporationEncrypted screencasting
CN109640116B (en)*2018-12-242020-09-11广州微算互联信息技术有限公司Cloud mobile phone network video coding method and server

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN102930661A (en)*2012-10-312013-02-13浪潮齐鲁软件产业有限公司Cloud computing-based network invoicing method by using mobile phone
CN103036674A (en)*2012-12-042013-04-10同济大学Computer permission control method based on mobile dynamic password
CN107147609A (en)*2016-03-012017-09-08中兴通讯股份有限公司A kind of method and cloud terminal, Cloud Server for lifting cloud terminal security energy-conservation
CN108833797A (en)*2018-06-062018-11-16深圳京龙睿信科技有限公司A kind of device and its application method improving vehicle-mounted binocular vision system performance

Also Published As

Publication numberPublication date
CN110430441A (en)2019-11-08

Similar Documents

PublicationPublication DateTitle
CN110430441B (en)Cloud mobile phone video acquisition method, system, device and storage medium
CN105991962B (en)Connection method, information display method, device and system
US12015770B2 (en)Method for encoding video data, device, and storage medium
US9210372B2 (en)Communication method and device for video simulation image
CN110784740A (en) Video processing method, device, server and readable storage medium
CN108932948B (en)Audio data processing method and device, computer equipment and computer readable storage medium
CN113542875B (en)Video processing method, device, electronic equipment and storage medium
CN113473126B (en)Video stream processing method and device, electronic equipment and computer readable medium
CN110996122B (en)Video frame transmission method, device, computer equipment and storage medium
CN105338323A (en)Video monitoring method and device
US9306987B2 (en)Content message for video conferencing
CN113938457B (en)Method, system and equipment for cloud mobile phone to apply remote camera
CN113225585A (en)Video definition switching method and device, electronic equipment and storage medium
CN110300278A (en)Video transmission method and equipment
CN113630575B (en)Method, system and storage medium for displaying images of multi-person online video conference
CN113207040A (en)Data processing method, device and system for video remote quick playback
WO2021057697A1 (en)Video encoding and decoding methods and apparatuses, storage medium, and electronic device
CN110730364A (en)Cloud mobile phone data transmission method and device and storage medium
CN104010204A (en) Image information processing method and device
CN106303464A (en)A kind of wireless video monitoring service end, client, system and processing method
CN112533029B (en)Video time-sharing transmission method, camera device, system and storage medium
CN112183227B (en)Intelligent face region coding method and device
CN212137851U (en)Video output device supporting HEVC decoding
WO2022116822A1 (en)Data processing method and apparatus for immersive media, and computer-readable storage medium
CN111818336B (en)Video processing method, video processing apparatus, storage medium, and communication apparatus

Legal Events

DateCodeTitleDescription
PB01Publication
PB01Publication
SE01Entry into force of request for substantive examination
SE01Entry into force of request for substantive examination
GR01Patent grant
GR01Patent grant
EE01Entry into force of recordation of patent licensing contract
EE01Entry into force of recordation of patent licensing contract

Application publication date:20191108

Assignee:Guangzhou Duling Technology Co.,Ltd.

Assignor:Hunan micro computing Internet Information Technology Co.,Ltd.

Contract record no.:X2024990000103

Denomination of invention:A cloud mobile video capture method, system, device, and storage medium

Granted publication date:20210112

License type:Common License

Record date:20240315


[8]ページ先頭

©2009-2025 Movatter.jp