Movatterモバイル変換


[0]ホーム

URL:


CN106210453A - A kind of intelligent virtual studio system - Google Patents

A kind of intelligent virtual studio system
Download PDF

Info

Publication number
CN106210453A
CN106210453ACN201610649323.2ACN201610649323ACN106210453ACN 106210453 ACN106210453 ACN 106210453ACN 201610649323 ACN201610649323 ACN 201610649323ACN 106210453 ACN106210453 ACN 106210453A
Authority
CN
China
Prior art keywords
video
camera
virtual
module
card
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610649323.2A
Other languages
Chinese (zh)
Inventor
陈江林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Anhui Joy Mdt Infotech Ltd
Original Assignee
Anhui Joy Mdt Infotech Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Anhui Joy Mdt Infotech LtdfiledCriticalAnhui Joy Mdt Infotech Ltd
Priority to CN201610649323.2ApriorityCriticalpatent/CN106210453A/en
Publication of CN106210453ApublicationCriticalpatent/CN106210453A/en
Pendinglegal-statusCriticalCurrent

Links

Classifications

Landscapes

Abstract

The invention discloses a kind of intelligent virtual studio system, including real camera, image pick-up card, virtual video camera, Camera location device, synchronization and tracking control module, virtual scene generation module, foreground video time delay module, video frame synchronization device, Chroma Key module and Video Output Modules;Real camera and image pick-up card are all connected with Camera location device and foreground video time delay module, Camera location device connects synchronization and tracking control module, synchronization and tracking control module connects virtual video camera, virtual video camera connects virtual scene generation module, foreground video time delay module connects video frame synchronization device, video frame synchronization device and virtual scene generation module are all connected with Chroma Key module, and Chroma Key module connects Video Output Modules.Present invention reduces the cost of manufacture of TV programme, save substantial amounts of human and material resources, financial resources, and shorten the program making cycle, improve the utilization rate of studio.

Description

A kind of intelligent virtual studio system
Technical field
The invention belongs to Virtual Studio Technology field, relate to a kind of Virtual Studio System, specifically a kind of intelligent virtualIntend studio system.
Background technology
Augmented reality (AugmentedReality, be called for short AR) is the emerging technology that development in recent years is got up, it by means ofPhotoelectric technology, interaction technique, multi-sensor technology and computer picture and multimedia technology, the virtual environment that computer is generatedBlending with the real scene around user, virtual environment is the group of real scene about to make user be sure of from sensory effectsBecome part, thus strengthen and the extending user perception to surrounding.
Virtual Studio System, as a hot issue in current TV and film production field, promotes video display greatlyThe development of program making, restricts in high cost, is the most extremely necessary to provide the Virtual Studio System of a kind of low cost.
Summary of the invention
The present invention is directed to the deficiencies in the prior art, it is provided that a kind of intelligent virtual studio system, improve TV greatlyPlatform, to the creation of program and the ability of making, has been opened up TV programme space, has been reduced the cost of program making.
The purpose of the present invention can be achieved through the following technical solutions:
A kind of intelligent virtual studio system, including
Real camera and image pick-up card, for collection site video and image information;
Camera location device, for gathering the location parameter of real camera, The Cloud Terrace parameter and lens parameters;
Virtual video camera, is used for determining that real camera is relative to reality scene coordinate system position in virtual scene;
Synchronization and tracking control module, controls for the location parameter according to real camera, The Cloud Terrace parameter and lens parametersVirtual video camera parameter, makes virtual video camera keep Tong Bu with real camera;
Virtual scene generation module, picture, video and the three-dimensional mould in the three-dimensional virtual scene space that will designType information reads, and arranges the position attribution of virtual light, material, texture, model of place, obtains according to synchronization and tracking control moduleVirtual video camera parameter generate suitable three-dimensional virtual scene;
Chroma Key module, the live video image being used for collecting real camera and image pick-up card is as frontScape, is synthesized together the three-dimensional virtual scene image that virtual scene generation module generates as background, makes performer and threeDimension virtual scene blends;
Foreground video time delay module, for live video real camera and image pick-up card collected and image letterBreath time delay output, the time delay produced when using with adaptive coloration key technology;
Video frame synchronization device, for live video image information harmony real camera and image pick-up card collectedMessage breath synchronism output, it is ensured that sound picture synchronizes;
Video Output Modules, for video image output Chroma Key module synthesized;
Wherein, described real camera and image pick-up card are all connected with Camera location device and foreground video time delay mouldBlock, described Camera location device connects synchronization and tracking control module, and described synchronization and tracking control module connects virtual shootingMachine, described virtual video camera connects virtual scene generation module, and described foreground video time delay module connects video frame synchronizationDevice, described video frame synchronization device and virtual scene generation module are all connected with Chroma Key module, described Chroma Key moduleConnect Video Output Modules.
Further, described real camera uses ccd video camera, described image pick-up card to use MV-600 high-precisionDegree industrial picture capture card.
Further, described Chroma Key module includes three base color soft light, is used for providing stable for video keyingSite environment
Beneficial effects of the present invention: the present invention generates background and stage property by virtual scene generation module, can produceThat not actually exist or be difficult to the scene made, it is possible to changing scene in moment, can produce true studio cannot be realExisting effect, its space is not limited by physical space, and video camera can be with 360 degree of rotations, it is also possible to induce one a large amount of virtual specialEnvironment and stage property, therefore can create program more rich, more attracting, makes director break away from time, sky to a great extentBetween and stage property making in terms of restriction, it is thus achieved that the imagination space of bigger creation, it is possible to produce novel with cheap costVisual effect;Simultaneously as the making of scene, revise, preservation etc. is carried out the most on computers, makes and change electronics setting fastPrompt easy, save substantial amounts of human and material resources, financial resources, and shorten the program making cycle, improve the utilization rate of studio.
Accompanying drawing explanation
With specific embodiment, the present invention is described in further detail below in conjunction with the accompanying drawings.
Fig. 1 is the system schematic of the present invention.
Detailed description of the invention
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, completeDescribe, it is clear that described embodiment is only a part of embodiment of the present invention rather than whole embodiments wholely.Based onEmbodiment in the present invention, those of ordinary skill in the art obtained under not making creative work premise all otherEmbodiment, broadly falls into the scope of protection of the invention.
As it is shown in figure 1, the invention provides a kind of intelligent virtual studio system, including real camera, image acquisitionCard, virtual video camera, Camera location device, synchronization and tracking control module, virtual scene generation module, foreground video time delay mouldBlock, video frame synchronization device, Chroma Key module and Video Output Modules.
Real camera and image pick-up card are for collection site video and image information, and wherein, real camera usesCcd video camera, image pick-up card uses MV-600 high accuracy industrial picture capture card.
Camera location device is for gathering the location parameter of real camera, The Cloud Terrace parameter and lens parameters.
Virtual video camera is used to determine that real camera is relative to reality scene coordinate system position in virtual scene.
Synchronization and tracking control module controls void for the location parameter according to real camera, The Cloud Terrace parameter and lens parametersIntend camera parameters, make virtual video camera keep Tong Bu with real camera.
Virtual scene generation module picture, video and threedimensional model in the three-dimensional virtual scene space that will designInformation reads, and arranges the position attribution of virtual light, material, texture, model of place, obtains according to synchronization and tracking control moduleVirtual video camera parameter generates suitable three-dimensional virtual scene.
The live video image that real camera and image pick-up card are collected by Chroma Key module is as prospect, by voidThe three-dimensional virtual scene image intending scenario generating module generation is synthesized together as background, makes performer and virtual three dimensional fieldScape blends.Wherein, Chroma Key module includes three base color soft light, for the site environment stable for video keying offer.
Foreground video time delay module is for live video real camera and image pick-up card collected and image letterBreath time delay output, the time delay produced when using with adaptive coloration key technology.
Video frame synchronization device is for live video image information harmony real camera and image pick-up card collectedMessage breath synchronism output, it is ensured that sound picture synchronizes.
Video Output Modules is for video image output Chroma Key module synthesized.
Wherein, real camera and image pick-up card are all connected with Camera location device and foreground video time delay module, shootingMachine tracker connects synchronization and tracking control module, and synchronization and tracking control module connects virtual video camera, and virtual video camera connects voidIntending scenario generating module, foreground video time delay module connects video frame synchronization device, video frame synchronization device and virtual scene and generates mouldBlock is all connected with Chroma Key module, and Chroma Key module connects Video Output Modules.
Workflow of the present invention: real camera and image pick-up card first collection site video and image information, concurrentlyDeliver to foreground video time delay module;Camera location device obtains real camera location parameter in shooting process, The Cloud Terrace ginsengNumber and lens parameters, control virtual video camera parameter, the location of regulation virtual video camera and fortune by synchronization and tracking control moduleDynamic;After the picture designed in three-dimensional virtual scene space, video and three-dimensional model information are read by virtual scene generation module,Set the position attribution of virtual light, material, texture, model of place, generate according to virtual video camera parameter the most three-dimensionalVirtual scene, and the virtual background image of generation is passed to Chroma Key module;Foreground video time delay module is by live videoExporting video frame synchronization device with image information time delay, live video image information and acoustic information are synchronized by video frame synchronization deviceOutput is to Chroma Key module;Chroma Key module using the live video that collects as prospect, the virtual three dimensional field that will generateScape image is synthesized together as background, makes performer blend with three-dimensional virtual scene, is exported by Video Output Modules.
The present invention generates background and stage property by virtual scene generation module, can produce that not actually exist or be difficult toThe scene made, it is possible to changing scene in moment, can produce the effect that true studio cannot realize, its space is not subject toPhysical space limits, and video camera can be with 360 degree of rotations, it is also possible to induce one a large amount of virtual special environment and stage property, therefore can createMake program more rich, more attracting, the limit in terms of making director break away from time, space and stage property making to a great extentSystem, it is thus achieved that the imagination space of bigger creation, it is possible to produce novel visual effect with cheap cost;Simultaneously as fieldThe making of scape, revise, preservation etc. is carried out the most on computers, make and change electronics setting fast and simple, save substantial amounts ofHuman and material resources, financial resources, and shorten the program making cycle, improve the utilization rate of studio.
For convenience of description, it is divided into various unit, module to be respectively described with function when describing apparatus above.Certainly, existImplement the function of each unit, module to be realized in same or multiple softwares and/or hardware during the application.
As seen through the above description of the embodiments, those skilled in the art it can be understood that to the application canThe mode adding required general hardware platform by software realizes.Based on such understanding, the technical scheme essence of the applicationOn the part that in other words prior art contributed can embody with the form of software product, this computer software productCan be stored in storage medium, such as ROM/RAM, magnetic disc, CD etc., including some instructions with so that a computer equipment(can be personal computer, server, or the network equipment etc.) performs each embodiment of the application or embodimentMethod described in some part.
Device embodiments described above is only schematically, the wherein said unit illustrated as separating componentCan be or may not be physically separate, the parts shown as unit can be or may not be physics listUnit, i.e. may be located at a place, or can also be distributed on multiple NE.Can be selected it according to the actual needsIn some or all of module realize the purpose of present embodiment scheme.Those of ordinary skill in the art are not paying creationProperty work in the case of, be i.e. appreciated that and implement.
The application can be used in numerous general or special purpose computing system environment or configuration.Such as: personal computer, serviceDevice computer, handheld device or portable set, laptop device, multicomputer system, system based on microprocessor, top setBox, programmable consumer-elcetronics devices, network PC, minicomputer, mainframe computer, include any of the above system or equipmentDistributed computing environment etc..
The application can be described in the general context of computer executable instructions, such as programModule.Usually, program module includes performing particular task or realizing the routine of particular abstract data type, program, object, groupPart, data structure etc..The application can also be put into practice in a distributed computing environment, in these distributed computing environment, byThe remote processing devices connected by communication network performs task.In a distributed computing environment, program module is permissibleIt is positioned in the local and remote computer-readable storage medium of storage device.
In the description of this specification, the description of reference term " embodiment ", " example ", " concrete example " etc. meansSpecific features, structure, material or feature in conjunction with this embodiment or example description is contained at least one enforcement of the present inventionIn example or example.In this manual, the schematic representation to above-mentioned term is not necessarily referring to identical embodiment or example.And, the specific features of description, structure, material or feature can be to close in any one or more embodiments or exampleSuitable mode combines.
Above content is only to present configuration example and explanation, affiliated those skilled in the art coupleDescribed specific embodiment makes various amendment or supplements or use similar mode to substitute, without departing from inventionStructure or surmount scope defined in the claims, all should belong to protection scope of the present invention.

Claims (3)

CN201610649323.2A2016-08-092016-08-09A kind of intelligent virtual studio systemPendingCN106210453A (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN201610649323.2ACN106210453A (en)2016-08-092016-08-09A kind of intelligent virtual studio system

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN201610649323.2ACN106210453A (en)2016-08-092016-08-09A kind of intelligent virtual studio system

Publications (1)

Publication NumberPublication Date
CN106210453Atrue CN106210453A (en)2016-12-07

Family

ID=57514705

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN201610649323.2APendingCN106210453A (en)2016-08-092016-08-09A kind of intelligent virtual studio system

Country Status (1)

CountryLink
CN (1)CN106210453A (en)

Cited By (17)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN106657719A (en)*2017-01-042017-05-10海南大学Intelligent virtual studio system
CN107680105A (en)*2017-10-122018-02-09北京奇虎科技有限公司Video data real-time processing method and device, computing device based on virtual world
CN108259780A (en)*2018-04-172018-07-06北京艾沃次世代文化传媒有限公司For the anti-interference special efficacy audio video synchronization display methods of virtual film studio
CN109345635A (en)*2018-11-212019-02-15北京迪生数字娱乐科技股份有限公司Unmarked virtual reality mixes performance system
CN109982005A (en)*2017-12-272019-07-05艾迪普(北京)文化科技股份有限公司A kind of picture and text based on panoramic video follow synthetic method
CN110085252A (en)*2019-03-282019-08-02体奥动力(北京)体育传播有限公司The sound picture time-delay regulating method of race production center centralized control system
CN110691175A (en)*2019-08-192020-01-14深圳市励得数码科技有限公司Video processing method and device for simulating motion tracking of camera in studio
CN111447340A (en)*2020-05-292020-07-24深圳市瑞立视多媒体科技有限公司Mixed reality virtual preview shooting system
CN111756956A (en)*2020-06-232020-10-09网易(杭州)网络有限公司Virtual light control method and device, medium and equipment in virtual studio
CN113038262A (en)*2021-01-082021-06-25深圳市智胜科技信息有限公司Panoramic live broadcast method and device
CN113160338A (en)*2021-05-182021-07-23视境技术(深圳)有限公司AR/VR virtual reality fusion studio character space positioning
CN113271482A (en)*2021-05-172021-08-17广东彼雍德云教育科技有限公司Portable full-width image scratching blackboard
CN113489920A (en)*2021-06-292021-10-08维沃移动通信(杭州)有限公司Video synthesis method and device and electronic equipment
CN114040090A (en)*2021-08-252022-02-11先壤影视制作(上海)有限公司Method, device, equipment, storage medium, acquisition part and system for synchronizing virtuality and reality
CN115996273A (en)*2021-10-192023-04-21广州博冠信息科技有限公司 Lighting control method and device, electronic device, storage medium
CN117082225A (en)*2023-10-122023-11-17山东海量信息技术研究院Virtual delay video generation method, device, equipment and storage medium
CN118075552A (en)*2024-04-222024-05-24黑龙江省邦盾科技有限公司Studio video feature image enhancement processing method

Citations (11)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
EP0772350A2 (en)*1995-10-301997-05-07Kabushiki Kaisha PhotronKeying system and composite image producing method
JPH10327350A (en)*1997-05-231998-12-08Sony CorpImage forming device and image forming method
EP0989747A2 (en)*1998-09-282000-03-29Canon Kabushiki KaishaTelevision lens apparatus adapted for a virtual studio
CN1477856A (en)*2002-08-212004-02-25北京新奥特集团True three-dimensional virtual studio system and its implement method
WO2009035199A1 (en)*2007-09-152009-03-19Young-Dae KimVirtual studio posture correction machine
CN101668126A (en)*2008-09-022010-03-10新奥特(北京)视频技术有限公司Method for realizing unlimited blue-box function used in virtual studio systems
CN101668127A (en)*2008-09-032010-03-10新奥特(北京)视频技术有限公司Virtual studio system with multiple-to-multiple structure
CN102739984A (en)*2011-08-292012-10-17新奥特(北京)视频技术有限公司Method and system for realizing high-definition virtual scenery
CN103841299A (en)*2012-11-232014-06-04西安天动数字科技有限公司Virtual studio system
CN203912065U (en)*2014-06-122014-10-29西安宏源视讯设备有限责任公司Video signal time delay switching system based on FPGA
CN104836938A (en)*2015-04-302015-08-12江苏卡罗卡国际动漫城有限公司Virtual studio system based on AR technology

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
EP0772350A2 (en)*1995-10-301997-05-07Kabushiki Kaisha PhotronKeying system and composite image producing method
JPH10327350A (en)*1997-05-231998-12-08Sony CorpImage forming device and image forming method
EP0989747A2 (en)*1998-09-282000-03-29Canon Kabushiki KaishaTelevision lens apparatus adapted for a virtual studio
CN1477856A (en)*2002-08-212004-02-25北京新奥特集团True three-dimensional virtual studio system and its implement method
WO2009035199A1 (en)*2007-09-152009-03-19Young-Dae KimVirtual studio posture correction machine
CN101668126A (en)*2008-09-022010-03-10新奥特(北京)视频技术有限公司Method for realizing unlimited blue-box function used in virtual studio systems
CN101668127A (en)*2008-09-032010-03-10新奥特(北京)视频技术有限公司Virtual studio system with multiple-to-multiple structure
CN102739984A (en)*2011-08-292012-10-17新奥特(北京)视频技术有限公司Method and system for realizing high-definition virtual scenery
CN103841299A (en)*2012-11-232014-06-04西安天动数字科技有限公司Virtual studio system
CN203912065U (en)*2014-06-122014-10-29西安宏源视讯设备有限责任公司Video signal time delay switching system based on FPGA
CN104836938A (en)*2015-04-302015-08-12江苏卡罗卡国际动漫城有限公司Virtual studio system based on AR technology

Cited By (22)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN106657719A (en)*2017-01-042017-05-10海南大学Intelligent virtual studio system
CN107680105A (en)*2017-10-122018-02-09北京奇虎科技有限公司Video data real-time processing method and device, computing device based on virtual world
CN109982005A (en)*2017-12-272019-07-05艾迪普(北京)文化科技股份有限公司A kind of picture and text based on panoramic video follow synthetic method
CN108259780A (en)*2018-04-172018-07-06北京艾沃次世代文化传媒有限公司For the anti-interference special efficacy audio video synchronization display methods of virtual film studio
CN109345635A (en)*2018-11-212019-02-15北京迪生数字娱乐科技股份有限公司Unmarked virtual reality mixes performance system
CN109345635B (en)*2018-11-212023-08-18北京迪生数字娱乐科技股份有限公司Virtual reality mixed performance system without mark points
CN110085252A (en)*2019-03-282019-08-02体奥动力(北京)体育传播有限公司The sound picture time-delay regulating method of race production center centralized control system
CN110691175A (en)*2019-08-192020-01-14深圳市励得数码科技有限公司Video processing method and device for simulating motion tracking of camera in studio
CN110691175B (en)*2019-08-192021-08-24深圳市励得数码科技有限公司Video processing method and device for simulating motion tracking of camera in studio
CN111447340A (en)*2020-05-292020-07-24深圳市瑞立视多媒体科技有限公司Mixed reality virtual preview shooting system
CN111756956A (en)*2020-06-232020-10-09网易(杭州)网络有限公司Virtual light control method and device, medium and equipment in virtual studio
CN113038262A (en)*2021-01-082021-06-25深圳市智胜科技信息有限公司Panoramic live broadcast method and device
CN113038262B (en)*2021-01-082025-01-14深圳市智胜科技信息有限公司 A panoramic live broadcast method and device
CN113271482A (en)*2021-05-172021-08-17广东彼雍德云教育科技有限公司Portable full-width image scratching blackboard
CN113160338A (en)*2021-05-182021-07-23视境技术(深圳)有限公司AR/VR virtual reality fusion studio character space positioning
CN113489920B (en)*2021-06-292024-08-20维沃移动通信(杭州)有限公司Video synthesis method and device and electronic equipment
CN113489920A (en)*2021-06-292021-10-08维沃移动通信(杭州)有限公司Video synthesis method and device and electronic equipment
CN114040090A (en)*2021-08-252022-02-11先壤影视制作(上海)有限公司Method, device, equipment, storage medium, acquisition part and system for synchronizing virtuality and reality
CN115996273A (en)*2021-10-192023-04-21广州博冠信息科技有限公司 Lighting control method and device, electronic device, storage medium
CN117082225A (en)*2023-10-122023-11-17山东海量信息技术研究院Virtual delay video generation method, device, equipment and storage medium
CN117082225B (en)*2023-10-122024-02-09山东海量信息技术研究院Virtual delay video generation method, device, equipment and storage medium
CN118075552A (en)*2024-04-222024-05-24黑龙江省邦盾科技有限公司Studio video feature image enhancement processing method

Similar Documents

PublicationPublication DateTitle
CN106210453A (en)A kind of intelligent virtual studio system
Matsuyama et al.3D video and its applications
CN102945564A (en)True 3D modeling system and method based on video perspective type augmented reality
CN107463248A (en)A kind of remote interaction method caught based on dynamic with line holographic projections
Blonde et al.A virtual studio for live broadcasting: The Mona Lisa project
CN108200445A (en)The virtual studio system and method for virtual image
CN102834849A (en)Image drawing device for drawing stereoscopic image, image drawing method, and image drawing program
US20240267596A1 (en)Method for generating live-streaming data, storage medium, and electronic device thereof
CN108345637A (en)A kind of performance preview method and system based on augmented reality
CN111683260A (en)Program video generation method, system and storage medium based on virtual anchor
KR100801643B1 (en) 3D Conti manufacturing system and its provision method
CN108305308A (en)It performs under the line of virtual image system and method
CN107071297A (en)A kind of virtual reality system that logical computer room displaying is believed for electric power
KR20150129260A (en)Service System and Method for Object Virtual Reality Contents
Zerman et al.User behaviour analysis of volumetric video in augmented reality
CN106530408A (en)Museum temporary exhibition planning and design system
CN107995481B (en)A kind of display methods and device of mixed reality
CN110766805B (en)Interactive three-dimensional and VR simulation bottom-crossing system of thermal power plant
WO2024027063A1 (en)Livestream method and apparatus, storage medium, electronic device and product
CN113781660A (en)Method and device for rendering and processing virtual scene on line in live broadcast room
CN115866160B (en)Low-cost movie virtualization manufacturing system and method
CN103841299A (en)Virtual studio system
CN103049933A (en)Image processing apparatus and method thereof
CN112732255A (en)Rendering method, device, equipment and storage medium
WO2023217138A1 (en)Parameter configuration method and apparatus, device, storage medium and product

Legal Events

DateCodeTitleDescription
C06Publication
PB01Publication
C10Entry into substantive examination
SE01Entry into force of request for substantive examination
RJ01Rejection of invention patent application after publication
RJ01Rejection of invention patent application after publication

Application publication date:20161207


[8]ページ先頭

©2009-2025 Movatter.jp