Movatterモバイル変換


[0]ホーム

URL:


ZA202002064B - Optimizing audio delivery for virtual reality applications - Google Patents

Optimizing audio delivery for virtual reality applications

Info

Publication number
ZA202002064B
ZA202002064BZA2020/02064AZA202002064AZA202002064BZA 202002064 BZA202002064 BZA 202002064BZA 2020/02064 AZA2020/02064 AZA 2020/02064AZA 202002064 AZA202002064 AZA 202002064AZA 202002064 BZA202002064 BZA 202002064B
Authority
ZA
South Africa
Prior art keywords
audio
virtual reality
video
audio stream
reality applications
Prior art date
Application number
ZA2020/02064A
Inventor
Adrian Murtaza
Harald Fuchs
Bernd Czelhan
Jan Plogsties
Matteo Agnelli
Ingo Hofmann
Original Assignee
Fraunhofer Ges Forschung
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fraunhofer Ges ForschungfiledCriticalFraunhofer Ges Forschung
Publication of ZA202002064BpublicationCriticalpatent/ZA202002064B/en

Links

Classifications

Landscapes

Abstract

There are disclosed techniques, systems, methods and instructions for a virtual reality, VR, augmented reality, AR, mixed reality, MR, or 360-degree video environment. In one example, the system (102) comprises at least one media video decoder configured to decode video signals from video streams for the representation of VR, AR, MR or 360-degree video environment scenes to a user. The system comprises at least one audio decoder (104) configured to decode audio signals (108) from at least one audio stream (106). The system (102) is configured to request (112) at least one audio stream (106) and/or one audio element of an audio stream and/or one adaptation set to a server (120) on the basis of at least the user's current viewport and/or head orientation and/or movement data and/or interaction metadata and/or virtual positional data (110).
ZA2020/02064A2017-10-122020-05-04Optimizing audio delivery for virtual reality applicationsZA202002064B (en)

Applications Claiming Priority (2)

Application NumberPriority DateFiling DateTitle
EP171962592017-10-12
PCT/EP2018/077770WO2019072984A1 (en)2017-10-122018-10-11Optimizing audio delivery for virtual reality applications

Publications (1)

Publication NumberPublication Date
ZA202002064Btrue ZA202002064B (en)2024-11-27

Family

ID=60191107

Family Applications (5)

Application NumberTitlePriority DateFiling Date
ZA2020/02064AZA202002064B (en)2017-10-122020-05-04Optimizing audio delivery for virtual reality applications
ZA2022/08388AZA202208388B (en)2017-10-122022-07-27Optimizing audio delivery for virtual reality applications
ZA2022/08364AZA202208364B (en)2017-10-122022-07-27Optimizing audio delivery for virtual reality applications
ZA2023/04926AZA202304926B (en)2017-10-122023-05-03Optimizing audio delivery for virtual reality applications
ZA2024/05290AZA202405290B (en)2017-10-122024-07-08Optimizing audio delivery for virtual reality applications

Family Applications After (4)

Application NumberTitlePriority DateFiling Date
ZA2022/08388AZA202208388B (en)2017-10-122022-07-27Optimizing audio delivery for virtual reality applications
ZA2022/08364AZA202208364B (en)2017-10-122022-07-27Optimizing audio delivery for virtual reality applications
ZA2023/04926AZA202304926B (en)2017-10-122023-05-03Optimizing audio delivery for virtual reality applications
ZA2024/05290AZA202405290B (en)2017-10-122024-07-08Optimizing audio delivery for virtual reality applications

Country Status (18)

CountryLink
US (2)US11354084B2 (en)
EP (2)EP3695613B1 (en)
JP (3)JP7295851B2 (en)
KR (4)KR102568373B1 (en)
CN (5)CN116193213B (en)
AR (6)AR113357A1 (en)
AU (2)AU2018348762B2 (en)
BR (1)BR112020008073A2 (en)
CA (6)CA3078858A1 (en)
ES (1)ES2970490T3 (en)
MX (6)MX2020003450A (en)
MY (1)MY205925A (en)
PL (1)PL3695613T3 (en)
RU (2)RU2750505C1 (en)
SG (2)SG10202106080XA (en)
TW (1)TWI713911B (en)
WO (1)WO2019072984A1 (en)
ZA (5)ZA202002064B (en)

Families Citing this family (29)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
US10242486B2 (en)*2017-04-172019-03-26Intel CorporationAugmented reality and virtual reality feedback enhancement system, apparatus and method
EP4583515A3 (en)2018-02-222025-09-03Dolby International ABMethods, apparatus and systems for side load processing of packetized media streams
CN112673651B (en)*2018-07-132023-09-15诺基亚技术有限公司 Multi-view multi-user audio user experience
CN109151565B (en)*2018-09-042019-12-20北京达佳互联信息技术有限公司Method and device for playing voice, electronic equipment and storage medium
JP2020137044A (en)*2019-02-252020-08-31ソニーセミコンダクタソリューションズ株式会社Audio signal processing device
US11211073B2 (en)*2019-04-222021-12-28Sony CorporationDisplay control of different verbatim text of vocal deliverance of performer-of-interest in a live event
US11432097B2 (en)2019-07-032022-08-30Qualcomm IncorporatedUser interface for controlling audio rendering for extended reality experiences
US20210006976A1 (en)*2019-07-032021-01-07Qualcomm IncorporatedPrivacy restrictions for audio rendering
US11429340B2 (en)*2019-07-032022-08-30Qualcomm IncorporatedAudio capture and rendering for extended reality experiences
GB2589603A (en)*2019-12-042021-06-09Nokia Technologies OyAudio scene change signaling
CN111246225B (en)*2019-12-252022-02-08北京达佳互联信息技术有限公司Information interaction method and device, electronic equipment and computer readable storage medium
CN113585389A (en)*2020-05-012021-11-02迪尔公司Work vehicle magnetorheological fluid joystick system providing implement command guidance
JP7371595B2 (en)*2020-09-152023-10-31横河電機株式会社 Apparatus, system, method and program
US11355139B2 (en)*2020-09-222022-06-07International Business Machines CorporationReal-time vs non-real time audio streaming
GB2599359A (en)2020-09-232022-04-06Nokia Technologies OySpatial audio rendering
US12010496B2 (en)*2020-09-252024-06-11Apple Inc.Method and system for performing audio ducking for headsets
EP4060997A1 (en)*2021-03-172022-09-21Koninklijke Philips N.V.Pre-processing immersive video
US11914157B2 (en)2021-03-292024-02-27International Business Machines CorporationAdjustable air columns for head mounted displays
US11710491B2 (en)*2021-04-202023-07-25Tencent America LLCMethod and apparatus for space of interest of audio scene
US12204815B2 (en)*2021-06-022025-01-21Tencent America LLCAdaptive audio delivery and rendering
KR102687875B1 (en)*2021-07-192024-07-25가우디오랩 주식회사Method and apparatus for switching an audio scene in a multi-view environment
CN113660347B (en)*2021-08-312024-05-07Oppo广东移动通信有限公司 Data processing method, device, electronic device and readable storage medium
US20230086248A1 (en)*2021-09-212023-03-23Meta Platforms Technologies, LlcVisual navigation elements for artificial reality environments
US11983214B2 (en)*2021-11-052024-05-14Tencent America LLCReuse of redundant assets with client query
US20230260537A1 (en)*2022-02-162023-08-17Google LlcSingle Vector Digital Voice Accelerometer
US20230394755A1 (en)*2022-06-022023-12-07Apple Inc.Displaying a Visual Representation of Audible Data Based on a Region of Interest
US12137335B2 (en)*2022-08-192024-11-05Dzco IncMethod for navigating multidimensional space using sound
KR102732148B1 (en)*2022-10-312024-11-20한국전자통신연구원Method, apparatus, and system for providing zoomable stereo 360 vr video
CN116709162B (en)*2023-08-092023-11-21腾讯科技(深圳)有限公司Audio processing method and related equipment

Family Cites Families (36)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
US20020103554A1 (en)*2001-01-292002-08-01Hewlett-Packard CompanyInteractive audio system
AUPR989802A0 (en)*2002-01-092002-01-31Lake Technology LimitedInteractive spatialized audiovisual system
JP2004072694A (en)2002-08-092004-03-04Sony CorpInformation providing system and method, information providing apparatus and method, recording medium, and program
DE102005008366A1 (en)*2005-02-232006-08-24Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.Device for driving wave-field synthesis rendering device with audio objects, has unit for supplying scene description defining time sequence of audio objects
JP2007029506A (en)*2005-07-282007-02-08Konami Digital Entertainment:KkGame device, sound data creating method, and program
US20080022348A1 (en)2006-07-032008-01-24Samoa Opulence Investment Inc.Interactive video display system and a method thereof
FR2915177B1 (en)2007-04-202009-07-10Airbus France Sa AIRCRAFT ENGINE AND AIRCRAFT ENGINE CLAMPING DEVICE COMPRISING AT LEAST ONE SUCH DEVICE
US20090094375A1 (en)*2007-10-052009-04-09Lection David BMethod And System For Presenting An Event Using An Electronic Device
US8520872B2 (en)*2008-08-142013-08-27Samsung Electronics Co., Ltd.Apparatus and method for sound processing in a virtual reality system
US8798776B2 (en)2008-09-302014-08-05Dolby International AbTranscoding of audio metadata
WO2010063100A1 (en)*2008-12-012010-06-10Nortel Networks LimitedMethod and apparatus for providing a video representation of a three dimensional computer-generated virtual environment
US10326978B2 (en)*2010-06-302019-06-18Warner Bros. Entertainment Inc.Method and apparatus for generating virtual or augmented reality presentations with 3D audio positioning
CN106484115B (en)*2011-10-282019-04-19奇跃公司 Systems and methods for augmented and virtual reality
US20150296247A1 (en)2012-02-292015-10-15ExXothermic, Inc.Interaction of user devices and video devices
US11102261B2 (en)*2013-03-142021-08-24Arris Enterprises LlcDevices, systems, and methods for converting or translating dynamic adaptive streaming over HTTP (DASH) to HTTP live streaming (HLS)
EP2830052A1 (en)*2013-07-222015-01-28Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.Audio decoder, audio encoder, method for providing at least four audio channel signals on the basis of an encoded representation, method for providing an encoded representation on the basis of at least four audio channel signals and computer program using a bandwidth extension
US20150302651A1 (en)*2014-04-182015-10-22Sam ShpigelmanSystem and method for augmented or virtual reality entertainment experience
CN106463148B (en)*2014-05-302019-10-01索尼公司 Information processing device and information processing method
US9787846B2 (en)*2015-01-212017-10-10Microsoft Technology Licensing, LlcSpatial audio signal processing for objects with associated audio content
WO2016138502A1 (en)*2015-02-272016-09-01Arris Enterprises, Inc.Adaptive joint bitrate allocation
GB2536025B (en)*2015-03-052021-03-03Nokia Technologies OyVideo streaming method
KR102351060B1 (en)2015-09-162022-01-12매직 립, 인코포레이티드 Mixing Head Pose of Audio Files
US20170109131A1 (en)*2015-10-202017-04-20Bragi GmbHEarpiece 3D Sound Localization Using Mixed Sensor Array for Virtual Reality System and Method
US10229540B2 (en)2015-12-222019-03-12Google LlcAdjusting video rendering rate of virtual reality content and processing of a stereoscopic image
WO2017120681A1 (en)*2016-01-152017-07-20Michael GodfreyMethod and system for automatically determining a positional three dimensional output of audio information based on a user's orientation within an artificial immersive environment
US10229541B2 (en)2016-01-282019-03-12Sony Interactive Entertainment America LlcMethods and systems for navigation within virtual reality space using head mounted display
US10291910B2 (en)*2016-02-122019-05-14Gopro, Inc.Systems and methods for spatially adaptive video encoding
US11017712B2 (en)*2016-08-122021-05-25Intel CorporationOptimized display image rendering
CN109891850B (en)*2016-09-092023-04-04Vid拓展公司Method and apparatus for reducing 360 degree view adaptive streaming media delay
CN106774891A (en)*2016-12-152017-05-31北京小鸟看看科技有限公司The audio effect generating method of virtual reality scenario, equipment and virtual reality device
US10659906B2 (en)*2017-01-132020-05-19Qualcomm IncorporatedAudio parallax for virtual reality, augmented reality, and mixed reality
GB2560923A (en)*2017-03-282018-10-03Nokia Technologies OyVideo streaming
KR102517906B1 (en)*2017-06-152023-04-05돌비 인터네셔널 에이비 Method, apparatus and system for optimizing communication between transmitter and receiver in computer-assisted reality applications
US11164606B2 (en)*2017-06-302021-11-02Qualcomm IncorporatedAudio-driven viewport selection
WO2019007477A1 (en)*2017-07-032019-01-10Telefonaktiebolaget Lm Ericsson (Publ)Methods for personalized 360 video delivery
JP7187944B2 (en)2018-09-282022-12-13トヨタ自動車株式会社 Processing equipment and processing method

Also Published As

Publication numberPublication date
KR20240137132A (en)2024-09-19
BR112020008073A2 (en)2020-11-03
TW201924362A (en)2019-06-16
EP3695613A1 (en)2020-08-19
EP3695613B1 (en)2024-01-03
ZA202304926B (en)2024-07-31
AR125882A2 (en)2023-08-23
AU2018348762B2 (en)2023-08-10
CN116193212A (en)2023-05-30
RU2765569C1 (en)2022-02-01
US20220261215A1 (en)2022-08-18
AR125881A2 (en)2023-08-23
SG11202003269SA (en)2020-05-28
MX2023012966A (en)2023-11-15
AU2023263436A1 (en)2023-11-23
CN116193212B (en)2025-09-23
AU2018348762A1 (en)2020-05-07
CN116193213B (en)2025-09-23
KR20250033317A (en)2025-03-07
CA3230231A1 (en)2019-04-18
CN116193215A (en)2023-05-30
CA3230310A1 (en)2019-04-18
EP3695613C0 (en)2024-01-03
CA3230205A1 (en)2019-04-18
KR20200078537A (en)2020-07-01
MX2020003450A (en)2020-10-01
ZA202405290B (en)2025-05-28
ZA202208388B (en)2023-03-29
JP7655688B2 (en)2025-04-02
KR20230130729A (en)2023-09-12
ES2970490T3 (en)2024-05-29
JP2023116635A (en)2023-08-22
MX2023012963A (en)2023-11-15
SG10202106080XA (en)2021-07-29
AU2023263436B2 (en)2025-08-28
WO2019072984A1 (en)2019-04-18
CA3078858A1 (en)2019-04-18
PL3695613T3 (en)2024-06-17
KR102568373B1 (en)2023-08-18
EP4329319A3 (en)2024-04-24
CN111466122A (en)2020-07-28
US20200278828A1 (en)2020-09-03
CN111466122B (en)2023-02-28
TWI713911B (en)2020-12-21
CN116193213A (en)2023-05-30
MY205925A (en)2024-11-20
KR102707356B1 (en)2024-09-13
US11354084B2 (en)2022-06-07
JP2025090843A (en)2025-06-17
JP2020537418A (en)2020-12-17
CN116193214B (en)2025-09-05
CA3230221A1 (en)2019-04-18
CN116193215B (en)2025-09-23
MX2023012965A (en)2023-11-15
AR113357A1 (en)2020-04-22
EP4329319A2 (en)2024-02-28
AR125880A2 (en)2023-08-23
JP7295851B2 (en)2023-06-21
ZA202208364B (en)2023-03-29
AR125884A2 (en)2023-08-23
CN116193214A (en)2023-05-30
CA3230304A1 (en)2019-04-18
RU2750505C1 (en)2021-06-29
MX2023012967A (en)2023-11-15
MX2023012964A (en)2023-11-15
US12411648B2 (en)2025-09-09
KR102774081B1 (en)2025-02-26
AR125883A2 (en)2023-08-23

Similar Documents

PublicationPublication DateTitle
ZA202405290B (en)Optimizing audio delivery for virtual reality applications
MY203373A (en)Method and apparatus for efficient delivery and usage of audio messages for high quality of experience
JP6735415B2 (en) Method and apparatus for controlled selection of viewing point and viewing orientation of audiovisual content
US10511767B2 (en)Information processing device, information processing method, and program
WO2014145307A3 (en)Provision of video conferencing services using reflector multipoint control units (mcu) and transcoder mcu combinations
US11438731B2 (en)Method and apparatus for incorporating location awareness in media content
WO2021061725A8 (en)Video-based point cloud streams
MX2012009358A (en)Systems and methods to provide trick play during streaming playback.
CN114223211A (en)Information processing apparatus, information processing method, and computer program
ZA202405288B (en)Optimizing audio delivery for virtual reality applications
US9813462B2 (en)Unified dynamic executable media playlists across connected endpoints
US20240276076A1 (en)Techniques for automatically personalizing media viewing experiences
US20230362421A1 (en)Aligning a plurality of variously encoded content streams
US20240276048A1 (en)Techniques for generating video tracks based on user preferences
KR20250149740A (en) Technologies to automatically personalize media viewing experiences
KR20250148650A (en) Techniques for switching between video tracks when playing media titles
WO2024173138A1 (en)Techniques for switching between video tracks when playing back a media title
CN114257835A (en)Live broadcast system based on education cloud platform and live broadcast method thereof
Van der MeerMotivation for a Systems Standard

[8]ページ先頭

©2009-2025 Movatter.jp