CN105100679B - Server and method for providing collaboration service and user terminal for receiving collaboration service - Google Patents

Abstract

Translated fromChinese

提供了用于提供协作服务的服务器、方法和装置。该服务器包括：存储器，被配置为存储计算机可执行指令；以及处理器，被配置为处理计算机可执行指令来提供包括显示用户的视频的第一区域和显示可编辑文档的第二区域的屏幕。处理器还被配置为处理计算机可执行指令来接收对视频的时间点的选择，以及按照与视频的所选择的时间点相对应的状态提供可编辑文档。

Servers, methods and apparatus for providing collaborative services are provided. The server includes: a memory configured to store computer-executable instructions; and a processor configured to process the computer-executable instructions to provide a screen including a first area displaying a video of a user and a second area displaying an editable document. The processor is also configured to process the computer-executable instructions to receive a selection of a time point of the video, and to provide the editable document in a state corresponding to the selected time point of the video.

Description

Translated fromChinese

提供协作服务的服务器和方法及接收协作服务的用户终端Server and method for providing collaboration service and user terminal for receiving collaboration service

相关申请的交叉引用CROSS-REFERENCE TO RELATED APPLICATIONS

本申请要求2014年5月23日在韩国知识产权局递交的韩国专利申请10-2014-0062625号、2014年12月1日在美国专利商标局递交的美国非临时专利申请14/556,616号、2015年2月6日在韩国知识产权局递交的韩国专利申请10-2015-0018870号和2015年5月6日在美国专利商标局递交的美国非临时专利申请14/705,147号的优先权，这里通过引用并入这些申请的全部公开内容用于所有目的。This application claims Korean Patent Application No. 10-2014-0062625, filed with the Korean Intellectual Property Office on May 23, 2014, and US Non-Provisional Patent Application No. 14/556,616, filed with the United States Patent and Trademark Office on December 1, 2014, and 2015 Priority of Korean Patent Application No. 10-2015-0018870, filed with the Korean Intellectual Property Office on Feb. 6, 2015 and U.S. Non-Provisional Patent Application No. 14/705,147, filed with the U.S. Patent and Trademark Office on May 6, 2015, hereby The entire disclosures of these applications are incorporated by reference for all purposes.

技术领域technical field

示范性实施例的一些方面涉及用于提供协作服务(collaboration service)的方法和服务器和用于请求协作服务的用户终端。Some aspects of the exemplary embodiments relate to methods and servers for providing collaboration services and user terminals for requesting collaboration services.

背景技术Background technique

由于科学和技术的进步，诸如智能电话、平板PC、桌面型计算机、膝上型计算机等等之类的各种类型的用户终端正在改进并变得更加精良。用户终端已演进成了高端多媒体设备，这些设备能够连接到网络以搜索因特网上的信息并且发送或接收文件以及捕捉和重放照片或运动图像。Due to advances in science and technology, various types of user terminals such as smart phones, tablet PCs, desktop computers, laptop computers, and the like are improving and becoming more sophisticated. User terminals have evolved into high-end multimedia devices capable of connecting to a network to search for information on the Internet and send or receive files and capture and playback photos or moving images.

随着用户终端的发展，对云计算的需求正在增大。云计算指的是允许用户将信息存储在因特网上的服务器中并在任何时间从任何地方经由用户终端访问服务器以使用存储的信息的技术。为了满足对云计算的这种增大的需求，各种各样的使用云计算的应用正被开发。With the development of user terminals, the demand for cloud computing is increasing. Cloud computing refers to a technology that allows a user to store information in a server on the Internet and access the server from anywhere at any time via a user terminal to use the stored information. In order to meet this increasing demand for cloud computing, various applications using cloud computing are being developed.

用户终端和云计算技术的进步允许了多个用户利用其终端连接到服务器并且执行相同应用或访问相同信息。Advances in user terminals and cloud computing technologies allow multiple users to connect to a server using their terminals and execute the same applications or access the same information.

发明内容SUMMARY OF THE INVENTION

示范性实施例的一些方面包括一种用于提供协作服务的方法和服务器和用于接收协作服务的用户终端，这些协作服务允许了用户协作地编辑文档，其方式是通过将基于与每个用户相关联的视频呼叫图像中包括的语音生成的会议纪要同步到被协作编辑的文档，以使得用户在协作编辑文档的同时识别情境信息。Aspects of the exemplary embodiments include a method and server for providing collaborative services, and user terminals for receiving collaborative services that allow users to collaboratively edit documents by The speech-generated meeting minutes included in the associated video call image are synchronized to the collaboratively edited document to allow users to identify contextual information while collaboratively editing the document.

另外的方面一部分将在接下来的描述中记载，一部分将从描述中清楚显现，或者可通过实践给出的示范性实施例来获知。Additional aspects will be described in part in the description that follows, in part will be apparent from the description, or may be learned by practice of the exemplary embodiments given.

根据示范性实施例的一方面，一种用于提供允许用户编辑文档的协作服务的服务器包括：通信单元，用于从请求协作服务的用户终端接收与编辑文档的每个用户相关联的视频呼叫图像和关于被编辑的文档的编辑信息；控制器，用于将基于与每个用户相关联的视频呼叫图像中包括的语音生成的会议纪要的细节与根据编辑信息编辑的文档同步；以及存储器，用于存储会议纪要的细节和文档。According to an aspect of an exemplary embodiment, a server for providing a collaboration service allowing users to edit a document includes a communication unit for receiving a video call associated with each user editing a document from a user terminal requesting the collaboration service an image and editing information about the edited document; a controller for synchronizing the details of the meeting minutes generated based on the voice included in the video call image associated with each user with the document edited according to the editing information; and a memory, Details and documents for storing meeting minutes.

根据示范性实施例的一方面，一种提供允许用户编辑文档的协作服务的方法包括：从请求协作服务的用户终端接收与编辑文档的每个用户相关联的视频呼叫图像和关于被编辑的文档的编辑信息；将基于与每个用户相关联的视频呼叫图像中包括的语音生成的会议纪要的细节与根据接收到的编辑信息编辑的文档同步；以及存储会议纪要的细节和文档。According to an aspect of an exemplary embodiment, a method of providing a collaboration service that allows a user to edit a document includes receiving, from a user terminal requesting the collaboration service, a video call image associated with each user editing the document and information about the edited document editing information; synchronizing the details of the meeting minutes generated based on the voice included in the video call image associated with each user with the document edited according to the received editing information; and storing the details of the meeting minutes and the document.

根据示范性实施例的一方面，一种用于从提供允许用户编辑文档的协作服务的服务器接收协作服务的用户终端包括：音频/视频输入单元，用于输入用户的语音和视频；用户输入单元，用于接收关于被编辑的文档的编辑信息；控制器，其获取通过对用户的语音和视频执行信号处理而获得的视频呼叫图像和编辑信息；通信单元，其将所获取的视频呼叫图像和编辑信息发送到服务器，并且从服务器接收与编辑文档的每个用户相关联的视频呼叫图像、基于与每个用户相关联的视频呼叫图像中包括的语音生成的会议纪要和与会议纪要的细节同步的文档；以及输出单元，其输出接收到的与每个用户相关联的视频呼叫图像、会议纪要和文档。According to an aspect of an exemplary embodiment, a user terminal for receiving a collaboration service from a server providing a collaboration service allowing a user to edit a document includes: an audio/video input unit for inputting a user's voice and video; a user input unit , for receiving editing information about the edited document; a controller, which acquires a video call image and editing information obtained by performing signal processing on the user's voice and video; a communication unit, which combines the acquired video call image and Editing information is sent to the server, and video call images associated with each user editing the document, meeting minutes generated based on speech included in the video call images associated with each user, and details synchronized with the meeting minutes are received from the server documents; and an output unit that outputs the received video call images, meeting minutes, and documents associated with each user.

根据示范性实施例的一方面，提供了通过使基于与每个用户相关联的视频呼叫图像中包含的语音生成的会议纪要与被协作编辑的文档同步来便于用户对文档的协作编辑的协作服务，从而允许了用户在协作编辑文档的同时识别情境信息。According to an aspect of an exemplary embodiment, there is provided a collaboration service that facilitates collaborative editing of documents by users by synchronizing meeting minutes generated based on speech contained in a video call image associated with each user with the collaboratively edited document , allowing users to identify contextual information while collaboratively editing documents.

根据示范性实施例的一方面，提供了一种用于提供协作服务的服务器，该服务器包括：存储器，被配置为存储计算机可执行指令；以及处理器，被配置为处理计算机可执行指令来提供包括显示用户的视频的第一区域和显示可编辑文档的第二区域的屏幕。处理器还被配置为处理计算机可执行指令来接收对视频的时间点的选择，以及按照与视频的所选择的时间点相对应的状态提供可编辑文档。According to an aspect of the exemplary embodiments, there is provided a server for providing a collaboration service, the server comprising: a memory configured to store computer-executable instructions; and a processor configured to process the computer-executable instructions to provide A screen includes a first area displaying a video of the user and a second area displaying an editable document. The processor is also configured to process the computer-executable instructions to receive a selection of a point in time of the video, and to provide the editable document in a state corresponding to the selected point in time of the video.

处理器还可被配置为处理计算机可执行指令来接收对可编辑文档的编辑的选择，并且从与所选择的编辑相对应的时间点再现视频。The processor may also be configured to process computer-executable instructions to receive selections of edits to the editable document, and to reproduce video from a point in time corresponding to the selected edits.

屏幕还可包括第三区域，该第三区域显示与视频的时间点和可编辑文档的编辑相对应的项目的文本记录。The screen may also include a third area that displays a textual transcript of the item corresponding to the point in time of the video and the edit of the editable document.

处理器还可被配置为处理计算机可执行指令来接收从项目的文本记录中对项目的选择，从与所选择的项目相对应的时间点再现视频，并且按照与所选择的项目相对应的状态提供可编辑文档。The processor may also be configured to process computer-executable instructions to receive a selection of an item from a textual record of the item, reproduce video from a point in time corresponding to the selected item, and in accordance with a state corresponding to the selected item Provides editable documentation.

处理器还可被配置为处理计算机可执行指令来基于视频中的用户的语音生成项目的文本记录。The processor may also be configured to process computer-executable instructions to generate a textual transcript of the item based on the user's speech in the video.

处理器还可被配置为处理计算机可执行指令来基于用户对可编辑文档的编辑生成项目的文本记录。The processor may also be configured to process the computer-executable instructions to generate a textual record of the item based on the user's edits to the editable document.

可编辑文档可被显示在文字处理程序(word processing program)中。Editable documents can be displayed in word processing programs.

根据示范性实施例的一方面，提供了一种用于提供协作服务的方法，该方法包括显示包括显示用户的视频的第一区域和显示可编辑文档的第二区域的屏幕。该方法还包括接收对视频的时间点的选择，并且按照与视频的所选择的时间点相对应的状态显示可编辑文档。According to an aspect of an exemplary embodiment, there is provided a method for providing a collaboration service, the method comprising displaying a screen including a first area displaying a video of a user and a second area displaying an editable document. The method also includes receiving a selection of a time point of the video, and displaying the editable document in a state corresponding to the selected time point of the video.

该方法还可包括接收对可编辑文档的编辑的选择，并且从与所选择的编辑相对应的时间点再现视频。The method may also include receiving a selection of an edit of the editable document, and reproducing the video from a point in time corresponding to the selected edit.

屏幕还可包括第三区域，该第三区域显示与视频的时间点和可编辑文档的编辑相对应的项目的文本记录。The screen may also include a third area that displays a textual transcript of the item corresponding to the point in time of the video and the edit of the editable document.

该方法还可包括接收从项目的文本记录中对项目的选择，从与所选择的项目相对应的时间点再现视频，并且按照与所选择的项目相对应的状态提供可编辑文档。The method may also include receiving a selection of an item from a textual record of the item, reproducing the video from a point in time corresponding to the selected item, and providing the editable document in a state corresponding to the selected item.

该方法还可包括基于视频中的用户的语音生成项目的文本记录。The method may also include generating a textual transcript of the item based on the user's speech in the video.

该方法还可包括基于用户对可编辑文档的编辑生成项目的文本记录。The method may also include generating a textual record of the item based on the user's edits to the editable document.

一种非暂态计算机可读介质可包括可执行来执行该方法的计算机可读指令。A non-transitory computer readable medium may include computer readable instructions executable to perform the method.

根据示范性实施例的一方面，提供了一种用于提供协作服务的终端，该终端包括显示器，其被配置为显示包括显示用户的视频的第一区域和显示可编辑文档的第二区域的屏幕。该终端还包括：输入设备，被配置为接收对视频的时间点的选择；以及控制器，被配置为控制显示器按照与视频的所选择的时间点相对应的状态显示可编辑文档。According to an aspect of an exemplary embodiment, there is provided a terminal for providing a collaboration service, the terminal including a display configured to display a display including a first area displaying a video of a user and a second area displaying an editable document Screen. The terminal also includes: an input device configured to receive a selection of a time point of the video; and a controller configured to control the display to display the editable document in a state corresponding to the selected time point of the video.

输入设备还可被配置为接收对可编辑文档的编辑的选择，并且控制器还可被配置为控制显示器从与所选择的编辑相对应的时间点再现视频。The input device may also be configured to receive a selection of an edit of the editable document, and the controller may be further configured to control the display to reproduce video from a point in time corresponding to the selected edit.

输入设备还可被配置为接收从项目的文本记录中对项目的选择，并且控制器还可被配置为：控制显示器从与所选择的项目相对应的时间点再现视频，并且控制显示器按照与所选择的项目相对应的状态显示可编辑文档。The input device may also be configured to receive a selection of an item from the textual record of the item, and the controller may be further configured to: control the display to reproduce video from a point in time corresponding to the selected item, and control the display to follow the selected item. The status corresponding to the selected item displays the editable document.

项目的文本记录可以是基于视频中的用户的语音生成的。The textual transcript of the item may be generated based on the user's speech in the video.

项目的文本记录可以是基于用户对可编辑文档的编辑生成的。A textual record of an item may be generated based on a user's edits to an editable document.

根据示范性实施例的一方面，提供了一种用于提供协作服务的服务器，该服务器包括通信设备，其被配置为发送要显示的文档，并且接收对显示的文档的一部分的选择。服务器还包括控制器，其被配置为确定要显示的用户的视频的一部分和要显示的文本项目的一部分，视频的该部分和文本项目的该部分对应于显示的文档的所选择部分。According to an aspect of an exemplary embodiment, there is provided a server for providing a collaboration service, the server comprising a communication device configured to transmit a document to be displayed and to receive a selection of a portion of the displayed document. The server also includes a controller configured to determine a portion of the user's video to be displayed and a portion of the text item to be displayed, the portion of the video and the portion of the text item corresponding to the selected portion of the displayed document.

通信设备还可被配置为发送要显示的视频，并且接收对显示的视频的另一部分的选择，并且控制器还可被配置为确定要显示的文档的另一部分和要显示的文本项目的另一部分，文档的该另一部分和文本项目的该另一部分对应于显示的视频的所选择的另一部分。The communication device may also be configured to transmit the video to be displayed and receive a selection of another portion of the displayed video, and the controller may be further configured to determine another portion of the document to be displayed and another portion of the text item to be displayed , the other part of the document and the other part of the text item correspond to the selected other part of the displayed video.

通信设备还可被配置为发送要显示的文本项目，并且接收对显示的文本项目的另一部分的选择，并且控制器还可被配置为确定要显示的视频的另一部分和要显示的文档的另一部分，视频的该另一部分和文档的该另一部分对应于显示的文本项目的所选择的另一部分。The communication device may also be configured to transmit a text item to be displayed and receive a selection of another portion of the displayed text item, and the controller may be further configured to determine another portion of the video to be displayed and another portion of the document to be displayed. The part, the other part of the video and the other part of the document correspond to the selected other part of the displayed text item.

附图说明Description of drawings

通过以下结合附图对示范性实施例的描述，这些和/或其他方面将变得清楚并且更容易领会，附图中：These and/or other aspects will be apparent and more readily appreciated from the following description of the exemplary embodiments, taken in conjunction with the accompanying drawings, in which:

图1图示了用于提供协作服务的环境；Figure 1 illustrates an environment for providing collaborative services;

图2是根据示范性实施例的用户终端的配置的框图；2 is a block diagram of a configuration of a user terminal according to an exemplary embodiment;

图3是根据示范性实施例的用于提供协作服务的服务器的配置的框图；3 is a block diagram of a configuration of a server for providing collaboration services according to an exemplary embodiment;

图4根据示范性实施例图示了用于提供协作服务的服务器的控制器；4 illustrates a controller of a server for providing collaborative services, according to an exemplary embodiment;

图5根据示范性实施例图示了可被包括在用于提供协作服务的服务器的控制器中的图像管理处理器；5 illustrates an image management processor that may be included in a controller of a server for providing collaborative services, according to an exemplary embodiment;

图6根据示范性实施例图示了可被存储在用于提供协作服务的服务器的存储器中的综合管理数据库(DB)；6 illustrates an integrated management database (DB) that may be stored in a memory of a server for providing collaborative services, according to an exemplary embodiment;

图7根据示范性实施例图示了可被存储在用于提供协作服务的服务器的存储器中的用户信息DB；7 illustrates a user information DB that may be stored in a memory of a server for providing collaborative services, according to an exemplary embodiment;

图8根据示范性实施例图示了可被存储在用于提供协作服务的服务器的存储器中的文档DB；8 illustrates a document DB that may be stored in a memory of a server for providing collaboration services, according to an exemplary embodiment;

图9根据示范性实施例图示了可被存储在用于提供协作服务的服务器的存储器中的图像DB；9 illustrates an image DB that may be stored in a memory of a server for providing collaborative services, according to an exemplary embodiment;

图10是根据另一示范性实施例图示出用于提供协作服务的服务器被实现为多个分散服务器的图；10 is a diagram illustrating that a server for providing collaborative services is implemented as a plurality of distributed servers, according to another exemplary embodiment;

图11是根据另一示范性实施例的作为用于提供协作服务的分散服务器之一的综合管理服务器的框图；11 is a block diagram of an integrated management server as one of the distributed servers for providing collaborative services, according to another exemplary embodiment;

图12是根据另一示范性实施例的作为用于提供协作服务的分散服务器之一的用户管理服务器的框图；12 is a block diagram of a user management server as one of decentralized servers for providing collaborative services, according to another exemplary embodiment;

图13是根据另一示范性实施例的作为用于提供协作服务的分散服务器之一的文档管理服务器的框图；13 is a block diagram of a document management server as one of decentralized servers for providing collaboration services, according to another exemplary embodiment;

图14是根据另一示范性实施例的作为用于提供协作服务的分散服务器之一的图像管理服务器的框图；14 is a block diagram of an image management server as one of decentralized servers for providing collaborative services, according to another exemplary embodiment;

图15根据示范性实施例图示了在利用用于提供协作服务的服务器处理文档的同时根据对执行协作服务的请求发起协作服务的过程；15 illustrates a process of initiating a collaboration service according to a request to execute the collaboration service while processing a document with a server for providing the collaboration service, according to an exemplary embodiment;

图16根据示范性实施例图示了用于接收协作服务的用户终端请求执行协作服务的示例；16 illustrates an example in which a user terminal for receiving a collaborative service requests to perform a collaborative service, according to an exemplary embodiment;

图17根据示范性实施例图示了用于接收协作服务的用户终端请求创建群组的示例；17 illustrates an example of a user terminal requesting to create a group for receiving collaborative services, according to an exemplary embodiment;

图18根据示范性实施例图示了用于接收协作服务的用户终端执行群组成员的管理的示例；18 illustrates an example in which a user terminal for receiving a collaboration service performs management of group members, according to an exemplary embodiment;

图19根据示范性实施例图示了当在文档被处理的同时发起协作服务以使得用户终端准备好协作地编辑文档时每个用户终端的状态；19 illustrates the state of each user terminal when a collaboration service is initiated while the document is being processed to prepare the user terminal to collaboratively edit the document, according to an exemplary embodiment;

图20根据示范性实施例图示了在用于接收协作服务的用户终端上显示包括地址窗口和菜单的用户界面和视频呼叫图像的方法；20 illustrates a method of displaying a user interface including an address window and a menu and a video call image on a user terminal for receiving a collaboration service, according to an exemplary embodiment;

图21根据示范性实施例图示了在用于接收协作服务的用户终端上显示视频呼叫图像的方法；21 illustrates a method of displaying a video call image on a user terminal for receiving a collaboration service, according to an exemplary embodiment;

图22根据示范性实施例图示了在用于接收协作服务的用户终端上显示视频呼叫图像的另一方法；22 illustrates another method of displaying a video call image on a user terminal for receiving collaborative services, according to an exemplary embodiment;

图23根据示范性实施例图示了利用用于提供协作服务的服务器在视频会议期间根据对执行协作服务的请求发起协作服务的过程；23 illustrates a process for initiating a collaboration service during a video conference based on a request to perform a collaboration service using a server for providing collaboration services, according to an exemplary embodiment;

图24根据示范性实施例图示了在作出对执行协作服务的请求之前在用于接收协作服务的用户终端中执行视频会议的示例；24 illustrates an example of performing a video conference in a user terminal for receiving a collaborative service before making a request to perform a collaborative service, according to an exemplary embodiment;

图25根据示范性实施例图示了在用于接收协作服务的用户终端中在作出对执行协作服务的请求之前选择在视频会议期间共享的文档的过程；25 illustrates a process of selecting a document to be shared during a video conference before making a request to perform a collaboration service in a user terminal for receiving a collaboration service, according to an exemplary embodiment;

图26根据示范性实施例图示了在作出对执行协作服务的请求之前在用于接收协作服务的用户终端上显示在视频会议中共享的文档的示例；26 illustrates an example of displaying a document shared in a video conference on a user terminal for receiving a collaboration service before a request to perform a collaboration service is made, according to an exemplary embodiment;

图27根据示范性实施例图示了用于接收协作服务的用户终端在视频会议期间请求执行协作服务的示例；27 illustrates an example in which a user terminal for receiving a collaboration service requests execution of a collaboration service during a video conference, according to an exemplary embodiment;

图28根据示范性实施例图示了当在视频会议期间发起协作服务以使得每个用户终端准备好协作地编辑文档时每个用户终端的状态；28 illustrates the state of each user terminal when a collaboration service is initiated during a video conference to prepare each user terminal to collaboratively edit a document, according to an exemplary embodiment;

图29根据示范性实施例图示了在用于提供协作服务的服务器中从视频呼叫图像生成示出会议的纪要(以下称为会议纪要)的图像并将会议纪要发送到每个用户终端的过程；29 illustrates a process of generating an image showing the minutes of a meeting (hereinafter referred to as meeting minutes) from a video call image and transmitting the meeting minutes to each user terminal in a server for providing a collaboration service, according to an exemplary embodiment ;

图30根据示范性实施例图示了在每个用于接收协作服务的用户终端上显示会议纪要的示例；30 illustrates an example of displaying meeting minutes on each user terminal for receiving collaboration services, according to an exemplary embodiment;

图31根据示范性实施例图示了在每个用于接收协作服务的用户终端上显示会议纪要的另一示例；31 illustrates another example of displaying meeting minutes on each user terminal for receiving collaboration services, according to an exemplary embodiment;

图32根据示范性实施例图示了向用于提供协作服务的服务器请求管理群组成员和彼此协作的群组的过程；32 illustrates a process of requesting a server for providing collaboration services to manage group members and groups that collaborate with each other, according to an exemplary embodiment;

图33根据示范性实施例图示了在用于接收协作服务的用户终端中设定关于每个群组成员的信息的示例；33 illustrates an example of setting information on each group member in a user terminal for receiving a collaboration service, according to an exemplary embodiment;

图34根据示范性实施例图示了在用于接收协作服务的用户终端中将当前群组分割成多个群组的示例；34 illustrates an example of dividing a current group into a plurality of groups in a user terminal for receiving collaborative services, according to an exemplary embodiment;

图35图示了在当前群组被分割成多个群组时每个用户终端的状态；35 illustrates the state of each user terminal when the current group is divided into a plurality of groups;

图36根据示范性实施例图示了在用于提供协作服务的服务器中限制正被协作编辑的文档的编辑范围的过程；36 illustrates a process of limiting the editing scope of a document being collaboratively edited in a server for providing collaboration services, according to an exemplary embodiment;

图37根据示范性实施例图示了在用于接收协作服务的用户终端中由第一用户锁定第一编辑范围的示例；37 illustrates an example of locking a first editing range by a first user in a user terminal for receiving a collaboration service, according to an exemplary embodiment;

图38根据示范性实施例图示了在用于接收协作服务的用户终端中由第二用户锁定第二编辑范围的示例；38 illustrates an example of locking a second editing range by a second user in a user terminal for receiving a collaboration service, according to an exemplary embodiment;

图39根据示范性实施例图示了在用于接收协作服务的用户终端中由第三用户锁定第三编辑范围的示例；39 illustrates an example in which a third editing range is locked by a third user in a user terminal for receiving a collaboration service, according to an exemplary embodiment;

图40根据示范性实施例图示了在用于接收协作服务的用户终端中对于页中的多个区域锁定第一至第三编辑范围的示例；40 illustrates an example of locking the first to third editing ranges for a plurality of regions in a page in a user terminal for receiving a collaboration service, according to an exemplary embodiment;

图41根据示范性实施例图示了在用于提供协作服务的服务器中协作地编辑文档的过程；41 illustrates a process for collaboratively editing a document in a server for providing collaboration services, according to an exemplary embodiment;

图42根据示范性实施例图示了在用于接收协作服务的用户终端中由第一用户编辑被协作编辑的文档的示例；42 illustrates an example of editing a collaboratively edited document by a first user in a user terminal for receiving collaborative services, according to an exemplary embodiment;

图43根据示范性实施例图示了在用于接收协作服务的用户终端中由第二用户编辑被协作编辑的文档的示例；43 illustrates an example of editing a collaboratively edited document by a second user in a user terminal for receiving collaborative services, according to an exemplary embodiment;

图44根据示范性实施例图示了在用于接收协作服务的用户终端中利用会议纪要来识别正被协作编辑的文档的编辑信息的示例；44 illustrates an example of identifying editing information of a document being collaboratively edited using meeting minutes in a user terminal for receiving collaboration services, according to an exemplary embodiment;

图45根据示范性实施例图示了在用于接收协作服务的用户终端中利用会议纪要来编辑被协作编辑的文档的示例；45 illustrates an example of editing a collaboratively edited document using meeting minutes in a user terminal for receiving collaborative services, according to an exemplary embodiment;

图46根据示范性实施例图示了如下示例：在用于接收协作服务的用户终端中，对于正被协作编辑的文档的图像、视频呼叫图像和会议纪要中的每一者设定设备以便利用向用户终端注册的其他设备分开显示这些图像；FIG. 46 illustrates an example in which, in a user terminal for receiving a collaboration service, a device is set for each of an image of a document being collaboratively edited, a video call image, and a meeting minutes so as to utilize, according to an exemplary embodiment. display these images separately from other devices registered with the user terminal;

图47根据示范性实施例图示了在多个设备上分开显示正被协作编辑的文档、视频呼叫图像和会议纪要的示例；47 illustrates an example of separate display of documents being collaboratively edited, video call images, and meeting minutes on multiple devices, according to an exemplary embodiment;

图48根据示范性实施例图示了通过向用于提供协作服务的服务器请求终止协作服务来终止协作服务并将协作编辑的文档发送到另一用户终端的过程；48 illustrates a process of terminating a collaboration service and sending a collaboratively edited document to another user terminal by requesting a server for providing collaboration services to terminate the collaboration service, according to an exemplary embodiment;

图49根据示范性实施例图示了用于审查的文档、用于审查的视频呼叫图像和用于审查的会议纪要被彼此同步的示例；49 illustrates an example in which documents for review, video call images for review, and meeting minutes for review are synchronized with each other, according to an exemplary embodiment;

图50根据示范性实施例图示了向用于提供协作服务的服务器请求用于审查的文档并且审查文档的编辑的过程；50 illustrates a process of requesting a document for review from a server for providing collaboration services and reviewing edits of the document, according to an exemplary embodiment;

图51根据示范性实施例图示了如下示例：当用于审查的文档的被编辑部分被选择时，均与所选择的被编辑部分同步的用于审查的会议纪要和用于审查的视频呼叫图像在用于接收协作服务的用户终端中被输出；51 illustrates an example of a meeting minutes for review and a video call for review, both synchronized with the selected edited portion when an edited portion of a document for review is selected, according to an exemplary embodiment the image is output in the user terminal for receiving the collaboration service;

图52根据示范性实施例图示了向用于提供协作服务的服务器请求用于审查的视频呼叫图像并且审查文档的编辑的过程；52 illustrates a process of requesting a video call image for review from a server for providing collaboration services and reviewing editing of a document, according to an exemplary embodiment;

图53根据示范性实施例图示了如下示例：当用于审查的视频呼叫图像的要被再现的一部分被选择时，均与所选择的被再现部分同步的用于审查的会议纪要和用于审查的文档在用于接收协作服务的用户终端中被输出；FIG. 53 illustrates an example in which, when a portion of a video call image for review to be reproduced is selected, meeting minutes for review and The reviewed document is output in the user terminal for receiving the collaboration service;

图54根据示范性实施例图示了向用于提供协作服务的服务器请求用于审查的会议纪要并审查文档的编辑的过程；54 illustrates a process of requesting meeting minutes for review from a server for providing collaboration services and reviewing edits of documents, according to an exemplary embodiment;

图55根据示范性实施例图示了如下示例：当用于审查的会议纪要中的文本被选择时，均与所选择的文本同步的用于审查的视频呼叫图像和用于审查的文档在用于接收协作服务的用户终端中被输出；55 illustrates an example in which, when text in the meeting minutes for review is selected, a video call image for review and a document for review, both synchronized with the selected text, are in use, according to an exemplary embodiment. is output in the user terminal that receives the collaboration service;

图56是根据示范性实施例的提供协作服务的方法的流程图；并且FIG. 56 is a flowchart of a method of providing a collaborative service according to an exemplary embodiment; and

图57是根据示范性实施例的接收协作服务的方法的流程图。FIG. 57 is a flowchart of a method of receiving a collaboration service according to an exemplary embodiment.

具体实施方式Detailed ways

现在将详细谈及实施例，实施例的示例在附图中图示，附图中相似的标号始终指代相似的元素。在此，当前实施例是被提供来使得本公开将会透彻且完整，而不应当被解释为限于本文记载的描述。从而，下面仅仅是参考附图描述示范性实施例以说明本描述的各方面。本领域普通技术人员从描述及其示范性实施例容易推断出的变体或组合被视为在发明构思的范围内。诸如“…中的至少一个”之类的表述当在元素的列表之前时修饰整个元素列表，而不修饰列表中的个体元素。Reference will now be made in detail to the embodiments, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout. Here, the current embodiments are provided so that this disclosure will be thorough and complete, and should not be construed as limited to the descriptions set forth herein. Accordingly, exemplary embodiments are merely described below with reference to the figures to illustrate aspects of the present description. Variations or combinations that can be easily inferred by one of ordinary skill in the art from the description and the exemplary embodiments thereof are deemed to be within the scope of the inventive concept. Expressions such as "at least one of" when preceding a list of elements modify the entire list of elements, but not individual elements in the list.

还应理解，术语“包括”当在本说明书中使用时规定了所述元素、组件、步骤和/或操作的存在，但并不排除一个或多个元素、组件、步骤和/或操作的存在或添加。It will also be understood that the term "comprising" when used in this specification specifies the presence of stated elements, components, steps and/or operations, but does not exclude the presence of one or more elements, components, steps and/or operations or add.

另外，应理解，虽然本文中可使用术语“第一”、“第二”等等来描述各种元素和/或组件，但这些元素和/或组件不应当受这些术语所限。这些术语只是用于区分一个元素或组件与另一元素或组件。In addition, it should be understood that, although the terms "first," "second," etc. may be used herein to describe various elements and/or components, these elements and/or components should not be limited by these terms. These terms are only used to distinguish one element or component from another.

当前实施例涉及用于提供协作服务的方法和服务器和用于接收协作服务的用户终端，并且在本文中省略对本领域技术人员公知的功能或构造的详细描述。The current embodiment relates to a method and a server for providing a collaboration service and a user terminal for receiving the collaboration service, and detailed descriptions of functions or configurations known to those skilled in the art are omitted herein.

图1图示了用于提供协作服务的环境。Figure 1 illustrates an environment for providing collaborative services.

协作服务指的是当多个用户彼此协作来执行追求相同目标的特定任务时向这些用户提供的一类服务。在允许多个用户协作编辑文档的协作服务中，用于协作用户之间的通信的文档编辑程序或工具可作为一类协作服务被提供给用户。在此情况下，被协作编辑的文档可以是在用于提供协作服务的服务器100上可执行的任何种类的文档，无论其类型或内容如何。例如，该文档可包含文本或多媒体内容。Collaborative services refer to a class of services provided to multiple users when they collaborate with each other to perform specific tasks in pursuit of the same goal. In a collaboration service that allows multiple users to collaboratively edit a document, a document editing program or tool for communication between the collaborating users may be provided to the users as a type of collaboration service. In this case, the collaboratively edited document may be any kind of document executable on theserver 100 for providing collaborative services, regardless of its type or content. For example, the document may contain text or multimedia content.

服务器100可以是用于存储允许每个用户与其他用户协作的各种类型的应用和数据的服务器。服务器100既可执行局域通信也可执行远程通信。服务器100也可经由网络连接到多个用户终端200。Theserver 100 may be a server for storing various types of applications and data that allow each user to collaborate with other users. Theserver 100 can perform both local communication and remote communication. Theserver 100 may also be connected to a plurality ofuser terminals 200 via a network.

用户终端200可以是可用于与服务器100连接的各种类型的用户设备。例如，用户终端200可以是能够与服务器100执行有线或无线通信的智能电话、平板PC、桌面型计算机或膝上型计算机。另外，用户终端200可以是被配置为捕捉和再现视频呼叫图像以允许协作编辑文档的用户参与视频会议的用户设备。Theuser terminal 200 may be various types of user equipment available for connection with theserver 100 . For example, theuser terminal 200 may be a smartphone, a tablet PC, a desktop computer, or a laptop computer capable of performing wired or wireless communication with theserver 100 . Additionally, theuser terminal 200 may be a user device configured to capture and reproduce video call images to allow users collaboratively editing a document to participate in a video conference.

在一个示范性实施例中，编辑文档可包括在文档、图像、视频、应用等等中添加、去除、修改和/或格式化文本、对象、图像、图形等等。然而，编辑不限于上述示范性实施例，而可包括对文档执行的其他操作。In one exemplary embodiment, editing a document may include adding, removing, modifying and/or formatting text, objects, images, graphics, etc. in the document, image, video, application, or the like. However, editing is not limited to the above-described exemplary embodiments, but may include other operations performed on documents.

在一个示范性实施例中，协作编辑可包括由多个用户同时或顺序地编辑文档，或者可既包括由多个用户同时编辑文档又包括由多个用户顺序地编辑文档。然而，协作编辑不限于上述示范性实施例，而可包括对文档执行的其他协作编辑。In one exemplary embodiment, collaborative editing may include concurrent or sequential editing of documents by multiple users, or may include both concurrent and sequential editing of documents by multiple users. However, the collaborative editing is not limited to the above-described exemplary embodiments, but may include other collaborative editing performed on documents.

图2是根据示范性实施例的用户终端200的配置的框图。本领域普通技术人员将会理解，用户终端200除了图2中所示的那些以外还可包括其他常见的组件。图2所示的组件中的每一个可根据实际实现的用户终端200的规格被集成、添加或省略。换言之，如果必要，两个或更多个组件可被组合成单个组件，或者单个组件可被分割成两个或更多个组件。FIG. 2 is a block diagram of a configuration of auser terminal 200 according to an exemplary embodiment. Those of ordinary skill in the art will understand that theuser terminal 200 may include other common components in addition to those shown in FIG. 2 . Each of the components shown in FIG. 2 may be integrated, added or omitted according to the specifications of theuser terminal 200 actually implemented. In other words, if necessary, two or more components may be combined into a single component, or a single component may be divided into two or more components.

参考图2，根据本实施例的用户终端200可包括控制器210、用户输入单元220(例如，用户输入)、音频/视频输入单元230(例如，音频/视频输入)、通信单元240(例如，通信器)和输出单元250(例如，输出)。2, theuser terminal 200 according to the present embodiment may include acontroller 210, a user input unit 220 (eg, user input), an audio/video input unit 230 (eg, audio/video input), a communication unit 240 (eg, communicator) and an output unit 250 (eg, output).

控制器210可控制显示单元251来显示存储在存储器(未示出)中的内容的一部分。或者，当用户在显示单元251的区域上执行操纵时，控制器210可执行与该操纵相对应的控制操作。Thecontroller 210 may control thedisplay unit 251 to display a part of the content stored in the memory (not shown). Alternatively, when the user performs manipulation on the area of thedisplay unit 251, thecontroller 210 may perform a control operation corresponding to the manipulation.

虽然在图2中未示出，但控制器210可包括从以下各项中选择的至少一者：随机访问存储器(RAM)、只读存储器(ROM)、中央处理单元(CPU)、图形处理单元(未示出)以及数据总线。RAM、ROM、CPU和图形处理单元(GPU)可经由数据总线连接到彼此。Although not shown in FIG. 2, thecontroller 210 may include at least one selected from random access memory (RAM), read only memory (ROM), central processing unit (CPU), graphics processing unit (not shown) and a data bus. RAM, ROM, CPU, and Graphics Processing Unit (GPU) may be connected to each other via a data bus.

CPU访问存储器(未示出)并且利用存储在存储器中的操作系统(O/S)执行启动。CPU还利用存储在存储器中的各种类型的程序、内容和数据来执行各种操作。The CPU accesses a memory (not shown) and performs booting with an operating system (O/S) stored in the memory. The CPU also performs various operations using various types of programs, contents and data stored in the memory.

ROM存储一组命令来启动系统。例如，当输入开启命令并且供应电力时，CPU根据ROM中存储的命令把存储器中存储的O/S拷贝到RAM中，执行O/S并且启动系统。当启动完成时，CPU把存储器中存储的各种程序拷贝到RAM中，执行被拷贝到RAM中的程序，并且执行各种操作。详细地说，GPU可生成屏幕，包括诸如内容、图标和菜单之类的各种对象的电子文档被显示在该屏幕上。GPU根据屏幕的布局计算要显示的每个对象的属性值，例如坐标值、形状、大小和颜色。GPU也可基于计算出的属性值创建包括对象的各种布局的屏幕。GPU创建的屏幕可被提供给显示单元251，以使得其被显示在显示单元251的每个区域上。ROM stores a set of commands to start the system. For example, when a power-on command is input and power is supplied, the CPU copies the O/S stored in the memory to the RAM according to the command stored in the ROM, executes the O/S, and starts the system. When the startup is completed, the CPU copies various programs stored in the memory into the RAM, executes the programs copied into the RAM, and performs various operations. In detail, the GPU may generate a screen on which electronic documents including various objects such as content, icons, and menus are displayed. The GPU calculates property values for each object to be displayed, such as coordinate values, shape, size, and color, based on the layout of the screen. The GPU may also create screens including various layouts of objects based on the calculated property values. The screen created by the GPU may be supplied to thedisplay unit 251 so that it is displayed on each area of thedisplay unit 251 .

控制器210控制视频处理器(未示出)和音频处理器(未示出)来分别处理在经由通信单元240接收的内容或存储器中存储的内容中包含的视频数据和音频数据。Thecontroller 210 controls a video processor (not shown) and an audio processor (not shown) to process video data and audio data contained in content received via thecommunication unit 240 or content stored in a memory, respectively.

用户输入单元220可从用户接收各种命令。用户输入单元220可包括从小键盘221、触摸面板223和笔识别面板225中选择的至少一者。Theuser input unit 220 may receive various commands from the user. Theuser input unit 220 may include at least one selected from akeypad 221 , atouch panel 223 and apen recognition panel 225 .

小键盘221可包括在用户终端200的主体的诸如前表面、侧表面和后表面之类的各种区域上提供的各种类型的键，例如机械按钮、滚轮等等。Thekeypad 221 may include various types of keys, such as mechanical buttons, scroll wheels, and the like, provided on various areas of the body of theuser terminal 200 such as the front, side, and rear surfaces.

触摸面板223可检测用户的触摸输入并且输出与检测到的触摸信号相对应的触摸事件值。当触摸面板223与显示面板(未示出)相组合以形成触摸屏(未示出)时，该触摸屏可被实现为各种类型的触摸传感器，例如电容式、电阻式和压电式触摸传感器。电容式触摸传感器使用覆盖在触摸屏的表面上的介电材料。当用户的身体的一部分触摸该触摸屏的表面时，电容式触摸传感器检测由用户的身体的该部分引起的微电并且计算触摸坐标。电阻式触摸传感器包括嵌入在触摸屏中的两个电极板。当用户触摸屏幕上的特定点时，上下电极板在触摸点处发生接触。电阻式触摸传感器检测由两个电极板的接触引起的电流并且计算触摸坐标。触摸屏上的触摸事件可大多利用人的手指来生成。然而，触摸事件也可经由可引起电容的变化的导电材料形成的物体来发生。Thetouch panel 223 may detect a user's touch input and output a touch event value corresponding to the detected touch signal. When thetouch panel 223 is combined with a display panel (not shown) to form a touch screen (not shown), the touch screen may be implemented as various types of touch sensors, such as capacitive, resistive, and piezoelectric touch sensors. Capacitive touch sensors use a dielectric material that covers the surface of the touch screen. When a part of the user's body touches the surface of the touch screen, the capacitive touch sensor detects the micro-electricity caused by the part of the user's body and calculates the touch coordinates. Resistive touch sensors include two electrode pads embedded in the touch screen. When the user touches a specific point on the screen, the upper and lower electrode pads make contact at the touch point. The resistive touch sensor detects the current caused by the contact of the two electrode plates and calculates the touch coordinates. Touch events on a touch screen can be mostly generated using human fingers. However, touch events can also occur via objects formed of conductive materials that can cause changes in capacitance.

笔识别面板225根据对触摸笔(例如，触控笔或数字化笔)的操纵感测笔的接近输入或触摸输入，并且输出与感测到的笔的接近输入或触摸输入相对应的笔接近事件或笔触摸事件。笔识别面板225可利用电磁谐振(Electro Magnetic Resonance，EMR)技术来实现，并且根据由笔的接近或触摸引起的电磁场的强度的变动来感测触摸输入或接近输入。具体而言，笔识别面板225可包括具有网格结构的电磁感应线圈传感器(未示出)和顺序地向电磁感应线圈传感器的环形线圈提供具有预定频率的交流(AC)信号的电信号处理器(未示出)。当其中具有谐振电路的笔被布置得靠近笔识别面板225的环形线圈时，从环形线圈发送的磁场基于笔的谐振电路中的相互电磁感应来生成电流。基于该电流从笔中的谐振电路的线圈创建感应场。笔识别面板225随后从处于信号接收状态中的环形线圈检测该感应场并且感测笔被保持紧邻和触摸的点的位置。笔识别面板225可被布置在显示面板下方并且具有充分的面积以便覆盖显示面板的显示区域。Thepen recognition panel 225 senses a proximity input or touch input of a pen according to manipulation of a touch pen (eg, a stylus pen or a digitizing pen), and outputs a pen proximity event corresponding to the sensed proximity input or touch input of the pen or pen touch events. Thepen recognition panel 225 may be implemented using Electro Magnetic Resonance (EMR) technology, and sense a touch input or a proximity input according to a change in the intensity of an electromagnetic field caused by the proximity or touch of the pen. Specifically, thepen recognition panel 225 may include an electromagnetic induction coil sensor (not shown) having a grid structure and an electrical signal processor sequentially supplying an alternating current (AC) signal having a predetermined frequency to a loop coil of the electromagnetic induction coil sensor (not shown). When a pen having a resonant circuit therein is disposed close to the loop coil of thepen recognition panel 225, the magnetic field transmitted from the loop coil generates current based on mutual electromagnetic induction in the pen's resonance circuit. Based on this current an induced field is created from the coils of the resonant circuit in the pen. Thepen recognition panel 225 then detects this inductive field from the loop coil in the signal receiving state and senses the position of the point where the pen is held next to and touched. Thepen recognition panel 225 may be arranged below the display panel and have a sufficient area to cover the display area of the display panel.

音频/视频输入单元230可包括麦克风231和拍摄单元233。麦克风231接收用户的语音或其他声音并将用户的语音或其他声音转换成音频数据。控制器210可将经由麦克风231输入的用户的语音用于视频会议，或者可将音频数据存储在存储器中。拍摄单元233可根据用户的控制拍摄静止或运动图像。拍摄单元233可利用多个相机来实现，例如前置相机和后置相机。The audio/video input unit 230 may include amicrophone 231 and a photographingunit 233 . Themicrophone 231 receives and converts the user's voice or other sounds into audio data. Thecontroller 210 may use the user's voice input via themicrophone 231 for the video conference, or may store audio data in the memory. The photographingunit 233 may photograph still or moving images according to a user's control. The photographingunit 233 may be implemented with a plurality of cameras, such as a front camera and a rear camera.

当音频/视频输入单元230包括麦克风231和拍摄单元233时，控制器210可利用经由麦克风231输入的用户的语音和由拍摄单元233识别的用户的视频来生成视频呼叫图像。When the audio/video input unit 230 includes themicrophone 231 and the photographingunit 233 , thecontroller 210 may generate a video call image using the user's voice input via themicrophone 231 and the user's video recognized by the photographingunit 233 .

用户终端200可在运动控制模式或语音控制模式中操作。当用户终端200在运动控制模式中操作时，控制器210可激活拍摄单元233来拍摄用户，跟踪用户的运动的变化，并且执行与该变化相对应的控制操作。当用户终端200在语音控制模式中操作时，控制器210分析经由麦克风231输入的用户的语音并且根据所分析的用户的语音来执行控制操作。Theuser terminal 200 may operate in a motion control mode or a voice control mode. When theuser terminal 200 operates in the motion control mode, thecontroller 210 may activate the photographingunit 233 to photograph the user, track changes in the user's motion, and perform control operations corresponding to the changes. When theuser terminal 200 operates in the voice control mode, thecontroller 210 analyzes the user's voice input via themicrophone 231 and performs a control operation according to the analyzed user's voice.

通信单元240可根据各种类型的通信方法与不同类型的外部设备执行通信。通信单元240可包括从无线保真(Wi-Fi)芯片241、蓝牙芯片243、近场通信(NFC)芯片245和无线通信芯片247中选择的至少一者。控制器210可经由通信单元240与各种外部设备通信。Thecommunication unit 240 may perform communication with various types of external devices according to various types of communication methods. Thecommunication unit 240 may include at least one selected from a wireless fidelity (Wi-Fi)chip 241 , aBluetooth chip 243 , a near field communication (NFC)chip 245 and awireless communication chip 247 . Thecontroller 210 may communicate with various external devices via thecommunication unit 240 .

Wi-Fi芯片241和蓝牙芯片243可分别利用Wi-Fi和蓝牙技术来执行通信。使用Wi-Fi芯片241或蓝牙芯片243的通信单元240可在发送或接收诸如服务集合标识符(SSID)或会话密钥之类的连接信息并利用连接信息建立通信连接之后发送或接收各种类型的信息。NFC芯片245指的是利用在包括135kHz、13.56MHz、433MHz、860至960MHz和2.45GHz在内的各种射频识别(RFID)频率带之中的13.56MHz频率带上操作的NFC技术来执行通信的芯片。无线通信芯片247指的是根据诸如电气与电子工程师学会(IEEE)、Zigbee、第三代(3G)、第三代合作伙伴计划(3GPP)和长期演进(LTE)之类的各种通信标准来执行通信的芯片。The Wi-Fi chip 241 and theBluetooth chip 243 may perform communication using Wi-Fi and Bluetooth technologies, respectively. Thecommunication unit 240 using the Wi-Fi chip 241 or theBluetooth chip 243 may transmit or receive various types of connection information such as a service set identifier (SSID) or a session key and establish a communication connection using the connection information. Information. TheNFC chip 245 refers to performing communication using NFC technology operating on a 13.56MHz frequency band among various radio frequency identification (RFID) frequency bands including 135kHz, 13.56MHz, 433MHz, 860 to 960MHz, and 2.45GHz chip. Thewireless communication chip 247 refers to a chip based on various communication standards such as Institute of Electrical and Electronics Engineers (IEEE), Zigbee, 3rd Generation (3G), 3rd Generation Partnership Project (3GPP), and Long Term Evolution (LTE). The chip that performs the communication.

输出单元250可包括显示单元251和扬声器253。Theoutput unit 250 may include adisplay unit 251 and aspeaker 253 .

显示单元251可包括显示面板(未示出)和用于控制显示面板的控制器(未示出)。显示面板的示例可包括液晶显示器(LCD)、有机发光二极管(OLED)显示器、有源矩阵OLED(AM-OLED)、等离子显示面板(PDP)和其他各种显示器。显示面板可形成为柔性的、透明的或可穿戴的显示器。显示单元251可与用户输入单元220的触摸面板223相组合以形成触摸屏(未示出)。例如，触摸屏可包括集成的模块，其中显示面板与触摸面板223相组合以形成分层结构。Thedisplay unit 251 may include a display panel (not shown) and a controller (not shown) for controlling the display panel. Examples of the display panel may include a liquid crystal display (LCD), an organic light emitting diode (OLED) display, an active matrix OLED (AM-OLED), a plasma display panel (PDP), and various other displays. The display panel can be formed as a flexible, transparent or wearable display. Thedisplay unit 251 may be combined with thetouch panel 223 of theuser input unit 220 to form a touch screen (not shown). For example, the touch screen may include an integrated module in which the display panel is combined with thetouch panel 223 to form a layered structure.

扬声器253可输出由音频处理器(未示出)生成的音频数据。Thespeaker 253 may output audio data generated by an audio processor (not shown).

用户终端200的上述组件可被赋予与上述那些不同的名称。另外，根据本实施例的用户终端200可包括上述组件中的至少一者。用户终端200可不包括这些组件中的一些或者可还包括额外的组件。用户终端200可通过使用上述组件中的至少一者来执行以下操作。The above-described components of theuser terminal 200 may be given names different from those described above. In addition, theuser terminal 200 according to the present embodiment may include at least one of the above-mentioned components. Theuser terminal 200 may not include some of these components or may also include additional components. Theuser terminal 200 may perform the following operations by using at least one of the above components.

用于从用于提供协作服务的服务器100接收协作服务的用户终端200经由音频/视频输入单元230接收用户的语音和视频并且经由用户输入单元220接收关于被协作编辑的文档的编辑信息。在示范性实施例中，利用文字处理程序、电子数据表程序、幻灯片程序、演示程序、动画程序、图形程序、笔记记录程序、记事本程序和其他类似的程序中的一个或多个来协作地编辑文档。编辑信息可包括用于编辑文档的信息，并且可包括例如从以下各项中选择的至少一者：文本信息、图像信息、表格信息、拷贝信息、粘贴信息、字间距信息、行间距信息、字大小信息、颜色信息和与文档的编辑有关的其他各种信息。Theuser terminal 200 for receiving the collaboration service from the server for providingcollaboration service 100 receives the user's voice and video via the audio/video input unit 230 and editing information on the collaboratively edited document via theuser input unit 220 . In an exemplary embodiment, one or more of a word processing program, a spreadsheet program, a slideshow program, a presentation program, an animation program, a graphics program, a note-taking program, a notepad program, and other similar programs are used to collaborate to edit the document. The editing information may include information for editing the document, and may include, for example, at least one selected from the following: text information, image information, table information, copy information, paste information, letter spacing information, line spacing information, word spacing information Size information, color information, and various other information related to the editing of the document.

用户终端200的控制器210可获取通过对用户的语音和视频执行信号处理而获得的视频呼叫图像和编辑信息，并将视频呼叫图像和编辑信息发送到服务器100。通信单元240从服务器100接收与协作编辑文档的每个用户相关联的视频呼叫图像、示出基于与每个用户相关联的视频呼叫图像中包括的语音生成的会议的纪要(以下称为“会议纪要”)的图像和与会议纪要同步的正被协作编辑的文档。输出单元250输出接收到的与每个用户相关联的视频呼叫图像、会议纪要和正被协作编辑的文档。会议纪要可以是作为包括从关于会议的文本、包括关于会议的文本的文档和图表中选择的至少一者的图像输出的信息。另外，会议纪要可包括基于用户的语音生成的文本、生成每个文本的时间的时间信息和提供给用户的协作编辑文档的页信息，该用户在文本被生成时说出该文本。换言之，会议纪要的细节可包括从文本、时间信息、页信息和图像信息中选择的至少一者。Thecontroller 210 of theuser terminal 200 may acquire a video call image and editing information obtained by performing signal processing on the user's voice and video, and transmit the video call image and editing information to theserver 100 . Thecommunication unit 240 receives, from theserver 100, a video call image associated with each user who collaboratively edits a document, a summary showing a meeting generated based on the voice included in the video call image associated with each user (hereinafter referred to as a "meeting"). Minutes”) and the document being collaboratively edited in sync with the meeting minutes. Theoutput unit 250 outputs the received video call image, meeting minutes, and document being collaboratively edited in association with each user. The meeting minutes may be information output as an image including at least one selected from text about the meeting, a document including the text about the meeting, and a diagram. In addition, the meeting minutes may include texts generated based on the user's voice, time information of the time each text was generated, and page information of the collaboratively edited document provided to the user who spoke the text as it was generated. In other words, the details of the meeting minutes may include at least one selected from text, time information, page information, and image information.

在一个示范性实施例中，文档的编辑可由相应的指示符来指示，该指示符可以是标记、高亮、对象、图标或来自视频呼叫图像的图像中的一个或多个，所述图像例如是用户的缩略图像。In one exemplary embodiment, editing of the document may be indicated by a corresponding indicator, which may be one or more of a marker, highlight, object, icon, or image from a video call image, such as is the user's thumbnail image.

此外，由于会议纪要和文档是彼此同步的，所以对于会议纪要和文档中的至少一者的用户输入可伴随着另一者中的变化。例如，通信单元240可以把关于用户从会议纪要中选择的文本的信息发送到服务器100，并且响应于该发送，接收关于与被选择文本同步的文档的被编辑部分的信息。输出单元250随后可输出与被选择文本同步的文档的被编辑部分。Furthermore, because the meeting minutes and documents are synchronized with each other, user input to at least one of the meeting minutes and documents may be accompanied by changes in the other. For example, thecommunication unit 240 may transmit information about the text selected by the user from the meeting minutes to theserver 100 and, in response to the transmission, receive information about the edited portion of the document synchronized with the selected text. Theoutput unit 250 may then output the edited portion of the document synchronized with the selected text.

会议纪要可以是基于视频中的用户的语音生成的项目的文本记录。会议纪要也可以是基于用户对可编辑文档的编辑生成的项目的文本记录。The meeting minutes may be a textual recording of the item generated based on the user's speech in the video. The meeting minutes may also be textual records of items generated based on user edits to editable documents.

图3是根据示范性实施例的用于提供协作服务的服务器100的配置的框图。本领域普通技术人员将会理解，服务器100除了图3中所示的那些以外还可包括其他常见的组件。根据服务器100的实际实现，图3所示的每个组件可被集成、添加或省略。换言之，如果必要，两个或更多个组件可被组合成单个组件，或者单个组件可被分割成两个或更多个组件。FIG. 3 is a block diagram of a configuration of aserver 100 for providing a collaboration service according to an exemplary embodiment. Those of ordinary skill in the art will appreciate thatserver 100 may include other common components in addition to those shown in FIG. 3 . Depending on the actual implementation of theserver 100, each component shown in FIG. 3 may be integrated, added, or omitted. In other words, if necessary, two or more components may be combined into a single component, or a single component may be divided into two or more components.

通信单元110可与包括用户终端(图2中的200)在内的外部设备执行通信。例如，用于提供允许对文档的协作编辑的协作服务的服务器100可从用户终端200接收与协作服务有关的各种请求，包括对发起协作服务的请求，创建协作工作环境所必要的设定信息，和关于被协作编辑的文档的编辑信息。另外，响应于与协作服务有关的各种请求，服务器100可提供与协作服务的提供有关的所有事项。Thecommunication unit 110 may perform communication with external devices including a user terminal (200 in FIG. 2). For example, theserver 100 for providing a collaboration service allowing collaborative editing of a document may receive various requests related to the collaboration service from theuser terminal 200, including a request to initiate a collaboration service, setting information necessary to create a collaboration work environment , and editing information about the collaboratively edited document. In addition, in response to various requests related to the cooperation service, theserver 100 may provide all matters related to the provision of the cooperation service.

控制器130可执行对服务器100的整体控制。控制器130获取经由通信单元110接收的信息和请求并将接收到的信息和请求存储在存储器150中。存储器150可包括存储装置或数据库。控制器130也可处理接收到的信息和请求。例如，控制器130可基于从第四用户终端(图48中的600)接收的信息来生成在协作服务中要使用的图像或者执行用于管理接收到的信息的处理。另外，响应于所获取的请求，控制器130可将提供协作服务所必要的信息发送到用户终端200。Thecontroller 130 may perform overall control of theserver 100 . Thecontroller 130 acquires information and requests received via thecommunication unit 110 and stores the received information and requests in thememory 150 . Thememory 150 may include a storage device or a database.Controller 130 may also process received information and requests. For example, thecontroller 130 may generate an image to be used in the collaboration service or perform processing for managing the received information based on the information received from the fourth user terminal (600 in FIG. 48 ). In addition, in response to the acquired request, thecontroller 130 may transmit information necessary to provide the cooperation service to theuser terminal 200 .

控制器130可执行与协作编辑文档的每个用户相关联的视频呼叫图像、基于视频呼叫图像中包括的语音生成的会议纪要和根据接收到的编辑信息协作编辑的文档的整体管理。视频呼叫图像、会议纪要和文档被用于协作服务中。例如，控制器130可执行与每个用户相关联的视频呼叫图像、会议纪要和正被协作编辑的文档的诸如生成、存储、处理和删除之类的管理操作。现在将参考图3和图4来更详细描述服务器100的控制器130。Thecontroller 130 may perform overall management of the video call image associated with each user who collaboratively edits the document, the meeting minutes generated based on the voice included in the video call image, and the collaboratively edited document according to the received editing information. Video call images, meeting minutes and documents are used in collaboration services. For example, thecontroller 130 may perform management operations such as generation, storage, processing, and deletion of video call images, meeting minutes, and documents being collaboratively edited, associated with each user. Thecontroller 130 of theserver 100 will now be described in more detail with reference to FIGS. 3 and 4 .

图4根据示范性实施例图示了用于提供协作服务的服务器100的控制器130。参考图3，服务器100的控制器130可包括综合管理处理器131、用户管理处理器133、文档管理处理器135和图像管理处理器137。本领域普通技术人员将会理解，控制器130除了图4中所示的那些以外还可包括其他常见的组件。控制器130可包括多个如图4所示的处理器，或者与图4不同，处理器中的一些或全部可被集成到单个控制器中。FIG. 4 illustrates thecontroller 130 of theserver 100 for providing collaboration services, according to an exemplary embodiment. 3 , thecontroller 130 of theserver 100 may include anintegrated management processor 131 , auser management processor 133 , adocument management processor 135 and animage management processor 137 . Those of ordinary skill in the art will understand that thecontroller 130 may include other common components in addition to those shown in FIG. 4 . Thecontroller 130 may include multiple processors as shown in FIG. 4 or, unlike FIG. 4, some or all of the processors may be integrated into a single controller.

综合管理处理器131执行对于提供协作服务的整体控制。综合管理处理器131可以把接收到的与协作服务有关的信息和请求分别指派给用户管理处理器133、文档管理处理器135和图像管理处理器137并且控制对这些信息和请求的处理。另外，响应于与协作服务有关的请求，综合管理处理器131可利用从用户管理处理器133、文档管理处理器135和图像管理处理器137中选择的至少一者来发送关于协作服务的信息。综合管理处理器131在对于提供协作服务的综合管理中使用的协作服务相关信息、根据综合管理生成、修改和删除的协作服务相关信息和协作服务支持软件可被存储在综合管理数据库(DB)151中。Theintegrated management processor 131 performs overall control for providing cooperative services. Theintegrated management processor 131 may assign the received information and requests related to the collaboration service to theuser management processor 133 , thedocument management processor 135 and theimage management processor 137 and control the processing of the information and requests, respectively. In addition, in response to the request related to the collaboration service, theintegrated management processor 131 may transmit information on the collaboration service using at least one selected from theuser management processor 133 , thedocument management processor 135 , and theimage management processor 137 . Collaboration service-related information used by theintegrated management processor 131 in integrated management for providing collaboration services, collaboration service-related information generated, modified, and deleted according to the integrated management, and collaboration service support software may be stored in an integrated management database (DB) 151 middle.

为了实现与协作编辑文档的每个用户相关联的视频呼叫图像、基于与每个用户相关联的视频呼叫图像中包括的语音生成的会议纪要和被协作编辑的文档之间的同步，综合管理处理器131可向从用户终端200输入到通信单元240的视频呼叫图像、文档的编辑信息和/或根据编辑信息对文档的编辑的结果添加日志数据。例如，如果编辑信息是用于插入文本的文本信息，则文档的编辑的结果可以是其中具有该文本的文档或者被插入到文档中的文本。如果编辑信息是用于拷贝和粘贴文本的拷贝信息，则文档的编辑的结果可以是文本被拷贝到的文档或者被粘贴到文档中的拷贝文本。如果编辑信息是用于调整字大小的信息，则文档的编辑的结果可以是其中字体大小已被调整的文档或文本。如上所述，视频呼叫图像、会议纪要和文档被用于协作服务中。在此情况下，日志数据可以是与视频呼叫图像或编辑信息被服务器100接收的时间有关的数据。换言之，视频呼叫图像的一部分和编辑信息基于视频呼叫图像或编辑信息被服务器100接收的时间或在该时间的预定范围内彼此同步。因此，视频呼叫图像可与被协作编辑的文档同步。另外，会议纪要可利用被添加到视频呼叫图像的日志数据本身与被协作编辑的文档同步。为各种类型的图像和被协作编辑的文档之间的同步添加的日志数据的属性和同步间隔可被改变。In order to achieve synchronization between the video call image associated with each user of the collaboratively edited document, the meeting minutes generated based on the voice included in the video call image associated with each user, and the collaboratively edited document, an integrated management process Themonitor 131 may add log data to the video call image input from theuser terminal 200 to thecommunication unit 240, the editing information of the document, and/or the result of editing of the document according to the editing information. For example, if the editing information is text information for inserting text, the result of the editing of the document may be the document having the text therein or the text inserted into the document. If the editing information is copy information for copying and pasting text, the result of the editing of the document may be the document to which the text is copied or the copied text that is pasted into the document. If the editing information is information for adjusting the font size, the result of the editing of the document may be a document or text in which the font size has been adjusted. As mentioned above, video call images, meeting minutes and documents are used in collaboration services. In this case, the log data may be data related to the time when the video call image or editing information is received by theserver 100 . In other words, a part of the video call image and the editing information are synchronized with each other based on the time when the video call image or the editing information is received by theserver 100 or within a predetermined range of the time. Thus, the video call image can be synchronized with the collaboratively edited document. Additionally, the meeting minutes may be synchronized with the collaboratively edited document itself using log data added to the video call image. Attributes and synchronization intervals of log data added for synchronization between various types of images and collaboratively edited documents may be changed.

在示范性实施例中，取代视频呼叫图像，可以有编辑文档的用户的静止图像并且用户的音频可与被协作编辑的文档同步。在另外一个示范性实施例中，用户的静止图像对应于用户的音频的一部分或全部。In an exemplary embodiment, instead of a video call image, there may be a still image of the user editing the document and the user's audio may be synchronized with the collaboratively edited document. In another exemplary embodiment, the still image of the user corresponds to a portion or all of the user's audio.

日志数据可以是基于视频中的用户的语音生成的项目的文本记录。日志数据可以是基于用户对可编辑文档的编辑生成的项目的文本记录。The log data may be a textual record of the item generated based on the user's speech in the video. The log data may be a textual record of items generated based on user edits to the editable document.

用户管理处理器133可管理关于使用协作服务的多个用户的信息。换言之，用户管理处理器133可管理关于每个用户的个人信息和关于每个群组中的群组成员的信息。用户管理处理器133在用户管理中使用的用户信息和根据用户管理生成、修改和删除的用户信息可被存储在用户信息DB 153中。Theuser management processor 133 may manage information on a plurality of users using the collaboration service. In other words, theuser management processor 133 may manage personal information about each user and information about group members in each group. User information used in user management by theuser management processor 133 and user information generated, modified, and deleted according to the user management may be stored in theuser information DB 153 .

文档管理处理器135根据从用户终端200接收的编辑信息对被协作编辑的文档执行整体控制。当在用于提供协作服务的服务器100上执行用于处理文档的程序时，文档管理处理器135可根据从用户终端200接收的编辑信息和与文档的处理有关的请求对被协作编辑的文档执行整体控制。例如，文档管理处理器135可执行文档的诸如创建、编辑、存储和删除之类的管理操作。被文档管理处理器135用于文档管理的文档信息和根据文档管理生成、修改和删除的文档可被存储在文档DB 155中。Thedocument management processor 135 performs overall control of the collaboratively edited document according to the editing information received from theuser terminal 200 . When a program for processing a document is executed on theserver 100 for providing a collaboration service, thedocument management processor 135 may execute a collaboratively edited document according to editing information received from theuser terminal 200 and a request related to the processing of the document. Overall control. For example, thedocument management processor 135 may perform management operations such as creation, editing, storage, and deletion of documents. Document information used for document management by thedocument management processor 135 and documents generated, modified, and deleted according to the document management may be stored in thedocument DB 155 .

图像管理处理器137对与协作编辑文档的每个用户相关联的视频呼叫图像和基于与每个用户相关联的视频呼叫图像中包括的语音生成的会议纪要执行整体控制。例如，图像管理处理器137可执行与每个用户相关联的视频呼叫图像以及会议纪要的诸如创建、存储、处理和删除之类的管理操作。被图像管理处理器137用于图像管理的图像信息和根据图像管理生成、修改和删除的图像信息可被存储在图像DB 157中。现在将参考图5更详细描述图像管理处理器137。Theimage management processor 137 performs overall control over the video call image associated with each user who collaboratively edits the document and the meeting minutes generated based on the voice included in the video call image associated with each user. For example, theimage management processor 137 may perform management operations such as creation, storage, processing, and deletion of video call images and meeting minutes associated with each user. Image information used for image management by theimage management processor 137 and image information generated, modified, and deleted according to the image management may be stored in theimage DB 157 . Theimage management processor 137 will now be described in more detail with reference to FIG. 5 .

图5根据示范性实施例图示了可被包括在用于提供协作服务的服务器100的控制器130中的图像管理处理器137。FIG. 5 illustrates animage management processor 137 that may be included in thecontroller 130 of theserver 100 for providing collaboration services, according to an exemplary embodiment.

参考图5，图像管理处理器137可包括音频/视频处理器138和音频转换器139。本领域普通技术人员将会理解，图像管理处理器137除了图5中所示的那些以外还可包括其他常见的组件。Referring to FIG. 5 , theimage management processor 137 may include an audio/video processor 138 and anaudio converter 139 . Those of ordinary skill in the art will appreciate that theimage management processor 137 may include other common components in addition to those shown in FIG. 5 .

音频/视频处理器138可对输入图像信号执行信号处理。在此情况下，信号处理可以指图像的创建或处理。图像的处理可以指对其的编辑。所得到的包含音频信号和视频信号的图像信号可经由通信单元110被发送到用户终端200或者被存储在图像DB 157中。The audio/video processor 138 may perform signal processing on the input image signal. In this context, signal processing may refer to the creation or processing of images. The processing of an image may refer to its editing. The resulting image signal including the audio signal and the video signal may be transmitted to theuser terminal 200 via thecommunication unit 110 or stored in theimage DB 157 .

音频转换器139可以把与接收协作服务的每个用户相关联的视频呼叫图像中包括的语音转换成文本形式的信息。图像管理处理器137可从音频转换器139接收文本形式的信息以便创建会议纪要。Theaudio converter 139 may convert the voice included in the video call image associated with each user receiving the collaboration service into information in text form.Image management processor 137 may receive information in text form fromaudio converter 139 in order to create meeting minutes.

返回参考图3，服务器100可包括存储器150。存储器150可包括从综合管理DB 151、用户信息DB 153、文档DB 155、安全文档DB 158和图像DB 157中选择的至少一者，如下文参考图6至图9更详细描述。Referring back to FIG. 3 , theserver 100 may include thememory 150 . Thememory 150 may include at least one selected from theintegrated management DB 151 , theuser information DB 153 , thedocument DB 155 , thesecurity document DB 158 , and theimage DB 157 , as described in more detail below with reference to FIGS. 6 to 9 .

图6根据示范性实施例图示了可被存储在用于提供协作服务的服务器100的存储器150中的综合管理DB 151。FIG. 6 illustrates anintegrated management DB 151 that may be stored in thememory 150 of theserver 100 for providing collaboration services, according to an exemplary embodiment.

综合管理DB 151可存储服务器100提供协作服务所必要的各种软件和信息。参考图6，综合管理DB 151可存储协作服务支持软件和协作服务相关信息。Theintegrated management DB 151 can store various software and information necessary for theserver 100 to provide cooperative services. Referring to FIG. 6, theintegrated management DB 151 may store collaboration service support software and collaboration service related information.

协作服务支持软件可包括在服务器100上执行的OS和应用和用于支持协作服务的各种类型的数据。协作服务相关信息可包括关于对各种数据库的访问的信息、诸如为各种类型的图像和被协作编辑的文档之间的同步添加的日志数据的属性和同步间隔之类的同步信息和在利用由服务器100提供的协作服务执行协作时生成的协作历史信息。The collaboration service support software may include an OS and applications executed on theserver 100 and various types of data for supporting the collaboration service. Collaboration service related information may include information about access to various databases, synchronization information such as attributes and synchronization intervals of log data added for synchronization between various types of images and documents being collaboratively edited, and Collaboration history information generated when collaboration is performed by the collaboration service provided by theserver 100 .

图7根据示范性实施例图示了可被存储在用于提供协作服务的服务器100的存储器150中的用户信息DB 153。FIG. 7 illustrates theuser information DB 153 that may be stored in thememory 150 of theserver 100 for providing collaboration services, according to an exemplary embodiment.

参考图7，用户信息DB 153可存储关于协作服务的每个用户的个人信息和关于每个群组中的群组成员的信息。用户信息DB 153可为每个用户存储诸如用于获得对服务器100的访问的账户之类的唯一标识符、存储在服务器100中的个人信息和关于对服务器100提供的协作服务的使用的信息。存储在服务器100中的个人信息可以是上传到服务器100的各种类型的数据和应用。关于对服务器100提供的协作服务的使用的信息可以是表示用户被允许使用协作服务的时段或者使用协作服务的权限的信息。Referring to FIG. 7 , theuser information DB 153 may store personal information on each user of the collaboration service and information on group members in each group. Theuser information DB 153 may store, for each user, a unique identifier such as an account used to gain access to theserver 100 , personal information stored in theserver 100 , and information on use of the collaboration service provided by theserver 100 . The personal information stored in theserver 100 may be various types of data and applications uploaded to theserver 100 . The information on the use of the collaboration service provided by theserver 100 may be information indicating a period during which the user is allowed to use the collaboration service or the authority to use the collaboration service.

图8根据示范性实施例图示了可被存储在提供协作服务的服务器100的存储器150中的文档DB 155。FIG. 8 illustrates adocument DB 155 that may be stored in thememory 150 of theserver 100 providing collaboration services, according to an exemplary embodiment.

参考图8，文档DB 155可存储利用服务器100创建或编辑的文档。如图8所示，文档DB 155可存储文档的属性信息，其中可包括关于文档的共享与否的信息和版本信息。当利用协作服务对文档进行编辑时，文档DB 155可将关于每个用户的编辑信息与编辑文档的用户的账户和用于同步的日志数据一起存储。Referring to FIG. 8 , thedocument DB 155 may store documents created or edited using theserver 100 . As shown in FIG. 8 , thedocument DB 155 may store attribute information of the document, which may include information on whether the document is shared or not and version information. When editing a document using the collaboration service, thedocument DB 155 may store edit information about each user together with the account of the user who edited the document and log data for synchronization.

此外，如果执行要求安全性的协作写入，则服务器100可具有单独的安全性增强区域，在这里分开存储文档和编辑信息。安全文档DB 158可以像文档DB 155那样存储利用服务器100创建或编辑的文档，但安全文档DB 158可以是安全性被进一步增强的DB。例如，存储在安全文档DB 158中的文档可以是为了存储而双倍或三倍加密的，或者为了执行文档或者使用允许对文档的编辑的协作服务可要求对用户或用户终端的认证。对用户或用户终端的认证可基于例如口令、认证密钥、个人标识号(PIN)、生物信息、公共密钥证书、介质访问控制(MAC)地址和/或经由电话的批准来执行。Furthermore, if collaborative writing requiring security is performed, theserver 100 may have a separate security-enhanced area where documents and editing information are stored separately. Thesecure document DB 158 may store documents created or edited with theserver 100 like thedocument DB 155, but thesecure document DB 158 may be a DB whose security is further enhanced. For example, documents stored insecure document DB 158 may be double or triple encrypted for storage, or authentication of a user or user terminal may be required in order to execute the document or use a collaboration service that allows editing of the document. Authentication of the user or user terminal may be performed based on, for example, a password, authentication key, personal identification number (PIN), biometric information, public key certificate, media access control (MAC) address and/or approval via telephone.

另外，存储在安全文档DB 158中的文档可仅在用户为其使用支付单独的费用或者用户位于特定地方时被提供。In addition, the documents stored in thesecure document DB 158 may be provided only when the user pays a separate fee for its use or the user is located in a specific place.

当协作编辑的文档以这种方式被存储在安全文档DB 158中时，诸如创建、编辑、存储和删除之类的管理操作可经由安全文档DB 158来执行。例如，如果从用户终端200接收到编辑信息，则服务器100可经由安全文档DB 158执行在文档的编辑期间可发生的活动，例如先前文档和编辑信息的临时存储、编辑的结果的存储和/或编辑命令的存储。When collaboratively edited documents are stored in thesecure document DB 158 in this manner, management operations such as creation, editing, storage, and deletion can be performed via thesecure document DB 158 . For example, if editing information is received from theuser terminal 200, theserver 100 may, via thesecure document DB 158, perform activities that may occur during editing of the document, such as temporary storage of previous documents and editing information, storage of the results of the editing, and/or Storage for editing commands.

详细而言，下面将通过描述创建使用协作服务的群组并且存储协作编辑文档的示范性实施例来详细说明用户确定要存储在安全文档DB 158中的文档的方法。In detail, a method for a user to determine a document to be stored in thesecure document DB 158 will be explained in detail below by describing an exemplary embodiment in which a group using a collaboration service is created and a collaboratively edited document is stored.

图9根据示范性实施例图示了可被存储在用于提供协作服务的服务器100的存储器150中的图像DB 157。FIG. 9 illustrates animage DB 157 that may be stored in thememory 150 of theserver 100 for providing collaboration services, according to an exemplary embodiment.

参考图9，图像DB 157可存储与协作编辑文档的每个用户相关联的视频呼叫图像和基于与每个用户相关联的视频呼叫图像中包括的语音生成的会议纪要。如图9中所示，对于协作编辑文档的每个群组，图像DB 157可以将与每个用户相关联的视频呼叫图像与每个用户的账户和日志数据一起存储。图像DB 157也可对于每个群组将会议纪要与说出每个文本的用户的账户和用于同步的日志数据一起存储。Referring to FIG. 9 , theimage DB 157 may store a video call image associated with each user who collaboratively edits a document and meeting minutes generated based on voice included in the video call image associated with each user. As shown in FIG. 9, for each group of collaboratively edited documents, theimage DB 157 may store the video call image associated with each user along with each user's account and log data. Theimage DB 157 may also store meeting minutes for each group together with the account of the user who spoke each text and log data for synchronization.

返回参考图3，服务器100的上述组件可被赋予与上文描述的那些不同的名称。另外，根据本实施例的用于提供协作服务的服务器100可包括上述组件中的至少一者。服务器100可不包括这些组件中的一些或者可还包括额外的组件。服务器100可通过使用上述组件中的至少一者来执行以下操作。Referring back to FIG. 3, the above-described components ofserver 100 may be given different names than those described above. In addition, theserver 100 for providing a collaboration service according to the present embodiment may include at least one of the above-mentioned components.Server 100 may not include some of these components or may also include additional components. Theserver 100 may perform the following operations by using at least one of the above-described components.

用于提供允许对文档的协作编辑的服务器100可从请求协作服务的用户终端接收与协作编辑文档的每个用户相关联的视频呼叫图像和关于文档的编辑信息，并且存储接收到的与每个用户相关联的视频呼叫图像、基于与每个用户相关联的视频呼叫图像中包括的语音生成的会议纪要和根据接收到的编辑信息协作编辑的文档。Theserver 100 for providing permission for collaborative editing of a document may receive, from a user terminal requesting a collaborative service, a video call image associated with each user who collaboratively edits a document and editing information about the document, and store the received data associated with each user. Video call images associated with users, meeting minutes generated based on speech included in the video call images associated with each user, and documents collaboratively edited based on the received editing information.

此外，服务器100可将文档与会议纪要同步以使得用户可在协作编辑文档的同时识别情境信息。换言之，服务器100可将文档与会议纪要同步以使得用户可通过会议纪要中包含的文本识别正被协作编辑的文档的状态。In addition, theserver 100 may synchronize the document with the meeting minutes so that users can identify contextual information while collaboratively editing the document. In other words, theserver 100 may synchronize the document with the meeting minutes so that the user can recognize the status of the document being collaboratively edited through the text contained in the meeting minutes.

同步指的是匹配执行事件的时间。同步也可包括匹配已经执行的事件的发生时间。另外，同步可以指事件的同时发生或者调整事件发生的时间间隔以使得它们在预定范围内被执行。例如，与其他用户协作以编辑文档的用户说出的文本(例如，会议纪要中包括的文本)可与在生成该文本时协作编辑的文档同步。在此情况下，与文档同步可包括将用户说出的文本与关于在生成该文本时编辑的文档的编辑信息或者与根据编辑信息对文档的编辑结果同步。编辑的结果可以是根据编辑信息编辑的文档或者被编辑的文档的一部分。如果编辑的结果是被编辑的文档的一部分，则编辑信息可以与编辑的结果相同。例如，如果编辑信息是用户想要添加到文档的输入文本，则编辑的结果可以是其中有该输入文本的被编辑文档。Synchronization refers to the timing of matching execution events. Synchronization may also include matching the occurrence time of events that have already been performed. Additionally, synchronization may refer to the simultaneous occurrence of events or to adjust the time interval at which events occur so that they are performed within a predetermined range. For example, text spoken by a user collaborating with other users to edit a document (eg, text included in meeting minutes) may be synchronized with the collaboratively edited document at the time the text was generated. In this case, synchronizing with the document may include synchronizing the text spoken by the user with editing information about the document edited when the text was generated, or with editing results of the document according to the editing information. The result of the editing may be a document edited according to the editing information or a part of the edited document. If the result of the edit is part of the edited document, the edit information may be the same as the result of the edit. For example, if the edit information is input text that the user wants to add to the document, the result of the edit may be the edited document with the input text in it.

另外，同步可包括将同时或几乎同时(例如，在少于5秒钟内)发生的多个任务彼此相关。在此情况下，将多个任务相关可以指多个任务被聚集到群组中并被一起管理，或者执行(例如，存储、输出或显示)多个任务的时间被匹配到彼此。Additionally, synchronization may include correlating multiple tasks that occur simultaneously or nearly simultaneously (eg, within less than 5 seconds) to each other. In this context, correlating multiple tasks may refer to multiple tasks being aggregated into groups and managed together, or that the times at which multiple tasks are performed (eg, stored, output, or displayed) are matched to each other.

在示范性实施例中，例如，如果用户在经由语音讨论会议细节的同时编辑文档，则同步可包括将编辑信息或编辑的结果与用户在编辑信息被服务器100接收时或者在编辑的结果在服务器100中被生成时说出的文本相连接。在此情况下，关于编辑信息或编辑的结果与用户说出的文本之间的同步和连接的信息可被存储在存储器150中。In an exemplary embodiment, for example, if a user edits a document while discussing meeting details via voice, synchronization may include synchronizing the edited information or the result of the edit with the user when the edit information is received by theserver 100 or when the result of the edit is at theserver 100 are connected to the text spoken when generated. In this case, information on the synchronization and connection between the edited information or the edited result and the text spoken by the user may be stored in thememory 150 .

另外，同步可包括将在短时间段中(例如，在少于10分钟内)一起发生的多个任务彼此相关。或者，同步可包括将在多个任务之一发生之前或之后的特定时段中(例如，在少于5分钟内)发生的多个任务中的一些彼此相关。Additionally, synchronization may include correlating multiple tasks that occur together over a short period of time (eg, within less than 10 minutes). Alternatively, synchronizing may include correlating some of the plurality of tasks that occur within a certain period of time (eg, within less than 5 minutes) before or after one of the plurality of tasks occurs.

在此情况下，将多个任务相关可以指在短时间段中一起发生的多个任务被聚集到群组中并被一起管理，或者执行(例如，存储、输出或显示)多个任务的时间被匹配到彼此。In this context, correlating multiple tasks may refer to the time at which multiple tasks that occur together in a short period of time are aggregated into groups and managed together, or when multiple tasks are performed (eg, stored, output, or displayed) are matched to each other.

例如，当在3:10pm到3:15pm之间在被协作编辑的文档中输入或者向该文档拷贝文本“专利策略”时，用户可在同一时间间隔期间说出语音“非常重要”。在此情况下，该语音可被转换成文本，然后被存储在会议纪要中。For example, when entering or copying the text "patent policy" into a collaboratively edited document between 3:10pm and 3:15pm, the user may speak the speech "very important" during the same time interval. In this case, the speech can be converted to text and then stored in the meeting minutes.

在此情形中，在3:10pm到3:15pm之间输入或拷贝的文本“专利策略”可与用户说出的文本“非常重要”互连。例如，互连文本可以指，如果一个文本以后被显示，则将另一文本一起显示。以这种方式将编辑的结果与用户说出的文本互连可被称为两者被彼此同步。In this case, the text "patent strategy" entered or copied between 3:10pm and 3:15pm may be interconnected with the text "very important" spoken by the user. For example, interconnecting text may mean that if one text is later displayed, the other text is displayed together. Interconnecting the edited results with the text spoken by the user in this manner may be said to be synchronized with each other.

服务器100也可通过从与每个用户相关联的视频呼叫图像中提取与会议纪要中的每个文本相对应的一部分来基于会议纪要生成被编辑图像，以使得用户可在协作编辑文档的同时识别情境信息。由于基于会议纪要的被编辑图像被视为与会议纪要同步，并且会议纪要与文档同步，所以被编辑图像、会议纪要和文档彼此同步。Theserver 100 may also generate edited images based on the meeting minutes by extracting a portion corresponding to each text in the meeting minutes from the video call image associated with each user, so that the users can recognize while collaboratively editing the document situational information. Since the edited image based on the meeting minutes is considered to be synchronized with the meeting minutes, and the meeting minutes are synchronized with the document, the edited image, the meeting minutes and the document are synchronized with each other.

另外，服务器100可将会议纪要和文档同步到与每个用户相关联的视频呼叫图像以便存储。Additionally,server 100 may synchronize meeting minutes and documents to video call images associated with each user for storage.

此外，在协作编辑文档之后的审查期间，用户可利用与文档同步的各种类型的图像来识别在协作编辑时存在的情境信息。Furthermore, during a review period after collaboratively editing a document, the user may utilize various types of images synchronized with the document to identify contextual information that was present at the time of collaborative editing.

图10是根据另一示范性实施例图示出用于提供协作服务的服务器100被实现为多个分散服务器的图。虽然省略了，但以上关于服务器100的描述可应用到图10所示的服务器100。FIG. 10 is a diagram illustrating that aserver 100 for providing a collaboration service is implemented as a plurality of distributed servers, according to another exemplary embodiment. Although omitted, the above description about theserver 100 is applicable to theserver 100 shown in FIG. 10 .

参考图10，用于提供协作服务的分散服务器可包括综合管理服务器101、用户管理服务器103、文档管理服务器105和图像管理服务器107。与图3的服务器100中不同，集成到控制器130中的各种处理器和存储在存储器150中的各种数据库被实现为多个分散服务器。Referring to FIG. 10 , distributed servers for providing collaboration services may include anintegrated management server 101 , auser management server 103 , adocument management server 105 , and animage management server 107 . Unlike in theserver 100 of FIG. 3 , various processors integrated into thecontroller 130 and various databases stored in thememory 150 are implemented as a plurality of distributed servers.

综合管理服务器101、用户管理服务器103、文档管理服务器105和图像管理服务器107之一可与另一服务器执行通信并且彼此交换各种类型的数据。例如，综合管理服务器101可与用户终端200执行通信以将接收到的与协作服务有关的信息和请求发送到从用户管理服务器103、文档管理服务器105和图像管理服务器107中选择的至少一者。综合管理服务器101也可从另一服务器获取对该发送的响应并且向用户终端200提供协作服务。当服务器100以这种方式被实现为多个分散服务器时，此配置可便于服务器100的维护和管理。One of theintegrated management server 101, theuser management server 103, thedocument management server 105, and theimage management server 107 can perform communication with the other server and exchange various types of data with each other. For example, theintegrated management server 101 may perform communication with theuser terminal 200 to transmit the received information and request related to the collaboration service to at least one selected from theuser management server 103 , thedocument management server 105 and theimage management server 107 . Theintegrated management server 101 can also acquire a response to the transmission from another server and provide theuser terminal 200 with a collaboration service. When theserver 100 is implemented as a plurality of distributed servers in this manner, this configuration can facilitate maintenance and management of theserver 100 .

图11是根据另一示范性实施例的作为用于提供协作服务的分散服务器之一的综合管理服务器101的框图。FIG. 11 is a block diagram of anintegrated management server 101 as one of the distributed servers for providing collaboration services, according to another exemplary embodiment.

参考图11，综合管理服务器101可包括通信单元111、综合管理处理器131和综合管理DB 151。对图4所示的综合管理处理器131和图6所示的综合管理DB 151的描述可应用到综合管理处理器131和综合管理DB 151。本领域普通技术人员将会理解，综合管理服务器101除了图11中所示的那些以外还可包括其他常见的组件。Referring to FIG. 11 , theintegrated management server 101 may include acommunication unit 111 , anintegrated management processor 131 , and anintegrated management DB 151 . The description of theintegrated management processor 131 shown in FIG. 4 and theintegrated management DB 151 shown in FIG. 6 can be applied to theintegrated management processor 131 and theintegrated management DB 151 . Those of ordinary skill in the art will understand that theintegrated management server 101 may include other common components in addition to those shown in FIG. 11 .

综合管理服务器101可请求用户管理服务器103确认连接到用于提供协作服务的服务器100的用户是否被授权使用协作服务。综合管理服务器101也可请求文档管理服务器105根据从用户终端200接收的编辑信息编辑文档，或者获取存储在文档管理服务器105中的文档。综合管理服务器101也可以把在协作服务中使用的视频呼叫图像或会议纪要存储在图像管理服务器107中或者获取存储在图像管理服务器107中的图像。综合管理服务器101可使用用户信息和日志数据以便获取彼此同步的图像和/或文档。例如，综合管理服务器101可获取具有相同用户信息和日志数据的会议纪要中的所有文本和关于被协作编辑的文档的编辑信息，并且向用户终端200提供使用彼此同步的会议纪要和文档的协作服务。Theintegrated management server 101 may request theuser management server 103 to confirm whether the user connected to theserver 100 for providing the cooperation service is authorized to use the cooperation service. Theintegrated management server 101 may also request thedocument management server 105 to edit the document according to the editing information received from theuser terminal 200 or acquire the document stored in thedocument management server 105 . Theintegrated management server 101 may also store video call images or meeting minutes used in the collaboration service in theimage management server 107 or acquire images stored in theimage management server 107 . Theintegrated management server 101 may use user information and log data in order to acquire images and/or documents that are synchronized with each other. For example, theintegrated management server 101 may acquire all texts in the meeting minutes with the same user information and log data and editing information on the collaboratively edited document, and provide theuser terminal 200 with a collaboration service using the meeting minutes and documents synchronized with each other .

图12是根据另一示范性实施例的作为用于提供协作服务的分散服务器之一的用户管理服务器103的框图。FIG. 12 is a block diagram of auser management server 103 as one of the decentralized servers for providing collaboration services, according to another exemplary embodiment.

参考图12，用户管理服务器103可包括通信单元113、用户管理处理器133和用户信息DB 153。对图4所示的用户管理处理器133和图7所示的用户信息DB 153的描述可应用到用户管理处理器133和用户信息DB 153。本领域普通技术人员将会理解，综合管理服务器103除了图12中所示的那些以外还可包括其他常见的组件。Referring to FIG. 12 , theuser management server 103 may include acommunication unit 113 , auser management processor 133 and auser information DB 153 . The descriptions of theuser management processor 133 shown in FIG. 4 and theuser information DB 153 shown in FIG. 7 are applicable to theuser management processor 133 and theuser information DB 153 . Those of ordinary skill in the art will understand that theintegrated management server 103 may include other common components in addition to those shown in FIG. 12 .

用户管理服务器103可管理关于使用协作服务的多个用户的信息。用户管理处理器133可管理关于每个用户的个人信息和关于每个群组中的群组成员的信息。在用户管理中使用的用户信息和根据用户管理生成、修改和删除的用户信息可被存储在用户信息DB153中。Theuser management server 103 may manage information on a plurality of users using the collaboration service. Theuser management processor 133 may manage personal information about each user and information about group members in each group. User information used in the user management and user information generated, modified, and deleted according to the user management may be stored in theuser information DB 153 .

图13是根据另一示范性实施例的作为用于提供协作服务的分散服务器之一的文档管理服务器105的框图。FIG. 13 is a block diagram of adocument management server 105 as one of decentralized servers for providing collaboration services, according to another exemplary embodiment.

参考图13，文档管理服务器105可包括通信单元115、文档管理处理器135和文档DB155。为了执行要求安全性的协作写入，文档管理服务器105可还包括安全文档DB 158。对图4所示的文档管理处理器135和图8所示的文档DB 155的描述可应用到文档管理处理器135和文档DB 155。本领域普通技术人员将会理解，文档管理服务器105除了图13中所示的那些以外还可包括其他常见的组件。Referring to FIG. 13 , thedocument management server 105 may include acommunication unit 115 , adocument management processor 135 and adocument DB 155 . In order to perform collaborative writing requiring security, thedocument management server 105 may further include asecure document DB 158 . The descriptions of thedocument management processor 135 shown in FIG. 4 and thedocument DB 155 shown in FIG. 8 are applicable to thedocument management processor 135 and thedocument DB 155 . Those of ordinary skill in the art will appreciate that thedocument management server 105 may include other common components in addition to those shown in FIG. 13 .

文档管理服务器105可根据被协作编辑的文档的编辑信息对该文档执行整体控制。用于文档管理的文档信息和根据文档管理生成、修改和删除的文档可被存储在文档DB155中。文档管理服务器105也可经由通信单元115与其他服务器通信。例如，文档管理服务器105可经由通信单元115接收对存储在其中的文档的编辑的请求或者接收文档。Thedocument management server 105 can perform overall control of the collaboratively edited document according to the editing information of the document. Document information for document management and documents generated, modified, and deleted according to the document management may be stored in thedocument DB 155 . Thedocument management server 105 can also communicate with other servers via thecommunication unit 115 . For example, thedocument management server 105 may receive a request for editing of a document stored therein or receive a document via thecommunication unit 115 .

图14是根据另一示范性实施例的作为用于提供协作服务的分散服务器之一的图像管理服务器107的框图。FIG. 14 is a block diagram of animage management server 107 as one of the decentralized servers for providing collaboration services, according to another exemplary embodiment.

参考图14，图像管理服务器105可包括通信单元117、图像管理处理器137和图像DB157。对图4所示的图像管理处理器137和图9所示的图像DB 157的描述可应用到图像管理处理器137和图像DB 157。本领域普通技术人员将会理解，文档管理服务器107除了图14中所示的那些以外还可包括其他常见的组件。Referring to FIG. 14 , theimage management server 105 may include acommunication unit 117 , animage management processor 137 and animage DB 157 . The descriptions of theimage management processor 137 shown in FIG. 4 and theimage DB 157 shown in FIG. 9 are applicable to theimage management processor 137 and theimage DB 157 . Those of ordinary skill in the art will appreciate that thedocument management server 107 may include other common components in addition to those shown in FIG. 14 .

图像管理处理器107可对与协作编辑的每个用户相关联的视频呼叫图像和基于与每个用户相关联的视频呼叫图像中包括的语音生成的会议纪要执行整体控制。图像管理服务器107也可经由通信单元117与其他服务器通信。例如，图像管理服务器107可经由通信单元117接收对存储在其中的图像的请求或者接收要存储在其中的图像。Theimage management processor 107 may perform overall control over the video call image associated with each user that is collaboratively edited and the meeting minutes generated based on the voice included in the video call image associated with each user. Theimage management server 107 can also communicate with other servers via thecommunication unit 117 . For example, theimage management server 107 may receive a request for an image stored therein or an image to be stored therein via thecommunication unit 117 .

图15根据示范性实施例图示了在利用用于提供协作服务的服务器100处理文档的同时根据对执行协作服务的请求发起协作服务的过程。详细而言，图15图示了准备接收协作服务的过程。当第一用户在利用服务器100处理文档的同时请求执行协作服务时，协作服务被提供以便通过与群组成员的视频会议来协作地编辑文档。然而，示范性实施例不限于准备接收协作服务的该过程。FIG. 15 illustrates a process of initiating a collaboration service according to a request to perform a collaboration service while a document is processed using theserver 100 for providing the collaboration service, according to an exemplary embodiment. In detail, FIG. 15 illustrates a process of preparing to receive a collaboration service. When the first user requests to perform the collaboration service while processing the document using theserver 100, the collaboration service is provided to collaboratively edit the document through a video conference with group members. However, exemplary embodiments are not limited to this process of preparing to receive collaborative services.

用于处理文档的程序可被安装在服务器100上。第一用户可经由第一用户终端300利用他或她的用户账户登录到服务器100中并且请求在服务器100上执行用于处理文档的程序。第二和第三用户可利用其用户账户登录到服务器100中并且接收由服务器100提供的协作服务。A program for processing documents may be installed on theserver 100 . The first user may log in to theserver 100 with his or her user account via thefirst user terminal 300 and request execution of a program for processing a document on theserver 100 . The second and third users can log into theserver 100 using their user accounts and receive the collaboration service provided by theserver 100 .

参考图15，第一用户终端300可向服务器100请求创建文档(操作S1505)。由于用于处理文档的程序被安装在服务器100上，所以第一用户可登录到服务器100中并且请求创建具有期望格式的文档。Referring to FIG. 15, thefirst user terminal 300 may request theserver 100 to create a document (operation S1505). Since the program for processing the document is installed on theserver 100, the first user can log in to theserver 100 and request to create a document in a desired format.

服务器100根据来自第一用户终端300的请求创建文档(操作S1510)。Theserver 100 creates a document according to a request from the first user terminal 300 (operation S1510).

第一用户终端300在其屏幕上显示由服务器100创建的文档，并且第一用户可通过该屏幕处理该文档(操作S1515)。在此情况下，在服务器100上执行的文档可被显示在在第一用户终端300上执行的web浏览器屏幕上。换言之，服务器100向第一用户终端300提供基于web的文档，并且第一用户终端300可通过web浏览器屏幕查看基于web的文档。Thefirst user terminal 300 displays the document created by theserver 100 on its screen, and the first user can process the document through the screen (operation S1515). In this case, the document executed on theserver 100 may be displayed on the screen of the web browser executed on thefirst user terminal 300 . In other words, theserver 100 provides the web-based document to thefirst user terminal 300, and thefirst user terminal 300 can view the web-based document through a web browser screen.

第一用户终端300可向服务器100发送关于文档的处理的信息(操作S1520)。发送关于文档的处理的信息的时间间隔可被调整。第一用户终端300可在每次发生与文档的处理有关的事件时向服务器100发送关于文档的处理的信息。Thefirst user terminal 300 may transmit information on the processing of the document to the server 100 (operation S1520). The time interval at which information about the processing of the document is sent may be adjusted. Thefirst user terminal 300 may transmit information on the processing of the document to theserver 100 every time an event related to the processing of the document occurs.

服务器100可存储从第一用户终端300接收的关于文档的处理的信息(操作S1525)。Theserver 100 may store the information on the processing of the document received from the first user terminal 300 (operation S1525).

第一用户可在第一用户终端300中选择执行到协作模式的切换(操作S1530)。The first user may choose to perform switching to the cooperation mode in the first user terminal 300 (operation S1530).

第一用户终端向服务器100请求执行协作服务(操作S1535)。现在将参考图16描述请求执行协作服务的第一用户终端300的状态。The first user terminal requests theserver 100 to perform the cooperation service (operation S1535). The state of thefirst user terminal 300 requesting to perform the cooperative service will now be described with reference to FIG. 16 .

图16根据示范性实施例图示了用于接收协作服务的第一用户终端300请求执行协作服务的示例。详细而言，图16示出了第一用户终端300的用户界面屏幕360。从上到下，用户界面屏幕360包括用于输入服务器100的地址的地址窗口361、菜单栏363和带状菜单栏365。菜单栏363和带状菜单栏365根据在服务器100上执行的程序的类型可具有不同的形状。FIG. 16 illustrates an example in which thefirst user terminal 300 for receiving the cooperation service requests to execute the cooperation service, according to an exemplary embodiment. In detail, FIG. 16 shows auser interface screen 360 of thefirst user terminal 300 . From top to bottom, theuser interface screen 360 includes anaddress window 361 for entering the address of theserver 100 , amenu bar 363 and aribbon menu bar 365 . Themenu bar 363 and thestrip menu bar 365 may have different shapes according to the types of programs executed on theserver 100 .

首先，第一用户可在菜单栏363中选择“协作”菜单，在显示的子菜单中点击(或触摸)“切换到协作模式”，并且执行到协作模式的切换。First, the first user may select the "Collaboration" menu in themenu bar 363, click (or touch) "Switch to Collaboration Mode" in the displayed submenu, and perform switching to the collaboration mode.

然后，根据来自第一用户的对执行到协作模式的切换的请求，指示当前模式是协作模式的模式指示符367和示出获得对当前文档的访问的用户的访问用户显示窗口369出现在用户界面屏幕360的右上侧。示出正被协作编辑的文档的窗口370可被显示在带状菜单栏365下方。Then, upon a request from the first user to perform a switch to collaborative mode, amode indicator 367 indicating that the current mode is collaborative mode and an accessuser display window 369 showing the user who gained access to the current document appear on the user interface The upper right side of thescreen 360. Awindow 370 showing the document being collaboratively edited may be displayed below theribbon menu bar 365 .

返回参考图15，第一用户可在第一用户终端300中执行群组创建菜单(操作S1540)。Referring back to FIG. 15 , the first user may execute a group creation menu in the first user terminal 300 (operation S1540).

第一用户终端300可向服务器100请求群组的创建(操作S1545)。Thefirst user terminal 300 may request theserver 100 for creation of a group (operation S1545).

图17根据示范性实施例图示了用于接收协作服务的第一用户终端300请求创建群组的示例。FIG. 17 illustrates an example in which thefirst user terminal 300 for receiving the collaboration service requests to create a group, according to an exemplary embodiment.

在第一用户终端300的用户界面屏幕360上，第一用户可选择地址窗口361与带状菜单栏365之间的菜单栏363中的“协作”菜单，然后选择显示的子菜单中的“创建群组”。On theuser interface screen 360 of thefirst user terminal 300, the first user can select the "Collaboration" menu in themenu bar 363 between theaddress window 361 and theribbon menu bar 365, and then select "Create" in the displayed submenu group".

选择“创建群组”将在第一用户终端300的用户界面屏幕360上显示创建群组窗口362。为了创建群组，第一用户可在群组名称、可访问性、口令和默认权限中输入适当的值，并且按压完成按钮。如图17所示，第一用户可分别在群组名称、可访问性、口令和默认权限中选择并输入“群组1”、“私有”、“****”(不显示以便其他用户不能查看它)和“读/写”。在此情况下，如果第一用户设定了口令，则群组成员被允许通过经由输入口令参与创建的群组来使用协作服务。另外，创建群组窗口362还可包括用于选择设定经由协作服务编辑的文档的安全级别的模式的菜单362-1。例如，如果经由菜单362-1提供了分别用于将安全级别设定到高、中、低的按钮，则用户可通过选择与高、中、低相对应的按钮之一来确定群组成员对其协作执行协作服务的文档的安全级别。Selecting "create group" will display a creategroup window 362 on theuser interface screen 360 of thefirst user terminal 300 . To create a group, the first user can enter the appropriate values for the group name, accessibility, password, and default permissions, and press the Done button. As shown in Figure 17, the first user can select and enter "Group 1", "Private", "****" (not displayed for other users to cannot view it) and "read/write". In this case, if the first user sets a password, the group members are allowed to use the collaboration service by participating in the created group by entering the password. Additionally, thecreate group window 362 may also include a menu 362-1 for selecting a mode for setting the security level of documents edited via the collaboration service. For example, if buttons for setting the security level to high, medium, and low, respectively, are provided via menu 362-1, the user may determine the group membership pair by selecting one of the buttons corresponding to high, medium, and low The security level of the document with which it collaborates to perform the collaboration service.

根据示范性实施例，如果用户将安全级别设定到高，则经由协作服务编辑的文档可被存储在安全文档DB 158中。另外，如果用户将安全级别设定到中，则经由协作服务编辑的文档可被存储在文档DB 155中，但除了输入相应口令之外可要求进一步的认证。另外，如果用户将安全级别设定到低，则创建的群组所工作的文档可被存储在文档DB 155中并且可被任何用户访问，而不要求输入口令，或者没有口令。According to an exemplary embodiment, if the user sets the security level to high, documents edited via the collaboration service may be stored in thesecure document DB 158 . Additionally, if the user sets the security level to , documents edited via the collaboration service may be stored in thedocument DB 155, but may require further authentication in addition to entering the corresponding password. In addition, if the user sets the security level to low, the documents that the created group works on can be stored in thedocument DB 155 and can be accessed by any user without requiring a password, or without a password.

根据另一示范性实施例，如果用户将安全级别设定到高，则参与协作服务的群组成员可受到限制。例如，对群组的参与可仅限于位于在从第一用户起的预定范围内的地方或者位于预先指定的地方的用户。或者，可仅允许经由预先指定的IP段访问的用户参与群组。作为另一示例，可仅允许经由预先指定的设备标识信息(例如，MAC地址等等)访问的用户参与群组。According to another exemplary embodiment, if the user sets the security level to high, group members participating in the collaboration service may be restricted. For example, participation in the group may be limited to users located at places within a predetermined range from the first user or at pre-designated places. Alternatively, only users accessing via a pre-specified IP segment may be allowed to participate in the group. As another example, only users accessing via pre-specified device identification information (eg, MAC address, etc.) may be allowed to participate in the group.

根据另一示范性实施例，如果用户将安全级别设定到高，则在正经由协作服务编辑文档的同时可限制另一应用的执行。例如，可限制在用户终端上执行另一应用以防止对正编辑的文档的捕捉、拷贝或发送。According to another exemplary embodiment, if the user sets the security level to high, the execution of another application may be restricted while the document is being edited via the collaboration service. For example, execution of another application on the user terminal may be restricted to prevent capturing, copying or sending of the document being edited.

根据另一示范性实施例，如果用户将安全级别设定到高，则经由协作服务编辑的文档的加密的复杂度在该文档被存储时可被增大。这个增大的加密复杂度可增加存储被编辑的文档所花的时间，但可进一步增强文档的安全性。According to another exemplary embodiment, if the user sets the security level to high, the complexity of encryption of a document edited via a collaboration service may be increased when the document is stored. This increased encryption complexity can increase the time it takes to store the edited document, but can further enhance the security of the document.

根据另一示范性实施例，如果用户将安全级别设定到高，则服务器100可经由单独的安全通道将被编辑的文档发送到用户终端。例如，服务器100可将被编辑的文档转换成图像以将该图像经由安全通道以流数据的形式提供到用户终端。如果被编辑的文档是图像，则该文档的安全性可被进一步增强，因为用户终端难以解析该文档的结构、内容或文本。According to another exemplary embodiment, if the user sets the security level to high, theserver 100 may transmit the edited document to the user terminal via a separate secure channel. For example, theserver 100 may convert the edited document into an image to provide the image to the user terminal in the form of streaming data via a secure channel. If the edited document is an image, the security of the document can be further enhanced because it is difficult for the user terminal to parse the structure, content or text of the document.

返回参考图15，服务器100可根据来自第一用户终端300的请求创建群组(操作S1550)。根据上述示例，可向服务器100注册具有群组名称“群组1”的私有群组，并且第一用户(例如，用户A)可以是群组1中的当前群组成员。Referring back to FIG. 15 , theserver 100 may create a group according to a request from the first user terminal 300 (operation S1550). According to the above example, a private group with the group name "Group1" may be registered with theserver 100, and the first user (eg, User A) may be a current group member in Group1.

第一用户终端300可执行群组成员管理菜单(操作S1555)。Thefirst user terminal 300 may execute the group member management menu (operation S1555).

第一用户终端300可向服务器100请求邀请群组成员(操作S1560)。现在将参考图18更详细描述群组成员的管理。Thefirst user terminal 300 may request theserver 100 to invite group members (operation S1560). The management of group members will now be described in more detail with reference to FIG. 18 .

图18根据示范性实施例图示了用于接收协作服务的第一用户终端300执行群组成员的管理的示例。FIG. 18 illustrates an example in which thefirst user terminal 300 for receiving a collaboration service performs management of group members, according to an exemplary embodiment.

在第一用户终端300的用户界面屏幕360上，第一用户可选择地址窗口361与带状菜单栏365之间的菜单栏363中的“协作”菜单，然后选择显示的子菜单中的“管理群组成员”。On theuser interface screen 360 of thefirst user terminal 300, the first user can select the "Collaboration" menu in themenu bar 363 between theaddress window 361 and theribbon menu bar 365, and then select "Management" in the displayed submenu group members".

然后，管理群组成员窗口364可被显示在第一用户终端300的用户界面屏幕360上。第一用户可通过按压“添加成员”按钮来向服务器100请求邀请群组成员。Then, a managementgroup member window 364 may be displayed on theuser interface screen 360 of thefirst user terminal 300 . The first user may request theserver 100 to invite group members by pressing the "Add Member" button.

返回参考图15，服务器100可邀请第二用户终端400和第三用户终端500，并且第二用户终端400和第三用户终端500可连接到服务器100(操作S1565)。Referring back to FIG. 15 , theserver 100 may invite thesecond user terminal 400 and thethird user terminal 500, and thesecond user terminal 400 and thethird user terminal 500 may connect to the server 100 (operation S1565).

在此情况下，如果第一用户在群组的创建期间设定了口令，则服务器100可从第二用户终端400和第三用户终端500接收口令。在此情况下，口令可以是群组成员输入的文本，或者可在发送到服务器100之前被加密。In this case, if the first user sets a password during creation of the group, theserver 100 may receive the password from thesecond user terminal 400 and thethird user terminal 500 . In this case, the password may be text entered by the group members, or may be encrypted before being sent to theserver 100 .

在接收到口令后，服务器100可通过确定接收到的口令是否与第一用户创建的口令相同来执行群组成员的认证。当认证得到确认时，服务器100可向第二用户终端400和第三用户终端500提供使用协作服务的权力。After receiving the password, theserver 100 may perform authentication of the group members by determining whether the received password is the same as the password created by the first user. When the authentication is confirmed, theserver 100 may provide thesecond user terminal 400 and thethird user terminal 500 with the right to use the cooperation service.

此外，虽然大体上向每个群组指派一个口令，但也可向每个群组成员赋予不同的口令。例如，第二用户终端400和第三用户终端500可使用不同的口令来参与该群组。或者，第二用户终端400和第三用户终端500中只有一者可被要求输入其口令。Furthermore, while generally each group is assigned one password, each group member may be assigned a different password. For example, thesecond user terminal 400 and thethird user terminal 500 may use different passwords to participate in the group. Alternatively, only one of thesecond user terminal 400 and thethird user terminal 500 may be required to enter its password.

第二用户终端400和第三用户终端500可请求执行被协作编辑的文档并从服务器100接收基于web的文档(操作S1570)。Thesecond user terminal 400 and thethird user terminal 500 may request to execute the collaboratively edited document and receive the web-based document from the server 100 (operation S1570).

第二用户终端400和第三用户终端500可分别在第二用户终端400和第三用户终端500的屏幕上显示正在服务器100上执行的文档(操作S1575)。在此情况下，在服务器100上执行的文档可被显示在第二用户终端400和第三用户终端500上执行的web浏览器屏幕上。Thesecond user terminal 400 and thethird user terminal 500 may display the document being executed on theserver 100 on the screens of thesecond user terminal 400 and thethird user terminal 500, respectively (operation S1575). In this case, the document executed on theserver 100 may be displayed on the web browser screens executed on thesecond user terminal 400 and thethird user terminal 500 .

第一至第三用户终端300、400和500可经由服务器100彼此交换视频呼叫图像(操作S1580)。视频呼叫图像的交换可继续直到对终止协作服务的请求被作出为止。The first tothird user terminals 300, 400 and 500 may exchange video call images with each other via the server 100 (operation S1580). The exchange of video call images may continue until a request to terminate the collaborative service is made.

其他方的视频呼叫图像可分别被输出到第一至第三用户终端300、400和500(操作S1585)。例如，与第二和第三用户相关联的视频呼叫图像可被输出到第一用户终端300。The video call images of the other parties may be output to the first tothird user terminals 300, 400 and 500, respectively (operation S1585). For example, video call images associated with the second and third users may be output to thefirst user terminal 300 .

图19根据示范性实施例图示了当在文档正被处理的同时协作服务被发起以使得第一至第三用户终端300、400和500准备好协作编辑文档时第一至第三用户终端300、400和500的状态。参考图19，第一至第三用户终端300、400和500可连接到服务器100。19 illustrates the first tothird user terminals 300 when a collaboration service is initiated while the document is being processed to make the first tothird user terminals 300, 400 and 500 ready to collaboratively edit the document according to an exemplary embodiment , 400 and 500 states. Referring to FIG. 19 , the first tothird user terminals 300 , 400 and 500 may be connected to theserver 100 .

示出正被协作编辑的文档的窗口370和示出第二和第三用户(例如，“白”和“崔”)的视频呼叫图像的窗口380可被显示在第一用户终端300上。Awindow 370 showing the document being collaboratively edited and awindow 380 showing video call images of the second and third users (eg, "Bai" and "Cui") may be displayed on thefirst user terminal 300 .

类似地，示出正被协作编辑的文档的窗口470和示出第一和第三用户(例如，“安”和“崔”)的视频呼叫图像的窗口480可被显示在第二用户终端400上。Similarly, awindow 470 showing the document being collaboratively edited and awindow 480 showing video call images of the first and third users (eg, 'Ann' and 'Cui') may be displayed on thesecond user terminal 400 superior.

同样地，示出正被协作编辑的文档的窗口570和示出第一和第二用户(例如，“安”和“白”)的视频呼叫图像的窗口580可被显示在第三用户终端500上。在示范性实施例中，视频呼叫图像可包括运动视觉图像。在另外一个示范性实施例中，利用视频编解码器来处理运动视觉图像。Likewise, thewindow 570 showing the document being collaboratively edited and thewindow 580 showing the video call images of the first and second users (eg, "An" and "White") may be displayed on thethird user terminal 500 superior. In an exemplary embodiment, the video call images may include motion vision images. In another exemplary embodiment, a video codec is utilized to process motion vision images.

在一个示范性实施例中，视频呼叫图像可以是第一和第二用户的静止图像，同时第一和第二用户提供的音频被播放。In one exemplary embodiment, the video call images may be still images of the first and second users while audio provided by the first and second users is played.

图20根据示范性实施例图示了在用于接收协作服务的第一用户终端300上显示包括地址窗口和菜单的用户界面和视频呼叫图像的方法。FIG. 20 illustrates a method of displaying a user interface including an address window and a menu and a video call image on thefirst user terminal 300 for receiving a collaboration service, according to an exemplary embodiment.

参考图20，示出视频呼叫图像的窗口380可被显示在其上显示了地址窗口、菜单栏和带状栏的第一用户终端300的右侧。如上文参考图19所述，第二和第三用户(例如，“白”和“崔”)的视频呼叫图像可出现在第一用户终端上的窗口380中。然而，第一用户可操纵协作编辑文档的用户中的一些的视频呼叫图像以使得它们不被显示在第一用户终端300上。Referring to FIG. 20 , awindow 380 showing a video call image may be displayed on the right side of thefirst user terminal 300 on which an address window, a menu bar, and a ribbon bar are displayed. As described above with reference to FIG. 19, the video call images of the second and third users (eg, "Bai" and "Cui") may appear in thewindow 380 on the first user terminal. However, the first user may manipulate video call images of some of the users collaboratively editing the document so that they are not displayed on thefirst user terminal 300 .

图21根据示范性实施例图示了在用于接收协作服务的第一用户终端300上显示视频呼叫图像的方法。FIG. 21 illustrates a method of displaying a video call image on thefirst user terminal 300 for receiving a collaboration service, according to an exemplary embodiment.

参考图21，在第一用户终端300上显示的示出视频呼叫图像的窗口380的大小可被调整。换言之，可以调整根据在第一用户终端300中预设的默认大小显示的示出视频呼叫图像的窗口380的大小。可利用多手指手势、点击并拖曳方法等等来调整窗口380的大小。Referring to FIG. 21 , the size of awindow 380 showing a video call image displayed on thefirst user terminal 300 may be adjusted. In other words, the size of thewindow 380 showing the video call image displayed according to the default size preset in thefirst user terminal 300 may be adjusted.Window 380 may be resized using multi-finger gestures, click and drag methods, and the like.

图22根据示范性实施例图示了在用于接收协作服务的第一用户终端300上显示视频呼叫图像的另一方法。FIG. 22 illustrates another method of displaying a video call image on thefirst user terminal 300 for receiving a collaboration service, according to an exemplary embodiment.

参考图22，在第一用户终端300上显示的示出视频呼叫图像的窗口380的位置可被调整。换言之，可以调整根据在第一用户终端300中预设的默认位置显示的示出视频呼叫图像的窗口380的位置。可利用拖放方法等等来调整窗口380的位置。Referring to FIG. 22, the position of thewindow 380 showing the video call image displayed on thefirst user terminal 300 may be adjusted. In other words, the position of thewindow 380 showing the video call image displayed according to the default position preset in thefirst user terminal 300 may be adjusted. The position of thewindow 380 may be adjusted using a drag and drop method or the like.

图23根据示范性实施例图示了利用用于提供协作服务的服务器100在视频会议期间根据对执行协作服务的请求发起协作服务的过程。详细而言，图23图示了准备接收协作服务的过程。当第一用户利用服务器100运行视频会议和文档时，协作服务被提供来共享文档并且在视频会议期间协作地编辑该文档。然而，实施例不限于准备接收协作服务的该过程。FIG. 23 illustrates a process of initiating a collaboration service according to a request to perform a collaboration service during a video conference using theserver 100 for providing a collaboration service, according to an exemplary embodiment. In detail, FIG. 23 illustrates a process of preparing to receive a collaboration service. When the first user utilizes theserver 100 to run the videoconference and document, collaboration services are provided to share the document and collaboratively edit the document during the videoconference. However, embodiments are not limited to this process of preparing to receive collaborative services.

参考图23，第一用户终端230可向服务器100请求为视频会议创建群组(操作S2305)。Referring to FIG. 23, thefirst user terminal 230 may request theserver 100 to create a group for the video conference (operation S2305).

服务器100可根据来自第一用户终端300的请求创建群组(操作S2310)。Theserver 100 may create a group according to a request from the first user terminal 300 (operation S2310).

第一用户终端300可执行群组成员管理菜单(操作S2315)。Thefirst user terminal 300 may execute the group member management menu (operation S2315).

第一用户终端300可向服务器100请求为该视频会议邀请群组成员(操作S2320)。Thefirst user terminal 300 may request theserver 100 to invite group members for the video conference (operation S2320).

在此情况下，为视频会议创建群组和邀请群组成员可按与上文参考图17和图18描述的那些类似的方式执行。In this case, creating a group for the video conference and inviting group members may be performed in a similar manner to those described above with reference to FIGS. 17 and 18 .

服务器100邀请第二用户终端400和第三用户终端500，并且第二用户终端400和第三用户终端500可连接到服务器100(操作S2325)。Theserver 100 invites thesecond user terminal 400 and thethird user terminal 500, and thesecond user terminal 400 and thethird user terminal 500 may connect to the server 100 (operation S2325).

第一至第三用户终端300、400和500可经由服务器100彼此交换视频呼叫图像(操作S2330)。视频呼叫图像的交换可继续直到对终止协作服务的请求被作出为止。The first tothird user terminals 300, 400 and 500 may exchange video call images with each other via the server 100 (operation S2330). The exchange of video call images may continue until a request to terminate the collaborative service is made.

其他方的视频呼叫图像可分别被输出到第一至第三用户终端300、400和500(操作S2335)。例如，与第二和第三用户相关联的视频呼叫图像可被输出到第一用户终端300。在操作S2305至S2335中，视频会议的群组被创建，群组成员被邀请，并且视频会议被执行。现在将参考图24详细描述用于视频会议的用户界面屏幕。The video call images of the other parties may be output to the first tothird user terminals 300, 400 and 500, respectively (operation S2335). For example, video call images associated with the second and third users may be output to thefirst user terminal 300 . In operations S2305 to S2335, a group of a video conference is created, group members are invited, and a video conference is performed. The user interface screen for the video conference will now be described in detail with reference to FIG. 24 .

图24根据示范性实施例图示了在作出对执行协作服务的请求之前在用于接收协作服务的第一用户终端300中执行视频会议的示例。FIG. 24 illustrates an example in which a video conference is performed in thefirst user terminal 300 for receiving a collaboration service before a request to perform a collaboration service is made, according to an exemplary embodiment.

详细而言，图24示出了第一用户终端300的用户界面屏幕360。从上到下，用户界面屏幕360包括用于输入服务器100的地址的地址窗口361、菜单栏363和带状菜单栏365。菜单栏363和带状菜单栏365根据在服务器100上执行的程序的类型可具有不同的形状。图24所示的用户界面屏幕360具有与图16所示的类似的结构，但与之不同之处在于菜单栏363和带状栏365的形状被改变以匹配用于视频会议的程序。In detail, FIG. 24 shows auser interface screen 360 of thefirst user terminal 300 . From top to bottom, theuser interface screen 360 includes anaddress window 361 for entering the address of theserver 100 , amenu bar 363 and aribbon menu bar 365 . Themenu bar 363 and thestrip menu bar 365 may have different shapes according to the types of programs executed on theserver 100 . Theuser interface screen 360 shown in FIG. 24 has a similar structure to that shown in FIG. 16, but differs in that the shapes of themenu bar 363 and theribbon bar 365 are changed to match the program for the video conference.

此外，模式指示符367可指示出当前模式是视频会议模式，并且访问用户显示窗口369可示出当前参与视频会议的用户的名称。Additionally, themode indicator 367 may indicate that the current mode is the video conference mode, and the accessinguser display window 369 may show the names of the users currently participating in the video conference.

用于显示其他方的视频呼叫图像的区域、聊天区域和表示在视频会议期间使用的基本功能的简单图标出现在视频会议窗口375上。视频会议窗口375还可包括备忘录区域或用于显示共享文档的区域，所述共享文档是运行视频会议所需要的。An area for displaying video call images of other parties, a chat area, and simple icons representing basic functions used during the video conference appear on thevideo conference window 375 . Thevideo conference window 375 may also include a memo area or an area for displaying shared documents that are required to run the video conference.

返回参考图23，第一用户可从文档列表中选择他或她想要与参与视频会议的其他用户共享的文档(操作S2340)。Referring back to FIG. 23, the first user may select a document he or she wants to share with other users participating in the video conference from the document list (operation S2340).

图25根据示范性实施例图示了在用于接收协作服务的第一用户终端300中在作出对执行协作服务的请求之前选择在视频会议期间共享的文档的过程。FIG. 25 illustrates a process of selecting a document to be shared during a video conference before making a request to perform a collaboration service in thefirst user terminal 300 for receiving a collaboration service, according to an exemplary embodiment.

参考图25，在第一用户终端300上显示的视频会议窗口375中，第一用户可从表示在视频会议期间使用的基本功能的简单图标中选择存储共享文档的文件夹并且打开该文件夹以识别出可共享的文档列表376。Referring to FIG. 25, in thevideo conference window 375 displayed on thefirst user terminal 300, the first user can select a folder in which a shared document is stored from simple icons representing basic functions used during the video conference and open the folder to A list ofsharable documents 376 is identified.

第一用户可从文档的列表中选择至少一个文档并且与其他用户共享所选文档。在此情况下，第一用户可选择具有不同文档格式的两个文件以同时共享两个文档。参考图25，第一用户可从文档列表376选择“present.doc”和“Graph.pdf”两者。The first user can select at least one document from the list of documents and share the selected document with other users. In this case, the first user may select two files with different document formats to share both documents at the same time. Referring to FIG. 25 , the first user may select both “present.doc” and “Graph.pdf” from thedocument list 376 .

返回参考图23，第一用户终端300可请求服务器100执行从文档列表中选择的文档(操作S2345)。Referring back to FIG. 23, thefirst user terminal 300 may request theserver 100 to execute the document selected from the document list (operation S2345).

服务器100可执行第一用户终端300请求执行的文档(操作S2350)。用于执行文档的程序可被安装在服务器100上。Theserver 100 may execute the document requested to be executed by the first user terminal 300 (operation S2350). A program for executing the document may be installed on theserver 100 .

服务器100可以把在服务器100上执行的文档作为基于web的文档发送到第一至第三用户终端300、400和500(操作S2355)。Theserver 100 may transmit the document executed on theserver 100 to the first tothird user terminals 300, 400 and 500 as a web-based document (operation S2355).

第一至第三用户终端300、400和500可分别经由web浏览器显示作为基于web的文档发送的文档(操作S2360)。The first tothird user terminals 300, 400, and 500 may display documents transmitted as web-based documents via web browsers, respectively (operation S2360).

图26根据示范性实施例图示了在作出对执行协作服务的请求之前在用于接收协作服务的第一用户终端300上显示在视频会议期间共享的文档的示例。FIG. 26 illustrates an example of displaying a document shared during a video conference on thefirst user terminal 300 for receiving the collaboration service before a request to perform the collaboration service is made, according to an exemplary embodiment.

参考图26，用于显示其他方的视频呼叫图像的区域、聊天区域和表示在视频会议期间使用的基本功能的简单图标出现在第一用户终端300的视频会议窗口375上。与图25中不同，第一用户选择的两类共享文档可一起被显示在视频会议窗口375上。26 , an area for displaying video call images of other parties, a chat area, and simple icons representing basic functions used during a video conference appear on thevideo conference window 375 of thefirst user terminal 300. Unlike in FIG. 25 , the two types of shared documents selected by the first user may be displayed together on thevideo conference window 375 .

返回参考图23，第一用户可在第一用户终端300中选择执行到协作模式的切换(操作S2365)。现在将参考图27描述在第一用户终端300中选择执行到协作模式的切换。Referring back to FIG. 23 , the first user may select to perform switching to the cooperation mode in the first user terminal 300 (operation S2365). Selecting execution of switching to the cooperative mode in thefirst user terminal 300 will now be described with reference to FIG. 27 .

图27根据示范性实施例图示了用于接收协作服务的第一用户终端300在视频会议期间请求执行协作服务的示例。FIG. 27 illustrates an example in which thefirst user terminal 300 for receiving the collaboration service requests execution of the collaboration service during a video conference, according to an exemplary embodiment.

详细而言，图27示出了第一用户终端300的用户界面屏幕360。从上到下，用户界面屏幕360包括用于输入服务器100的地址的地址窗口361、菜单栏363和带状菜单栏365。模式指示符367可指示出当前模式是视频会议模式，并且访问用户显示窗口369可显示当前参与视频会议的用户的名称。In detail, FIG. 27 shows auser interface screen 360 of thefirst user terminal 300 . From top to bottom, theuser interface screen 360 includes anaddress window 361 for entering the address of theserver 100 , amenu bar 363 and aribbon menu bar 365 . Amode indicator 367 may indicate that the current mode is a video conference mode, and an accessuser display window 369 may display the names of users currently participating in the video conference.

参考图27，第一用户在菜单栏363中选择“协作”菜单，在显示的子菜单中点击(或触摸)“切换到协作模式”，并且执行到协作模式的切换。Referring to FIG. 27 , the first user selects the “Collaboration” menu in themenu bar 363, clicks (or touches) “Switch to Collaboration Mode” in the displayed submenu, and performs switching to the collaboration mode.

返回参考图23，第一用户终端300可向服务器100请求执行允许对文档的协作编辑的协作服务(操作S2370)。在此情况下，可进一步提供用于设定被协作编辑的文档的安全状态的菜单。例如，响应于用户输入，即点击(或触摸)“切换到协作模式”，被协作编辑的文档的安全级别可被设定。可经由用于分别选择高、中、低的按钮来提供安全级别，并且服务器100上存储文档的DB的位置可选择性地依据所选择的安全级别而变化。例如，如果用户将安全级别设定到高，则创建的群组所工作的文档可被存储在安全文档DB158中。另一方面，如果用户将安全级别设定到中或低，则创建的群组所工作的文档可被存储在文档DB 155中。Referring back to FIG. 23 , thefirst user terminal 300 may request theserver 100 to perform a collaboration service allowing collaborative editing of a document (operation S2370). In this case, a menu for setting the security status of the collaboratively edited document may be further provided. For example, in response to a user input, ie, clicking (or touching) "switch to collaborative mode," the security level of the collaboratively edited document may be set. The security level may be provided via buttons for selecting high, medium, and low, respectively, and the location of the DB where the document is stored on theserver 100 may be selectively changed according to the selected security level. For example, if the user sets the security level to high, the documents on which the created group works may be stored in thesecure document DB 158 . On the other hand, if the user sets the security level to medium or low, the documents on which the created group works may be stored in thedocument DB 155 .

现在将参考图28详细描述在请求执行允许对文档的协作编辑的协作服务时第一至第三用户终端300、400和500的状态。The states of the first tothird user terminals 300 , 400 and 500 upon request to execute a collaboration service allowing collaborative editing of a document will now be described in detail with reference to FIG. 28 .

图28根据示范性实施例图示了当协作服务在视频会议期间被发起以使得第一至第三用户终端300、400和500准备好协作编辑文档时第一至第三用户终端300、400和500的状态。参考图28，第一至第三用户终端300、400和500可连接到服务器100。28 illustrates the first tothird user terminals 300, 400 and the 500 status. Referring to FIG. 28 , the first tothird user terminals 300 , 400 and 500 may be connected to theserver 100 .

示出正被协作编辑的文档的窗口370和示出第二和第三用户(例如，“白”和“崔”)的视频呼叫图像的窗口380可被显示在第一用户终端300上。Awindow 370 showing the document being collaboratively edited and awindow 380 showing video call images of the second and third users (eg, "Bai" and "Cui") may be displayed on thefirst user terminal 300 .

类似地，示出正被协作编辑的文档的窗口470和示出第一和第三用户(例如，“安”和“崔”)的视频呼叫图像的窗口480可被显示在第二用户终端400上。Similarly, awindow 470 showing the document being collaboratively edited and awindow 480 showing video call images of the first and third users (eg, 'Ann' and 'Cui') may be displayed on thesecond user terminal 400 superior.

同样地，示出正被协作编辑的文档的窗口570和示出第一和第二用户(例如，“安”和“白”)的视频呼叫图像的窗口580可被显示在第三用户终端500上。Likewise, thewindow 570 showing the document being collaboratively edited and thewindow 580 showing the video call images of the first and second users (eg, "An" and "White") may be displayed on thethird user terminal 500 superior.

图19图示了当在文档正被处理的同时协作服务被发起以使得第一至第三用户终端300、400和500能够协作编辑文档时第一至第三用户终端300、400和500的状态。图28图示了当在视频会议期间协作服务被发起以使得第一至第三用户终端300、400和500能够协作编辑文档时第一至第三用户终端300、400和500的状态。图19和图28都示出了准备接收协作服务以便协作编辑文档的过程。第一至第三用户终端300、400和500中的每一者示出了在根据执行到协作模式的切换而接收允许对文档的协作编辑的协作服务之后的相同状态。图28所示的示例与图19所示的示例的不同之处仅在于两种不同类型的文档被分别显示在窗口370、470和570中。19 illustrates states of the first tothird user terminals 300, 400 and 500 when a collaboration service is initiated while the document is being processed to enable the first tothird user terminals 300, 400 and 500 to collaboratively edit the document . 28 illustrates states of the first tothird user terminals 300, 400 and 500 when a collaboration service is initiated to enable the first tothird user terminals 300, 400 and 500 to collaboratively edit a document during a video conference. 19 and 28 both illustrate the process of preparing to receive collaboration services for collaborative editing of documents. Each of the first tothird user terminals 300 , 400 and 500 shows the same state after receiving a collaboration service allowing collaborative editing of a document according to performing a switch to the collaboration mode. The example shown in FIG. 28 differs from the example shown in FIG. 19 only in that two different types of documents are displayed inwindows 370, 470, and 570, respectively.

图29根据示范性实施例图示了在用于提供协作服务的服务器100中从视频呼叫图像生成会议纪要并将会议纪要发送到第一至第三用户终端300、400和500中的每一者的过程。如上所述，当文档准备好被协作编辑时，视频呼叫图像可在用户终端之间被交换，并且该文档可被显示在每个用户终端的屏幕上。由于会议纪要是基于视频呼叫图像中包括的语音生成的，所以应当在每个用户终端之间交换视频呼叫图像。换言之，由于虽然没有描述视频呼叫图像的发送/接收，但视频呼叫图像的发送/接收继续直到对终止协作服务的请求被作出为止，所以这里假定在每个用户终端之间连续交换视频呼叫图像。FIG. 29 illustrates generating and transmitting meeting minutes from video call images to each of the first tothird user terminals 300 , 400 and 500 in theserver 100 for providing collaboration services according to an exemplary embodiment the process of. As described above, when the document is ready to be collaboratively edited, video call images can be exchanged between user terminals, and the document can be displayed on the screen of each user terminal. Since the minutes of the meeting are generated based on the voice included in the video call image, the video call image should be exchanged between each user terminal. In other words, since the transmission/reception of the video call image continues until a request for termination of the cooperative service is made although the transmission/reception of the video call image is not described, it is assumed here that the video call image is continuously exchanged between each user terminal.

参考图29，服务器100可将视频呼叫图像中包括的语音转换成文本(操作S2905)。服务器100可将与每个用户相关联的视频呼叫图像中包含的语音转换成文本并基于该文本生成会议纪要。换言之，由于第一至第三用户终端300、400和500中的每一者经由服务器100发送或接收视频呼叫图像，所以每次与每个用户相关联的视频呼叫图像被发送或接收时，服务器100可将视频呼叫图像中包括的语音转换成文本。Referring to FIG. 29, theserver 100 may convert the voice included in the video call image into text (operation S2905). Theserver 100 may convert the speech contained in the video call image associated with each user into text and generate meeting minutes based on the text. In other words, since each of the first tothird user terminals 300, 400, and 500 transmits or receives a video call image via theserver 100, every time a video call image associated with each user is transmitted or received, theserver 100 may convert the speech included in the video call image into text.

服务器100可向第一至第三用户终端300、400和500发送会议纪要(操作S2910)。例如，每次每个用户的视频呼叫图像被发送或接收时，服务器100可将视频呼叫图像中的语音转换成文本并且将包括该文本的会议纪要发送到第一至第三终端300、400和500中的每一者。Theserver 100 may transmit the meeting minutes to the first tothird user terminals 300, 400 and 500 (operation S2910). For example, every time a video call image of each user is transmitted or received, theserver 100 may convert the voice in the video call image into text and transmit the meeting minutes including the text to the first tothird terminals 300, 400 and each of the 500.

第一至第三终端300、400和500中的每一者可显示从服务器100接收的会议纪要(操作S2915)。从在第一至第三终端300、400和500中的每一者上显示会议纪要时起，可认为完整提供了允许对文档的协作编辑的协作服务。Each of the first tothird terminals 300, 400 and 500 may display the meeting minutes received from the server 100 (operation S2915). From the time when the minutes of the meeting are displayed on each of the first tothird terminals 300 , 400 and 500 , it can be considered that a collaboration service allowing collaborative editing of documents is provided completely.

图30根据示范性实施例图示了在用于接收协作服务的第一至第三用户终端300、400和500中的每一者上显示会议纪要的示例。参考图30，第一至第三用户终端300、400和500可连接到用于提供协作服务的服务器100。FIG. 30 illustrates an example of displaying meeting minutes on each of the first tothird user terminals 300, 400, and 500 for receiving a collaboration service, according to an exemplary embodiment. Referring to FIG. 30 , the first tothird user terminals 300, 400 and 500 may be connected to theserver 100 for providing cooperation services.

示出正被协作编辑的文档的窗口370、示出第二和第三用户(例如，“白”和“崔”)的视频呼叫图像的窗口380和示出会议纪要的窗口390可被显示在第一用户终端300上。Awindow 370 showing the document being collaboratively edited, awindow 380 showing the video call images of the second and third users (eg, "Bai" and "Cui"), and awindow 390 showing the meeting minutes may be displayed on the on thefirst user terminal 300 .

类似地，示出正被协作编辑的文档的窗口470、示出第一和第三用户(例如，“安”和“崔”)的视频呼叫图像的窗口480和示出会议纪要的窗口490可被显示在第二用户终端400上。Similarly,window 470 showing the document being collaboratively edited,window 480 showing video call images of the first and third users (eg, "Ann" and "Cui"), andwindow 490 showing the meeting minutes may be is displayed on thesecond user terminal 400 .

类似地，示出正被协作编辑的文档的窗口570、示出第一和第二用户(例如，“安”和“白”)的视频呼叫图像的窗口580和示出会议纪要的窗口590可被显示在第三用户终端500上。Similarly,window 570 showing the document being collaboratively edited,window 580 showing the video call images of the first and second users (eg, "Ann" and "White"), andwindow 590 showing the meeting minutes may be is displayed on thethird user terminal 500 .

从图30清楚可见，在第一用户终端300上显示的窗口390以文本的形式显示了第一用户(例如，“安”)在视频会议期间说了什么。详细而言，会议纪要可包括作为用户信息的“安”、作为关于文本发生的时间的信息的“(09:01)”、作为关于正被协作编辑并且被在文本发生时说出该文本的用户查看的文档中的页的信息的“[1]”以及作为视频呼叫图像中的语音被转换成的文本的“这是今天要协作编辑的文档”。换言之，会议纪要可包括关于会议纪要中的每个文本发生的时间的信息和关于在该文本发生时说出该文本的用户查看的文档中的页的信息。As is clear from FIG. 30, thewindow 390 displayed on thefirst user terminal 300 displays in the form of text what the first user (eg, "An") said during the video conference. In detail, the meeting minutes may include "An" as user information, "(09:01)" as information about when the text occurred, "(09:01)" as information about the text being collaboratively edited and spoken as the text occurred "[1]" of the information of the page in the document viewed by the user, and "This is a document to be collaboratively edited today" as the text into which the voice in the video call image is converted. In other words, the meeting minutes may include information about when each text in the meeting minutes occurred and information about the pages in the document viewed by the user who spoke the text when the text occurred.

此外，在第二用户终端400和第三用户终端500上显示的示出会议纪要的窗口490和590包括与在第一用户终端300上显示的窗口390相同的细节。Also, thewindows 490 and 590 showing the minutes of the meeting displayed on thesecond user terminal 400 and thethird user terminal 500 include the same details as thewindow 390 displayed on thefirst user terminal 300 .

图31根据示范性实施例图示了在用于接收协作服务的第一至第三用户终端300、400和500中的每一者上显示会议纪要的另一示例。参考图31，第一至第三用户终端300、400和500可连接到用于提供协作服务的服务器100。FIG. 31 illustrates another example of displaying meeting minutes on each of the first tothird user terminals 300, 400, and 500 for receiving a collaboration service, according to an exemplary embodiment. Referring to FIG. 31 , the first tothird user terminals 300, 400 and 500 may be connected to theserver 100 for providing cooperation services.

如上文参考图30所述，示出正被协作编辑的文档的窗口370、470和570、示出除了特定用户以外的其余用户的视频呼叫图像的窗口380、480和580以及示出会议纪要的窗口390、490和590可分别被显示在第一至第三用户终端300、400和500上。在此情况下，会议纪要可包括关于会议纪要中的每个文本发生的时间的信息和关于在该文本发生时说出该文本的用户查看的文档中的页的信息。As described above with reference to FIG. 30 ,windows 370 , 470 and 570 showing documents being collaboratively edited,windows 380 , 480 and 580 showing video call images of users other than a specific user, andwindows 380 , 480 and 580 showingmeeting minutes Windows 390, 490 and 590 may be displayed on the first tothird user terminals 300, 400 and 500, respectively. In this case, the meeting minutes may include information about the time each text in the meeting minutes occurred and information about the pages in the document viewed by the user who spoke the text when the text occurred.

图30和图31分别示出了通过执行图15和图23的过程获得的结果。图31所示的示例与图30所示的示例的不同之处仅在于两种不同类型的文档被分别显示在窗口370、470和570中。Figures 30 and 31 show the results obtained by performing the procedures of Figures 15 and 23, respectively. The example shown in FIG. 31 differs from the example shown in FIG. 30 only in that two different types of documents are displayed inwindows 370, 470, and 570, respectively.

图32根据示范性实施例图示了向用于提供协作服务的服务器100请求管理群组成员和彼此协作的群组的过程。在服务器100在提供允许对文档的协作编辑的协作服务的同时，居于群组之首的第一用户可认为有必要管理群组成员或群组。换言之，第一用户可能想要改变关于群组中的每个成员的信息或者将具有较大的大小的群组分割成若干个更小的群组。FIG. 32 illustrates a process of requesting theserver 100 for providing collaboration services to manage group members and groups that collaborate with each other, according to an exemplary embodiment. While theserver 100 provides a collaboration service that allows collaborative editing of documents, a first user at the head of the group may consider it necessary to manage group members or groups. In other words, the first user may want to change information about each member of the group or split a group of larger size into several smaller groups.

现在将参考图32描述对群组成员的管理。The management of group members will now be described with reference to FIG. 32 .

参考图32，第一用户终端300可执行群组成员管理菜单(操作S3205)。第一用户可在执行群组成员管理菜单时弹出的群组成员窗口中设定每个群组成员或每个群组成员所属的子群组的权限。Referring to FIG. 32, thefirst user terminal 300 may execute a group member management menu (operation S3205). The first user can set the authority of each group member or the subgroup to which each group member belongs in the group member window popped up when the group member management menu is executed.

第一用户终端300可向服务器100发送关于每个群组成员的信息(操作S3210)。换言之，如果第一用户终端300执行群组成员管理菜单以使得对关于每个群组成员的信息作出改变，则第一用户终端300可将关于每个群组成员的信息发送到服务器100以反映出该改变。Thefirst user terminal 300 may transmit information on each group member to the server 100 (operation S3210). In other words, if thefirst user terminal 300 executes the group member management menu so that a change is made to the information about each group member, thefirst user terminal 300 may transmit the information about each group member to theserver 100 to reflect out the change.

服务器100可存储关于每个群组成员的信息(操作S3215)。现在将参考图33详细描述通过设定关于每个群组成员的信息来管理群组成员。Theserver 100 may store information about each group member (operation S3215). The management of group members by setting information on each group member will now be described in detail with reference to FIG. 33 .

图33根据示范性实施例图示了在用于接收协作服务的第一用户终端300中设定关于每个群组成员的信息的示例。FIG. 33 illustrates an example of setting information on each group member in thefirst user terminal 300 for receiving a collaboration service, according to an exemplary embodiment.

参考图33，在第一用户终端300的用户界面屏幕360上，第一用户可选择地址窗口361与带状菜单栏365之间的菜单栏363中的“协作”菜单，然后选择显示的子菜单中的“管理群组成员”。Referring to FIG. 33 , on theuser interface screen 360 of thefirst user terminal 300, the first user can select the "Collaboration" menu in themenu bar 363 between theaddress window 361 and theribbon menu bar 365, and then select the displayed submenu Manage group members in .

然后，管理群组成员窗口364可被显示在第一用户终端300的用户界面屏幕360上。第一用户可通过改变或设定关于当前成员的信息并按压“完成”按钮来设定关于每个群组成员的信息。参考图33，第二用户(例如，“白”)具有读和写的权限并且属于子群组G1-1。类似地，第三用户(例如，“崔”)具有读和写的权限并且属于子群组G1-2。Then, a managementgroup member window 364 may be displayed on theuser interface screen 360 of thefirst user terminal 300 . The first user can set the information about each group member by changing or setting the information about the current member and pressing the "Done" button. Referring to FIG. 33, a second user (eg, "white") has read and write permissions and belongs to the subgroup G1-1. Similarly, a third user (eg, "Cui") has read and write permissions and belongs to subgroup G1-2.

返回参考图32，第一用户终端300可执行群组管理菜单(操作S3220)。Referring back to FIG. 32, thefirst user terminal 300 may execute a group management menu (operation S3220).

第一用户终端300可向服务器100请求分割群组(操作S3225)。Thefirst user terminal 300 may request theserver 100 to divide the group (operation S3225).

服务器100可根据来自第一用户终端300的请求将群组分割成更小的群组(操作S3230)。现在将参考图34详细描述群组的管理。Theserver 100 may divide the group into smaller groups according to the request from the first user terminal 300 (operation S3230). The management of groups will now be described in detail with reference to FIG. 34 .

图34根据示范性实施例图示了在用于接收协作服务的第一用户终端300中将当前群组分割成多个群组的示例。FIG. 34 illustrates an example of dividing a current group into a plurality of groups in thefirst user terminal 300 for receiving a collaboration service, according to an exemplary embodiment.

如上文参考图33所述，关于每个群组成员的信息可被设定以使得第二用户(例如，“白”)与第三用户(例如，“崔”)属于不同的子群组。如果具有不同子群组的多个用户属于单个群组，则居于群组之首的第一用户可分割该群组。As described above with reference to FIG. 33, the information about each group member may be set such that the second user (eg, "Bai") and the third user (eg, "Cui") belong to different subgroups. If multiple users with different subgroups belong to a single group, the first user at the head of the group can split the group.

参考图34，在第一用户终端300的用户界面屏幕360上，第一用户可选择地址窗口361与带状菜单栏365之间的菜单栏363中的“协作”菜单，然后选择显示的子菜单中的“管理群组”。Referring to FIG. 34 , on theuser interface screen 360 of thefirst user terminal 300, the first user can select the "Collaboration" menu in themenu bar 363 between theaddress window 361 and theribbon menu bar 365, and then select the displayed submenu Manage Groups in .

然后，可进一步显示子菜单“分割群组”和“合并群组”。如果具有不同子群组的多个用户属于当前群组，并且从而当前群组要被分割，则子菜单“分割群组”可被激活。通过选择子菜单“分割群组”，第一用户可将当前群组分割成多个子群组。现在将参考图35详细描述分割群组的结果。Then, submenus "Split Group" and "Merge Group" may be further displayed. If multiple users with different subgroups belong to the current group, and thus the current group is to be split, the submenu "Split Group" may be activated. By selecting the sub-menu "Split Group", the first user can split the current group into multiple sub-groups. The result of dividing the group will now be described in detail with reference to FIG. 35 .

图35图示了在当前群组被分割成多个群组时第一至第三用户终端300、400和500中的每一者的状态。FIG. 35 illustrates the state of each of the first tothird user terminals 300, 400, and 500 when the current group is divided into a plurality of groups.

参考图35，第一至第三用户终端300、400和500可连接到用于提供协作服务的服务器100。Referring to FIG. 35 , the first tothird user terminals 300, 400 and 500 may be connected to theserver 100 for providing a collaboration service.

示出正被协作编辑的文档的窗口370、示出第二和第三用户(例如，“用户B”和“用户C”)的视频呼叫图像的窗口380和示出会议纪要的窗口390可被显示在第一用户终端300上。此外，访问用户显示窗口369指示出第一用户(例如，“用户A”)属于“群组1-1”和“群组1-2”并且在与第一用户属于至少一个相同群组的用户之中的“用户B”和“用户C”当前正在访问服务器100。Window 370 showing the document being collaboratively edited,window 380 showing video call images of the second and third users (eg, "User B" and "User C"), andwindow 390 showing the meeting minutes can be displayed on thefirst user terminal 300 . Additionally, the visitinguser display window 369 indicates that the first user (eg, "User A") belongs to "Group 1-1" and "Group 1-2" and is among users who belong to at least one same group as the first user Among them, "User B" and "User C" are currently accessing theserver 100 .

示出正被协作编辑的文档的窗口470、示出第一用户(例如，“用户A”)的视频呼叫图像的窗口480和示出会议纪要的窗口490可被显示在第二用户终端400上。此外，访问用户显示窗口469指示出第二用户(例如，“用户B”)属于“群组1-1”并且在与第二用户属于相同群组的用户之中的“用户A”当前在访问服务器100。Awindow 470 showing the document being collaboratively edited, awindow 480 showing a video call image of the first user (eg, "User A"), and awindow 490 showing the minutes of the meeting may be displayed on thesecond user terminal 400 . In addition, the visitinguser display window 469 indicates that the second user (eg, "User B") belongs to "Group 1-1" and that "User A" among users belonging to the same group as the second user is currently visitingserver 100.

示出正被协作编辑的文档的窗口570、示出第一用户(例如，“用户A”)的视频呼叫图像的窗口580和示出会议纪要的窗口590可被显示在第三用户终端500上。此外，访问用户显示窗口569指示出第三用户(例如，“用户C”)属于“群组1-2”并且在与第三用户属于相同群组的用户之中的“用户A”当前在访问服务器100。Thewindow 570 showing the document being collaboratively edited, thewindow 580 showing the video call image of the first user (eg, "User A"), and thewindow 590 showing the meeting minutes may be displayed on thethird user terminal 500 . Further, the visitinguser display window 569 indicates that a third user (eg, "User C") belongs to "Group 1-2" and that "User A" among users belonging to the same group as the third user is currently visitingserver 100.

换言之，由于第一和第二用户即“用户A”和“用户B”属于“群组1-1”，并且第一和第三用户即“用户A”和“用户C”属于“群组1-2”，所以可以看出第二和第三用户由于对当前群组的分割而不属于相同群组。In other words, since the first and second users namely "User A" and "User B" belong to "Group 1-1", and the first and third users namely "User A" and "User C" belong to "Group 1" -2", so it can be seen that the second and third users do not belong to the same group due to the split of the current group.

如果要协作编辑两种类型的文档并且对于每类文档需要协作，则如图35所示，通过将群组分割成多个子群组可实现高效的协作。If two types of documents are to be collaboratively edited and collaboration is required for each type of document, efficient collaboration can be achieved by dividing the group into multiple subgroups as shown in FIG. 35 .

图36根据示范性实施例图示了在用于提供协作服务的服务器100中限制正被协作编辑的文档的编辑范围的过程。由于当多个用户在文档上彼此协作时文档被协作编辑，所以可对每个用户预先指定编辑范围以防止编辑期间的冲突。FIG. 36 illustrates a process of limiting the editing scope of a document being collaboratively edited in theserver 100 for providing a collaboration service, according to an exemplary embodiment. Since a document is collaboratively edited when a plurality of users collaborate on a document with each other, an editing range can be pre-designated for each user to prevent conflicts during editing.

首先，将参考图36描述第一编辑范围被第一用户锁定的示例。First, an example in which the first editing range is locked by the first user will be described with reference to FIG. 36 .

第一用户可通过使用第一用户终端300来指定第一编辑范围(操作S3605)。The first user may designate the first editing range by using the first user terminal 300 (operation S3605).

第一用户终端300可将第一用户指定的第一编辑范围发送到服务器100(操作S3610)。Thefirst user terminal 300 may transmit the first editing range designated by the first user to the server 100 (operation S3610).

服务器100可基于第一编辑范围锁定正被协作编辑的文档的与第一编辑范围相对应的部分(操作S3615)。Theserver 100 may lock a portion of the document being collaboratively edited corresponding to the first editing scope based on the first editing scope (operation S3615).

服务器100可将锁定了第一编辑范围的文档作为基于web的文档发送到第一至第三用户终端300、400和500(操作S3620)。Theserver 100 may transmit the document in which the first editing range is locked to the first tothird user terminals 300, 400 and 500 as web-based documents (operation S3620).

第一至第三用户终端300、400和500可分别经由web浏览器显示锁定了第一编辑范围并被作为基于web的文档发送的文档(操作S3625)。The first tothird user terminals 300, 400, and 500 may display the documents, which are locked in the first editing range and sent as web-based documents, via web browsers, respectively (operation S3625).

接下来，将参考图36描述第二编辑范围被第二用户锁定的示例。Next, an example in which the second editing range is locked by the second user will be described with reference to FIG. 36 .

第二用户可通过使用第二用户终端400来指定第二编辑范围(操作S3630)。The second user may designate the second editing range by using the second user terminal 400 (operation S3630).

第二用户终端400可将第二用户指定的第二编辑范围发送到服务器100(操作S3635)。Thesecond user terminal 400 may transmit the second editing range designated by the second user to the server 100 (operation S3635).

服务器100可基于第二编辑范围锁定正被协作编辑的文档的与第二编辑范围相对应的部分(操作S3640)。Theserver 100 may lock a portion of the document being collaboratively edited corresponding to the second editing scope based on the second editing scope (operation S3640).

服务器100可将锁定了第二编辑范围的文档作为基于web的文档发送到第一至第三用户终端300、400和500(操作S3645)。Theserver 100 may transmit the document in which the second editing range is locked to the first tothird user terminals 300, 400 and 500 as web-based documents (operation S3645).

第一至第三用户终端300、400和500可分别经由web浏览器显示锁定了第二编辑范围并被作为基于web的文档发送的文档(操作S3650)。The first tothird user terminals 300, 400, and 500 may display the documents that are locked with the second editing range and sent as web-based documents via web browsers, respectively (operation S3650).

最后，将参考图36描述第三编辑范围被第三用户锁定的示例。Finally, an example in which the third editing range is locked by the third user will be described with reference to FIG. 36 .

第三用户可通过使用第三用户终端500来指定第三编辑范围(操作S3655)。The third user may designate the third editing range by using the third user terminal 500 (operation S3655).

第三用户终端500可将第三用户指定的第三编辑范围发送到服务器100(操作S3660)。Thethird user terminal 500 may transmit the third editing range designated by the third user to the server 100 (operation S3660).

服务器100可基于第三编辑范围锁定正被协作编辑的文档的与第三编辑范围相对应的部分(操作S3665)。Theserver 100 may lock a portion of the document being collaboratively edited corresponding to the third editing scope based on the third editing scope (operation S3665).

服务器100可将锁定了第三编辑范围的文档作为基于web的文档发送到第一至第三用户终端300、400和500(操作S3670)。Theserver 100 may transmit the document in which the third editing range is locked to the first tothird user terminals 300, 400 and 500 as web-based documents (operation S3670).

第一至第三用户终端300、400和500可分别经由web浏览器显示锁定了第三编辑范围并被作为基于web的文档发送的文档(操作S3675)。The first tothird user terminals 300 , 400 , and 500 may display the documents that have locked the third editing range and are transmitted as web-based documents via web browsers, respectively (operation S3675 ).

现在将参考图37至图40详细描述显示对于每个用户锁定了编辑范围的文档的方法。A method of displaying a document whose editing range is locked for each user will now be described in detail with reference to FIGS. 37 to 40 .

图37根据示范性实施例图示了在用于接收协作服务的第一用户终端300中由第一用户锁定第一编辑范围371的示例。FIG. 37 illustrates an example in which thefirst editing range 371 is locked by the first user in thefirst user terminal 300 for receiving the collaboration service, according to an exemplary embodiment.

参考图37，示出正被协作编辑的文档的窗口370、示出视频呼叫图像的窗口380和示出会议纪要的窗口390可被显示在第一用户终端300上。在此情况下，当第一用户(例如，“安”)指定窗口370中显示的文档中的第一页并且请求用于提供协作服务的服务器(图36中的100)锁定第一编辑范围371时，锁定了第一编辑范围371的文档可如图37所示被显示。可以利用与每个用户相对应的预定颜色、图案或标记指示出每个用户的编辑范围被锁定，以便其他用户可认识到它。Referring to FIG. 37 , awindow 370 showing a document being collaboratively edited, awindow 380 showing a video call image, and awindow 390 showing a meeting minutes may be displayed on thefirst user terminal 300 . In this case, when the first user (eg, "An") designates the first page in the document displayed in thewindow 370 and requests the server for providing the collaboration service (100 in FIG. 36 ) to lock thefirst editing range 371 , the document in which thefirst editing range 371 is locked may be displayed as shown in FIG. 37 . Each user's edit range may be indicated to be locked with a predetermined color, pattern or mark corresponding to each user so that other users can recognize it.

此外，第一用户的视频呼叫图像被输出到窗口380，并且第一用户说出的文本被显示在窗口390中。换言之，与说出会议纪要中的文本的用户相关联的视频呼叫图像可与会议纪要一起被显示。为此，在窗口380中可只显示与会议纪要中的文本相对应的视频呼叫图像。Also, the video call image of the first user is output to thewindow 380 , and the text spoken by the first user is displayed in thewindow 390 . In other words, a video call image associated with the user speaking the text in the meeting minutes may be displayed with the meeting minutes. To this end, only the video call image corresponding to the text in the meeting minutes may be displayed in thewindow 380 .

图38根据示范性实施例图示了在用于接收协作服务的第一用户终端300中由第二用户锁定第二编辑范围372的示例。FIG. 38 illustrates an example in which thesecond editing range 372 is locked by the second user in thefirst user terminal 300 for receiving the collaboration service, according to an exemplary embodiment.

参考图38，示出正被协作编辑的文档的窗口370、示出视频呼叫图像的窗口380和示出会议纪要的窗口390可被显示在第一用户终端300上。在此情况下，当第二用户(例如，“白”)利用第二用户终端400指定正被协作编辑的文档中的第二页并且请求服务器(图36中的100)锁定第二编辑范围372时，锁定了第二编辑范围372的文档可如图38所示被显示。Referring to FIG. 38 , awindow 370 showing a document being collaboratively edited, awindow 380 showing a video call image, and awindow 390 showing a meeting minutes may be displayed on thefirst user terminal 300 . In this case, when the second user (eg, "white") specifies the second page in the document being collaboratively edited using thesecond user terminal 400 and requests the server (100 in FIG. 36 ) to lock thesecond editing range 372 , the document in which thesecond editing range 372 is locked may be displayed as shown in FIG. 38 .

此外，第二用户的视频呼叫图像被输出到窗口380，并且第二用户说出的文本被显示在窗口390中。换言之，与说出会议纪要中的文本的用户相关联的视频呼叫图像可与会议纪要一起被显示。为此，在窗口380中可只显示与会议纪要中的文本相对应的视频呼叫图像。Also, the video call image of the second user is output to thewindow 380 , and the text spoken by the second user is displayed in thewindow 390 . In other words, a video call image associated with the user speaking the text in the meeting minutes may be displayed with the meeting minutes. To this end, only the video call image corresponding to the text in the meeting minutes may be displayed in thewindow 380 .

图39根据示范性实施例图示了在用于接收协作服务的第一用户终端300中由第三用户锁定第三编辑范围373的示例。FIG. 39 illustrates an example in which thethird editing range 373 is locked by the third user in thefirst user terminal 300 for receiving the collaboration service, according to an exemplary embodiment.

参考图39，示出正被协作编辑的文档的窗口370、示出视频呼叫图像的窗口380和示出会议纪要的窗口390可被显示在第一用户终端300上。在此情况下，当第三用户(例如，“崔”)利用第三用户终端500指定正被协作编辑的文档中的第三页并且请求服务器(图36中的100)锁定第三编辑范围373时，锁定了第三编辑范围373的文档可如图39所示被显示。Referring to FIG. 39 , awindow 370 showing a document being collaboratively edited, awindow 380 showing a video call image, and awindow 390 showing a meeting minutes may be displayed on thefirst user terminal 300 . In this case, when the third user (eg, "Cui") specifies the third page in the document being collaboratively edited using thethird user terminal 500 and requests the server (100 in FIG. 36 ) to lock thethird editing range 373 , the document in which thethird editing range 373 is locked may be displayed as shown in FIG. 39 .

此外，第三用户的视频呼叫图像被输出到窗口380，并且第三用户说出的文本被显示在窗口390中。换言之，与说出会议纪要中的文本的用户相关联的视频呼叫图像可与会议纪要一起被显示。为此，在窗口380中可只显示与会议纪要中的文本相对应的视频呼叫图像。Also, the video call image of the third user is output to thewindow 380 , and the text spoken by the third user is displayed in thewindow 390 . In other words, a video call image associated with the user speaking the text in the meeting minutes may be displayed with the meeting minutes. To this end, only the video call image corresponding to the text in the meeting minutes may be displayed in thewindow 380 .

参考图37至图39，第一至第三用户中的每一者可对正被协作编辑的文档中的每一页指定编辑范围。另外，第一至第三用户中的每一者在他或她自己的用户终端上查看的文档的页号与会议纪要中的文本一起被显示。可通过转换每个用户的视频呼叫图像中的语音来获得文本。关于文本发生的时间的信息也可与文本和页号一起被显示，并且与会议纪要中的最新文本相对应的用户的视频呼叫图像被显示。Referring to FIGS. 37 to 39 , each of the first to third users may specify an editing range for each page in the document being collaboratively edited. In addition, the page number of the document viewed by each of the first to third users on his or her own user terminal is displayed together with the text in the meeting minutes. The text can be obtained by converting the speech in the video call image of each user. Information about when the text occurred may also be displayed along with the text and page number, and the user's video call image corresponding to the latest text in the meeting minutes is displayed.

图40根据示范性实施例图示了在用于接收协作服务的第一用户终端300中对于页中的多个区域锁定第一至第三编辑范围371至373的示例。FIG. 40 illustrates an example in which the first to third editing ranges 371 to 373 are locked for a plurality of regions in a page in thefirst user terminal 300 for receiving a collaboration service, according to an exemplary embodiment.

参考图40，示出正被协作编辑的文档的窗口370、示出视频呼叫图像的窗口380和示出会议纪要的窗口390可被显示在第一用户终端300上。Referring to FIG. 40 , awindow 370 showing a document being collaboratively edited, awindow 380 showing a video call image, and awindow 390 showing a meeting minutes may be displayed on thefirst user terminal 300 .

当第一用户(例如，“安”)指定在窗口370中显示的文档中的第一页中的区域为第一编辑范围371并且请求用于提供协作服务的服务器(图36中的100)锁定该区域时，锁定了第一编辑范围371的文档可如图40所示被显示。When the first user (eg, "An") designates an area in the first page of the document displayed in thewindow 370 as thefirst editing range 371 and requests the server (100 in FIG. 36 ) for providing the collaboration service to be locked In this area, the document in which thefirst editing range 371 is locked can be displayed as shown in FIG. 40 .

另外，当第二用户(例如，“白”)利用第二用户终端400指定正被协作编辑的文档的第一页中的一区域为第二编辑范围372并且请求服务器(图36中的100)锁定第二编辑范围372时，锁定了第二编辑范围372的文档可如图40所示被显示。In addition, when the second user (eg, "white") uses thesecond user terminal 400 to designate an area in the first page of the document being collaboratively edited as thesecond editing range 372 and requests the server (100 in FIG. 36 ) When thesecond editing range 372 is locked, the document in which thesecond editing range 372 is locked may be displayed as shown in FIG. 40 .

在此情况下，当第三用户(例如，“崔”)利用第三用户终端500指定正被协作编辑的文档的第一页中的区域为第三编辑范围373并且请求服务器(图36中的100)锁定第三编辑范围373时，锁定了第三编辑范围373的文档可如图40所示被显示。In this case, when a third user (eg, "Cui") uses thethird user terminal 500 to designate an area in the first page of the document being collaboratively edited as thethird editing range 373 and requests the server (in FIG. 36 ) 100) When thethird editing range 373 is locked, the document in which thethird editing range 373 is locked can be displayed as shown in FIG. 40 .

此外，第三用户的视频呼叫图像被输出到窗口380，并且第三用户说出的文本被显示在窗口390中。换言之，与说出会议纪要中的文本的用户相关联的视频呼叫图像可与会议纪要一起被显示。为此，在窗口380中可只显示与会议纪要中的文本相对应的视频呼叫图像。Also, the video call image of the third user is output to thewindow 380 , and the text spoken by the third user is displayed in thewindow 390 . In other words, a video call image associated with the user speaking the text in the meeting minutes may be displayed with the meeting minutes. To this end, only the video call image corresponding to the text in the meeting minutes may be displayed in thewindow 380 .

参考图40，第一至第三用户中的每一者可对正被协作编辑的文档内的一页的每个区域指定编辑范围。另外，第一至第三用户中的每一者在他或她自己的用户终端上查看的文档的页号与会议纪要中的文本一起被显示。可通过转换每个用户的视频呼叫图像中的语音来获得文本。关于文本发生的时间的信息也可与文本和页号一起被显示，并且与会议纪要中的最新文本相对应的用户的视频呼叫图像被显示。Referring to FIG. 40 , each of the first to third users may specify an editing range for each area of a page within the document being collaboratively edited. In addition, the page number of the document viewed by each of the first to third users on his or her own user terminal is displayed together with the text in the meeting minutes. The text can be obtained by converting the speech in the video call image of each user. Information about when the text occurred may also be displayed along with the text and page number, and the user's video call image corresponding to the latest text in the meeting minutes is displayed.

图41根据示范性实施例图示了在用于提供协作服务的服务器100中编辑被协作编辑的文档的过程。FIG. 41 illustrates a process of editing a collaboratively edited document in theserver 100 for providing collaborative services, according to an exemplary embodiment.

首先，将参考图41详细描述被协作编辑的文档被第一用户根据第一编辑信息来编辑并被显示的示例。First, an example in which a collaboratively edited document is edited by the first user according to the first editing information and displayed will be described in detail with reference to FIG. 41 .

第一用户可在第一用户终端300中编辑被协作编辑的文档(操作S4105)。The first user may edit the collaboratively edited document in the first user terminal 300 (operation S4105).

第一用户终端300可将第一编辑信息发送到服务器100(操作S4110)。Thefirst user terminal 300 may transmit the first editing information to the server 100 (operation S4110).

服务器100可存储第一编辑信息(操作S4115)。Theserver 100 may store the first editing information (operation S4115).

服务器100可将编辑的文档作为基于web的文档发送到第一至第三用户终端300、400和500(操作S4120)。Theserver 100 may transmit the edited document as a web-based document to the first tothird user terminals 300, 400 and 500 (operation S4120).

第一至第三用户终端300、400和500可分别经由web浏览器显示被根据第一编辑信息编辑并被作为基于web的文档发送的文档(操作S4125)。The first tothird user terminals 300, 400, and 500 may display documents edited according to the first editing information and transmitted as web-based documents via web browsers, respectively (operation S4125).

接下来，将参考图41详细描述被协作编辑的文档被第二用户根据第二编辑信息来编辑并被显示的示例。Next, an example in which the collaboratively edited document is edited by the second user according to the second editing information and displayed will be described in detail with reference to FIG. 41 .

第二用户可在第二用户终端400中编辑被协作编辑的文档(操作S4130)。The second user may edit the collaboratively edited document in the second user terminal 400 (operation S4130).

第二用户终端400可将第二编辑信息发送到服务器100(操作S4135)。Thesecond user terminal 400 may transmit the second editing information to the server 100 (operation S4135).

服务器100可存储第二编辑信息(操作S4140)。Theserver 100 may store the second editing information (operation S4140).

服务器100可将编辑的文档作为基于web的文档发送到第一至第三用户终端300、400和500(操作S4145)。Theserver 100 may transmit the edited document as a web-based document to the first tothird user terminals 300, 400 and 500 (operation S4145).

第一至第三用户终端300、400和500可分别经由web浏览器显示被根据第二编辑信息编辑并被作为基于web的文档发送的文档(操作S4150)。The first tothird user terminals 300, 400, and 500 may display documents edited according to the second editing information and transmitted as web-based documents via web browsers, respectively (operation S4150).

现在将参考图42和图43描述被协作编辑的文档被第一和第二用户根据第一编辑信息和第二编辑信息顺序编辑的示例。An example in which a collaboratively edited document is sequentially edited by the first and second users according to the first edit information and the second edit information will now be described with reference to FIGS. 42 and 43 .

图42根据示范性实施例图示了在用于接收协作服务的第一用户终端300中由第一用户编辑被协作编辑的文档的示例。FIG. 42 illustrates an example of editing a collaboratively edited document by a first user in thefirst user terminal 300 for receiving a collaborative service, according to an exemplary embodiment.

参考图42，示出正被协作编辑的文档的窗口370、示出视频呼叫图像的窗口380和示出会议纪要的窗口390可被显示在第一用户终端300上。Referring to FIG. 42 , awindow 370 showing a document being collaboratively edited, awindow 380 showing a video call image, and awindow 390 showing a meeting minutes may be displayed on thefirst user terminal 300 .

当第一用户(例如，“安”)编辑在窗口370中显示的文档的第一页中的一部分，通过视频呼叫图像说出关于对该部分的编辑并且向用于提供协作服务的服务器(图41中的100)请求编辑时，如图42所示那样指示的具有由指示“安”的“A”表示的被编辑部分的文档可被显示。When the first user (eg, "An") edits a part of the first page of the document displayed in thewindow 370, speaks about the edit of the part through a video call image and reports to the server for providing the collaboration service (Fig. When editing is requested at 100) in 41, the document with the edited portion indicated by "A" indicating "An" as indicated in FIG. 42 may be displayed.

可利用与每个用户相对应的预定颜色、图案或标记来指示被编辑部分以使得其他用户可认识到谁编辑了该部分。The edited portion may be indicated with a predetermined color, pattern or indicia corresponding to each user so that other users may recognize who edited the portion.

参考图42，第一用户可编辑作为正被协作编辑的文档中的目录的一部分的目标，通过视频呼叫图像说出关于对该部分的编辑，并且在会议纪要中显示通过转换视频呼叫图像中的第一用户的语音来获得的文本。Referring to FIG. 42 , the first user can edit an object that is a part of the table of contents in the document being collaboratively edited, speak about the editing of the part through a video call image, and display in the meeting minutes by converting the content in the video call image. The first user's speech to get the text.

图43根据示范性实施例图示了在用于接收协作服务的第二用户终端400中由第二用户编辑被协作编辑的文档的示例。FIG. 43 illustrates an example of editing a collaboratively edited document by a second user in thesecond user terminal 400 for receiving a collaborative service, according to an exemplary embodiment.

参考图43，示出正被协作编辑的文档的窗口470、示出视频呼叫图像的窗口480和示出会议纪要的窗口490可被显示在第二用户终端400上。Referring to FIG. 43 , awindow 470 showing a document being collaboratively edited, awindow 480 showing a video call image, and awindow 490 showing a meeting minutes may be displayed on thesecond user terminal 400 .

当第二用户(例如，“白”)编辑正被协作编辑的文档的第二页中的一部分，通过视频呼叫图像说出关于对该部分的编辑并且向用于提供协作服务的服务器(图41中的100)请求编辑时，如图43所示那样指示的具有由指示“白”的“B”表示的被编辑部分的文档可被显示。When a second user (eg, "White") edits a part of the second page of the document being collaboratively edited, speaks about the editing of the part through a video call image and reports to the server for providing collaborative services (FIG. 41) When editing is requested at 100) in , the document with the edited portion indicated by "B" indicating "white" as indicated in FIG. 43 may be displayed.

可利用与每个用户相对应的预定颜色、图案或标记来指示被编辑部分以使得其他用户可认识到谁编辑了该部分。The edited portion may be indicated with a predetermined color, pattern or indicia corresponding to each user so that other users may recognize who edited the portion.

参考图43，第二用户可利用触摸笔编辑正被协作编辑的文档的第二页中的一部分，通过视频呼叫图像说出关于对该部分的编辑，并且在会议纪要中显示通过转换视频呼叫图像中的第二用户的语音来获得的文本。Referring to FIG. 43 , the second user can edit a part of the second page of the document being collaboratively edited using the touch pen, speak about the editing of the part through the video call image, and display the video call image by converting the video call image in the meeting minutes text in the second user's voice.

图44根据示范性实施例图示了在用于接收协作服务的第二用户终端400中利用会议纪要来识别正被协作编辑的文档的编辑信息的示例。FIG. 44 illustrates an example of identifying editing information of a document being collaboratively edited using meeting minutes in thesecond user terminal 400 for receiving a collaboration service, according to an exemplary embodiment.

参考图44，示出正被协作编辑的文档的窗口470、示出视频呼叫图像的窗口480和示出会议纪要的窗口490可被显示在第二用户终端400上。当在窗口490中累积了文本时，在窗口490的右侧可创建滚动条。Referring to FIG. 44 , awindow 470 showing a document being collaboratively edited, awindow 480 showing a video call image, and awindow 490 showing a meeting minutes may be displayed on thesecond user terminal 400 . When text is accumulated inwindow 490, a scroll bar may be created on the right side ofwindow 490.

服务器100可从第二用户终端400接收关于用户从会议纪要中选择的文本的信息并且向第二用户终端400发送关于正被协作编辑的文档的与所选择的文本同步的被编辑部分的信息。详细而言，如果在窗口490中选择了另一用户的文本，则与所选择的文本相对应的文档的编辑信息可被显示在窗口470中。这在会议纪要与文档同步时是可能的。Theserver 100 may receive information on the text selected by the user from the meeting minutes from thesecond user terminal 400 and transmit to thesecond user terminal 400 information on the edited part of the document being collaboratively edited synchronized with the selected text. In detail, if another user's text is selected in thewindow 490 , editing information of the document corresponding to the selected text may be displayed in thewindow 470 . This is possible when meeting minutes are synchronized with documents.

图45根据示范性实施例图示了在用于接收协作服务的第二用户终端400中利用会议纪要来编辑正被协作编辑的文档的示例。FIG. 45 illustrates an example of editing a document being collaboratively edited using meeting minutes in thesecond user terminal 400 for receiving a collaborative service, according to an exemplary embodiment.

参考图45，示出正被协作编辑的文档的窗口470、示出视频呼叫图像的窗口480和示出会议纪要的窗口490可被显示在第二用户终端400上。Referring to FIG. 45 , awindow 470 showing a document being collaboratively edited, awindow 480 showing a video call image, and awindow 490 showing a meeting minutes may be displayed on thesecond user terminal 400 .

用于提供协作服务的服务器(图41中的100)可从第二用户终端400接收关于用户从会议纪要中选择的文本的信息并且识别出是否有正被协作编辑的文档的与所选择的文本同步的被编辑部分。详细而言，如果第二用户从窗口490中选择他或她自己的文本并且没有与所选择的文本相对应的文档的编辑信息，则可利用所选择的文本作为文档的编辑信息来编辑该文档。这样，可利用在窗口490中显示的文本来编辑在窗口470中显示的文档。The server for providing the collaboration service (100 in FIG. 41 ) may receive information about the text selected by the user from the meeting minutes from thesecond user terminal 400 and identify whether there is a document being collaboratively edited with the selected text The edited part of the synchronization. In detail, if the second user selects his or her own text from thewindow 490 and there is no editing information of the document corresponding to the selected text, the document may be edited using the selected text as the editing information of the document . In this way, the document displayed inwindow 470 can be edited with the text displayed inwindow 490 .

图46根据示范性实施例图示了如下示例：在用于接收协作服务的用户终端中，对于正被协作编辑的文档的图像、视频呼叫图像和会议纪要中的每一者设定设备以便利用向用户终端注册的其他设备分开显示文档的图像、视频呼叫图像和会议纪要。FIG. 46 illustrates an example in which, in a user terminal for receiving a collaboration service, a device is set for each of an image of a document being collaboratively edited, a video call image, and a meeting minutes so as to utilize, according to an exemplary embodiment. Other devices registered with the user terminal separately display the image of the document, the image of the video call, and the minutes of the meeting.

详细而言，图46图示了图像特定设备设定窗口366。如果用户难以查看对正被协作编辑的文档的编辑、会议纪要和视频呼叫图像，则可对每个图像执行设备设定以使得文档的图像、视频呼叫图像和会议纪要中的至少一者被显示在当前向用户终端注册的设备上。In detail, FIG. 46 illustrates an image-specificdevice setting window 366 . If it is difficult for a user to view edits to the document being collaboratively edited, the meeting minutes, and the video call image, device settings may be performed for each image such that at least one of the document's image, the video call image, and the meeting minutes is displayed On the device currently registered with the user terminal.

图47根据示范性实施例图示了在多个设备上分开显示正被协作编辑的文档、视频呼叫图像和会议纪要的示例。47 illustrates an example of separately displaying a document being collaboratively edited, a video call image, and a meeting minutes on multiple devices, according to an exemplary embodiment.

当如上文参考图46所述对于每个图像完成设备设定时，文档、视频呼叫图像和会议纪要可被分别分开显示在PC 300-1、智能TV 300-2和平板PC 300-3上。When the device setting is completed for each image as described above with reference to FIG. 46, the document, video call image, and meeting minutes can be separately displayed on the PC 300-1, the smart TV 300-2, and the tablet PC 300-3, respectively.

图48根据示范性实施例图示了通过向用于提供协作服务的服务器100请求终止协作服务来终止协作服务并将协作编辑的文档发送到另一用户终端的过程。48 illustrates a process of terminating a collaboration service and transmitting a collaboratively edited document to another user terminal by requesting theserver 100 for providing the collaboration service to terminate the collaboration service, according to an exemplary embodiment.

参考图48，第一用户终端300可向服务器100请求终止协作服务(操作S4805)。Referring to FIG. 48, thefirst user terminal 300 may request theserver 100 to terminate the cooperation service (operation S4805).

服务器100可存储正被协作编辑的文档并终止用于处理文档的程序(操作S4810)。Theserver 100 may store the document being collaboratively edited and terminate the program for processing the document (operation S4810).

服务器100可存储会议纪要和视频呼叫图像(操作S4815)。Theserver 100 may store meeting minutes and video call images (operation S4815).

如果文档、会议纪要和视频呼叫图像全都被存储，服务器100可终止视频呼叫图像服务(操作S4820)。在此情况下，服务器100也可存储用于审查的文档、用于审查的视频呼叫图像和用于审查的会议纪要。用于审查的文档、用于审查的视频呼叫图像和用于审查的会议纪要指的是其中编辑信息与文本信息同步的图像，即，保留了对在利用协作服务对文档的协作编辑期间编辑的部分的指示的文档和与被编辑部分同步的图像。If the document, the meeting minutes and the video call image are all stored, theserver 100 may terminate the video call image service (operation S4820). In this case, theserver 100 may also store documents for review, video call images for review, and meeting minutes for review. Documents for review, video call images for review, and meeting minutes for review refer to images in which editing information is synchronized with textual information, i.e., the editing of documents during collaborative editing using collaboration services is preserved. The indicated document of the section and the image that is synchronized with the edited section.

第一用户终端300向服务器100请求共享被协作编辑的文档(操作S4825)。例如，为了与没有协作编辑文档的第四用户共享利用协作服务来协作编辑的文档，第一用户终端300可向服务器100请求共享该文档。Thefirst user terminal 300 requests theserver 100 to share the collaboratively edited document (operation S4825). For example, in order to share a document collaboratively edited using a collaboration service with a fourth user who does not collaboratively edit the document, thefirst user terminal 300 may request theserver 100 to share the document.

服务器100可检索第一用户终端300请求的文档(操作S4830)。Theserver 100 may retrieve the document requested by the first user terminal 300 (operation S4830).

服务器100可将检索的文档发送到第四用户终端600(操作S4835)。Theserver 100 may transmit the retrieved document to the fourth user terminal 600 (operation S4835).

第四用户终端600可显示发送来的文档(操作S4840)。在第四用户终端600的屏幕上显示的文档是基于web的文档。在服务器100上执行的文档可被显示在第四用户终端600上执行的web浏览器屏幕上。Thefourth user terminal 600 may display the transmitted document (operation S4840). The document displayed on the screen of thefourth user terminal 600 is a web-based document. The document executed on theserver 100 may be displayed on a web browser screen executed on thefourth user terminal 600 .

图49根据示范性实施例图示了用于审查的文档、用于审查的视频呼叫图像和用于审查的会议纪要被彼此同步的示例。FIG. 49 illustrates an example in which a document for review, a video call image for review, and a meeting minutes for review are synchronized with each other, according to an exemplary embodiment.

参考图49，可以使用于审查的文档、用于审查的视频呼叫图像和用于审查的会议纪要彼此同步。Referring to FIG. 49, the document for review, the video call image for review, and the meeting minutes for review can be synchronized with each other.

例如，当第一至第三用户在2014年5月21日参与视频呼叫时，第一用户(例如，“安”)可在2014年5月21日上午09:03在文档中输入句子“增强拥有的专利的利用率”，同时输出说“我将写下目标是增强拥有的专利的利用率”的语音。在此情况下，服务器100可将文档中的句子“增强拥有的专利的利用率”与会议纪要中的会议细节“我将写下目标是增强拥有的专利的利用率”同步。另外，在第一至第三用户在2014年5月21日参与视频呼叫时，当第一用户在文档中输入句子“增强拥有的专利的利用率”时输出的视频呼叫图像可与该文档和会议纪要同步。For example, when the first to third users participate in a video call on May 21, 2014, the first user (eg, "An") may enter the sentence "enhancement" in the document at 09:03 am on May 21, 2014 Utilization of owned patents", while outputting a speech saying "I will write down the goal is to enhance utilization of owned patents". In this case, theserver 100 may synchronize the sentence "enhance utilization of owned patents" in the document with the meeting details "I will write down the goal is to enhance utilization of owned patents" in the meeting minutes. In addition, when the first to third users participate in a video call on May 21, 2014, the video call image output when the first user inputs the sentence "enhancing the utilization of the patent owned" in the document can be combined with the document and the Meeting minutes are synchronized.

换言之，句子“增强拥有的专利的利用率”可与会议细节“我将写下目标是增强拥有的专利的利用率”同步。从而，句子“增强拥有的专利的利用率”、会议细节“我将写下目标是增强拥有的专利的利用率”和在2014年5月21日上午09:03输出的视频呼叫图像可彼此同步。In other words, the sentence "enhance the utilization of owned patents" can be synchronized with the meeting detail "I will write down that the goal is to enhance utilization of owned patents". Thus, the sentence "enhance the utilization of owned patents", the meeting details "I will write down the goal is to enhance the utilization of owned patents" and the video call image output at 09:03 am on May 21, 2014 can be synchronized with each other .

图50根据示范性实施例图示了向用于提供协作服务的服务器100请求用于审查的文档并且审查文档的编辑的过程。FIG. 50 illustrates a process of requesting a document for review from theserver 100 for providing a collaboration service and reviewing editing of the document, according to an exemplary embodiment.

参考图50，第三用户终端500可向服务器100请求用于审查的文档(操作S5005)。例如，第三用户可经由第三用户终端500登录到服务器100中并且从第三用户已经执行的协作服务的列表中的文档之中选择用于审查的文档。第三用户终端500随后可根据经由用户输入单元(图2中的220)接收的第三用户的选择信息向服务器100请求用于审查的文档。Referring to FIG. 50, thethird user terminal 500 may request a document for review from the server 100 (operation S5005). For example, the third user may log in to theserver 100 via thethird user terminal 500 and select a document for review from among documents in the list of collaboration services that the third user has executed. Thethird user terminal 500 may then request theserver 100 for a document for review according to the third user's selection information received via the user input unit ( 220 in FIG. 2 ).

服务器100可响应于该请求检索用于审查的文档(操作S5010)。例如，服务器100可从存储在文档DB(图3中的155)中的文档中检索与来自第三用户终端500的请求相对应的用于审查的文档。Theserver 100 may retrieve the document for review in response to the request (operation S5010). For example, theserver 100 may retrieve the document for review corresponding to the request from thethird user terminal 500 from the documents stored in the document DB (155 in FIG. 3 ).

服务器100可将用于审查的文档发送到第三用户终端500(操作S5015)。Theserver 100 may transmit the document for review to the third user terminal 500 (operation S5015).

第三用户终端500可从接收到的用于审查的文档中选择被编辑部分(操作S5050)。例如，如果第三用户终端500显示用于审查的文档，并且第三用户选择用于审查的文档中的句子或段落，则可从用于审查的文档中选择被编辑部分。Thethird user terminal 500 may select an edited part from the received document for review (operation S5050). For example, if thethird user terminal 500 displays a document for review, and the third user selects a sentence or paragraph in the document for review, an edited portion may be selected from the document for review.

第三用户终端500可将关于所选择的被编辑部分的编辑信息发送到服务器100(操作S5025)。Thethird user terminal 500 may transmit editing information about the selected edited part to the server 100 (operation S5025).

服务器100可识别与发送的编辑信息同步的用于审查的会议纪要和用于审查的视频呼叫图像中的部分(操作S5030)。例如，服务器100可基于综合管理DB(图3中的151)中包含的同步信息从图像DB(图3中的157)确定与编辑信息同步的用于审查的会议纪要和用于审查的视频呼叫图像。Theserver 100 may identify parts in the meeting minutes for review and the video call image for review synchronized with the transmitted editing information (operation S5030). For example, theserver 100 may determine the meeting minutes for review and the video call for review synchronized with the editing information from the image DB (157 in FIG. 3 ) based on the synchronization information contained in the integrated management DB (151 in FIG. 3 ) image.

服务器100可将与编辑信息同步的用于审查的会议纪要和用于审查的视频呼叫图像发送到第三用户终端500(操作S5035)。Theserver 100 may transmit the meeting minutes for review and the video call image for review synchronized with the editing information to the third user terminal 500 (operation S5035).

第三用户终端500可输出与编辑信息同步的用于审查的会议纪要和用于审查的视频呼叫图像(操作S5040)。例如，第三用户终端500可经由输出单元(图2中的250)输出接收到的用于审查的会议纪要和用于审查的视频呼叫图像。Thethird user terminal 500 may output the meeting minutes for review and the video call image for review synchronized with the editing information (operation S5040). For example, thethird user terminal 500 may output the received meeting minutes for review and video call images for review via the output unit ( 250 in FIG. 2 ).

现在将参考图51描述在操作S5040中输出的同步图像的示例。An example of the synchronization image output in operation S5040 will now be described with reference to FIG. 51 .

图51根据示范性实施例图示了如下示例：当用于审查的文档的被编辑部分被选择时，均与所选择的被编辑部分同步的用于审查的会议纪要和用于审查的视频呼叫图像在用于接收协作服务的第三用户终端500中被输出。51 illustrates an example of a meeting minutes for review and a video call for review, both synchronized with the selected edited portion when an edited portion of a document for review is selected, according to an exemplary embodiment The image is output in thethird user terminal 500 for receiving the collaboration service.

详细而言，图51图示了用于审查的文档的图像570、和示出与用于审查的文档图像570同步的用于审查的视频呼叫图像的窗口580以及与用于审查的文档图像570同步的用于审查的会议纪要590被输出到第三用户终端500的示例。In detail, FIG. 51 illustrates animage 570 of the document for review, and awindow 580 showing the video call image for review synchronized with thedocument image 570 for review and thedocument image 570 for review An example of thesynchronized meeting minutes 590 for review being output to thethird user terminal 500 .

在一个示范性实施例中，示出视频呼叫图像的窗口580可被显示在弹出窗口或另一窗口中。在另一示范性实施例中，视频呼叫图像可响应于选择对可编辑文档的编辑或者该编辑的指示符而被显示在弹出窗口或另一窗口中。在另外一个示范性实施例中，视频呼叫图像可响应于从项目的文本记录、日志数据或会议纪要中选择项目而被显示在弹出窗口或另一窗口中。In one exemplary embodiment, thewindow 580 showing the video call image may be displayed in a pop-up window or another window. In another exemplary embodiment, the video call image may be displayed in a pop-up window or another window in response to selecting an edit to the editable document or an indicator of the edit. In another exemplary embodiment, the video call image may be displayed in a pop-up window or another window in response to selecting an item from the item's text record, log data, or meeting minutes.

参考图51，第三用户终端500可在用于审查的图像570中选择表示句子或段落的被编辑部分。例如，第三用户终端500可选择指明句子“增强拥有的专利的利用率”的被编辑部分。Referring to FIG. 51 , thethird user terminal 500 may select an edited portion representing a sentence or paragraph in animage 570 for review. For example, thethird user terminal 500 may select the edited portion specifying the sentence "enhancing the utilization of the owned patent".

第三用户终端500可输出与所选择的被编辑部分同步的用于审查的会议纪要590。例如，假定当第一至第三用户在2014年5月21日参与视频呼叫时，第一用户(例如，“安”)在2014年5月21日上午09:03在文档中编辑句子“增强拥有的专利的利用率”，同时输出说“我将写下目标是增强拥有的专利的利用率”的语音。在此情况下，第三用户终端500可输出用于审查的会议纪要590，其中会议细节“我将写下目标是增强拥有的专利的利用率”被以粗体指示。Thethird user terminal 500 may output themeeting minutes 590 for review synchronized with the selected edited part. For example, assume that when the first to third users participate in a video call on May 21, 2014, the first user (eg, "An") edits the sentence "enhancement" in the document at 09:03 am on May 21, 2014 Utilization of owned patents", while outputting a speech saying "I will write down the goal is to enhance utilization of owned patents". In this case, thethird user terminal 500 may output themeeting minutes 590 for examination, in which the meeting details "I will write down that the goal is to enhance the utilization of the patent owned" is indicated in bold.

第三用户终端500也可输出用于示出与所选择的被编辑部分同步的用于审查的视频呼叫图像的窗口580。与开展2014年5月21日的视频会议的时间长度相对应的再现条可被显示在用于示出用于审查的视频呼叫图像的窗口580上。另外，用于示出用于审查的视频呼叫图像的窗口580可从与2014年5月21日上午09:03的时间相对应的重放位置被显示。然而，示范性实施例不限于此，而用于示出用于审查的视频呼叫图像的窗口580可以是与2014年5月21日上午09:03相对应的重放位置处的静止图像。Thethird user terminal 500 may also output awindow 580 for showing a video call image for review synchronized with the selected edited part. A reproduction bar corresponding to the length of time the video conference on May 21, 2014 was conducted may be displayed on thewindow 580 showing the video call image for review. Additionally, awindow 580 showing the video call image for review may be displayed from a playback position corresponding to the time of May 21, 2014 09:03 am. However, exemplary embodiments are not limited thereto, and thewindow 580 for showing the video call image for review may be a still image at a playback position corresponding to 09:03 am on May 21, 2014.

图52根据示范性实施例图示了向用于提供协作服务的服务器100请求用于审查的视频呼叫图像并且审查文档的编辑的过程。FIG. 52 illustrates a process of requesting a video call image for review from theserver 100 for providing a collaboration service and reviewing editing of a document, according to an exemplary embodiment.

参考图52，第三用户终端500可向服务器100请求用于审查的视频呼叫图像(操作S5205)。例如，第三用户可经由第三用户终端500登录到服务器100中并且从第三用户已经执行的协作服务的列表中的视频呼叫图像之中选择用于审查的视频呼叫图像。第三用户终端500随后可根据经由用户输入单元(图2中的220)接收的第三用户的选择信息向服务器100请求用于审查的视频呼叫图像。Referring to FIG. 52, thethird user terminal 500 may request theserver 100 for a video call image for review (operation S5205). For example, the third user may log in to theserver 100 via thethird user terminal 500 and select a video call image for review from among video call images in a list of collaboration services that the third user has performed. Thethird user terminal 500 may then request theserver 100 for a video call image for review according to the third user's selection information received via the user input unit ( 220 in FIG. 2 ).

服务器100可检索用于审查的视频呼叫图像(操作S5210)。例如，服务器100可从存储在图像DB 157中的图像中检索与来自第三用户终端500的请求相对应的用于审查的视频呼叫图像。Theserver 100 may retrieve the video call image for review (operation S5210). For example, theserver 100 may retrieve a video call image for review corresponding to the request from thethird user terminal 500 from the images stored in theimage DB 157 .

服务器100可将用于审查的视频呼叫图像发送到第三用户终端500(操作S5215)。Theserver 100 may transmit the video call image for review to the third user terminal 500 (operation S5215).

第三用户终端500可从接收到的用于审查的视频呼叫图像中选择要再现的部分(操作S5220)。例如，如果第三用户终端500为用于审查的视频呼叫图像显示再现条，并且第三用户选择再现条上的一点，则可从用于审查的视频呼叫图像中选择要再现的部分。Thethird user terminal 500 may select a portion to be reproduced from the received video call images for review (operation S5220). For example, if thethird user terminal 500 displays a reproduction bar for a video call image for review, and the third user selects a point on the reproduction bar, a portion to be reproduced can be selected from the video call image for review.

第三用户终端500可将关于所选择的要再现的部分的信息发送到服务器100(操作S5225)。Thethird user terminal 500 may transmit information on the selected part to be reproduced to the server 100 (operation S5225).

服务器100可识别与发送的关于要再现的部分的信息同步的用于审查的会议纪要和用于审查的文档中的部分(操作S5230)。例如，服务器100可基于综合管理DB 151中包含的同步信息分别从文档DB 155和图像DB 157中确定与关于要再现的部分的信息同步的用于审查的文档和用于审查的会议纪要。Theserver 100 may identify the meeting minutes for review and the part in the document for review synchronized with the transmitted information on the part to be reproduced (operation S5230). For example, theserver 100 may determine, from thedocument DB 155 and theimage DB 157 , based on synchronization information contained in theintegrated management DB 151 , the document for review and the meeting minutes for review, which are synchronized with the information on the part to be reproduced, respectively.

服务器100可将与关于要再现的部分的信息同步的用于审查的会议纪要和用于审查的文档发送到第三用户终端500(操作S5235)。Theserver 100 may transmit the meeting minutes for review and the document for review synchronized with the information on the part to be reproduced to the third user terminal 500 (operation S5235).

第三用户终端500可输出与关于要再现的部分的信息同步的用于审查的会议纪要和用于审查的文档(操作S5240)。例如，第三用户终端500可经由输出单元250输出接收到的用于审查的会议纪要和用于审查的文档。Thethird user terminal 500 may output the meeting minutes for review and the document for review synchronized with the information on the part to be reproduced (operation S5240). For example, thethird user terminal 500 may output the received meeting minutes for review and documents for review via theoutput unit 250 .

现在将参考图53描述在操作S5240中输出的同步图像的示例。An example of the synchronization image output in operation S5240 will now be described with reference to FIG. 53 .

图53根据示范性实施例图示了如下示例：当用于审查的视频呼叫图像的要被再现的一部分被选择时，均与所选择的被再现部分同步的用于审查的会议纪要和用于审查的文档在用于接收协作服务的第三用户终端500中被输出。FIG. 53 illustrates an example in which, when a portion of a video call image for review to be reproduced is selected, meeting minutes for review and The reviewed document is output in thethird user terminal 500 for receiving the collaboration service.

详细而言，图53图示了示出用于审查的视频呼叫图像的窗口580和均与用于审查的视频呼叫图像同步的用于审查的会议纪要590和用于审查的文档的图像570被输出到第三用户终端500的示例。In detail, FIG. 53 illustrates awindow 580 showing the video call image for review and the meeting minutes forreview 590 and the document forreview image 570 both synchronized with the video call image for review. An example of output to thethird user terminal 500 .

参考图53，第三用户终端500可在用于审查的视频呼叫图像中选择要再现的部分。例如，第三用户终端500可通过选择输出到第三用户终端500的用于审查的视频呼叫图像的再现条上的一点来从用于审查的视频呼叫图像中选择要再现的部分。Referring to FIG. 53 , thethird user terminal 500 may select a portion to be reproduced in the video call image for review. For example, thethird user terminal 500 may select a portion to be reproduced from the video call image for review by selecting a point on the reproduction bar of the video call image for review output to thethird user terminal 500 .

第三用户终端500可输出与所选择的要再现的部分同步的用于审查的会议纪要590。例如，假定在第一至第三用户在2014年5月21日参与视频呼叫时，第一用户(例如，“安”)输出说“我将写下目标是增强拥有的专利的利用率”的语音。如果所选择的要再现的部分包括2014年5月21日上午09:03，则第三用户终端500可输出指明句子“我将写下目标是增强拥有的专利的利用率”的用于审查的会议纪要590。Thethird user terminal 500 may output themeeting minutes 590 for review synchronized with the selected part to be reproduced. For example, it is assumed that when the first to third users participate in a video call on May 21, 2014, the first user (eg, "An") outputs a message saying "I will write down that the goal is to enhance the utilization of the patent owned". voice. If the selected portion to be reproduced includes 09:03 am on May 21, 2014, thethird user terminal 500 may output a statement for examination specifying the sentence "I will write down the goal is to enhance the utilization rate of the owned patent" Minutes of themeeting 590.

第三用户终端500还可输出与所选择的要再现的部分同步的用于审查的文档的图像570。例如，假定在第一至第三用户在2014年5月21日记录会议纪要的同时第一用户(例如，“安”)在2014年5月21日上午09:03编辑文档中的句子“增强拥有的专利的利用率”。如果所选择的要再现的部分包括2014年5月21日上午09:03，则第三用户终端500可输出包括句子“增强拥有的专利的利用率”的用于审查的文档的图像570。Thethird user terminal 500 may also output animage 570 of the document for review synchronized with the selected portion to be reproduced. For example, assume that the first user (eg, "Ann") edits the sentence "Enhancement" in the document on May 21, 2014 at 09:03 AM while the first to third users record the minutes of the meeting on May 21, 2014 Utilization of Patents Owned". If the selected portion to be reproduced includes 09:03 am on May 21, 2014, thethird user terminal 500 may output animage 570 of the document for examination including the sentence "enhancing the utilization of owned patents".

与开展2014年5月21日的视频会议的时间长度相对应的再现条可被显示在用于示出视频呼叫图像的窗口580上。另外，用于审查的视频呼叫图像可从与2014年5月21日上午09:03的时间相对应的重放位置被显示。然而，示范性实施例不限于此，而用于审查的视频呼叫图像可以是与2014年5月21日上午09:03相对应的重放位置处的静止图像。A reproduction bar corresponding to the length of time the video conference on May 21, 2014 was conducted may be displayed on thewindow 580 for showing the video call image. Additionally, the video call image for review may be displayed from a playback position corresponding to the time of May 21, 2014 at 09:03 am. However, exemplary embodiments are not limited thereto, and the video call image for review may be a still image at a playback position corresponding to 09:03 am on May 21, 2014.

图54根据示范性实施例图示了向用于提供协作服务的服务器100请求用于审查的会议纪要并审查文档的编辑的过程。FIG. 54 illustrates a process of requesting meeting minutes for review from theserver 100 for providing collaboration services and reviewing editing of the document, according to an exemplary embodiment.

参考图54，第三用户终端500可向服务器100请求用于审查的会议纪要(操作S5405)。例如，第三用户可经由第三用户终端500登录到服务器100中并且从第三用户已经执行的协作服务的列表中的会议纪要之中选择用于审查的会议纪要。第三用户终端500随后可根据经由用户输入单元220接收的第三用户的选择信息向服务器100请求用于审查的会议纪要。Referring to FIG. 54, thethird user terminal 500 may request theserver 100 for meeting minutes for review (operation S5405). For example, the third user may log in to theserver 100 via thethird user terminal 500 and select the meeting minutes for review from among meeting minutes in the list of collaboration services that the third user has performed. Thethird user terminal 500 may then request theserver 100 for meeting minutes for review according to the third user's selection information received via theuser input unit 220 .

服务器100可检索用于审查的会议纪要(操作S5410)。例如，服务器100可从存储在图像DB 157中的会议纪要中检索与来自第三用户终端500的请求相对应的用于审查的会议纪要。Theserver 100 may retrieve meeting minutes for review (operation S5410). For example, theserver 100 may retrieve the meeting minutes for review corresponding to the request from thethird user terminal 500 from the meeting minutes stored in theimage DB 157 .

服务器100可将用于审查的会议纪要发送到第三用户终端500(操作S5415)。Theserver 100 may transmit the meeting minutes for review to the third user terminal 500 (operation S5415).

第三用户终端500可从接收到的用于审查的会议纪要中选择要再现的部分(操作S5420)。例如，如果第三用户终端500显示用于审查的会议纪要，并且第三用户选择用于审查的会议纪要中的区域，则与所选择的区域相对应的时间点处的文本可被选择。Thethird user terminal 500 may select a portion to be reproduced from the received meeting minutes for review (operation S5420). For example, if thethird user terminal 500 displays meeting minutes for review, and the third user selects an area in the meeting minutes for review, text at a time point corresponding to the selected area may be selected.

第三用户终端500可将关于所选择的文本的信息发送到服务器100(操作S5425)。Thethird user terminal 500 may transmit information about the selected text to the server 100 (operation S5425).

服务器100可识别与发送的文本信息同步的用于审查的视频呼叫图像和用于审查的文档中的部分(操作S5430)。例如，服务器100可基于综合管理DB 151中包含的同步信息分别从文档DB 155和图像DB 157中确定与文本信息同步的用于审查的文档和用于审查的视频呼叫图像。Theserver 100 may identify the video call image for review and the part in the document for review synchronized with the transmitted text information (operation S5430). For example, theserver 100 may determine the document for review and the video call image for review synchronized with the text information from thedocument DB 155 and theimage DB 157 , respectively, based on synchronization information contained in theintegrated management DB 151 .

服务器100可将与文本信息同步的用于审查的视频呼叫图像和用于审查的文档发送到第三用户终端500(操作S5435)。Theserver 100 may transmit the video call image for review and the document for review synchronized with the text information to the third user terminal 500 (operation S5435).

第三用户终端500可输出与文本信息同步的用于审查的视频呼叫图像和用于审查的文档(操作S5440)。例如，第三用户终端500可经由输出单元250输出接收到的用于审查的视频呼叫图像和用于审查的文档。Thethird user terminal 500 may output the video call image for review and the document for review synchronized with the text information (operation S5440). For example, thethird user terminal 500 may output the received video call image for review and the document for review via theoutput unit 250 .

现在将参考图55详细描述在操作S5440中输出的同步图像的示例。An example of the synchronization image output in operation S5440 will now be described in detail with reference to FIG. 55 .

图55根据示范性实施例图示了如下示例：当用于审查的会议纪要中的文本被选择时，均与所选择的文本同步的用于审查的视频呼叫图像和用于审查的文档在用于接收协作服务的第三用户终端500中被输出。55 illustrates an example in which, when text in the meeting minutes for review is selected, a video call image for review and a document for review, both synchronized with the selected text, are in use, according to an exemplary embodiment. It is output to thethird user terminal 500 that receives the collaboration service.

详细而言，图55图示了用于审查的会议纪要590、以及均与用于审查的会议纪要590同步的用于审查的视频呼叫图像580和用于审查的文档的图像570被输出到第三用户终端500的示例。In detail, FIG. 55 illustrates that themeeting minutes 590 for review, and thevideo call image 580 for review and theimage 570 of the document for review, both synchronized with themeeting minutes 590 for review, are output to the first page. An example of threeuser terminals 500 .

参考图55，第三用户终端500可选择用于审查的会议纪要590中的特定时间点处的文本。例如，第三用户终端500可选择与2014年5月21日上午09:03的会议细节相对应的文本“我将写下目标是增强拥有的专利的利用率”。Referring to FIG. 55 , thethird user terminal 500 may select text at a specific time point in themeeting minutes 590 for review. For example, thethird user terminal 500 may select the text "I will write that the goal is to enhance the utilization of owned patents" corresponding to the details of the meeting at 09:03 am on May 21, 2014.

第三用户终端500可输出与所选择的文本同步的用于审查的视频呼叫图像。与开展2014年5月21日的视频会议的时间长度相对应的再现条可被显示在用于审查的视频呼叫图像上。另外，用于审查的视频呼叫图像可从与2014年5月21日上午09:03的时间相对应的重放位置被显示。然而，示范性实施例不限于此，而用于审查的视频呼叫图像可以是与2014年5月21日上午09:03相对应的重放位置处的静止图像。Thethird user terminal 500 may output a video call image for review synchronized with the selected text. A reproduction bar corresponding to the length of time the video conference on May 21, 2014 was conducted may be displayed on the video call image for review. Additionally, the video call image for review may be displayed from a playback position corresponding to the time of May 21, 2014 at 09:03 am. However, exemplary embodiments are not limited thereto, and the video call image for review may be a still image at a playback position corresponding to 09:03 am on May 21, 2014.

第三用户终端500还可输出与所选择的文本同步的用于审查的文档的图像570。例如，假定在第一至第三用户在2014年5月21日记录会议纪要的同时第一用户(例如，“安”)在2014年5月21日上午09:03编辑句子“增强拥有的专利的利用率”。如果与所选择的文本相对应的时间是2014年5月21日上午09:03，则第三用户终端500可输出指示句子“增强拥有的专利的利用率”的用于审查的文档的图像570。Thethird user terminal 500 may also output animage 570 of the document for review synchronized with the selected text. For example, assume that the first user (eg, "Ann") edits the sentence "Enhancing owned patents" at 09:03 am on May 21, 2014 while the first to third users record meeting minutes on May 21, 2014 utilization". If the time corresponding to the selected text is 09:03 am on May 21, 2014, thethird user terminal 500 may output animage 570 of the document for examination indicating the sentence "enhancing the utilization of owned patents" .

图56是根据示范性实施例的提供协作服务的方法的流程图。FIG. 56 is a flowchart of a method of providing a collaboration service according to an exemplary embodiment.

参考图56，根据本实施例的提供协作服务的方法包括由图3的用于提供协作服务的服务器按时间顺序执行的操作。从而，虽然下面省略了，但以上关于服务器100的描述可应用到图56的方法。Referring to FIG. 56 , the method for providing a collaboration service according to the present embodiment includes operations performed by the server for providing a collaboration service of FIG. 3 in chronological order. Thus, although omitted below, the above description about theserver 100 is applicable to the method of FIG. 56 .

服务器100从请求协作服务的用户终端接收与编辑文档的每个用户相关联的视频呼叫图像和关于被编辑的文档的编辑信息(操作S5610)。Theserver 100 receives a video call image associated with each user editing the document and editing information about the edited document from the user terminal requesting the collaboration service (operation S5610).

服务器100将基于与每个用户相关联的视频呼叫图像中包括的语音生成的会议纪要的细节与根据接收到的编辑信息编辑的文档同步(操作S5620)。Theserver 100 synchronizes the details of the meeting minutes generated based on the voice included in the video call image associated with each user with the document edited according to the received editing information (operation S5620).

服务器100存储接收到的与每个用户相关联的视频呼叫图像、会议纪要的细节和被编辑的文档(操作S5630)。Theserver 100 stores the received video call image associated with each user, the details of the meeting minutes, and the edited document (operation S5630).

图57是根据示范性实施例的接收协作服务的方法的流程图。FIG. 57 is a flowchart of a method of receiving a collaboration service according to an exemplary embodiment.

参考图57，根据本实施例的接收协作服务的方法包括由图2的用户终端200按时间顺序执行的操作。从而，虽然下面省略了，但以上关于用户终端200的描述可应用到图57的方法。Referring to FIG. 57 , the method of receiving a cooperative service according to the present embodiment includes operations performed by theuser terminal 200 of FIG. 2 in chronological order. Thus, although omitted below, the above description about theuser terminal 200 is applicable to the method of FIG. 57 .

用户终端200获取通过对用户的语音和视频执行信号处理而获得的视频呼叫图像和关于被编辑的文档的编辑信息(操作S5710)。Theuser terminal 200 acquires a video call image obtained by performing signal processing on the user's voice and video and editing information about the edited document (operation S5710).

用户终端200将所获取的视频呼叫图像和编辑信息发送到用于提供协作服务的服务器100(操作S5720)。Theuser terminal 200 transmits the acquired video call image and editing information to theserver 100 for providing the collaboration service (operation S5720).

用户终端200从服务器100接收与编辑文档的每个用户相关联的视频呼叫图像、基于与每个用户相关联的视频呼叫图像中包括的语音生成的会议纪要和与会议纪要的细节同步的文档(操作S5730)。Theuser terminal 200 receives, from theserver 100, a video call image associated with each user editing the document, meeting minutes generated based on the voice included in the video call image associated with each user, and a document synchronized with the details of the meeting minutes ( Operation S5730).

用户终端200输出接收到的与每个用户相关联的视频呼叫图像、会议纪要和文档(操作S5740)。Theuser terminal 200 outputs the received video call image, meeting minutes and documents associated with each user (operation S5740).

根据示范性实施例的提供协作服务的方法或接收协作服务的方法可被记录在可在计算机上执行的程序中，并且通过可利用计算机可读记录介质运行或执行这些程序的通用数字计算机和一个或多个处理器来实现。计算机可读记录介质的示例包括诸如磁存储介质(例如，软盘、硬盘等等)和光记录介质(例如，CD-ROM或DVD)之类的记录介质。A method of providing a collaboration service or a method of receiving a collaboration service according to an exemplary embodiment may be recorded in programs executable on a computer, and used by a general-use digital computer that can run or execute these programs using a computer-readable recording medium and a or multiple processors. Examples of the computer-readable recording medium include recording media such as magnetic storage media (eg, floppy disks, hard disks, etc.) and optical recording media (eg, CD-ROM or DVD).

虽然已参考附图描述了一个或多个示范性实施例，但本领域普通技术人员将会理解，在不脱离由所附权利要求限定的发明构思的精神和范围的情况下，可对其进行各种形式和细节上的改变。从而，本文描述的示范性实施例应当仅在描述意义上来加以考虑，而不是为了限制的。发明构思的范围不由对示范性实施例的详细描述限定，而由所附权利要求来限定，并且在所附权利要求及其等同物的范围内的所有差异都将被解释为包括在发明构思中。Although one or more exemplary embodiments have been described with reference to the accompanying drawings, those of ordinary skill in the art will understand that modifications may be made thereto without departing from the spirit and scope of the inventive concept as defined by the appended claims. Various changes in form and detail. Accordingly, the exemplary embodiments described herein should be considered in a descriptive sense only and not in a limiting sense. The scope of the inventive concept is defined not by the detailed description of the exemplary embodiments but by the appended claims, and all differences within the scope of the appended claims and their equivalents will be construed as being included in the inventive concept .

Claims (13)

Translated fromChinese

1.一种用于提供协作服务的服务器，该服务器包括：1. A server for providing collaboration services, the server comprising:存储器，被配置为存储计算机可执行指令；以及a memory configured to store computer-executable instructions; and处理器，被配置为处理所述计算机可执行指令来：a processor configured to process the computer-executable instructions to:提供包括显示视频的视频呼叫图像的第一区域和显示可编辑文档的第二区域的屏幕，其中可编辑文档是由会议参与者中的每一个在会议期间实时编辑的一个或多个编辑形成的一个实时协作编辑的文档，并且所述可编辑文档与视频呼叫图像同步，A screen is provided that includes a first area displaying a video call image of the video and a second area displaying an editable document, wherein the editable document is formed by one or more edits that each of the meeting participants edits in real time during the meeting a real-time collaboratively edited document, and the editable document is synchronized with the video call image,接收对所述视频的时间点的选择，receiving a selection of a time point for the video,按照与所述视频的所选择的时间点相对应的状态显示所述可编辑文档，displaying the editable document in a state corresponding to the selected time point of the video,接收对所述可编辑文档的编辑的选择，以及receiving an editorial selection of the editable document, and从与所选择的编辑相对应的时间点再现所述视频。The video is reproduced from a point in time corresponding to the selected edit.2.如权利要求1所述的服务器，其中，所述屏幕还包括第三区域，该第三区域显示与所述视频的时间点和与所述可编辑文档的编辑相对应的项目的文本记录。2. The server of claim 1, wherein the screen further comprises a third area displaying a textual record of a time point of the video and an item corresponding to an edit of the editable document .3.如权利要求2所述的服务器，其中，所述处理器还被配置为处理所述计算机可执行指令来：3. The server of claim 2, wherein the processor is further configured to process the computer-executable instructions to:接收从所述项目的文本记录中对项目的选择；receiving a selection of an item from a textual record of the item;从与所选择的项目相对应的时间点再现所述视频；以及reproducing the video from a point in time corresponding to the selected item; and按照与所选择的项目相对应的状态提供所述可编辑文档。The editable document is provided in a state corresponding to the selected item.4.如权利要求2所述的服务器，其中，所述处理器还被配置为处理所述计算机可执行指令来：4. The server of claim 2, wherein the processor is further configured to process the computer-executable instructions to:基于所述视频中的语音生成所述项目的文本记录。A textual transcript of the item is generated based on the speech in the video.5.如权利要求2所述的服务器，其中，所述处理器还被配置为处理所述计算机可执行指令来：5. The server of claim 2, wherein the processor is further configured to process the computer-executable instructions to:基于对所述可编辑文档的编辑生成所述项目的文本记录。A textual record of the item is generated based on the edits to the editable document.6.如权利要求1所述的服务器，其中，所述可编辑文档被显示在文字处理程序中。6. The server of claim 1, wherein the editable document is displayed in a word processing program.7.一种用于提供协作服务的方法，该方法包括：7. A method for providing collaborative services, the method comprising:显示包括显示视频的视频呼叫图像的第一区域和显示可编辑文档的第二区域的屏幕，其中可编辑文档是由会议参与者中的每一个在会议期间实时编辑的一个或多个编辑形成的一个实时协作编辑的文档，并且所述可编辑文档与视频呼叫图像同步；Displaying a screen comprising a first area displaying a video call image of a video and a second area displaying an editable document, wherein the editable document is formed by one or more edits that each of the meeting participants edits in real time during the meeting a real-time collaboratively edited document, and the editable document is synchronized with the video call image;接收对所述视频的时间点的选择；receiving a selection of a time point for the video;按照与所述视频的所选择的时间点相对应的状态显示所述可编辑文档；displaying the editable document in a state corresponding to the selected time point of the video;接收对所述可编辑文档的编辑的选择；以及receiving an edited selection of the editable document; and从与所选择的编辑相对应的时间点再现所述视频。The video is reproduced from a point in time corresponding to the selected edit.8.一种用于提供协作服务的终端，该终端包括：8. A terminal for providing collaborative services, the terminal comprising:显示器，被配置为显示包括显示视频的视频呼叫图像的第一区域和显示可编辑文档的第二区域的屏幕，其中可编辑文档是由会议参与者中的每一个在会议期间实时编辑的一个或多个编辑形成的一个实时协作编辑的文档，并且所述可编辑文档与视频呼叫图像同步；a display configured to display a screen comprising a first area displaying a video call image of a video and a second area displaying an editable document, wherein the editable document is one or more edited in real-time during the meeting by each of the meeting participants A real-time collaboratively edited document formed by multiple edits, and the editable document is synchronized with the video call image;输入设备，被配置为接收对所述视频的时间点的选择；an input device configured to receive a selection of a time point of the video;控制器，被配置为控制所述显示器按照与所述视频的所选择的时间点相对应的状态显示所述可编辑文档；a controller configured to control the display to display the editable document in a state corresponding to the selected time point of the video;其中，所述输入设备还被配置为接收对所述可编辑文档的编辑的选择，并且wherein the input device is further configured to receive a selection of editing of the editable document, and所述控制器还被配置为控制所述显示器从与所选择的编辑相对应的时间点再现所述视频。The controller is also configured to control the display to reproduce the video from a point in time corresponding to the selected edit.9.如权利要求8所述的终端，其中，所述屏幕还包括第三区域，该第三区域显示与所述视频的时间点和与所述可编辑文档的编辑相对应的项目的文本记录。9. The terminal of claim 8, wherein the screen further comprises a third area displaying a text record of a time point of the video and an item corresponding to editing of the editable document .10.如权利要求9所述的终端，其中：10. The terminal of claim 9, wherein:所述输入设备还被配置为接收从所述项目的文本记录中对项目的选择，并且the input device is further configured to receive a selection of an item from the textual record of the item, and所述控制器还被配置为：The controller is also configured to:控制所述显示器从与所选择的项目相对应的时间点再现所述视频，以及controlling the display to reproduce the video from a point in time corresponding to the selected item, and控制所述显示器按照与所选择的项目相对应的状态显示所述可编辑文档。The display is controlled to display the editable document in a state corresponding to the selected item.11.如权利要求9所述的终端，其中，所述项目的文本记录是基于所述视频中的语音生成的。11. The terminal of claim 9, wherein the textual recording of the item is generated based on speech in the video.12.如权利要求9所述的终端，其中，所述项目的文本记录是基于对所述可编辑文档的编辑生成的。12. The terminal of claim 9, wherein the textual record of the item is generated based on editing of the editable document.13.如权利要求8所述的终端，其中，所述可编辑文档被显示在文字处理程序中。13. The terminal of claim 8, wherein the editable document is displayed in a word processing program.

Images