相关申请的交叉引用Cross References to Related Applications
本申请要求2014年5月23日在韩国知识产权局递交的韩国专利申请10-2014-0062625号、2014年12月1日在美国专利商标局递交的美国非临时专利申请14/556,616号、2015年2月6日在韩国知识产权局递交的韩国专利申请10-2015-0018870号和2015年5月6日在美国专利商标局递交的美国非临时专利申请14/705,147号的优先权，这里通过引用并入这些申请的全部公开内容用于所有目的。This application claims Korean Patent Application No. 10-2014-0062625 filed with the Korean Intellectual Property Office on May 23, 2014, U.S. Nonprovisional Patent Application No. 14/556,616 filed with the United States Patent and Trademark Office on December 1, 2014, 2015 Priority of Korean Patent Application No. 10-2015-0018870, filed with the Korean Intellectual Property Office on February 6, 2015, and U.S. Nonprovisional Patent Application No. 14/705,147, filed with the United States Patent and Trademark Office on May 6, 2015, hereby adopted The entire disclosures of these applications are incorporated by reference for all purposes.
技术领域technical field
示范性实施例的一些方面涉及用于提供协作服务(collaborationservice)的方法和服务器和用于请求协作服务的用户终端。Some aspects of the exemplary embodiments relate to a method and server for providing a collaboration service (collaboration service) and a user terminal for requesting the collaboration service.
背景技术Background technique
由于科学和技术的进步，诸如智能电话、平板PC、桌面型计算机、膝上型计算机等等之类的各种类型的用户终端正在改进并变得更加精良。用户终端已演进成了高端多媒体设备，这些设备能够连接到网络以搜索因特网上的信息并且发送或接收文件以及捕捉和重放照片或运动图像。Due to advances in science and technology, various types of user terminals, such as smart phones, tablet PCs, desktop computers, laptop computers, etc., are improving and becoming more sophisticated. User terminals have evolved into high-end multimedia devices capable of connecting to a network to search for information on the Internet and to send or receive files and to capture and play back photos or moving images.
随着用户终端的发展，对云计算的需求正在增大。云计算指的是允许用户将信息存储在因特网上的服务器中并在任何时间从任何地方经由用户终端访问服务器以使用存储的信息的技术。为了满足对云计算的这种增大的需求，各种各样的使用云计算的应用正被开发。With the development of user terminals, the demand for cloud computing is increasing. Cloud computing refers to a technology that allows a user to store information in a server on the Internet and access the server from anywhere at any time via a user terminal to use the stored information. In order to meet this increased demand for cloud computing, various applications using cloud computing are being developed.
用户终端和云计算技术的进步允许了多个用户利用其终端连接到服务器并且执行相同应用或访问相同信息。Advances in user terminals and cloud computing technologies have allowed multiple users to connect to a server using their terminals and execute the same application or access the same information.
发明内容Contents of the invention
示范性实施例的一些方面包括一种用于提供协作服务的方法和服务器和用于接收协作服务的用户终端，这些协作服务允许了用户协作地编辑文档，其方式是通过将基于与每个用户相关联的视频呼叫图像中包括的语音生成的会议纪要同步到被协作编辑的文档，以使得用户在协作编辑文档的同时识别情境信息。Aspects of the exemplary embodiments include a method and server for providing collaboration services and user terminals for receiving collaboration services that allow users to collaboratively edit documents by combining Voice-generated meeting minutes included in the associated video call image are synchronized to the document being collaboratively edited so that users recognize contextual information while collaboratively editing the document.
另外的方面一部分将在接下来的描述中记载，一部分将从描述中清楚显现，或者可通过实践给出的示范性实施例来获知。Additional aspects will be set forth in part in the description which follows and in part will be apparent from the description, or may be learned by practice of the exemplary embodiments given.
根据示范性实施例的一方面，一种用于提供允许用户编辑文档的协作服务的服务器包括：通信单元，用于从请求协作服务的用户终端接收与编辑文档的每个用户相关联的视频呼叫图像和关于被编辑的文档的编辑信息；控制器，用于将基于与每个用户相关联的视频呼叫图像中包括的语音生成的会议纪要的细节与根据编辑信息编辑的文档同步；以及存储器，用于存储会议纪要的细节和文档。According to an aspect of an exemplary embodiment, a server for providing a collaboration service allowing a user to edit a document includes: a communication unit for receiving a video call associated with each user editing a document from a user terminal requesting the collaboration service an image and editing information on the edited document; a controller for synchronizing details of a meeting minutes generated based on a voice included in a video call image associated with each user with the document edited according to the editing information; and a memory, Used to store meeting minutes details and documents.
根据示范性实施例的一方面，一种提供允许用户编辑文档的协作服务的方法包括：从请求协作服务的用户终端接收与编辑文档的每个用户相关联的视频呼叫图像和关于被编辑的文档的编辑信息；将基于与每个用户相关联的视频呼叫图像中包括的语音生成的会议纪要的细节与根据接收到的编辑信息编辑的文档同步；以及存储会议纪要的细节和文档。According to an aspect of the exemplary embodiments, a method of providing a collaboration service allowing users to edit documents includes receiving, from a user terminal requesting the collaboration service, a video call image associated with each user who edits a document and information about the edited document. synchronizing the details of the meeting minutes generated based on the voice included in the video call image associated with each user with the document edited according to the received editing information; and storing the details of the meeting minutes and the document.
根据示范性实施例的一方面，一种用于从提供允许用户编辑文档的协作服务的服务器接收协作服务的用户终端包括：音频/视频输入单元，用于输入用户的语音和视频；用户输入单元，用于接收关于被编辑的文档的编辑信息；控制器，其获取通过对用户的语音和视频执行信号处理而获得的视频呼叫图像和编辑信息；通信单元，其将所获取的视频呼叫图像和编辑信息发送到服务器，并且从服务器接收与编辑文档的每个用户相关联的视频呼叫图像、基于与每个用户相关联的视频呼叫图像中包括的语音生成的会议纪要和与会议纪要的细节同步的文档；以及输出单元，其输出接收到的与每个用户相关联的视频呼叫图像、会议纪要和文档。According to an aspect of an exemplary embodiment, a user terminal for receiving a collaboration service from a server providing a collaboration service allowing a user to edit a document includes: an audio/video input unit for inputting voice and video of a user; a user input unit , for receiving edit information on the edited document; a controller that acquires a video call image and edit information obtained by performing signal processing on a user's voice and video; a communication unit that combines the acquired video call image and Editing information is sent to the server, and video call images associated with each user who edited the document, meeting minutes generated based on voice included in the video call images associated with each user, and details of the meeting minutes are received from the server and an output unit that outputs received video call images, meeting minutes, and documents associated with each user.
根据示范性实施例的一方面，提供了通过使基于与每个用户相关联的视频呼叫图像中包含的语音生成的会议纪要与被协作编辑的文档同步来便于用户对文档的协作编辑的协作服务，从而允许了用户在协作编辑文档的同时识别情境信息。According to an aspect of the exemplary embodiments, there is provided a collaboration service that facilitates collaborative editing of documents by users by synchronizing meeting minutes generated based on voice contained in a video call image associated with each user with collaboratively edited documents , allowing users to identify contextual information while collaboratively editing documents.
根据示范性实施例的一方面，提供了一种用于提供协作服务的服务器，该服务器包括：存储器，被配置为存储计算机可执行指令；以及处理器，被配置为处理计算机可执行指令来提供包括显示用户的视频的第一区域和显示可编辑文档的第二区域的屏幕。处理器还被配置为处理计算机可执行指令来接收对视频的时间点的选择，以及按照与视频的所选择的时间点相对应的状态提供可编辑文档。According to an aspect of an exemplary embodiment, there is provided a server for providing a collaborative service, the server including: a memory configured to store computer-executable instructions; and a processor configured to process the computer-executable instructions to provide A screen comprising a first area displaying a user's video and a second area displaying an editable document. The processor is further configured to process computer-executable instructions to receive a selection of a time point of the video, and provide the editable document in a state corresponding to the selected time point of the video.
处理器还可被配置为处理计算机可执行指令来接收对可编辑文档的编辑的选择，并且从与所选择的编辑相对应的时间点再现视频。The processor may also be configured to process the computer-executable instructions to receive a selection of an edit of the editable document, and to render the video from a point in time corresponding to the selected edit.
屏幕还可包括第三区域，该第三区域显示与视频的时间点和可编辑文档的编辑相对应的项目的文本记录。The screen may also include a third area displaying a text record of items corresponding to the time point of the video and the editing of the editable document.
处理器还可被配置为处理计算机可执行指令来接收从项目的文本记录中对项目的选择，从与所选择的项目相对应的时间点再现视频，并且按照与所选择的项目相对应的状态提供可编辑文档。The processor may also be configured to process the computer-executable instructions to receive a selection of an item from the text record of the item, render the video from a point in time corresponding to the selected item, and in a state corresponding to the selected item Provides editable documentation.
处理器还可被配置为处理计算机可执行指令来基于视频中的用户的语音生成项目的文本记录。The processor may also be configured to process computer-executable instructions to generate a textual transcript of the item based on the user's speech in the video.
处理器还可被配置为处理计算机可执行指令来基于用户对可编辑文档的编辑生成项目的文本记录。The processor may also be configured to process computer-executable instructions to generate a textual record of the item based on user edits to the editable document.
可编辑文档可被显示在文字处理程序(wordprocessingprogram)中。Editable documents can be displayed in a word processing program.
根据示范性实施例的一方面，提供了一种用于提供协作服务的方法，该方法包括显示包括显示用户的视频的第一区域和显示可编辑文档的第二区域的屏幕。该方法还包括接收对视频的时间点的选择，并且按照与视频的所选择的时间点相对应的状态显示可编辑文档。According to an aspect of an exemplary embodiment, there is provided a method for providing a collaboration service, the method including displaying a screen including a first area displaying a video of a user and a second area displaying an editable document. The method also includes receiving a selection of a time point of the video, and displaying the editable document in a state corresponding to the selected time point of the video.
该方法还可包括接收对可编辑文档的编辑的选择，并且从与所选择的编辑相对应的时间点再现视频。The method may further include receiving a selection of an edit of the editable document, and reproducing the video from a time point corresponding to the selected edit.
屏幕还可包括第三区域，该第三区域显示与视频的时间点和可编辑文档的编辑相对应的项目的文本记录。The screen may also include a third area displaying a text record of items corresponding to the time point of the video and the editing of the editable document.
该方法还可包括接收从项目的文本记录中对项目的选择，从与所选择的项目相对应的时间点再现视频，并且按照与所选择的项目相对应的状态提供可编辑文档。The method may further include receiving a selection of the item from the text record of the item, reproducing the video from a time point corresponding to the selected item, and providing the editable document in a state corresponding to the selected item.
该方法还可包括基于视频中的用户的语音生成项目的文本记录。The method may also include generating a textual transcript of the item based on the user's speech in the video.
该方法还可包括基于用户对可编辑文档的编辑生成项目的文本记录。The method may also include generating a textual record of the item based on the user's edits to the editable document.
一种非暂态计算机可读介质可包括可执行来执行该方法的计算机可读指令。A non-transitory computer readable medium may include computer readable instructions executable to perform the method.
根据示范性实施例的一方面，提供了一种用于提供协作服务的终端，该终端包括显示器，其被配置为显示包括显示用户的视频的第一区域和显示可编辑文档的第二区域的屏幕。该终端还包括：输入设备，被配置为接收对视频的时间点的选择；以及控制器，被配置为控制显示器按照与视频的所选择的时间点相对应的状态显示可编辑文档。According to an aspect of an exemplary embodiment, there is provided a terminal for providing a collaboration service, the terminal including a display configured to display an image including a first area displaying a user's video and a second area displaying an editable document. Screen. The terminal also includes: an input device configured to receive a selection of a time point of the video; and a controller configured to control the display to display the editable document in a state corresponding to the selected time point of the video.
输入设备还可被配置为接收对可编辑文档的编辑的选择，并且控制器还可被配置为控制显示器从与所选择的编辑相对应的时间点再现视频。The input device may also be configured to receive a selection of an edit of the editable document, and the controller may also be configured to control the display to reproduce video from a point in time corresponding to the selected edit.
输入设备还可被配置为接收从项目的文本记录中对项目的选择，并且控制器还可被配置为：控制显示器从与所选择的项目相对应的时间点再现视频，并且控制显示器按照与所选择的项目相对应的状态显示可编辑文档。The input device may also be configured to receive a selection of an item from a text record of the item, and the controller may also be configured to: control the display to reproduce video from a point in time corresponding to the selected item, and control the display to The status corresponding to the selected item shows that the document can be edited.
项目的文本记录可以是基于视频中的用户的语音生成的。A text transcript of an item may be generated based on the user's voice in the video.
项目的文本记录可以是基于用户对可编辑文档的编辑生成的。A text record of an item may be generated based on a user's edits to an editable document.
根据示范性实施例的一方面，提供了一种用于提供协作服务的服务器，该服务器包括通信设备，其被配置为发送要显示的文档，并且接收对显示的文档的一部分的选择。服务器还包括控制器，其被配置为确定要显示的用户的视频的一部分和要显示的文本项目的一部分，视频的该部分和文本项目的该部分对应于显示的文档的所选择部分。According to an aspect of an exemplary embodiment, there is provided a server for providing a collaboration service, the server including a communication device configured to transmit a document to be displayed, and to receive a selection of a part of the displayed document. The server also includes a controller configured to determine a portion of the user's video and a portion of the text item to display to be displayed, the portion of the video and the portion of the text item corresponding to the selected portion of the displayed document.
通信设备还可被配置为发送要显示的视频，并且接收对显示的视频的另一部分的选择，并且控制器还可被配置为确定要显示的文档的另一部分和要显示的文本项目的另一部分，文档的该另一部分和文本项目的该另一部分对应于显示的视频的所选择的另一部分。The communication device may also be configured to transmit the video to be displayed and receive a selection of another portion of the displayed video, and the controller may be further configured to determine another portion of the document to be displayed and another portion of the text item to be displayed , the other portion of the document and the other portion of the text item correspond to the selected another portion of the displayed video.
通信设备还可被配置为发送要显示的文本项目，并且接收对显示的文本项目的另一部分的选择，并且控制器还可被配置为确定要显示的视频的另一部分和要显示的文档的另一部分，视频的该另一部分和文档的该另一部分对应于显示的文本项目的所选择的另一部分。The communication device may also be configured to transmit a text item to be displayed and receive a selection of another portion of the displayed text item, and the controller may also be configured to determine another portion of the video to be displayed and another portion of the document to be displayed. The one part, the other part of the video and the other part of the document correspond to the selected another part of the displayed text item.
附图说明Description of drawings
通过以下结合附图对示范性实施例的描述，这些和/或其他方面将变得清楚并且更容易领会，附图中：These and/or other aspects will become apparent and more readily appreciated from the following description of exemplary embodiments in conjunction with the accompanying drawings, in which:
图1图示了用于提供协作服务的环境；Figure 1 illustrates an environment for providing collaboration services;
图2是根据示范性实施例的用户终端的配置的框图；2 is a block diagram of a configuration of a user terminal according to an exemplary embodiment;
图3是根据示范性实施例的用于提供协作服务的服务器的配置的框图；FIG. 3 is a block diagram of a configuration of a server for providing a collaboration service, according to an exemplary embodiment;
图4根据示范性实施例图示了用于提供协作服务的服务器的控制器；FIG. 4 illustrates a controller of a server for providing a collaboration service, according to an exemplary embodiment;
图5根据示范性实施例图示了可被包括在用于提供协作服务的服务器的控制器中的图像管理处理器；FIG. 5 illustrates an image management processor that may be included in a controller of a server for providing a collaboration service, according to an exemplary embodiment;
图6根据示范性实施例图示了可被存储在用于提供协作服务的服务器的存储器中的综合管理数据库(DB)；FIG. 6 illustrates a comprehensive management database (DB) that may be stored in a memory of a server for providing a collaboration service, according to an exemplary embodiment;
图7根据示范性实施例图示了可被存储在用于提供协作服务的服务器的存储器中的用户信息DB；FIG. 7 illustrates a user information DB that may be stored in a memory of a server for providing a collaboration service, according to an exemplary embodiment;
图8根据示范性实施例图示了可被存储在用于提供协作服务的服务器的存储器中的文档DB；FIG. 8 illustrates a document DB that may be stored in a memory of a server for providing a collaboration service, according to an exemplary embodiment;
图9根据示范性实施例图示了可被存储在用于提供协作服务的服务器的存储器中的图像DB；FIG. 9 illustrates an image DB that may be stored in a memory of a server for providing a collaboration service, according to an exemplary embodiment;
图10是根据另一示范性实施例图示出用于提供协作服务的服务器被实现为多个分散服务器的图；FIG. 10 is a diagram illustrating that a server for providing a collaboration service is implemented as a plurality of distributed servers according to another exemplary embodiment;
图11是根据另一示范性实施例的作为用于提供协作服务的分散服务器之一的综合管理服务器的框图；11 is a block diagram of an integrated management server as one of distributed servers for providing collaboration services according to another exemplary embodiment;
图12是根据另一示范性实施例的作为用于提供协作服务的分散服务器之一的用户管理服务器的框图；FIG. 12 is a block diagram of a user management server as one of distributed servers for providing collaboration services according to another exemplary embodiment;
图13是根据另一示范性实施例的作为用于提供协作服务的分散服务器之一的文档管理服务器的框图；13 is a block diagram of a document management server as one of distributed servers for providing collaboration services according to another exemplary embodiment;
图14是根据另一示范性实施例的作为用于提供协作服务的分散服务器之一的图像管理服务器的框图；FIG. 14 is a block diagram of an image management server as one of distributed servers for providing a collaboration service, according to another exemplary embodiment;
图15根据示范性实施例图示了在利用用于提供协作服务的服务器处理文档的同时根据对执行协作服务的请求发起协作服务的过程；FIG. 15 illustrates a process of initiating a collaboration service according to a request for execution of the collaboration service while processing a document using a server for providing the collaboration service, according to an exemplary embodiment;
图16根据示范性实施例图示了用于接收协作服务的用户终端请求执行协作服务的示例；FIG. 16 illustrates an example in which a user terminal for receiving a collaboration service requests execution of the collaboration service, according to an exemplary embodiment;
图17根据示范性实施例图示了用于接收协作服务的用户终端请求创建群组的示例；FIG. 17 illustrates an example in which a user terminal for receiving a collaboration service requests to create a group, according to an exemplary embodiment;
图18根据示范性实施例图示了用于接收协作服务的用户终端执行群组成员的管理的示例；FIG. 18 illustrates an example in which a user terminal for receiving a collaboration service performs management of group members, according to an exemplary embodiment;
图19根据示范性实施例图示了当在文档被处理的同时发起协作服务以使得用户终端准备好协作地编辑文档时每个用户终端的状态；19 illustrates a state of each user terminal when a collaboration service is initiated while a document is being processed so that the user terminal is ready to collaboratively edit the document, according to an exemplary embodiment;
图20根据示范性实施例图示了在用于接收协作服务的用户终端上显示包括地址窗口和菜单的用户界面和视频呼叫图像的方法；FIG. 20 illustrates a method of displaying a user interface including an address window and a menu and a video call image on a user terminal for receiving a collaboration service, according to an exemplary embodiment;
图21根据示范性实施例图示了在用于接收协作服务的用户终端上显示视频呼叫图像的方法；FIG. 21 illustrates a method of displaying a video call image on a user terminal for receiving a collaboration service, according to an exemplary embodiment;
图22根据示范性实施例图示了在用于接收协作服务的用户终端上显示视频呼叫图像的另一方法；FIG. 22 illustrates another method of displaying a video call image on a user terminal for receiving a collaboration service, according to an exemplary embodiment;
图23根据示范性实施例图示了利用用于提供协作服务的服务器在视频会议期间根据对执行协作服务的请求发起协作服务的过程；FIG. 23 illustrates a process of initiating a collaboration service according to a request for performing the collaboration service during a video conference using a server for providing the collaboration service, according to an exemplary embodiment;
图24根据示范性实施例图示了在作出对执行协作服务的请求之前在用于接收协作服务的用户终端中执行视频会议的示例；FIG. 24 illustrates an example of performing a video conference in a user terminal for receiving a collaboration service before making a request for performing the collaboration service, according to an exemplary embodiment;
图25根据示范性实施例图示了在用于接收协作服务的用户终端中在作出对执行协作服务的请求之前选择在视频会议期间共享的文档的过程；25 illustrates a process of selecting a document shared during a video conference before making a request to perform a collaboration service in a user terminal for receiving a collaboration service, according to an exemplary embodiment;
图26根据示范性实施例图示了在作出对执行协作服务的请求之前在用于接收协作服务的用户终端上显示在视频会议中共享的文档的示例；26 illustrates an example of displaying a document shared in a video conference on a user terminal for receiving a collaboration service before a request for performing the collaboration service is made, according to an exemplary embodiment;
图27根据示范性实施例图示了用于接收协作服务的用户终端在视频会议期间请求执行协作服务的示例；FIG. 27 illustrates an example in which a user terminal for receiving a collaboration service requests execution of the collaboration service during a video conference, according to an exemplary embodiment;
图28根据示范性实施例图示了当在视频会议期间发起协作服务以使得每个用户终端准备好协作地编辑文档时每个用户终端的状态；28 illustrates a state of each user terminal when a collaboration service is initiated during a video conference so that each user terminal is ready to collaboratively edit a document, according to an exemplary embodiment;
图29根据示范性实施例图示了在用于提供协作服务的服务器中从视频呼叫图像生成示出会议的纪要(以下称为会议纪要)的图像并将会议纪要发送到每个用户终端的过程；29 illustrates a process of generating an image showing minutes of a meeting (hereinafter referred to as meeting minutes) from a video call image in a server for providing a collaboration service and transmitting the meeting minutes to each user terminal, according to an exemplary embodiment. ;
图30根据示范性实施例图示了在每个用于接收协作服务的用户终端上显示会议纪要的示例；30 illustrates an example of displaying meeting minutes on each user terminal for receiving a collaboration service, according to an exemplary embodiment;
图31根据示范性实施例图示了在每个用于接收协作服务的用户终端上显示会议纪要的另一示例；31 illustrates another example of displaying meeting minutes on each user terminal for receiving a collaboration service, according to an exemplary embodiment;
图32根据示范性实施例图示了向用于提供协作服务的服务器请求管理群组成员和彼此协作的群组的过程；32 illustrates a process of requesting management of group members and groups collaborating with each other to a server for providing a collaboration service, according to an exemplary embodiment;
图33根据示范性实施例图示了在用于接收协作服务的用户终端中设定关于每个群组成员的信息的示例；33 illustrates an example of setting information on each group member in a user terminal for receiving a collaboration service, according to an exemplary embodiment;
图34根据示范性实施例图示了在用于接收协作服务的用户终端中将当前群组分割成多个群组的示例；FIG. 34 illustrates an example of dividing a current group into a plurality of groups in a user terminal for receiving a collaboration service, according to an exemplary embodiment;
图35图示了在当前群组被分割成多个群组时每个用户终端的状态；Figure 35 illustrates the state of each user terminal when the current group is divided into a plurality of groups;
图36根据示范性实施例图示了在用于提供协作服务的服务器中限制正被协作编辑的文档的编辑范围的过程；FIG. 36 illustrates a process of limiting an editing range of a document being collaboratively edited in a server for providing a collaboration service, according to an exemplary embodiment;
图37根据示范性实施例图示了在用于接收协作服务的用户终端中由第一用户锁定第一编辑范围的示例；37 illustrates an example in which a first editing range is locked by a first user in a user terminal for receiving a collaboration service, according to an exemplary embodiment;
图38根据示范性实施例图示了在用于接收协作服务的用户终端中由第二用户锁定第二编辑范围的示例；38 illustrates an example in which a second editing range is locked by a second user in a user terminal for receiving a collaboration service, according to an exemplary embodiment;
图39根据示范性实施例图示了在用于接收协作服务的用户终端中由第三用户锁定第三编辑范围的示例；FIG. 39 illustrates an example in which a third editing range is locked by a third user in a user terminal for receiving a collaboration service, according to an exemplary embodiment;
图40根据示范性实施例图示了在用于接收协作服务的用户终端中对于页中的多个区域锁定第一至第三编辑范围的示例；40 illustrates an example of locking first to third editing ranges for a plurality of regions in a page in a user terminal for receiving a collaboration service, according to an exemplary embodiment;
图41根据示范性实施例图示了在用于提供协作服务的服务器中协作地编辑文档的过程；FIG. 41 illustrates a process of collaboratively editing a document in a server for providing a collaboration service, according to an exemplary embodiment;
图42根据示范性实施例图示了在用于接收协作服务的用户终端中由第一用户编辑被协作编辑的文档的示例；42 illustrates an example of editing a collaboratively edited document by a first user in a user terminal for receiving a collaboration service, according to an exemplary embodiment;
图43根据示范性实施例图示了在用于接收协作服务的用户终端中由第二用户编辑被协作编辑的文档的示例；43 illustrates an example of editing a collaboratively edited document by a second user in a user terminal for receiving a collaboration service, according to an exemplary embodiment;
图44根据示范性实施例图示了在用于接收协作服务的用户终端中利用会议纪要来识别正被协作编辑的文档的编辑信息的示例；44 illustrates an example of identifying editing information of a document being collaboratively edited using a meeting minute in a user terminal for receiving a collaboration service, according to an exemplary embodiment;
图45根据示范性实施例图示了在用于接收协作服务的用户终端中利用会议纪要来编辑被协作编辑的文档的示例；45 illustrates an example of editing a collaboratively edited document using meeting minutes in a user terminal for receiving a collaboration service, according to an exemplary embodiment;
图46根据示范性实施例图示了如下示例：在用于接收协作服务的用户终端中，对于正被协作编辑的文档的图像、视频呼叫图像和会议纪要中的每一者设定设备以便利用向用户终端注册的其他设备分开显示这些图像；FIG. 46 illustrates an example in which, in a user terminal for receiving a collaboration service, a device is set for each of an image of a document being collaboratively edited, a video call image, and a meeting minutes so as to be utilized, according to an exemplary embodiment. display these images separately to other devices registered with the user terminal;
图47根据示范性实施例图示了在多个设备上分开显示正被协作编辑的文档、视频呼叫图像和会议纪要的示例；47 illustrates an example of separately displaying a document being collaboratively edited, a video call image, and meeting minutes on a plurality of devices, according to an exemplary embodiment;
图48根据示范性实施例图示了通过向用于提供协作服务的服务器请求终止协作服务来终止协作服务并将协作编辑的文档发送到另一用户终端的过程；48 illustrates a process of terminating a collaboration service and transmitting a collaboratively edited document to another user terminal by requesting a server for providing the collaboration service to terminate the collaboration service, according to an exemplary embodiment;
图49根据示范性实施例图示了用于审查的文档、用于审查的视频呼叫图像和用于审查的会议纪要被彼此同步的示例；49 illustrates an example in which a document for review, a video call image for review, and a meeting minute for review are synchronized with each other, according to an exemplary embodiment;
图50根据示范性实施例图示了向用于提供协作服务的服务器请求用于审查的文档并且审查文档的编辑的过程；50 illustrates a process of requesting a document for review from a server for providing a collaboration service and reviewing editing of the document, according to an exemplary embodiment;
图51根据示范性实施例图示了如下示例：当用于审查的文档的被编辑部分被选择时，均与所选择的被编辑部分同步的用于审查的会议纪要和用于审查的视频呼叫图像在用于接收协作服务的用户终端中被输出；51 illustrates an example of meeting minutes for review and video calls for review, both synchronized with the selected edited portion, when an edited portion of a document for review is selected, according to an exemplary embodiment. The image is output in the user terminal for receiving the collaboration service;
图52根据示范性实施例图示了向用于提供协作服务的服务器请求用于审查的视频呼叫图像并且审查文档的编辑的过程；52 illustrates a process of requesting a video call image for review from a server for providing a collaboration service and reviewing editing of a document, according to an exemplary embodiment;
图53根据示范性实施例图示了如下示例：当用于审查的视频呼叫图像的要被再现的一部分被选择时，均与所选择的被再现部分同步的用于审查的会议纪要和用于审查的文档在用于接收协作服务的用户终端中被输出；53 illustrates an example in which, when a part of a video call image for review to be reproduced is selected, the minutes for review and the minutes for review are all synchronized with the selected reproduced part, according to an exemplary embodiment. The reviewed document is output in the user terminal for receiving the collaboration service;
图54根据示范性实施例图示了向用于提供协作服务的服务器请求用于审查的会议纪要并审查文档的编辑的过程；54 illustrates a process of requesting a meeting minute for review and reviewing editing of a document from a server for providing a collaboration service, according to an exemplary embodiment;
图55根据示范性实施例图示了如下示例：当用于审查的会议纪要中的文本被选择时，均与所选择的文本同步的用于审查的视频呼叫图像和用于审查的文档在用于接收协作服务的用户终端中被输出；FIG. 55 illustrates an example in which, when text in meeting minutes for review is selected, a video call image for review and a document for review, both synchronized with the selected text, are in use, according to an exemplary embodiment. is output in the user terminal receiving the collaborative service;
图56是根据示范性实施例的提供协作服务的方法的流程图；并且56 is a flowchart of a method of providing a collaboration service according to an exemplary embodiment; and
图57是根据示范性实施例的接收协作服务的方法的流程图。FIG. 57 is a flowchart of a method of receiving a collaboration service, according to an exemplary embodiment.
具体实施方式Detailed ways
现在将详细谈及实施例，实施例的示例在附图中图示，附图中相似的标号始终指代相似的元素。在此，当前实施例是被提供来使得本公开将会透彻且完整，而不应当被解释为限于本文记载的描述。从而，下面仅仅是参考附图描述示范性实施例以说明本描述的各方面。本领域普通技术人员从描述及其示范性实施例容易推断出的变体或组合被视为在发明构思的范围内。诸如“…中的至少一个”之类的表述当在元素的列表之前时修饰整个元素列表，而不修饰列表中的个体元素。Reference will now be made in detail to embodiments, examples of which are illustrated in the accompanying drawings, wherein like numerals refer to like elements throughout. Here, the present embodiments are provided so that this disclosure will be thorough and complete, and should not be construed as being limited to the description set forth herein. Accordingly, the exemplary embodiments are merely described below, by referring to the figures, to explain aspects of the present description. Variations or combinations that can be easily deduced by a person of ordinary skill in the art from the description and its exemplary embodiments are considered to be within the scope of the inventive concept. Expressions such as "at least one of," when preceding a list of elements, modify the entire list of elements and do not modify the individual elements of the list.
还应理解，术语“包括”当在本说明书中使用时规定了所述元素、组件、步骤和/或操作的存在，但并不排除一个或多个元素、组件、步骤和/或操作的存在或添加。It should also be understood that the term "comprising" when used in this specification specifies the presence of stated elements, components, steps and/or operations, but does not exclude the presence of one or more elements, components, steps and/or operations or add.
另外，应理解，虽然本文中可使用术语“第一”、“第二”等等来描述各种元素和/或组件，但这些元素和/或组件不应当受这些术语所限。这些术语只是用于区分一个元素或组件与另一元素或组件。In addition, it should be understood that although the terms "first", "second", etc. may be used herein to describe various elements and/or components, these elements and/or components should not be limited by these terms. These terms are only used to distinguish one element or component from another element or component.
当前实施例涉及用于提供协作服务的方法和服务器和用于接收协作服务的用户终端，并且在本文中省略对本领域技术人员公知的功能或构造的详细描述。The current embodiment relates to a method and server for providing a collaboration service and a user terminal for receiving the collaboration service, and detailed descriptions of functions or configurations known to those skilled in the art are omitted herein.
图1图示了用于提供协作服务的环境。Figure 1 illustrates an environment for providing collaboration services.
协作服务指的是当多个用户彼此协作来执行追求相同目标的特定任务时向这些用户提供的一类服务。在允许多个用户协作编辑文档的协作服务中，用于协作用户之间的通信的文档编辑程序或工具可作为一类协作服务被提供给用户。在此情况下，被协作编辑的文档可以是在用于提供协作服务的服务器100上可执行的任何种类的文档，无论其类型或内容如何。例如，该文档可包含文本或多媒体内容。Collaborative services refer to a class of services provided to multiple users when they collaborate with each other to perform a specific task in pursuit of the same goal. In a collaboration service that allows multiple users to collaboratively edit a document, a document editing program or tool for communication between collaborative users may be provided to users as a type of collaboration service. In this case, the collaboratively edited document may be any kind of document executable on the server 100 for providing the collaborative service regardless of its type or content. For example, the document may contain text or multimedia content.
服务器100可以是用于存储允许每个用户与其他用户协作的各种类型的应用和数据的服务器。服务器100既可执行局域通信也可执行远程通信。服务器100也可经由网络连接到多个用户终端200。The server 100 may be a server for storing various types of applications and data that allow each user to cooperate with other users. The server 100 can perform both local communication and long-distance communication. The server 100 may also be connected to a plurality of user terminals 200 via a network.
用户终端200可以是可用于与服务器100连接的各种类型的用户设备。例如，用户终端200可以是能够与服务器100执行有线或无线通信的智能电话、平板PC、桌面型计算机或膝上型计算机。另外，用户终端200可以是被配置为捕捉和再现视频呼叫图像以允许协作编辑文档的用户参与视频会议的用户设备。The user terminal 200 may be various types of user equipment available for connection with the server 100 . For example, the user terminal 200 may be a smartphone, a tablet PC, a desktop computer, or a laptop computer capable of performing wired or wireless communication with the server 100 . In addition, the user terminal 200 may be a user device configured to capture and reproduce a video call image to allow users who collaboratively edit documents to participate in a video conference.
在一个示范性实施例中，编辑文档可包括在文档、图像、视频、应用等等中添加、去除、修改和/或格式化文本、对象、图像、图形等等。然而，编辑不限于上述示范性实施例，而可包括对文档执行的其他操作。In one exemplary embodiment, editing a document may include adding, removing, modifying and/or formatting text, objects, images, graphics, etc. in the document, image, video, application, and the like. However, editing is not limited to the above-described exemplary embodiments, but may include other operations performed on the document.
在一个示范性实施例中，协作编辑可包括由多个用户同时或顺序地编辑文档，或者可既包括由多个用户同时编辑文档又包括由多个用户顺序地编辑文档。然而，协作编辑不限于上述示范性实施例，而可包括对文档执行的其他协作编辑。In one exemplary embodiment, collaborative editing may include simultaneous or sequential editing of a document by multiple users, or may include both simultaneous editing of a document by multiple users and sequential editing of a document by multiple users. However, collaborative editing is not limited to the above-described exemplary embodiments, but may include other collaborative editing performed on documents.
图2是根据示范性实施例的用户终端200的配置的框图。本领域普通技术人员将会理解，用户终端200除了图2中所示的那些以外还可包括其他常见的组件。图2所示的组件中的每一个可根据实际实现的用户终端200的规格被集成、添加或省略。换言之，如果必要，两个或更多个组件可被组合成单个组件，或者单个组件可被分割成两个或更多个组件。FIG. 2 is a block diagram of a configuration of a user terminal 200 according to an exemplary embodiment. Those of ordinary skill in the art will understand that the user terminal 200 may include other common components besides those shown in FIG. 2 . Each of the components shown in FIG. 2 may be integrated, added, or omitted according to the specifications of the user terminal 200 actually implemented. In other words, if necessary, two or more components may be combined into a single component, or a single component may be divided into two or more components.
参考图2，根据本实施例的用户终端200可包括控制器210、用户输入单元220(例如，用户输入)、音频/视频输入单元230(例如，音频/视频输入)、通信单元240(例如，通信器)和输出单元250(例如，输出)。Referring to FIG. 2, a user terminal 200 according to the present embodiment may include a controller 210, a user input unit 220 (for example, user input), an audio/video input unit 230 (for example, audio/video input), a communication unit 240 (for example, communicator) and output unit 250 (eg, output).
控制器210可控制显示单元251来显示存储在存储器(未示出)中的内容的一部分。或者，当用户在显示单元251的区域上执行操纵时，控制器210可执行与该操纵相对应的控制操作。The controller 210 may control the display unit 251 to display a part of the content stored in the memory (not shown). Alternatively, when the user performs a manipulation on the area of the display unit 251, the controller 210 may perform a control operation corresponding to the manipulation.
虽然在图2中未示出，但控制器210可包括从以下各项中选择的至少一者：随机访问存储器(RAM)、只读存储器(ROM)、中央处理单元(CPU)、图形处理单元(未示出)以及数据总线。RAM、ROM、CPU和图形处理单元(GPU)可经由数据总线连接到彼此。Although not shown in FIG. 2, the controller 210 may include at least one selected from the following: random access memory (RAM), read only memory (ROM), central processing unit (CPU), graphics processing unit (not shown) and data bus. RAM, ROM, CPU, and graphics processing unit (GPU) may be connected to each other via a data bus.
CPU访问存储器(未示出)并且利用存储在存储器中的操作系统(O/S)执行启动。CPU还利用存储在存储器中的各种类型的程序、内容和数据来执行各种操作。The CPU accesses a memory (not shown) and performs booting with an operating system (O/S) stored in the memory. The CPU also performs various operations using various types of programs, contents, and data stored in the memory.
ROM存储一组命令来启动系统。例如，当输入开启命令并且供应电力时，CPU根据ROM中存储的命令把存储器中存储的O/S拷贝到RAM中，执行O/S并且启动系统。当启动完成时，CPU把存储器中存储的各种程序拷贝到RAM中，执行被拷贝到RAM中的程序，并且执行各种操作。详细地说，GPU可生成屏幕，包括诸如内容、图标和菜单之类的各种对象的电子文档被显示在该屏幕上。GPU根据屏幕的布局计算要显示的每个对象的属性值，例如坐标值、形状、大小和颜色。GPU也可基于计算出的属性值创建包括对象的各种布局的屏幕。GPU创建的屏幕可被提供给显示单元251，以使得其被显示在显示单元251的每个区域上。ROM stores a set of commands to start the system. For example, when a turn-on command is input and power is supplied, the CPU copies the O/S stored in the memory to the RAM according to the command stored in the ROM, executes the O/S and starts the system. When the startup is completed, the CPU copies various programs stored in the memory into the RAM, executes the programs copied into the RAM, and performs various operations. In detail, the GPU may generate a screen on which electronic documents including various objects such as contents, icons, and menus are displayed. The GPU calculates attribute values, such as coordinate values, shape, size, and color, of each object to be displayed based on the layout of the screen. The GPU can also create screens including various layouts of objects based on the calculated attribute values. The screen created by the GPU may be provided to the display unit 251 such that it is displayed on each area of the display unit 251 .
控制器210控制视频处理器(未示出)和音频处理器(未示出)来分别处理在经由通信单元240接收的内容或存储器中存储的内容中包含的视频数据和音频数据。The controller 210 controls a video processor (not shown) and an audio processor (not shown) to respectively process video data and audio data contained in content received via the communication unit 240 or content stored in a memory.
用户输入单元220可从用户接收各种命令。用户输入单元220可包括从小键盘221、触摸面板223和笔识别面板225中选择的至少一者。The user input unit 220 may receive various commands from a user. The user input unit 220 may include at least one selected from a keypad 221 , a touch panel 223 and a pen recognition panel 225 .
小键盘221可包括在用户终端200的主体的诸如前表面、侧表面和后表面之类的各种区域上提供的各种类型的键，例如机械按钮、滚轮等等。The keypad 221 may include various types of keys, such as mechanical buttons, scroll wheels, etc., provided on various areas of the body of the user terminal 200, such as a front surface, a side surface, and a rear surface.
触摸面板223可检测用户的触摸输入并且输出与检测到的触摸信号相对应的触摸事件值。当触摸面板223与显示面板(未示出)相组合以形成触摸屏(未示出)时，该触摸屏可被实现为各种类型的触摸传感器，例如电容式、电阻式和压电式触摸传感器。电容式触摸传感器使用覆盖在触摸屏的表面上的介电材料。当用户的身体的一部分触摸该触摸屏的表面时，电容式触摸传感器检测由用户的身体的该部分引起的微电并且计算触摸坐标。电阻式触摸传感器包括嵌入在触摸屏中的两个电极板。当用户触摸屏幕上的特定点时，上下电极板在触摸点处发生接触。电阻式触摸传感器检测由两个电极板的接触引起的电流并且计算触摸坐标。触摸屏上的触摸事件可大多利用人的手指来生成。然而，触摸事件也可经由可引起电容的变化的导电材料形成的物体来发生。The touch panel 223 may detect a user's touch input and output a touch event value corresponding to the detected touch signal. When the touch panel 223 is combined with a display panel (not shown) to form a touch screen (not shown), the touch screen may be implemented as various types of touch sensors such as capacitive, resistive, and piezoelectric touch sensors. Capacitive touch sensors use a dielectric material that covers the surface of the touch screen. When a part of the user's body touches the surface of the touch screen, the capacitive touch sensor detects microelectricity caused by the part of the user's body and calculates touch coordinates. Resistive touch sensors include two electrode plates embedded in the touch screen. When the user touches a specific point on the screen, the upper and lower electrode plates come into contact at the touch point. A resistive touch sensor detects a current caused by contact of two electrode plates and calculates touch coordinates. Touch events on a touch screen can mostly be generated with a human finger. However, a touch event can also occur via an object formed of a conductive material that can cause a change in capacitance.
笔识别面板225根据对触摸笔(例如，触控笔或数字化笔)的操纵感测笔的接近输入或触摸输入，并且输出与感测到的笔的接近输入或触摸输入相对应的笔接近事件或笔触摸事件。笔识别面板225可利用电磁谐振(ElectroMagneticResonance，EMR)技术来实现，并且根据由笔的接近或触摸引起的电磁场的强度的变动来感测触摸输入或接近输入。具体而言，笔识别面板225可包括具有网格结构的电磁感应线圈传感器(未示出)和顺序地向电磁感应线圈传感器的环形线圈提供具有预定频率的交流(AC)信号的电信号处理器(未示出)。当其中具有谐振电路的笔被布置得靠近笔识别面板225的环形线圈时，从环形线圈发送的磁场基于笔的谐振电路中的相互电磁感应来生成电流。基于该电流从笔中的谐振电路的线圈创建感应场。笔识别面板225随后从处于信号接收状态中的环形线圈检测该感应场并且感测笔被保持紧邻和触摸的点的位置。笔识别面板225可被布置在显示面板下方并且具有充分的面积以便覆盖显示面板的显示区域。The pen recognition panel 225 senses a pen proximity input or a touch input according to a manipulation of a touch pen (eg, a stylus pen or a digitizer pen), and outputs a pen proximity event corresponding to the sensed pen proximity input or touch input. or pen touch events. The pen recognition panel 225 may be implemented using ElectroMagnetic Resonance (EMR) technology, and senses a touch input or proximity input according to a change in the strength of an electromagnetic field caused by approach or touch of a pen. Specifically, the pen recognition panel 225 may include an electromagnetic induction coil sensor (not shown) having a grid structure and an electrical signal processor that sequentially supplies an alternating current (AC) signal having a predetermined frequency to a loop coil of the electromagnetic induction coil sensor. (not shown). When a pen having a resonance circuit therein is arranged close to the loop coil of the pen recognition panel 225, a magnetic field transmitted from the loop coil generates a current based on mutual electromagnetic induction in the resonance circuit of the pen. An induction field is created based on this current from the coil of the resonant circuit in the pen. The pen recognition panel 225 then detects the induction field from the loop coil in the signal receiving state and senses the position of the point where the pen is held in close proximity and touched. The pen recognition panel 225 may be disposed under the display panel and have a sufficient area so as to cover a display area of the display panel.
音频/视频输入单元230可包括麦克风231和拍摄单元233。麦克风231接收用户的语音或其他声音并将用户的语音或其他声音转换成音频数据。控制器210可将经由麦克风231输入的用户的语音用于视频会议，或者可将音频数据存储在存储器中。拍摄单元233可根据用户的控制拍摄静止或运动图像。拍摄单元233可利用多个相机来实现，例如前置相机和后置相机。The audio/video input unit 230 may include a microphone 231 and a photographing unit 233 . The microphone 231 receives a user's voice or other sound and converts the user's voice or other sound into audio data. The controller 210 may use the user's voice input via the microphone 231 for a video conference, or may store audio data in a memory. The photographing unit 233 may photograph still or moving images according to user's control. The photographing unit 233 can be implemented with multiple cameras, such as a front camera and a rear camera.
当音频/视频输入单元230包括麦克风231和拍摄单元233时，控制器210可利用经由麦克风231输入的用户的语音和由拍摄单元233识别的用户的视频来生成视频呼叫图像。When the audio/video input unit 230 includes the microphone 231 and the photographing unit 233 , the controller 210 may generate a video call image using the user's voice input through the microphone 231 and the user's video recognized by the photographing unit 233 .
用户终端200可在运动控制模式或语音控制模式中操作。当用户终端200在运动控制模式中操作时，控制器210可激活拍摄单元233来拍摄用户，跟踪用户的运动的变化，并且执行与该变化相对应的控制操作。当用户终端200在语音控制模式中操作时，控制器210分析经由麦克风231输入的用户的语音并且根据所分析的用户的语音来执行控制操作。The user terminal 200 may operate in a motion control mode or a voice control mode. When the user terminal 200 operates in the motion control mode, the controller 210 may activate the photographing unit 233 to photograph the user, track a change in the user's motion, and perform a control operation corresponding to the change. When the user terminal 200 operates in the voice control mode, the controller 210 analyzes the user's voice input via the microphone 231 and performs a control operation according to the analyzed user's voice.
通信单元240可根据各种类型的通信方法与不同类型的外部设备执行通信。通信单元240可包括从无线保真(Wi-Fi)芯片241、蓝牙芯片243、近场通信(NFC)芯片245和无线通信芯片247中选择的至少一者。控制器210可经由通信单元240与各种外部设备通信。The communication unit 240 may perform communication with various types of external devices according to various types of communication methods. The communication unit 240 may include at least one selected from a wireless fidelity (Wi-Fi) chip 241 , a Bluetooth chip 243 , a near field communication (NFC) chip 245 , and a wireless communication chip 247 . The controller 210 can communicate with various external devices via the communication unit 240 .
Wi-Fi芯片241和蓝牙芯片243可分别利用Wi-Fi和蓝牙技术来执行通信。使用Wi-Fi芯片241或蓝牙芯片243的通信单元240可在发送或接收诸如服务集合标识符(SSID)或会话密钥之类的连接信息并利用连接信息建立通信连接之后发送或接收各种类型的信息。NFC芯片245指的是利用在包括135kHz、13.56MHz、433MHz、860至960MHz和2.45GHz在内的各种射频识别(RFID)频率带之中的13.56MHz频率带上操作的NFC技术来执行通信的芯片。无线通信芯片247指的是根据诸如电气与电子工程师学会(IEEE)、Zigbee、第三代(3G)、第三代合作伙伴计划(3GPP)和长期演进(LTE)之类的各种通信标准来执行通信的芯片。The Wi-Fi chip 241 and the Bluetooth chip 243 may perform communication using Wi-Fi and Bluetooth technologies, respectively. The communication unit 240 using the Wi-Fi chip 241 or the Bluetooth chip 243 can transmit or receive various types of Information. The NFC chip 245 refers to a device that performs communication using NFC technology operating on the 13.56MHz frequency band among various radio frequency identification (RFID) frequency bands including 135kHz, 13.56MHz, 433MHz, 860 to 960MHz, and 2.45GHz. chip. The wireless communication chip 247 refers to a wireless communication chip based on various communication standards such as Institute of Electrical and Electronics Engineers (IEEE), Zigbee, 3rd Generation (3G), 3rd Generation Partnership Project (3GPP), and Long Term Evolution (LTE). The chip that performs the communication.
输出单元250可包括显示单元251和扬声器253。The output unit 250 may include a display unit 251 and a speaker 253 .
显示单元251可包括显示面板(未示出)和用于控制显示面板的控制器(未示出)。显示面板的示例可包括液晶显示器(LCD)、有机发光二极管(OLED)显示器、有源矩阵OLED(AM-OLED)、等离子显示面板(PDP)和其他各种显示器。显示面板可形成为柔性的、透明的或可穿戴的显示器。显示单元251可与用户输入单元220的触摸面板223相组合以形成触摸屏(未示出)。例如，触摸屏可包括集成的模块，其中显示面板与触摸面板223相组合以形成分层结构。The display unit 251 may include a display panel (not shown) and a controller (not shown) for controlling the display panel. Examples of the display panel may include a liquid crystal display (LCD), an organic light emitting diode (OLED) display, an active matrix OLED (AM-OLED), a plasma display panel (PDP), and other various displays. The display panel can be formed as a flexible, transparent or wearable display. The display unit 251 may be combined with the touch panel 223 of the user input unit 220 to form a touch screen (not shown). For example, the touch screen may include an integrated module in which the display panel is combined with the touch panel 223 to form a layered structure.
扬声器253可输出由音频处理器(未示出)生成的音频数据。The speaker 253 may output audio data generated by an audio processor (not shown).
用户终端200的上述组件可被赋予与上述那些不同的名称。另外，根据本实施例的用户终端200可包括上述组件中的至少一者。用户终端200可不包括这些组件中的一些或者可还包括额外的组件。用户终端200可通过使用上述组件中的至少一者来执行以下操作。The aforementioned components of the user terminal 200 may be given different names from those described above. In addition, the user terminal 200 according to the present embodiment may include at least one of the above-mentioned components. The user terminal 200 may not include some of these components or may further include additional components. The user terminal 200 may perform the following operations by using at least one of the above-described components.
用于从用于提供协作服务的服务器100接收协作服务的用户终端200经由音频/视频输入单元230接收用户的语音和视频并且经由用户输入单元220接收关于被协作编辑的文档的编辑信息。在示范性实施例中，利用文字处理程序、电子数据表程序、幻灯片程序、演示程序、动画程序、图形程序、笔记记录程序、记事本程序和其他类似的程序中的一个或多个来协作地编辑文档。编辑信息可包括用于编辑文档的信息，并且可包括例如从以下各项中选择的至少一者：文本信息、图像信息、表格信息、拷贝信息、粘贴信息、字间距信息、行间距信息、字大小信息、颜色信息和与文档的编辑有关的其他各种信息。The user terminal 200 for receiving a collaboration service from the server 100 for providing the collaboration service receives a user's voice and video via the audio/video input unit 230 and edit information on a collaboratively edited document via the user input unit 220 . In an exemplary embodiment, one or more of a word processing program, a spreadsheet program, a slideshow program, a presentation program, an animation program, a graphics program, a note-taking program, a notepad program, and other similar programs are used to collaborate to edit the document. The editing information may include information for editing a document, and may include, for example, at least one selected from the following: text information, image information, form information, copy information, paste information, word spacing information, line spacing information, word spacing information, Size information, color information, and other various information related to editing of the document.
用户终端200的控制器210可获取通过对用户的语音和视频执行信号处理而获得的视频呼叫图像和编辑信息，并将视频呼叫图像和编辑信息发送到服务器100。通信单元240从服务器100接收与协作编辑文档的每个用户相关联的视频呼叫图像、示出基于与每个用户相关联的视频呼叫图像中包括的语音生成的会议的纪要(以下称为“会议纪要”)的图像和与会议纪要同步的正被协作编辑的文档。输出单元250输出接收到的与每个用户相关联的视频呼叫图像、会议纪要和正被协作编辑的文档。会议纪要可以是作为包括从关于会议的文本、包括关于会议的文本的文档和图表中选择的至少一者的图像输出的信息。另外，会议纪要可包括基于用户的语音生成的文本、生成每个文本的时间的时间信息和提供给用户的协作编辑文档的页信息，该用户在文本被生成时说出该文本。换言之，会议纪要的细节可包括从文本、时间信息、页信息和图像信息中选择的至少一者。The controller 210 of the user terminal 200 may acquire a video call image and edit information obtained by performing signal processing on the user's voice and video, and transmit the video call image and edit information to the server 100 . The communication unit 240 receives, from the server 100, a video call image associated with each user who collaboratively edits a document, a minutes showing a meeting generated based on a voice included in the video call image associated with each user (hereinafter referred to as “meeting session”). Minutes") and the document being collaboratively edited in sync with the meeting minutes. The output unit 250 outputs received video call images, meeting minutes, and documents being collaboratively edited associated with each user. The minutes of the meeting may be information output as an image including at least one selected from text about the meeting, a document including the text about the meeting, and a graph. In addition, the meeting minutes may include text generated based on the user's voice, time information of when each text was generated, and page information of a collaboratively edited document provided to the user who spoke the text when it was generated. In other words, the details of the minutes may include at least one selected from text, time information, page information, and image information.
在一个示范性实施例中，文档的编辑可由相应的指示符来指示，该指示符可以是标记、高亮、对象、图标或来自视频呼叫图像的图像中的一个或多个，所述图像例如是用户的缩略图像。In an exemplary embodiment, editing of a document may be indicated by a corresponding indicator, which may be one or more of a marker, a highlight, an object, an icon, or an image from a video call image such as is the user's thumbnail image.
此外，由于会议纪要和文档是彼此同步的，所以对于会议纪要和文档中的至少一者的用户输入可伴随着另一者中的变化。例如，通信单元240可以把关于用户从会议纪要中选择的文本的信息发送到服务器100，并且响应于该发送，接收关于与被选择文本同步的文档的被编辑部分的信息。输出单元250随后可输出与被选择文本同步的文档的被编辑部分。Furthermore, since the meeting minutes and documents are synchronized with each other, user input to at least one of the meeting minutes and documents may be accompanied by changes in the other. For example, the communication unit 240 may transmit information on the text selected by the user from the meeting minutes to the server 100 and, in response to the transmission, receive information on the edited portion of the document synchronized with the selected text. The output unit 250 may then output the edited portion of the document synchronized with the selected text.
会议纪要可以是基于视频中的用户的语音生成的项目的文本记录。会议纪要也可以是基于用户对可编辑文档的编辑生成的项目的文本记录。The meeting minutes may be a text transcript of the item generated based on the user's speech in the video. Minutes may also be a text record of items generated based on user edits to editable documents.
图3是根据示范性实施例的用于提供协作服务的服务器100的配置的框图。本领域普通技术人员将会理解，服务器100除了图3中所示的那些以外还可包括其他常见的组件。根据服务器100的实际实现，图3所示的每个组件可被集成、添加或省略。换言之，如果必要，两个或更多个组件可被组合成单个组件，或者单个组件可被分割成两个或更多个组件。FIG. 3 is a block diagram of a configuration of a server 100 for providing a collaboration service, according to an exemplary embodiment. Those of ordinary skill in the art will understand that server 100 may include other common components besides those shown in FIG. 3 . According to the actual implementation of the server 100, each component shown in FIG. 3 may be integrated, added, or omitted. In other words, if necessary, two or more components may be combined into a single component, or a single component may be divided into two or more components.
通信单元110可与包括用户终端(图2中的200)在内的外部设备执行通信。例如，用于提供允许对文档的协作编辑的协作服务的服务器100可从用户终端200接收与协作服务有关的各种请求，包括对发起协作服务的请求，创建协作工作环境所必要的设定信息，和关于被协作编辑的文档的编辑信息。另外，响应于与协作服务有关的各种请求，服务器100可提供与协作服务的提供有关的所有事项。The communication unit 110 may perform communication with external devices including a user terminal (200 in FIG. 2). For example, the server 100 for providing a collaborative service that allows collaborative editing of documents may receive various requests related to the collaborative service from the user terminal 200, including a request for initiating the collaborative service, setting information necessary for creating a collaborative work environment , and edit information about the document being collaboratively edited. Also, in response to various requests related to the collaboration service, the server 100 may provide all matters related to the provision of the collaboration service.
控制器130可执行对服务器100的整体控制。控制器130获取经由通信单元110接收的信息和请求并将接收到的信息和请求存储在存储器150中。存储器150可包括存储装置或数据库。控制器130也可处理接收到的信息和请求。例如，控制器130可基于从第四用户终端(图48中的600)接收的信息来生成在协作服务中要使用的图像或者执行用于管理接收到的信息的处理。另外，响应于所获取的请求，控制器130可将提供协作服务所必要的信息发送到用户终端200。The controller 130 may perform overall control of the server 100 . The controller 130 acquires information and requests received via the communication unit 110 and stores the received information and requests in the memory 150 . Memory 150 may include a storage device or a database. Controller 130 may also process received information and requests. For example, the controller 130 may generate an image to be used in the collaboration service based on information received from the fourth user terminal (600 in FIG. 48 ) or perform a process for managing the received information. In addition, the controller 130 may transmit information necessary to provide the collaboration service to the user terminal 200 in response to the acquired request.
控制器130可执行与协作编辑文档的每个用户相关联的视频呼叫图像、基于视频呼叫图像中包括的语音生成的会议纪要和根据接收到的编辑信息协作编辑的文档的整体管理。视频呼叫图像、会议纪要和文档被用于协作服务中。例如，控制器130可执行与每个用户相关联的视频呼叫图像、会议纪要和正被协作编辑的文档的诸如生成、存储、处理和删除之类的管理操作。现在将参考图3和图4来更详细描述服务器100的控制器130。The controller 130 may perform overall management of a video call image associated with each user who collaboratively edits a document, a meeting minute generated based on a voice included in the video call image, and a collaboratively edited document according to received editing information. Video call images, meeting minutes and documents are used in collaboration services. For example, the controller 130 may perform management operations such as generation, storage, processing, and deletion of video call images, meeting minutes, and documents being collaboratively edited associated with each user. The controller 130 of the server 100 will now be described in more detail with reference to FIGS. 3 and 4 .
图4根据示范性实施例图示了用于提供协作服务的服务器100的控制器130。参考图3，服务器100的控制器130可包括综合管理处理器131、用户管理处理器133、文档管理处理器135和图像管理处理器137。本领域普通技术人员将会理解，控制器130除了图4中所示的那些以外还可包括其他常见的组件。控制器130可包括多个如图4所示的处理器，或者与图4不同，处理器中的一些或全部可被集成到单个控制器中。FIG. 4 illustrates the controller 130 of the server 100 for providing a collaboration service, according to an exemplary embodiment. Referring to FIG. 3 , the controller 130 of the server 100 may include an integrated management processor 131 , a user management processor 133 , a document management processor 135 , and an image management processor 137 . Those of ordinary skill in the art will appreciate that the controller 130 may include other common components besides those shown in FIG. 4 . The controller 130 may include a plurality of processors as shown in FIG. 4, or, unlike FIG. 4, some or all of the processors may be integrated into a single controller.
综合管理处理器131执行对于提供协作服务的整体控制。综合管理处理器131可以把接收到的与协作服务有关的信息和请求分别指派给用户管理处理器133、文档管理处理器135和图像管理处理器137并且控制对这些信息和请求的处理。另外，响应于与协作服务有关的请求，综合管理处理器131可利用从用户管理处理器133、文档管理处理器135和图像管理处理器137中选择的至少一者来发送关于协作服务的信息。综合管理处理器131在对于提供协作服务的综合管理中使用的协作服务相关信息、根据综合管理生成、修改和删除的协作服务相关信息和协作服务支持软件可被存储在综合管理数据库(DB)151中。The integrated management processor 131 performs overall control for providing collaborative services. The general management processor 131 may assign received information and requests related to the collaboration service to the user management processor 133, the document management processor 135, and the image management processor 137, respectively and control processing of the information and requests. Also, the general management processor 131 may transmit information on the collaboration service using at least one selected from the user management processor 133 , the document management processor 135 , and the image management processor 137 in response to a request related to the collaboration service. Cooperation service-related information used by the comprehensive management processor 131 in comprehensive management for providing collaborative services, collaborative service-related information generated, modified, and deleted according to comprehensive management, and collaborative service support software may be stored in a comprehensive management database (DB) 151 middle.
为了实现与协作编辑文档的每个用户相关联的视频呼叫图像、基于与每个用户相关联的视频呼叫图像中包括的语音生成的会议纪要和被协作编辑的文档之间的同步，综合管理处理器131可向从用户终端200输入到通信单元240的视频呼叫图像、文档的编辑信息和/或根据编辑信息对文档的编辑的结果添加日志数据。例如，如果编辑信息是用于插入文本的文本信息，则文档的编辑的结果可以是其中具有该文本的文档或者被插入到文档中的文本。如果编辑信息是用于拷贝和粘贴文本的拷贝信息，则文档的编辑的结果可以是文本被拷贝到的文档或者被粘贴到文档中的拷贝文本。如果编辑信息是用于调整字大小的信息，则文档的编辑的结果可以是其中字体大小已被调整的文档或文本。如上所述，视频呼叫图像、会议纪要和文档被用于协作服务中。在此情况下，日志数据可以是与视频呼叫图像或编辑信息被服务器100接收的时间有关的数据。换言之，视频呼叫图像的一部分和编辑信息基于视频呼叫图像或编辑信息被服务器100接收的时间或在该时间的预定范围内彼此同步。因此，视频呼叫图像可与被协作编辑的文档同步。另外，会议纪要可利用被添加到视频呼叫图像的日志数据本身与被协作编辑的文档同步。为各种类型的图像和被协作编辑的文档之间的同步添加的日志数据的属性和同步间隔可被改变。In order to achieve synchronization between the video call image associated with each user who collaboratively edits the document, the meeting minutes generated based on the voice included in the video call image associated with each user, and the collaboratively edited document, the integrated management process The monitor 131 may add log data to a video call image input from the user terminal 200 to the communication unit 240, editing information of a document, and/or a result of editing a document according to the editing information. For example, if the editing information is text information for inserting text, the result of editing of the document may be a document having the text therein or text inserted into the document. If the editing information is copy information for copying and pasting text, a result of editing of the document may be a document into which text is copied or copied text pasted into the document. If the editing information is information for adjusting the word size, the result of editing of the document may be a document or text in which the font size has been adjusted. As described above, video call images, meeting minutes, and documents are used in collaboration services. In this case, the log data may be data related to the time when the video call image or editing information is received by the server 100 . In other words, a part of the video call image and the editing information are synchronized with each other based on the time when the video call image or the editing information is received by the server 100 or within a predetermined range of the time. Thus, video call images can be synchronized with collaboratively edited documents. In addition, meeting minutes can be synchronized with collaboratively edited documents using the log data itself added to the video call image. Attributes and synchronization intervals of log data added for synchronization between various types of images and collaboratively edited documents can be changed.
在示范性实施例中，取代视频呼叫图像，可以有编辑文档的用户的静止图像并且用户的音频可与被协作编辑的文档同步。在另外一个示范性实施例中，用户的静止图像对应于用户的音频的一部分或全部。In an exemplary embodiment, instead of the video call image, there may be a still image of the user editing the document and the user's audio may be synchronized with the collaboratively edited document. In another exemplary embodiment, the still image of the user corresponds to part or all of the user's audio.
日志数据可以是基于视频中的用户的语音生成的项目的文本记录。日志数据可以是基于用户对可编辑文档的编辑生成的项目的文本记录。The log data may be a text record of items generated based on the user's speech in the video. Log data may be a text record of items generated based on user edits to editable documents.
用户管理处理器133可管理关于使用协作服务的多个用户的信息。换言之，用户管理处理器133可管理关于每个用户的个人信息和关于每个群组中的群组成员的信息。用户管理处理器133在用户管理中使用的用户信息和根据用户管理生成、修改和删除的用户信息可被存储在用户信息DB153中。The user management processor 133 may manage information on a plurality of users using the collaboration service. In other words, the user management processor 133 may manage personal information about each user and information about group members in each group. User information used by the user management processor 133 in user management and user information generated, modified, and deleted according to the user management may be stored in the user information DB 153 .
文档管理处理器135根据从用户终端200接收的编辑信息对被协作编辑的文档执行整体控制。当在用于提供协作服务的服务器100上执行用于处理文档的程序时，文档管理处理器135可根据从用户终端200接收的编辑信息和与文档的处理有关的请求对被协作编辑的文档执行整体控制。例如，文档管理处理器135可执行文档的诸如创建、编辑、存储和删除之类的管理操作。被文档管理处理器135用于文档管理的文档信息和根据文档管理生成、修改和删除的文档可被存储在文档DB155中。The document management processor 135 performs overall control on the collaboratively edited document according to editing information received from the user terminal 200 . When a program for processing a document is executed on the server 100 for providing a collaborative service, the document management processor 135 may execute the cooperatively edited document on the basis of editing information received from the user terminal 200 and a request related to the processing of the document. overall control. For example, the document management processor 135 may perform management operations such as creation, editing, storage, and deletion of documents. Document information used for document management by the document management processor 135 and documents generated, modified, and deleted according to the document management may be stored in the document DB 155 .
图像管理处理器137对与协作编辑文档的每个用户相关联的视频呼叫图像和基于与每个用户相关联的视频呼叫图像中包括的语音生成的会议纪要执行整体控制。例如，图像管理处理器137可执行与每个用户相关联的视频呼叫图像以及会议纪要的诸如创建、存储、处理和删除之类的管理操作。被图像管理处理器137用于图像管理的图像信息和根据图像管理生成、修改和删除的图像信息可被存储在图像DB157中。现在将参考图5更详细描述图像管理处理器137。The image management processor 137 performs overall control over the video call image associated with each user who collaboratively edits the document and the meeting minutes generated based on the voice included in the video call image associated with each user. For example, the image management processor 137 may perform management operations such as creation, storage, processing, and deletion of video call images associated with each user and meeting minutes. Image information used for image management by the image management processor 137 and image information generated, modified, and deleted according to image management may be stored in the image DB 157 . The image management processor 137 will now be described in more detail with reference to FIG. 5 .
图5根据示范性实施例图示了可被包括在用于提供协作服务的服务器100的控制器130中的图像管理处理器137。FIG. 5 illustrates an image management processor 137 that may be included in the controller 130 of the server 100 for providing a collaboration service, according to an exemplary embodiment.
参考图5，图像管理处理器137可包括音频/视频处理器138和音频转换器139。本领域普通技术人员将会理解，图像管理处理器137除了图5中所示的那些以外还可包括其他常见的组件。Referring to FIG. 5 , the image management processor 137 may include an audio/video processor 138 and an audio converter 139 . Those of ordinary skill in the art will understand that the image management processor 137 may include other common components besides those shown in FIG. 5 .
音频/视频处理器138可对输入图像信号执行信号处理。在此情况下，信号处理可以指图像的创建或处理。图像的处理可以指对其的编辑。所得到的包含音频信号和视频信号的图像信号可经由通信单元110被发送到用户终端200或者被存储在图像DB157中。The audio/video processor 138 may perform signal processing on an input image signal. In this context, signal processing can refer to the creation or manipulation of images. Manipulation of an image may refer to editing thereof. The resulting image signal including an audio signal and a video signal may be transmitted to the user terminal 200 via the communication unit 110 or stored in the image DB 157 .
音频转换器139可以把与接收协作服务的每个用户相关联的视频呼叫图像中包括的语音转换成文本形式的信息。图像管理处理器137可从音频转换器139接收文本形式的信息以便创建会议纪要。The audio converter 139 may convert voice included in a video call image associated with each user receiving the collaboration service into text form information. Image management processor 137 may receive information in text form from audio converter 139 for creating meeting minutes.
返回参考图3，服务器100可包括存储器150。存储器150可包括从综合管理DB151、用户信息DB153、文档DB155、安全文档DB158和图像DB157中选择的至少一者，如下文参考图6至图9更详细描述。Referring back to FIG. 3 , the server 100 may include a memory 150 . The memory 150 may include at least one selected from a general management DB 151 , a user information DB 153 , a document DB 155 , a security document DB 158 , and an image DB 157 , as described in more detail below with reference to FIGS. 6 to 9 .
图6根据示范性实施例图示了可被存储在用于提供协作服务的服务器100的存储器150中的综合管理DB151。FIG. 6 illustrates an integrated management DB 151 that may be stored in the memory 150 of the server 100 for providing collaboration services, according to an exemplary embodiment.
综合管理DB151可存储服务器100提供协作服务所必要的各种软件和信息。参考图6，综合管理DB151可存储协作服务支持软件和协作服务相关信息。The comprehensive management DB 151 can store various software and information necessary for the server 100 to provide collaboration services. Referring to FIG. 6, the comprehensive management DB 151 may store collaboration service support software and collaboration service related information.
协作服务支持软件可包括在服务器100上执行的OS和应用和用于支持协作服务的各种类型的数据。协作服务相关信息可包括关于对各种数据库的访问的信息、诸如为各种类型的图像和被协作编辑的文档之间的同步添加的日志数据的属性和同步间隔之类的同步信息和在利用由服务器100提供的协作服务执行协作时生成的协作历史信息。The collaboration service support software may include OS and applications executed on the server 100 and various types of data for supporting the collaboration service. The collaboration service-related information may include information on access to various databases, synchronization information such as attributes of log data added for synchronization between various types of images and collaboratively edited documents, and synchronization intervals, The collaboration history information generated when the collaboration service provided by the server 100 performs collaboration.
图7根据示范性实施例图示了可被存储在用于提供协作服务的服务器100的存储器150中的用户信息DB153。FIG. 7 illustrates a user information DB 153 that may be stored in the memory 150 of the server 100 for providing collaboration services, according to an exemplary embodiment.
参考图7，用户信息DB153可存储关于协作服务的每个用户的个人信息和关于每个群组中的群组成员的信息。用户信息DB153可为每个用户存储诸如用于获得对服务器100的访问的账户之类的唯一标识符、存储在服务器100中的个人信息和关于对服务器100提供的协作服务的使用的信息。存储在服务器100中的个人信息可以是上传到服务器100的各种类型的数据和应用。关于对服务器100提供的协作服务的使用的信息可以是表示用户被允许使用协作服务的时段或者使用协作服务的权限的信息。Referring to FIG. 7 , the user information DB 153 may store personal information about each user of the collaboration service and information about group members in each group. The user information DB 153 may store a unique identifier such as an account for gaining access to the server 100 , personal information stored in the server 100 , and information on use of collaboration services provided by the server 100 for each user. Personal information stored in the server 100 may be various types of data and applications uploaded to the server 100 . The information on the use of the collaboration service provided by the server 100 may be information representing a period during which the user is allowed to use the collaboration service or an authority to use the collaboration service.
图8根据示范性实施例图示了可被存储在提供协作服务的服务器100的存储器150中的文档DB155。FIG. 8 illustrates a document DB 155 that may be stored in the memory 150 of the server 100 providing a collaboration service, according to an exemplary embodiment.
参考图8，文档DB155可存储利用服务器100创建或编辑的文档。如图8所示，文档DB155可存储文档的属性信息，其中可包括关于文档的共享与否的信息和版本信息。当利用协作服务对文档进行编辑时，文档DB155可将关于每个用户的编辑信息与编辑文档的用户的账户和用于同步的日志数据一起存储。Referring to FIG. 8 , the document DB 155 may store documents created or edited using the server 100 . As shown in FIG. 8 , the document DB 155 may store document attribute information, which may include information on whether the document is shared or not and version information. When a document is edited using a collaboration service, the document DB 155 may store editing information about each user together with an account of the user who edited the document and log data for synchronization.
此外，如果执行要求安全性的协作写入，则服务器100可具有单独的安全性增强区域，在这里分开存储文档和编辑信息。安全文档DB158可以像文档DB155那样存储利用服务器100创建或编辑的文档，但安全文档DB158可以是安全性被进一步增强的DB。例如，存储在安全文档DB158中的文档可以是为了存储而双倍或三倍加密的，或者为了执行文档或者使用允许对文档的编辑的协作服务可要求对用户或用户终端的认证。对用户或用户终端的认证可基于例如口令、认证密钥、个人标识号(PIN)、生物信息、公共密钥证书、介质访问控制(MAC)地址和/或经由电话的批准来执行。Furthermore, if collaborative writing requiring security is performed, the server 100 may have a separate security-enhanced area where documents and editing information are separately stored. The secure document DB 158 may store documents created or edited with the server 100 like the document DB 155 , but the secure document DB 158 may be a DB in which security is further enhanced. For example, documents stored in the secure document DB 158 may be double or triple encrypted for storage, or authentication of a user or user terminal may be required for executing the document or using a collaboration service that allows editing of the document. Authentication of a user or user terminal may be performed based on, for example, passwords, authentication keys, personal identification numbers (PINs), biometric information, public key certificates, media access control (MAC) addresses, and/or approval via the phone.
另外，存储在安全文档DB158中的文档可仅在用户为其使用支付单独的费用或者用户位于特定地方时被提供。Additionally, documents stored in the secure document DB 158 may only be provided if the user pays a separate fee for its use or if the user is located in a particular location.
当协作编辑的文档以这种方式被存储在安全文档DB158中时，诸如创建、编辑、存储和删除之类的管理操作可经由安全文档DB158来执行。例如，如果从用户终端200接收到编辑信息，则服务器100可经由安全文档DB158执行在文档的编辑期间可发生的活动，例如先前文档和编辑信息的临时存储、编辑的结果的存储和/或编辑命令的存储。When collaboratively edited documents are stored in the secure document DB 158 in this way, management operations such as creation, editing, storage, and deletion can be performed via the secure document DB 158 . For example, if editing information is received from the user terminal 200, the server 100 may perform activities that may occur during editing of the document, such as temporary storage of previous documents and editing information, storage of editing results, and/or editing via the secure document DB 158, if editing information is received from the user terminal 200. Storage of commands.
详细而言，下面将通过描述创建使用协作服务的群组并且存储协作编辑文档的示范性实施例来详细说明用户确定要存储在安全文档DB158中的文档的方法。In detail, a method for a user to determine a document to be stored in the secure document DB 158 will be explained in detail below by describing an exemplary embodiment in which a group using a collaboration service is created and a collaboratively edited document is stored.
图9根据示范性实施例图示了可被存储在用于提供协作服务的服务器100的存储器150中的图像DB157。FIG. 9 illustrates an image DB 157 that may be stored in the memory 150 of the server 100 for providing collaboration services, according to an exemplary embodiment.
参考图9，图像DB157可存储与协作编辑文档的每个用户相关联的视频呼叫图像和基于与每个用户相关联的视频呼叫图像中包括的语音生成的会议纪要。如图9中所示，对于协作编辑文档的每个群组，图像DB157可以将与每个用户相关联的视频呼叫图像与每个用户的账户和日志数据一起存储。图像DB157也可对于每个群组将会议纪要与说出每个文本的用户的账户和用于同步的日志数据一起存储。Referring to FIG. 9 , the image DB 157 may store a video call image associated with each user who collaboratively edits a document and a meeting minute generated based on a voice included in the video call image associated with each user. As shown in FIG. 9 , for each group of collaboratively edited documents, the image DB 157 may store a video call image associated with each user together with each user's account and log data. The image DB 157 may also store meeting minutes for each group together with the account of the user who uttered each text and log data for synchronization.
返回参考图3，服务器100的上述组件可被赋予与上文描述的那些不同的名称。另外，根据本实施例的用于提供协作服务的服务器100可包括上述组件中的至少一者。服务器100可不包括这些组件中的一些或者可还包括额外的组件。服务器100可通过使用上述组件中的至少一者来执行以下操作。Referring back to FIG. 3 , the above-mentioned components of the server 100 may be given names different from those described above. In addition, the server 100 for providing a collaboration service according to the present embodiment may include at least one of the above-mentioned components. The server 100 may not include some of these components or may further include additional components. The server 100 may perform the following operations by using at least one of the above-described components.
用于提供允许对文档的协作编辑的服务器100可从请求协作服务的用户终端接收与协作编辑文档的每个用户相关联的视频呼叫图像和关于文档的编辑信息，并且存储接收到的与每个用户相关联的视频呼叫图像、基于与每个用户相关联的视频呼叫图像中包括的语音生成的会议纪要和根据接收到的编辑信息协作编辑的文档。The server 100 for providing permission for collaborative editing of documents may receive, from a user terminal requesting a collaborative service, a video call image associated with each user who collaboratively edits a document and editing information on the document, and store the received information related to each user. A video call image associated with the users, a meeting minutes generated based on the voice included in the video call image associated with each user, and a document collaboratively edited according to the received editing information.
此外，服务器100可将文档与会议纪要同步以使得用户可在协作编辑文档的同时识别情境信息。换言之，服务器100可将文档与会议纪要同步以使得用户可通过会议纪要中包含的文本识别正被协作编辑的文档的状态。In addition, the server 100 can synchronize documents with meeting minutes so that users can recognize contextual information while collaboratively editing documents. In other words, the server 100 may synchronize the document with the meeting minutes so that the user can recognize the status of the document being collaboratively edited through the text contained in the meeting minutes.
同步指的是匹配执行事件的时间。同步也可包括匹配已经执行的事件的发生时间。另外，同步可以指事件的同时发生或者调整事件发生的时间间隔以使得它们在预定范围内被执行。例如，与其他用户协作以编辑文档的用户说出的文本(例如，会议纪要中包括的文本)可与在生成该文本时协作编辑的文档同步。在此情况下，与文档同步可包括将用户说出的文本与关于在生成该文本时编辑的文档的编辑信息或者与根据编辑信息对文档的编辑结果同步。编辑的结果可以是根据编辑信息编辑的文档或者被编辑的文档的一部分。如果编辑的结果是被编辑的文档的一部分，则编辑信息可以与编辑的结果相同。例如，如果编辑信息是用户想要添加到文档的输入文本，则编辑的结果可以是其中有该输入文本的被编辑文档。Synchronization refers to matching the timing of execution events. Synchronization can also include matching the time of occurrence of events that have already been executed. In addition, synchronization may refer to simultaneous occurrence of events or adjustment of time intervals at which events occur so that they are performed within a predetermined range. For example, text spoken by a user collaborating with other users to edit a document (eg, text included in meeting minutes) may be synchronized with the document that was collaboratively edited when the text was generated. In this case, synchronizing with the document may include synchronizing the text spoken by the user with editing information about the document edited when the text was generated or with an editing result of the document according to the editing information. The editing result may be a document edited according to the editing information or a part of the edited document. If the edited result is a part of the edited document, the edited information may be the same as the edited result. For example, if the editing information is input text that the user wants to add to the document, the edited result may be an edited document having the input text therein.
另外，同步可包括将同时或几乎同时(例如，在少于5秒钟内)发生的多个任务彼此相关。在此情况下，将多个任务相关可以指多个任务被聚集到群组中并被一起管理，或者执行(例如，存储、输出或显示)多个任务的时间被匹配到彼此。Additionally, synchronization can include correlating multiple tasks that occur simultaneously or nearly simultaneously (eg, within less than 5 seconds) with one another. In this case, associating a plurality of tasks may mean that the plurality of tasks are gathered into a group and managed together, or times at which the plurality of tasks are executed (eg, stored, outputted, or displayed) are matched to each other.
在示范性实施例中，例如，如果用户在经由语音讨论会议细节的同时编辑文档，则同步可包括将编辑信息或编辑的结果与用户在编辑信息被服务器100接收时或者在编辑的结果在服务器100中被生成时说出的文本相连接。在此情况下，关于编辑信息或编辑的结果与用户说出的文本之间的同步和连接的信息可被存储在存储器150中。In an exemplary embodiment, for example, if a user edits a document while discussing details of a meeting via voice, synchronizing may include synchronizing the edited information or the results of the edits with the user when the edited information is received by the server 100 or when the edited results are on the server 100 100 is connected to the text spoken when it was generated. In this case, information on synchronization and connection between edited information or edited results and text spoken by the user may be stored in the memory 150 .
另外，同步可包括将在短时间段中(例如，在少于10分钟内)一起发生的多个任务彼此相关。或者，同步可包括将在多个任务之一发生之前或之后的特定时段中(例如，在少于5分钟内)发生的多个任务中的一些彼此相关。Additionally, synchronization may include correlating multiple tasks that occur together over a short period of time (eg, within less than 10 minutes) to each other. Alternatively, synchronizing may include relating some of the multiple tasks to each other that occur within a certain period of time (eg, within less than 5 minutes) before or after one of the multiple tasks occurs.
在此情况下，将多个任务相关可以指在短时间段中一起发生的多个任务被聚集到群组中并被一起管理，或者执行(例如，存储、输出或显示)多个任务的时间被匹配到彼此。In this case, correlating a plurality of tasks may mean that a plurality of tasks occurring together in a short period of time are gathered into a group and managed together, or a time when a plurality of tasks are executed (for example, stored, outputted, or displayed) are matched to each other.
例如，当在3:10pm到3:15pm之间在被协作编辑的文档中输入或者向该文档拷贝文本“专利策略”时，用户可在同一时间间隔期间说出语音“非常重要”。在此情况下，该语音可被转换成文本，然后被存储在会议纪要中。For example, when entering or copying the text "patent policy" into a collaboratively edited document between 3:10pm and 3:15pm, the user may speak the speech "very important" during the same time interval. In this case, the speech can be converted to text and then stored in the meeting minutes.
在此情形中，在3:10pm到3:15pm之间输入或拷贝的文本“专利策略”可与用户说出的文本“非常重要”互连。例如，互连文本可以指，如果一个文本以后被显示，则将另一文本一起显示。以这种方式将编辑的结果与用户说出的文本互连可被称为两者被彼此同步。In this case, the text "Patent Policy" entered or copied between 3:10pm and 3:15pm may be interconnected with the user-spoken text "Very Important". For example, interlinking text may mean that if one text is displayed later, another text is displayed together. Interconnecting the edited result with the user spoken text in this way may be said to be synchronized with each other.
服务器100也可通过从与每个用户相关联的视频呼叫图像中提取与会议纪要中的每个文本相对应的一部分来基于会议纪要生成被编辑图像，以使得用户可在协作编辑文档的同时识别情境信息。由于基于会议纪要的被编辑图像被视为与会议纪要同步，并且会议纪要与文档同步，所以被编辑图像、会议纪要和文档彼此同步。The server 100 can also generate an edited image based on the meeting minutes by extracting a part corresponding to each text in the meeting minutes from the video call image associated with each user, so that users can recognize while collaboratively editing the document contextual information. Since the edited image based on the minutes is considered to be synchronized with the minutes, and the minutes are synchronized with the document, the edited image, the minutes, and the document are synchronized with each other.
另外，服务器100可将会议纪要和文档同步到与每个用户相关联的视频呼叫图像以便存储。Additionally, the server 100 may synchronize meeting minutes and documents to the video call image associated with each user for storage.
此外，在协作编辑文档之后的审查期间，用户可利用与文档同步的各种类型的图像来识别在协作编辑时存在的情境信息。Furthermore, during a review after collaboratively editing a document, users can utilize various types of images synchronized with the document to identify contextual information that existed at the time of collaborative editing.
图10是根据另一示范性实施例图示出用于提供协作服务的服务器100被实现为多个分散服务器的图。虽然省略了，但以上关于服务器100的描述可应用到图10所示的服务器100。FIG. 10 is a diagram illustrating that a server 100 for providing a collaboration service is implemented as a plurality of distributed servers according to another exemplary embodiment. Although omitted, the above description about the server 100 is applicable to the server 100 shown in FIG. 10 .
参考图10，用于提供协作服务的分散服务器可包括综合管理服务器101、用户管理服务器103、文档管理服务器105和图像管理服务器107。与图3的服务器100中不同，集成到控制器130中的各种处理器和存储在存储器150中的各种数据库被实现为多个分散服务器。Referring to FIG. 10 , distributed servers for providing collaboration services may include an integrated management server 101 , a user management server 103 , a document management server 105 , and an image management server 107 . Unlike in the server 100 of FIG. 3, various processors integrated into the controller 130 and various databases stored in the memory 150 are implemented as a plurality of distributed servers.
综合管理服务器101、用户管理服务器103、文档管理服务器105和图像管理服务器107之一可与另一服务器执行通信并且彼此交换各种类型的数据。例如，综合管理服务器101可与用户终端200执行通信以将接收到的与协作服务有关的信息和请求发送到从用户管理服务器103、文档管理服务器105和图像管理服务器107中选择的至少一者。综合管理服务器101也可从另一服务器获取对该发送的响应并且向用户终端200提供协作服务。当服务器100以这种方式被实现为多个分散服务器时，此配置可便于服务器100的维护和管理。One of the comprehensive management server 101, the user management server 103, the document management server 105, and the image management server 107 can perform communication with another server and exchange various types of data with each other. For example, the comprehensive management server 101 may perform communication with the user terminal 200 to transmit received information and requests related to collaboration services to at least one selected from the user management server 103 , the document management server 105 , and the image management server 107 . The comprehensive management server 101 may also acquire a response to the transmission from another server and provide the user terminal 200 with the collaboration service. When the server 100 is implemented as a plurality of distributed servers in this manner, this configuration can facilitate maintenance and management of the server 100 .
图11是根据另一示范性实施例的作为用于提供协作服务的分散服务器之一的综合管理服务器101的框图。FIG. 11 is a block diagram of an integrated management server 101 as one of distributed servers for providing collaboration services according to another exemplary embodiment.
参考图11，综合管理服务器101可包括通信单元111、综合管理处理器131和综合管理DB151。对图4所示的综合管理处理器131和图6所示的综合管理DB151的描述可应用到综合管理处理器131和综合管理DB151。本领域普通技术人员将会理解，综合管理服务器101除了图11中所示的那些以外还可包括其他常见的组件。Referring to FIG. 11 , the comprehensive management server 101 may include a communication unit 111 , a comprehensive management processor 131 and a comprehensive management DB 151 . The description of the comprehensive management processor 131 shown in FIG. 4 and the comprehensive management DB 151 shown in FIG. 6 is applicable to the comprehensive management processor 131 and the comprehensive management DB 151 . Those of ordinary skill in the art will understand that the integrated management server 101 may include other common components besides those shown in FIG. 11 .
综合管理服务器101可请求用户管理服务器103确认连接到用于提供协作服务的服务器100的用户是否被授权使用协作服务。综合管理服务器101也可请求文档管理服务器105根据从用户终端200接收的编辑信息编辑文档，或者获取存储在文档管理服务器105中的文档。综合管理服务器101也可以把在协作服务中使用的视频呼叫图像或会议纪要存储在图像管理服务器107中或者获取存储在图像管理服务器107中的图像。综合管理服务器101可使用用户信息和日志数据以便获取彼此同步的图像和/或文档。例如，综合管理服务器101可获取具有相同用户信息和日志数据的会议纪要中的所有文本和关于被协作编辑的文档的编辑信息，并且向用户终端200提供使用彼此同步的会议纪要和文档的协作服务。The comprehensive management server 101 may request the user management server 103 to confirm whether the user connected to the server 100 for providing the collaboration service is authorized to use the collaboration service. The comprehensive management server 101 may also request the document management server 105 to edit the document according to the editing information received from the user terminal 200 , or acquire the document stored in the document management server 105 . The integrated management server 101 may also store video call images or meeting minutes used in the collaboration service in the image management server 107 or acquire images stored in the image management server 107 . The comprehensive management server 101 may use user information and log data in order to acquire images and/or documents synchronized with each other. For example, the comprehensive management server 101 may acquire all texts in meeting minutes having the same user information and log data and editing information on collaboratively edited documents, and provide the user terminal 200 with a collaboration service using meeting minutes and documents synchronized with each other .
图12是根据另一示范性实施例的作为用于提供协作服务的分散服务器之一的用户管理服务器103的框图。FIG. 12 is a block diagram of a user management server 103, which is one of distributed servers for providing collaboration services, according to another exemplary embodiment.
参考图12，用户管理服务器103可包括通信单元113、用户管理处理器133和用户信息DB153。对图4所示的用户管理处理器133和图7所示的用户信息DB153的描述可应用到用户管理处理器133和用户信息DB153。本领域普通技术人员将会理解，综合管理服务器103除了图12中所示的那些以外还可包括其他常见的组件。Referring to FIG. 12 , the user management server 103 may include a communication unit 113 , a user management processor 133 and a user information DB 153 . The description of the user management processor 133 shown in FIG. 4 and the user information DB 153 shown in FIG. 7 is applicable to the user management processor 133 and the user information DB 153 . Those of ordinary skill in the art will understand that the integrated management server 103 may include other common components besides those shown in FIG. 12 .
用户管理服务器103可管理关于使用协作服务的多个用户的信息。用户管理处理器133可管理关于每个用户的个人信息和关于每个群组中的群组成员的信息。在用户管理中使用的用户信息和根据用户管理生成、修改和删除的用户信息可被存储在用户信息DB153中。The user management server 103 can manage information on a plurality of users using the collaboration service. The user management processor 133 may manage personal information about each user and information about group members in each group. User information used in user management and user information generated, modified, and deleted according to user management may be stored in the user information DB 153 .
图13是根据另一示范性实施例的作为用于提供协作服务的分散服务器之一的文档管理服务器105的框图。FIG. 13 is a block diagram of a document management server 105 as one of distributed servers for providing collaboration services according to another exemplary embodiment.
参考图13，文档管理服务器105可包括通信单元115、文档管理处理器135和文档DB155。为了执行要求安全性的协作写入，文档管理服务器105可还包括安全文档DB158。对图4所示的文档管理处理器135和图8所示的文档DB155的描述可应用到文档管理处理器135和文档DB155。本领域普通技术人员将会理解，文档管理服务器105除了图13中所示的那些以外还可包括其他常见的组件。Referring to FIG. 13 , the document management server 105 may include a communication unit 115 , a document management processor 135 and a document DB 155 . In order to perform collaborative writing requiring security, the document management server 105 may further include a secure document DB 158 . The description of the document management processor 135 shown in FIG. 4 and the document DB 155 shown in FIG. 8 is applicable to the document management processor 135 and the document DB 155 . Those of ordinary skill in the art will appreciate that the document management server 105 may include other common components besides those shown in FIG. 13 .
文档管理服务器105可根据被协作编辑的文档的编辑信息对该文档执行整体控制。用于文档管理的文档信息和根据文档管理生成、修改和删除的文档可被存储在文档DB155中。文档管理服务器105也可经由通信单元115与其他服务器通信。例如，文档管理服务器105可经由通信单元115接收对存储在其中的文档的编辑的请求或者接收文档。The document management server 105 can perform overall control of a collaboratively edited document based on editing information of the document. Document information for document management and documents generated, modified and deleted according to document management may be stored in the document DB 155 . The document management server 105 can also communicate with other servers via the communication unit 115 . For example, the document management server 105 may receive a request for editing of a document stored therein or receive a document via the communication unit 115 .
图14是根据另一示范性实施例的作为用于提供协作服务的分散服务器之一的图像管理服务器107的框图。FIG. 14 is a block diagram of an image management server 107, which is one of distributed servers for providing collaboration services, according to another exemplary embodiment.
参考图14，图像管理服务器105可包括通信单元117、图像管理处理器137和图像DB157。对图4所示的图像管理处理器137和图9所示的图像DB157的描述可应用到图像管理处理器137和图像DB157。本领域普通技术人员将会理解，文档管理服务器107除了图14中所示的那些以外还可包括其他常见的组件。Referring to FIG. 14 , the image management server 105 may include a communication unit 117 , an image management processor 137 and an image DB 157 . The description of the image management processor 137 shown in FIG. 4 and the image DB 157 shown in FIG. 9 is applicable to the image management processor 137 and the image DB 157 . Those of ordinary skill in the art will appreciate that the document management server 107 may include other common components besides those shown in FIG. 14 .
图像管理处理器107可对与协作编辑的每个用户相关联的视频呼叫图像和基于与每个用户相关联的视频呼叫图像中包括的语音生成的会议纪要执行整体控制。图像管理服务器107也可经由通信单元117与其他服务器通信。例如，图像管理服务器107可经由通信单元117接收对存储在其中的图像的请求或者接收要存储在其中的图像。The image management processor 107 may perform overall control over the video call image associated with each user that is collaboratively edited and the meeting minutes generated based on the voice included in the video call image associated with each user. The image management server 107 can also communicate with other servers via the communication unit 117 . For example, the image management server 107 may receive a request for an image stored therein or receive an image to be stored therein via the communication unit 117 .
图15根据示范性实施例图示了在利用用于提供协作服务的服务器100处理文档的同时根据对执行协作服务的请求发起协作服务的过程。详细而言，图15图示了准备接收协作服务的过程。当第一用户在利用服务器100处理文档的同时请求执行协作服务时，协作服务被提供以便通过与群组成员的视频会议来协作地编辑文档。然而，示范性实施例不限于准备接收协作服务的该过程。FIG. 15 illustrates a process of initiating a collaboration service according to a request to perform the collaboration service while processing a document using the server 100 for providing the collaboration service, according to an exemplary embodiment. In detail, FIG. 15 illustrates a process of preparing to receive a collaboration service. When a first user requests execution of a collaboration service while processing a document using the server 100, the collaboration service is provided to collaboratively edit the document through a video conference with group members. However, exemplary embodiments are not limited to this process of preparing to receive collaboration services.
用于处理文档的程序可被安装在服务器100上。第一用户可经由第一用户终端300利用他或她的用户账户登录到服务器100中并且请求在服务器100上执行用于处理文档的程序。第二和第三用户可利用其用户账户登录到服务器100中并且接收由服务器100提供的协作服务。Programs for processing documents may be installed on the server 100 . A first user may log in to the server 100 with his or her user account via the first user terminal 300 and request execution of a program for processing a document on the server 100 . The second and third users may log in to the server 100 using their user accounts and receive collaboration services provided by the server 100 .
参考图15，第一用户终端300可向服务器100请求创建文档(操作S1505)。由于用于处理文档的程序被安装在服务器100上，所以第一用户可登录到服务器100中并且请求创建具有期望格式的文档。Referring to FIG. 15, the first user terminal 300 may request the server 100 to create a document (operation S1505). Since a program for processing documents is installed on the server 100, a first user may log in to the server 100 and request to create a document having a desired format.
服务器100根据来自第一用户终端300的请求创建文档(操作S1510)。The server 100 creates a document according to a request from the first user terminal 300 (operation S1510).
第一用户终端300在其屏幕上显示由服务器100创建的文档，并且第一用户可通过该屏幕处理该文档(操作S1515)。在此情况下，在服务器100上执行的文档可被显示在在第一用户终端300上执行的web浏览器屏幕上。换言之，服务器100向第一用户终端300提供基于web的文档，并且第一用户终端300可通过web浏览器屏幕查看基于web的文档。The first user terminal 300 displays the document created by the server 100 on its screen, and the first user can process the document through the screen (operation S1515). In this case, the document executed on the server 100 may be displayed on a web browser screen executed on the first user terminal 300 . In other words, the server 100 provides the web-based document to the first user terminal 300, and the first user terminal 300 can view the web-based document through a web browser screen.
第一用户终端300可向服务器100发送关于文档的处理的信息(操作S1520)。发送关于文档的处理的信息的时间间隔可被调整。第一用户终端300可在每次发生与文档的处理有关的事件时向服务器100发送关于文档的处理的信息。The first user terminal 300 may transmit information about the processing of the document to the server 100 (operation S1520). The time interval at which information about the processing of the document is sent can be adjusted. The first user terminal 300 may transmit information on the processing of the document to the server 100 every time an event related to the processing of the document occurs.
服务器100可存储从第一用户终端300接收的关于文档的处理的信息(操作S1525)。The server 100 may store information on the processing of the document received from the first user terminal 300 (operation S1525).
第一用户可在第一用户终端300中选择执行到协作模式的切换(操作S1530)。The first user may select to perform switching to the cooperation mode in the first user terminal 300 (operation S1530).
第一用户终端向服务器100请求执行协作服务(操作S1535)。现在将参考图16描述请求执行协作服务的第一用户终端300的状态。The first user terminal requests execution of the collaboration service from the server 100 (operation S1535). A state of the first user terminal 300 requesting to perform a collaboration service will now be described with reference to FIG. 16 .
图16根据示范性实施例图示了用于接收协作服务的第一用户终端300请求执行协作服务的示例。详细而言，图16示出了第一用户终端300的用户界面屏幕360。从上到下，用户界面屏幕360包括用于输入服务器100的地址的地址窗口361、菜单栏363和带状菜单栏365。菜单栏363和带状菜单栏365根据在服务器100上执行的程序的类型可具有不同的形状。FIG. 16 illustrates an example in which the first user terminal 300 for receiving a collaboration service requests to perform the collaboration service, according to an exemplary embodiment. In detail, FIG. 16 shows a user interface screen 360 of the first user terminal 300 . From top to bottom, the user interface screen 360 includes an address window 361 for inputting an address of the server 100 , a menu bar 363 , and a ribbon menu bar 365 . The menu bar 363 and the ribbon menu bar 365 may have different shapes according to the type of programs executed on the server 100 .
首先，第一用户可在菜单栏363中选择“协作”菜单，在显示的子菜单中点击(或触摸)“切换到协作模式”，并且执行到协作模式的切换。First, the first user may select a 'Collaboration' menu in the menu bar 363, click (or touch) 'Switch to Collaboration Mode' in the displayed submenu, and perform switching to the collaboration mode.
然后，根据来自第一用户的对执行到协作模式的切换的请求，指示当前模式是协作模式的模式指示符367和示出获得对当前文档的访问的用户的访问用户显示窗口369出现在用户界面屏幕360的右上侧。示出正被协作编辑的文档的窗口370可被显示在带状菜单栏365下方。Then, according to a request from the first user to perform switching to the collaboration mode, a mode indicator 367 indicating that the current mode is the collaboration mode and an access user display window 369 showing the user who obtained access to the current document appear on the user interface The upper right side of the screen 360. A window 370 showing the document being collaboratively edited may be displayed below the ribbon menu bar 365 .
返回参考图15，第一用户可在第一用户终端300中执行群组创建菜单(操作S1540)。Referring back to FIG. 15 , the first user may execute a group creation menu in the first user terminal 300 (operation S1540).
第一用户终端300可向服务器100请求群组的创建(操作S1545)。The first user terminal 300 may request creation of a group to the server 100 (operation S1545).
图17根据示范性实施例图示了用于接收协作服务的第一用户终端300请求创建群组的示例。FIG. 17 illustrates an example in which a first user terminal 300 for receiving a collaboration service requests to create a group, according to an exemplary embodiment.
在第一用户终端300的用户界面屏幕360上，第一用户可选择地址窗口361与带状菜单栏365之间的菜单栏363中的“协作”菜单，然后选择显示的子菜单中的“创建群组”。On the user interface screen 360 of the first user terminal 300, the first user can select the "Collaboration" menu in the menu bar 363 between the address window 361 and the ribbon menu bar 365, and then select the "Create" menu in the displayed submenu. group".
选择“创建群组”将在第一用户终端300的用户界面屏幕360上显示创建群组窗口362。为了创建群组，第一用户可在群组名称、可访问性、口令和默认权限中输入适当的值，并且按压完成按钮。如图17所示，第一用户可分别在群组名称、可访问性、口令和默认权限中选择并输入“群组1”、“私有”、“****”(不显示以便其他用户不能查看它)和“读/写”。在此情况下，如果第一用户设定了口令，则群组成员被允许通过经由输入口令参与创建的群组来使用协作服务。另外，创建群组窗口362还可包括用于选择设定经由协作服务编辑的文档的安全级别的模式的菜单362-1。例如，如果经由菜单362-1提供了分别用于将安全级别设定到高、中、低的按钮，则用户可通过选择与高、中、低相对应的按钮之一来确定群组成员对其协作执行协作服务的文档的安全级别。Selecting “Create Group” will display a create group window 362 on the user interface screen 360 of the first user terminal 300 . To create a group, the first user may enter appropriate values in Group Name, Accessibility, Password and Default Permissions and press the Done button. As shown in Figure 17, the first user can respectively select and input "group 1", "private" and "****" in the group name, accessibility, password and default permissions (not displayed so that other users cannot view it) and "read/write". In this case, if the first user sets the password, the group members are allowed to use the collaboration service by participating in the created group by inputting the password. In addition, the create group window 362 may further include a menu 362-1 for selecting a mode of setting a security level of a document edited via the collaboration service. For example, if buttons for respectively setting the security level to high, medium, and low are provided via the menu 362-1, the user can determine the group member's preference for security by selecting one of the buttons corresponding to high, medium, and low. The security level of the document whose collaboration executes the collaboration service.
根据示范性实施例，如果用户将安全级别设定到高，则经由协作服务编辑的文档可被存储在安全文档DB158中。另外，如果用户将安全级别设定到中，则经由协作服务编辑的文档可被存储在文档DB155中，但除了输入相应口令之外可要求进一步的认证。另外，如果用户将安全级别设定到低，则创建的群组所工作的文档可被存储在文档DB155中并且可被任何用户访问，而不要求输入口令，或者没有口令。According to an exemplary embodiment, if a user sets a security level to high, a document edited via a collaboration service may be stored in the secure document DB 158 . Also, if the user sets the security level to medium, documents edited via the collaboration service may be stored in the document DB 155, but further authentication may be required in addition to inputting a corresponding password. In addition, if the user sets the security level to low, the documents on which the created group works can be stored in the document DB 155 and can be accessed by any user without requiring input of a password, or without a password.
根据另一示范性实施例，如果用户将安全级别设定到高，则参与协作服务的群组成员可受到限制。例如，对群组的参与可仅限于位于在从第一用户起的预定范围内的地方或者位于预先指定的地方的用户。或者，可仅允许经由预先指定的IP段访问的用户参与群组。作为另一示例，可仅允许经由预先指定的设备标识信息(例如，MAC地址等等)访问的用户参与群组。According to another exemplary embodiment, if a user sets a security level to high, group members participating in a collaboration service may be restricted. For example, participation in a group may be limited to users located within a predetermined range from a first user or at pre-designated locations. Alternatively, only users accessing via pre-designated IP ranges may be allowed to participate in the group. As another example, only users accessed via pre-specified device identification information (eg, MAC address, etc.) may be allowed to participate in the group.
根据另一示范性实施例，如果用户将安全级别设定到高，则在正经由协作服务编辑文档的同时可限制另一应用的执行。例如，可限制在用户终端上执行另一应用以防止对正编辑的文档的捕捉、拷贝或发送。According to another exemplary embodiment, if a user sets a security level to high, execution of another application may be restricted while a document is being edited via a collaboration service. For example, execution of another application on the user terminal may be restricted to prevent capturing, copying or sending of the document being edited.
根据另一示范性实施例，如果用户将安全级别设定到高，则经由协作服务编辑的文档的加密的复杂度在该文档被存储时可被增大。这个增大的加密复杂度可增加存储被编辑的文档所花的时间，但可进一步增强文档的安全性。According to another exemplary embodiment, if a user sets a security level to high, complexity of encryption of a document edited via a collaboration service may be increased when the document is stored. This increased encryption complexity can increase the time it takes to store the edited document, but can further enhance the security of the document.
根据另一示范性实施例，如果用户将安全级别设定到高，则服务器100可经由单独的安全通道将被编辑的文档发送到用户终端。例如，服务器100可将被编辑的文档转换成图像以将该图像经由安全通道以流数据的形式提供到用户终端。如果被编辑的文档是图像，则该文档的安全性可被进一步增强，因为用户终端难以解析该文档的结构、内容或文本。According to another exemplary embodiment, if the user sets the security level to high, the server 100 may transmit the edited document to the user terminal via a separate secure channel. For example, the server 100 may convert the edited document into an image to provide the image to the user terminal in the form of streaming data via a secure channel. If the edited document is an image, the security of the document can be further enhanced because it is difficult for the user terminal to parse the structure, content or text of the document.
返回参考图15，服务器100可根据来自第一用户终端300的请求创建群组(操作S1550)。根据上述示例，可向服务器100注册具有群组名称“群组1”的私有群组，并且第一用户(例如，用户A)可以是群组1中的当前群组成员。Referring back to FIG. 15, the server 100 may create a group according to a request from the first user terminal 300 (operation S1550). According to the above-described example, a private group having a group name "group1" may be registered with the server 100, and a first user (eg, user A) may be a current group member in group1.
第一用户终端300可执行群组成员管理菜单(操作S1555)。The first user terminal 300 may execute a group member management menu (operation S1555).
第一用户终端300可向服务器100请求邀请群组成员(操作S1560)。现在将参考图18更详细描述群组成员的管理。The first user terminal 300 may request the server 100 to invite group members (operation S1560). Management of group members will now be described in more detail with reference to FIG. 18 .
图18根据示范性实施例图示了用于接收协作服务的第一用户终端300执行群组成员的管理的示例。FIG. 18 illustrates an example in which the first user terminal 300 for receiving a collaboration service performs management of group members, according to an exemplary embodiment.
在第一用户终端300的用户界面屏幕360上，第一用户可选择地址窗口361与带状菜单栏365之间的菜单栏363中的“协作”菜单，然后选择显示的子菜单中的“管理群组成员”。On the user interface screen 360 of the first user terminal 300, the first user can select the "Collaboration" menu in the menu bar 363 between the address window 361 and the ribbon menu bar 365, and then select the "Management" menu in the displayed submenu. group members".
然后，管理群组成员窗口364可被显示在第一用户终端300的用户界面屏幕360上。第一用户可通过按压“添加成员”按钮来向服务器100请求邀请群组成员。Then, a manage group members window 364 may be displayed on the user interface screen 360 of the first user terminal 300 . The first user may request the server 100 to invite group members by pressing the 'add member' button.
返回参考图15，服务器100可邀请第二用户终端400和第三用户终端500，并且第二用户终端400和第三用户终端500可连接到服务器100(操作S1565)。Referring back to FIG. 15 , the server 100 may invite the second user terminal 400 and the third user terminal 500, and the second user terminal 400 and the third user terminal 500 may connect to the server 100 (operation S1565).
在此情况下，如果第一用户在群组的创建期间设定了口令，则服务器100可从第二用户终端400和第三用户终端500接收口令。在此情况下，口令可以是群组成员输入的文本，或者可在发送到服务器100之前被加密。In this case, if the first user sets a password during creation of the group, the server 100 may receive the password from the second user terminal 400 and the third user terminal 500 . In this case, the password may be text entered by the group members, or may be encrypted before being sent to the server 100 .
在接收到口令后，服务器100可通过确定接收到的口令是否与第一用户创建的口令相同来执行群组成员的认证。当认证得到确认时，服务器100可向第二用户终端400和第三用户终端500提供使用协作服务的权力。After receiving the password, the server 100 may perform authentication of group members by determining whether the received password is the same as the password created by the first user. When the authentication is confirmed, the server 100 may provide the second user terminal 400 and the third user terminal 500 with an authority to use the collaboration service.
此外，虽然大体上向每个群组指派一个口令，但也可向每个群组成员赋予不同的口令。例如，第二用户终端400和第三用户终端500可使用不同的口令来参与该群组。或者，第二用户终端400和第三用户终端500中只有一者可被要求输入其口令。Furthermore, while each group is generally assigned one password, each group member may be assigned a different password. For example, the second user terminal 400 and the third user terminal 500 may use different passwords to participate in the group. Alternatively, only one of the second user terminal 400 and the third user terminal 500 may be required to enter its password.
第二用户终端400和第三用户终端500可请求执行被协作编辑的文档并从服务器100接收基于web的文档(操作S1570)。The second user terminal 400 and the third user terminal 500 may request to execute the collaboratively edited document and receive the web-based document from the server 100 (operation S1570).
第二用户终端400和第三用户终端500可分别在第二用户终端400和第三用户终端500的屏幕上显示正在服务器100上执行的文档(操作S1575)。在此情况下，在服务器100上执行的文档可被显示在第二用户终端400和第三用户终端500上执行的web浏览器屏幕上。The second user terminal 400 and the third user terminal 500 may display the document being executed on the server 100 on the screens of the second user terminal 400 and the third user terminal 500, respectively (operation S1575). In this case, the document executed on the server 100 may be displayed on the screens of web browsers executed on the second user terminal 400 and the third user terminal 500 .
第一至第三用户终端300、400和500可经由服务器100彼此交换视频呼叫图像(操作S1580)。视频呼叫图像的交换可继续直到对终止协作服务的请求被作出为止。The first to third user terminals 300, 400, and 500 may exchange video call images with each other via the server 100 (operation S1580). The exchange of video call images may continue until a request is made to terminate the collaboration service.
其他方的视频呼叫图像可分别被输出到第一至第三用户终端300、400和500(操作S1585)。例如，与第二和第三用户相关联的视频呼叫图像可被输出到第一用户终端300。Video call images of other parties may be output to the first to third user terminals 300, 400, and 500, respectively (operation S1585). For example, video call images associated with the second and third users may be output to the first user terminal 300 .
图19根据示范性实施例图示了当在文档正被处理的同时协作服务被发起以使得第一至第三用户终端300、400和500准备好协作编辑文档时第一至第三用户终端300、400和500的状态。参考图19，第一至第三用户终端300、400和500可连接到服务器100。FIG. 19 illustrates first to third user terminals 300 when a collaboration service is initiated while a document is being processed so that the first to third user terminals 300, 400, and 500 are ready to collaboratively edit a document, according to an exemplary embodiment. , 400 and 500 status. Referring to FIG. 19 , first to third user terminals 300 , 400 and 500 may be connected to the server 100 .
示出正被协作编辑的文档的窗口370和示出第二和第三用户(例如，“白”和“崔”)的视频呼叫图像的窗口380可被显示在第一用户终端300上。A window 370 showing a document being collaboratively edited and a window 380 showing video call images of the second and third users (eg, 'Bai' and 'Cui') may be displayed on the first user terminal 300 .
类似地，示出正被协作编辑的文档的窗口470和示出第一和第三用户(例如，“安”和“崔”)的视频呼叫图像的窗口480可被显示在第二用户终端400上。Similarly, a window 470 showing a document being collaboratively edited and a window 480 showing video call images of the first and third users (for example, "An" and "Cui") may be displayed on the second user terminal 400. superior.
同样地，示出正被协作编辑的文档的窗口570和示出第一和第二用户(例如，“安”和“白”)的视频呼叫图像的窗口580可被显示在第三用户终端500上。在示范性实施例中，视频呼叫图像可包括运动视觉图像。在另外一个示范性实施例中，利用视频编解码器来处理运动视觉图像。Likewise, a window 570 showing a document being collaboratively edited and a window 580 showing video call images of the first and second users (for example, "Ann" and "Bai") may be displayed on the third user terminal 500. superior. In an exemplary embodiment, the video call image may include a motion vision image. In another exemplary embodiment, a video codec is utilized to process motion vision images.
在一个示范性实施例中，视频呼叫图像可以是第一和第二用户的静止图像，同时第一和第二用户提供的音频被播放。In one exemplary embodiment, the video call image may be a still image of the first and second user while audio provided by the first and second user is played.
图20根据示范性实施例图示了在用于接收协作服务的第一用户终端300上显示包括地址窗口和菜单的用户界面和视频呼叫图像的方法。FIG. 20 illustrates a method of displaying a user interface including an address window and a menu and a video call image on the first user terminal 300 for receiving a collaboration service, according to an exemplary embodiment.
参考图20，示出视频呼叫图像的窗口380可被显示在其上显示了地址窗口、菜单栏和带状栏的第一用户终端300的右侧。如上文参考图19所述，第二和第三用户(例如，“白”和“崔”)的视频呼叫图像可出现在第一用户终端上的窗口380中。然而，第一用户可操纵协作编辑文档的用户中的一些的视频呼叫图像以使得它们不被显示在第一用户终端300上。Referring to FIG. 20 , a window 380 showing a video call image may be displayed on the right side of the first user terminal 300 on which an address window, a menu bar, and a ribbon bar are displayed. As described above with reference to FIG. 19, the video call images of the second and third users (eg, 'Bai' and 'Cui') may appear in the window 380 on the first user terminal. However, the first user may manipulate video call images of some of the users who collaboratively edit the document so that they are not displayed on the first user terminal 300 .
图21根据示范性实施例图示了在用于接收协作服务的第一用户终端300上显示视频呼叫图像的方法。FIG. 21 illustrates a method of displaying a video call image on the first user terminal 300 for receiving a collaboration service, according to an exemplary embodiment.
参考图21，在第一用户终端300上显示的示出视频呼叫图像的窗口380的大小可被调整。换言之，可以调整根据在第一用户终端300中预设的默认大小显示的示出视频呼叫图像的窗口380的大小。可利用多手指手势、点击并拖曳方法等等来调整窗口380的大小。Referring to FIG. 21 , a window 380 showing a video call image displayed on the first user terminal 300 may be resized in size. In other words, the size of the window 380 showing the video call image displayed according to the default size preset in the first user terminal 300 may be adjusted. Window 380 may be resized using multi-finger gestures, a tap-and-drag method, and the like.
图22根据示范性实施例图示了在用于接收协作服务的第一用户终端300上显示视频呼叫图像的另一方法。FIG. 22 illustrates another method of displaying a video call image on the first user terminal 300 for receiving a collaboration service, according to an exemplary embodiment.
参考图22，在第一用户终端300上显示的示出视频呼叫图像的窗口380的位置可被调整。换言之，可以调整根据在第一用户终端300中预设的默认位置显示的示出视频呼叫图像的窗口380的位置。可利用拖放方法等等来调整窗口380的位置。Referring to FIG. 22 , a position of a window 380 showing a video call image displayed on the first user terminal 300 may be adjusted. In other words, the position of the window 380 showing the video call image displayed according to the default position preset in the first user terminal 300 may be adjusted. The position of the window 380 may be adjusted using a drag and drop method or the like.
图23根据示范性实施例图示了利用用于提供协作服务的服务器100在视频会议期间根据对执行协作服务的请求发起协作服务的过程。详细而言，图23图示了准备接收协作服务的过程。当第一用户利用服务器100运行视频会议和文档时，协作服务被提供来共享文档并且在视频会议期间协作地编辑该文档。然而，实施例不限于准备接收协作服务的该过程。FIG. 23 illustrates a process of initiating a collaboration service according to a request for performing the collaboration service during a video conference using the server 100 for providing the collaboration service, according to an exemplary embodiment. In detail, FIG. 23 illustrates a process of preparing to receive a collaboration service. When a first user runs a video conference and a document using the server 100, a collaboration service is provided to share the document and collaboratively edit the document during the video conference. Embodiments, however, are not limited to this process of preparing to receive collaboration services.
参考图23，第一用户终端230可向服务器100请求为视频会议创建群组(操作S2305)。Referring to FIG. 23, the first user terminal 230 may request the server 100 to create a group for the video conference (operation S2305).
服务器100可根据来自第一用户终端300的请求创建群组(操作S2310)。The server 100 may create a group according to a request from the first user terminal 300 (operation S2310).
第一用户终端300可执行群组成员管理菜单(操作S2315)。The first user terminal 300 may execute a group member management menu (operation S2315).
第一用户终端300可向服务器100请求为该视频会议邀请群组成员(操作S2320)。The first user terminal 300 may request the server 100 to invite group members for the video conference (operation S2320).
在此情况下，为视频会议创建群组和邀请群组成员可按与上文参考图17和图18描述的那些类似的方式执行。In this case, creating a group for a video conference and inviting group members may be performed in a manner similar to those described above with reference to FIGS. 17 and 18 .
服务器100邀请第二用户终端400和第三用户终端500，并且第二用户终端400和第三用户终端500可连接到服务器100(操作S2325)。The server 100 invites the second user terminal 400 and the third user terminal 500, and the second user terminal 400 and the third user terminal 500 may connect to the server 100 (operation S2325).
第一至第三用户终端300、400和500可经由服务器100彼此交换视频呼叫图像(操作S2330)。视频呼叫图像的交换可继续直到对终止协作服务的请求被作出为止。The first to third user terminals 300, 400, and 500 may exchange video call images with each other via the server 100 (operation S2330). The exchange of video call images may continue until a request is made to terminate the collaboration service.
其他方的视频呼叫图像可分别被输出到第一至第三用户终端300、400和500(操作S2335)。例如，与第二和第三用户相关联的视频呼叫图像可被输出到第一用户终端300。在操作S2305至S2335中，视频会议的群组被创建，群组成员被邀请，并且视频会议被执行。现在将参考图24详细描述用于视频会议的用户界面屏幕。Video call images of other parties may be output to the first to third user terminals 300, 400, and 500, respectively (operation S2335). For example, video call images associated with the second and third users may be output to the first user terminal 300 . In operations S2305 to S2335, a group for the video conference is created, group members are invited, and the video conference is performed. A user interface screen for a video conference will now be described in detail with reference to FIG. 24 .
图24根据示范性实施例图示了在作出对执行协作服务的请求之前在用于接收协作服务的第一用户终端300中执行视频会议的示例。FIG. 24 illustrates an example of performing a video conference in the first user terminal 300 for receiving a collaboration service before making a request to perform the collaboration service, according to an exemplary embodiment.
详细而言，图24示出了第一用户终端300的用户界面屏幕360。从上到下，用户界面屏幕360包括用于输入服务器100的地址的地址窗口361、菜单栏363和带状菜单栏365。菜单栏363和带状菜单栏365根据在服务器100上执行的程序的类型可具有不同的形状。图24所示的用户界面屏幕360具有与图16所示的类似的结构，但与之不同之处在于菜单栏363和带状栏365的形状被改变以匹配用于视频会议的程序。In detail, FIG. 24 shows a user interface screen 360 of the first user terminal 300. Referring to FIG. From top to bottom, the user interface screen 360 includes an address window 361 for inputting an address of the server 100 , a menu bar 363 , and a ribbon menu bar 365 . The menu bar 363 and the ribbon menu bar 365 may have different shapes according to the type of programs executed on the server 100 . The user interface screen 360 shown in FIG. 24 has a similar structure to that shown in FIG. 16, but is different in that the shapes of the menu bar 363 and the ribbon bar 365 are changed to match the program for video conferencing.
此外，模式指示符367可指示出当前模式是视频会议模式，并且访问用户显示窗口369可示出当前参与视频会议的用户的名称。In addition, the mode indicator 367 may indicate that the current mode is a video conference mode, and the visiting user display window 369 may show the name of the user currently participating in the video conference.
用于显示其他方的视频呼叫图像的区域、聊天区域和表示在视频会议期间使用的基本功能的简单图标出现在视频会议窗口375上。视频会议窗口375还可包括备忘录区域或用于显示共享文档的区域，所述共享文档是运行视频会议所需要的。An area for displaying the other party's video call image, a chat area, and simple icons representing basic functions used during the video conference appear on the video conference window 375 . The video conferencing window 375 may also include a memo area or an area for displaying shared documents required to run the video conference.
返回参考图23，第一用户可从文档列表中选择他或她想要与参与视频会议的其他用户共享的文档(操作S2340)。Referring back to FIG. 23 , the first user may select a document he or she wants to share with other users participating in the video conference from the document list (operation S2340).
图25根据示范性实施例图示了在用于接收协作服务的第一用户终端300中在作出对执行协作服务的请求之前选择在视频会议期间共享的文档的过程。FIG. 25 illustrates a process of selecting a document shared during a video conference before making a request to perform a collaboration service in the first user terminal 300 for receiving a collaboration service, according to an exemplary embodiment.
参考图25，在第一用户终端300上显示的视频会议窗口375中，第一用户可从表示在视频会议期间使用的基本功能的简单图标中选择存储共享文档的文件夹并且打开该文件夹以识别出可共享的文档列表376。25, in the video conference window 375 displayed on the first user terminal 300, the first user can select a folder storing shared documents from simple icons representing basic functions used during the video conference and open the folder to A list of shareable documents is identified 376 .
第一用户可从文档的列表中选择至少一个文档并且与其他用户共享所选文档。在此情况下，第一用户可选择具有不同文档格式的两个文件以同时共享两个文档。参考图25，第一用户可从文档列表376选择“present.doc”和“Graph.pdf”两者。The first user may select at least one document from the list of documents and share the selected document with other users. In this case, the first user may select two files having different document formats to share the two documents at the same time. Referring to FIG. 25 , the first user may select both "present.doc" and "Graph.pdf" from the document list 376 .
返回参考图23，第一用户终端300可请求服务器100执行从文档列表中选择的文档(操作S2345)。Referring back to FIG. 23 , the first user terminal 300 may request the server 100 to execute a document selected from the document list (operation S2345).
服务器100可执行第一用户终端300请求执行的文档(操作S2350)。用于执行文档的程序可被安装在服务器100上。The server 100 may execute the document requested to be executed by the first user terminal 300 (operation S2350). Programs for executing documents may be installed on the server 100 .
服务器100可以把在服务器100上执行的文档作为基于web的文档发送到第一至第三用户终端300、400和500(操作S2355)。The server 100 may transmit the document executed on the server 100 to the first to third user terminals 300, 400, and 500 as a web-based document (operation S2355).
第一至第三用户终端300、400和500可分别经由web浏览器显示作为基于web的文档发送的文档(操作S2360)。The first to third user terminals 300, 400, and 500 may display documents transmitted as web-based documents via web browsers, respectively (operation S2360).
图26根据示范性实施例图示了在作出对执行协作服务的请求之前在用于接收协作服务的第一用户终端300上显示在视频会议期间共享的文档的示例。FIG. 26 illustrates an example of displaying a document shared during a video conference on the first user terminal 300 for receiving a collaboration service before a request for performing the collaboration service is made, according to an exemplary embodiment.
参考图26，用于显示其他方的视频呼叫图像的区域、聊天区域和表示在视频会议期间使用的基本功能的简单图标出现在第一用户终端300的视频会议窗口375上。与图25中不同，第一用户选择的两类共享文档可一起被显示在视频会议窗口375上。Referring to FIG. 26 , an area for displaying video call images of other parties, a chat area, and simple icons representing basic functions used during the video conference appear on the video conference window 375 of the first user terminal 300 . Unlike in FIG. 25 , two types of shared documents selected by the first user may be displayed together on the video conference window 375 .
返回参考图23，第一用户可在第一用户终端300中选择执行到协作模式的切换(操作S2365)。现在将参考图27描述在第一用户终端300中选择执行到协作模式的切换。Referring back to FIG. 23 , the first user may select to perform switching to the cooperation mode in the first user terminal 300 (operation S2365). Selectively performing switching to the cooperation mode in the first user terminal 300 will now be described with reference to FIG. 27 .
图27根据示范性实施例图示了用于接收协作服务的第一用户终端300在视频会议期间请求执行协作服务的示例。FIG. 27 illustrates an example in which the first user terminal 300 for receiving a collaboration service requests to perform the collaboration service during a video conference, according to an exemplary embodiment.
详细而言，图27示出了第一用户终端300的用户界面屏幕360。从上到下，用户界面屏幕360包括用于输入服务器100的地址的地址窗口361、菜单栏363和带状菜单栏365。模式指示符367可指示出当前模式是视频会议模式，并且访问用户显示窗口369可显示当前参与视频会议的用户的名称。In detail, FIG. 27 shows a user interface screen 360 of the first user terminal 300. Referring to FIG. From top to bottom, the user interface screen 360 includes an address window 361 for inputting an address of the server 100 , a menu bar 363 , and a ribbon menu bar 365 . The mode indicator 367 may indicate that the current mode is a video conference mode, and the visiting user display window 369 may display the names of users currently participating in the video conference.
参考图27，第一用户在菜单栏363中选择“协作”菜单，在显示的子菜单中点击(或触摸)“切换到协作模式”，并且执行到协作模式的切换。Referring to FIG. 27 , the first user selects the 'Collaboration' menu in the menu bar 363, clicks (or touches) 'Switch to Collaboration Mode' in the displayed submenu, and performs switching to the collaboration mode.
返回参考图23，第一用户终端300可向服务器100请求执行允许对文档的协作编辑的协作服务(操作S2370)。在此情况下，可进一步提供用于设定被协作编辑的文档的安全状态的菜单。例如，响应于用户输入，即点击(或触摸)“切换到协作模式”，被协作编辑的文档的安全级别可被设定。可经由用于分别选择高、中、低的按钮来提供安全级别，并且服务器100上存储文档的DB的位置可选择性地依据所选择的安全级别而变化。例如，如果用户将安全级别设定到高，则创建的群组所工作的文档可被存储在安全文档DB158中。另一方面，如果用户将安全级别设定到中或低，则创建的群组所工作的文档可被存储在文档DB155中。Referring back to FIG. 23 , the first user terminal 300 may request the server 100 to perform a collaboration service allowing collaborative editing of a document (operation S2370). In this case, a menu for setting the security status of the collaboratively edited document may be further provided. For example, in response to user input, ie, clicking (or touching) "Switch to Collaboration Mode," the security level of a collaboratively edited document may be set. Security levels can be provided via buttons for selecting high, medium, and low, respectively, and the location of a DB storing documents on the server 100 can be selectively changed depending on the selected security level. For example, if the user sets the security level to high, documents in which the created group works may be stored in the secure document DB 158 . On the other hand, if the user sets the security level to medium or low, documents in which the created group works can be stored in the document DB 155 .
现在将参考图28详细描述在请求执行允许对文档的协作编辑的协作服务时第一至第三用户终端300、400和500的状态。States of the first to third user terminals 300, 400, and 500 at the time of requesting execution of a collaboration service allowing collaborative editing of a document will now be described in detail with reference to FIG. 28 .
图28根据示范性实施例图示了当协作服务在视频会议期间被发起以使得第一至第三用户终端300、400和500准备好协作编辑文档时第一至第三用户终端300、400和500的状态。参考图28，第一至第三用户终端300、400和500可连接到服务器100。FIG. 28 illustrates when the collaboration service is initiated during a video conference so that the first to third user terminals 300, 400, and 500 are ready to collaboratively edit a document when the first to third user terminals 300, 400 and 500 500 status. Referring to FIG. 28 , first to third user terminals 300 , 400 and 500 may be connected to the server 100 .
示出正被协作编辑的文档的窗口370和示出第二和第三用户(例如，“白”和“崔”)的视频呼叫图像的窗口380可被显示在第一用户终端300上。A window 370 showing a document being collaboratively edited and a window 380 showing video call images of the second and third users (eg, 'Bai' and 'Cui') may be displayed on the first user terminal 300 .
类似地，示出正被协作编辑的文档的窗口470和示出第一和第三用户(例如，“安”和“崔”)的视频呼叫图像的窗口480可被显示在第二用户终端400上。Similarly, a window 470 showing a document being collaboratively edited and a window 480 showing video call images of the first and third users (for example, "An" and "Cui") may be displayed on the second user terminal 400. superior.
同样地，示出正被协作编辑的文档的窗口570和示出第一和第二用户(例如，“安”和“白”)的视频呼叫图像的窗口580可被显示在第三用户终端500上。Likewise, a window 570 showing a document being collaboratively edited and a window 580 showing video call images of the first and second users (for example, "Ann" and "Bai") may be displayed on the third user terminal 500. superior.
图19图示了当在文档正被处理的同时协作服务被发起以使得第一至第三用户终端300、400和500能够协作编辑文档时第一至第三用户终端300、400和500的状态。图28图示了当在视频会议期间协作服务被发起以使得第一至第三用户终端300、400和500能够协作编辑文档时第一至第三用户终端300、400和500的状态。图19和图28都示出了准备接收协作服务以便协作编辑文档的过程。第一至第三用户终端300、400和500中的每一者示出了在根据执行到协作模式的切换而接收允许对文档的协作编辑的协作服务之后的相同状态。图28所示的示例与图19所示的示例的不同之处仅在于两种不同类型的文档被分别显示在窗口370、470和570中。19 illustrates states of the first to third user terminals 300, 400, and 500 when a collaboration service is initiated to enable the first to third user terminals 300, 400, and 500 to collaboratively edit the document while the document is being processed . FIG. 28 illustrates states of the first to third user terminals 300, 400, and 500 when a collaboration service is initiated during a video conference to enable the first to third user terminals 300, 400, and 500 to edit documents collaboratively. Both Figure 19 and Figure 28 illustrate the process of preparing to receive collaboration services for collaborative editing of documents. Each of the first to third user terminals 300, 400, and 500 shows the same state after receiving a collaboration service allowing collaborative editing of a document according to performing switching to the collaboration mode. The example shown in FIG. 28 differs from the example shown in FIG. 19 only in that two different types of documents are displayed in windows 370, 470, and 570, respectively.
图29根据示范性实施例图示了在用于提供协作服务的服务器100中从视频呼叫图像生成会议纪要并将会议纪要发送到第一至第三用户终端300、400和500中的每一者的过程。如上所述，当文档准备好被协作编辑时，视频呼叫图像可在用户终端之间被交换，并且该文档可被显示在每个用户终端的屏幕上。由于会议纪要是基于视频呼叫图像中包括的语音生成的，所以应当在每个用户终端之间交换视频呼叫图像。换言之，由于虽然没有描述视频呼叫图像的发送/接收，但视频呼叫图像的发送/接收继续直到对终止协作服务的请求被作出为止，所以这里假定在每个用户终端之间连续交换视频呼叫图像。29 illustrates generating meeting minutes from a video call image and transmitting the meeting minutes to each of the first to third user terminals 300, 400, and 500 in the server 100 for providing a collaboration service, according to an exemplary embodiment. the process of. As described above, when a document is ready to be collaboratively edited, video call images can be exchanged between user terminals, and the document can be displayed on the screen of each user terminal. Since the meeting minutes are generated based on the voice included in the video call image, the video call image should be exchanged between each user terminal. In other words, since the transmission/reception of video call images continues until a request for termination of the collaborative service is made although not described, it is assumed here that video call images are continuously exchanged between each user terminal.
参考图29，服务器100可将视频呼叫图像中包括的语音转换成文本(操作S2905)。服务器100可将与每个用户相关联的视频呼叫图像中包含的语音转换成文本并基于该文本生成会议纪要。换言之，由于第一至第三用户终端300、400和500中的每一者经由服务器100发送或接收视频呼叫图像，所以每次与每个用户相关联的视频呼叫图像被发送或接收时，服务器100可将视频呼叫图像中包括的语音转换成文本。Referring to FIG. 29, the server 100 may convert voice included in a video call image into text (operation S2905). The server 100 may convert voice contained in a video call image associated with each user into text and generate meeting minutes based on the text. In other words, since each of the first to third user terminals 300, 400, and 500 transmits or receives a video call image via the server 100, each time a video call image associated with each user is transmitted or received, the server The 100 may convert voice included in a video call image into text.
服务器100可向第一至第三用户终端300、400和500发送会议纪要(操作S2910)。例如，每次每个用户的视频呼叫图像被发送或接收时，服务器100可将视频呼叫图像中的语音转换成文本并且将包括该文本的会议纪要发送到第一至第三终端300、400和500中的每一者。The server 100 may transmit the minutes of the meeting to the first to third user terminals 300, 400, and 500 (operation S2910). For example, every time each user's video call image is sent or received, the server 100 may convert the voice in the video call image into text and send meeting minutes including the text to the first to third terminals 300, 400 and 500 each.
第一至第三终端300、400和500中的每一者可显示从服务器100接收的会议纪要(操作S2915)。从在第一至第三终端300、400和500中的每一者上显示会议纪要时起，可认为完整提供了允许对文档的协作编辑的协作服务。Each of the first to third terminals 300, 400, and 500 may display the meeting minutes received from the server 100 (operation S2915). From when the meeting minutes are displayed on each of the first to third terminals 300, 400, and 500, it may be considered that a collaboration service allowing collaborative editing of documents is fully provided.
图30根据示范性实施例图示了在用于接收协作服务的第一至第三用户终端300、400和500中的每一者上显示会议纪要的示例。参考图30，第一至第三用户终端300、400和500可连接到用于提供协作服务的服务器100。FIG. 30 illustrates an example of displaying meeting minutes on each of the first to third user terminals 300, 400, and 500 for receiving a collaboration service, according to an exemplary embodiment. Referring to FIG. 30 , first to third user terminals 300, 400, and 500 may be connected to the server 100 for providing a collaboration service.
示出正被协作编辑的文档的窗口370、示出第二和第三用户(例如，“白”和“崔”)的视频呼叫图像的窗口380和示出会议纪要的窗口390可被显示在第一用户终端300上。A window 370 showing a document being collaboratively edited, a window 380 showing video call images of the second and third users (for example, "Bai" and "Cui"), and a window 390 showing meeting minutes may be displayed on on the first user terminal 300.
类似地，示出正被协作编辑的文档的窗口470、示出第一和第三用户(例如，“安”和“崔”)的视频呼叫图像的窗口480和示出会议纪要的窗口490可被显示在第二用户终端400上。Similarly, a window 470 showing a document being collaboratively edited, a window 480 showing video call images of the first and third users (e.g., "Ann" and "Cui"), and a window 490 showing meeting minutes may be is displayed on the second user terminal 400.
类似地，示出正被协作编辑的文档的窗口570、示出第一和第二用户(例如，“安”和“白”)的视频呼叫图像的窗口580和示出会议纪要的窗口590可被显示在第三用户终端500上。Similarly, window 570 showing a document being collaboratively edited, window 580 showing video call images of first and second users (e.g., "Ann" and "Bai"), and window 590 showing meeting minutes may be is displayed on the third user terminal 500.
从图30清楚可见，在第一用户终端300上显示的窗口390以文本的形式显示了第一用户(例如，“安”)在视频会议期间说了什么。详细而言，会议纪要可包括作为用户信息的“安”、作为关于文本发生的时间的信息的“(09:01)”、作为关于正被协作编辑并且被在文本发生时说出该文本的用户查看的文档中的页的信息的“[1]”以及作为视频呼叫图像中的语音被转换成的文本的“这是今天要协作编辑的文档”。换言之，会议纪要可包括关于会议纪要中的每个文本发生的时间的信息和关于在该文本发生时说出该文本的用户查看的文档中的页的信息。As is clear from FIG. 30, the window 390 displayed on the first user terminal 300 displays in text form what the first user (for example, "Ann") said during the video conference. In detail, the meeting minutes may include "Ann" as user information, "(09:01)" as information about when the text occurred, and "(09:01)" as information about the text being collaboratively edited and spoken as it occurred. "[1]" of the information of the page in the document viewed by the user and "This is a document to be edited collaboratively today" which is text into which voice in the video call image is converted. In other words, the meeting minutes may include information about when each text in the meeting minutes occurred and information about the pages in the document that were viewed by the user who spoke the text when the text occurred.
此外，在第二用户终端400和第三用户终端500上显示的示出会议纪要的窗口490和590包括与在第一用户终端300上显示的窗口390相同的细节。Also, the windows 490 and 590 showing meeting minutes displayed on the second user terminal 400 and the third user terminal 500 include the same details as the window 390 displayed on the first user terminal 300 .
图31根据示范性实施例图示了在用于接收协作服务的第一至第三用户终端300、400和500中的每一者上显示会议纪要的另一示例。参考图31，第一至第三用户终端300、400和500可连接到用于提供协作服务的服务器100。FIG. 31 illustrates another example of displaying meeting minutes on each of the first to third user terminals 300, 400, and 500 for receiving a collaboration service, according to an exemplary embodiment. Referring to FIG. 31 , first to third user terminals 300, 400, and 500 may be connected to the server 100 for providing a collaboration service.
如上文参考图30所述，示出正被协作编辑的文档的窗口370、470和570、示出除了特定用户以外的其余用户的视频呼叫图像的窗口380、480和580以及示出会议纪要的窗口390、490和590可分别被显示在第一至第三用户终端300、400和500上。在此情况下，会议纪要可包括关于会议纪要中的每个文本发生的时间的信息和关于在该文本发生时说出该文本的用户查看的文档中的页的信息。As described above with reference to FIG. 30 , windows 370, 470, and 570 showing documents being collaboratively edited, windows 380, 480, and 580 showing video call images of users other than a specific user, and windows showing meeting minutes The windows 390, 490, and 590 may be displayed on the first to third user terminals 300, 400, and 500, respectively. In this case, the meeting minutes may include information about when each text in the meeting minutes occurred and information about the pages in the document that were viewed by the user who spoke the text when it occurred.
图30和图31分别示出了通过执行图15和图23的过程获得的结果。图31所示的示例与图30所示的示例的不同之处仅在于两种不同类型的文档被分别显示在窗口370、470和570中。30 and 31 show results obtained by performing the processes of FIGS. 15 and 23, respectively. The example shown in FIG. 31 differs from the example shown in FIG. 30 only in that two different types of documents are displayed in windows 370, 470, and 570, respectively.
图32根据示范性实施例图示了向用于提供协作服务的服务器100请求管理群组成员和彼此协作的群组的过程。在服务器100在提供允许对文档的协作编辑的协作服务的同时，居于群组之首的第一用户可认为有必要管理群组成员或群组。换言之，第一用户可能想要改变关于群组中的每个成员的信息或者将具有较大的大小的群组分割成若干个更小的群组。FIG. 32 illustrates a process of requesting management of group members and groups collaborating with each other to the server 100 for providing a collaboration service, according to an exemplary embodiment. While the server 100 provides a collaboration service allowing collaborative editing of documents, a first user at the head of a group may consider it necessary to manage group members or groups. In other words, the first user may want to change information about each member of the group or split a group with a larger size into several smaller groups.
现在将参考图32描述对群组成员的管理。Management of group members will now be described with reference to FIG. 32 .
参考图32，第一用户终端300可执行群组成员管理菜单(操作S3205)。第一用户可在执行群组成员管理菜单时弹出的群组成员窗口中设定每个群组成员或每个群组成员所属的子群组的权限。Referring to FIG. 32, the first user terminal 300 may execute a group member management menu (operation S3205). The first user can set the authority of each group member or the subgroup to which each group member belongs in the group member window popped up when the group member management menu is executed.
第一用户终端300可向服务器100发送关于每个群组成员的信息(操作S3210)。换言之，如果第一用户终端300执行群组成员管理菜单以使得对关于每个群组成员的信息作出改变，则第一用户终端300可将关于每个群组成员的信息发送到服务器100以反映出该改变。The first user terminal 300 may transmit information about each group member to the server 100 (operation S3210). In other words, if the first user terminal 300 executes the group member management menu so that information about each group member is changed, the first user terminal 300 may transmit the information about each group member to the server 100 to reflect out the change.
服务器100可存储关于每个群组成员的信息(操作S3215)。现在将参考图33详细描述通过设定关于每个群组成员的信息来管理群组成员。The server 100 may store information on each group member (operation S3215). Managing group members by setting information on each group member will now be described in detail with reference to FIG. 33 .
图33根据示范性实施例图示了在用于接收协作服务的第一用户终端300中设定关于每个群组成员的信息的示例。FIG. 33 illustrates an example of setting information on each group member in the first user terminal 300 for receiving a collaboration service, according to an exemplary embodiment.
参考图33，在第一用户终端300的用户界面屏幕360上，第一用户可选择地址窗口361与带状菜单栏365之间的菜单栏363中的“协作”菜单，然后选择显示的子菜单中的“管理群组成员”。Referring to FIG. 33 , on the user interface screen 360 of the first user terminal 300, the first user can select the "Collaboration" menu in the menu bar 363 between the address window 361 and the ribbon menu bar 365, and then select the displayed submenu "Manage Group Members" in .
然后，管理群组成员窗口364可被显示在第一用户终端300的用户界面屏幕360上。第一用户可通过改变或设定关于当前成员的信息并按压“完成”按钮来设定关于每个群组成员的信息。参考图33，第二用户(例如，“白”)具有读和写的权限并且属于子群组G1-1。类似地，第三用户(例如，“崔”)具有读和写的权限并且属于子群组G1-2。Then, a manage group members window 364 may be displayed on the user interface screen 360 of the first user terminal 300 . The first user may set the information about each group member by changing or setting the information about the current member and pressing the "DONE" button. Referring to FIG. 33 , the second user (for example, "white") has read and write authority and belongs to the subgroup G1-1. Similarly, a third user (eg, "Cui") has read and write permissions and belongs to subgroup G1-2.
返回参考图32，第一用户终端300可执行群组管理菜单(操作S3220)。Referring back to FIG. 32 , the first user terminal 300 may execute a group management menu (operation S3220).
第一用户终端300可向服务器100请求分割群组(操作S3225)。The first user terminal 300 may request the server 100 to divide the group (operation S3225).
服务器100可根据来自第一用户终端300的请求将群组分割成更小的群组(操作S3230)。现在将参考图34详细描述群组的管理。The server 100 may divide the group into smaller groups according to the request from the first user terminal 300 (operation S3230). Management of groups will now be described in detail with reference to FIG. 34 .
图34根据示范性实施例图示了在用于接收协作服务的第一用户终端300中将当前群组分割成多个群组的示例。FIG. 34 illustrates an example of dividing a current group into a plurality of groups in the first user terminal 300 for receiving a collaboration service, according to an exemplary embodiment.
如上文参考图33所述，关于每个群组成员的信息可被设定以使得第二用户(例如，“白”)与第三用户(例如，“崔”)属于不同的子群组。如果具有不同子群组的多个用户属于单个群组，则居于群组之首的第一用户可分割该群组。As described above with reference to FIG. 33 , information on each group member may be set such that the second user (eg, 'Bai') and the third user (eg, 'Choi') belong to different subgroups. If multiple users with different subgroups belong to a single group, the first user at the head of the group can split the group.
参考图34，在第一用户终端300的用户界面屏幕360上，第一用户可选择地址窗口361与带状菜单栏365之间的菜单栏363中的“协作”菜单，然后选择显示的子菜单中的“管理群组”。Referring to FIG. 34 , on the user interface screen 360 of the first user terminal 300, the first user can select the "Collaboration" menu in the menu bar 363 between the address window 361 and the ribbon menu bar 365, and then select the displayed submenu "Manage Groups" in .
然后，可进一步显示子菜单“分割群组”和“合并群组”。如果具有不同子群组的多个用户属于当前群组，并且从而当前群组要被分割，则子菜单“分割群组”可被激活。通过选择子菜单“分割群组”，第一用户可将当前群组分割成多个子群组。现在将参考图35详细描述分割群组的结果。Then, sub-menus 'Split Group' and 'Merge Group' may be further displayed. If multiple users with different subgroups belong to the current group, and thus the current group is to be split, the submenu "Split Group" may be activated. By selecting the submenu "Split Group", the first user can divide the current group into multiple subgroups. The results of group division will now be described in detail with reference to FIG. 35 .
图35图示了在当前群组被分割成多个群组时第一至第三用户终端300、400和500中的每一者的状态。FIG. 35 illustrates a state of each of the first to third user terminals 300, 400, and 500 when the current group is divided into a plurality of groups.
参考图35，第一至第三用户终端300、400和500可连接到用于提供协作服务的服务器100。Referring to FIG. 35 , first to third user terminals 300, 400, and 500 may be connected to the server 100 for providing a collaboration service.
示出正被协作编辑的文档的窗口370、示出第二和第三用户(例如，“用户B”和“用户C”)的视频呼叫图像的窗口380和示出会议纪要的窗口390可被显示在第一用户终端300上。此外，访问用户显示窗口369指示出第一用户(例如，“用户A”)属于“群组1-1”和“群组1-2”并且在与第一用户属于至少一个相同群组的用户之中的“用户B”和“用户C”当前正在访问服务器100。A window 370 showing a document being collaboratively edited, a window 380 showing video call images of the second and third users (for example, "User B" and "User C"), and a window 390 showing meeting minutes may be displayed on the first user terminal 300. In addition, the visiting user display window 369 indicates that the first user (for example, "User A") belongs to "Group 1-1" and "Group 1-2" and is among users belonging to at least one of the same groups as the first user. Among them, “user B” and “user C” are currently accessing the server 100 .
示出正被协作编辑的文档的窗口470、示出第一用户(例如，“用户A”)的视频呼叫图像的窗口480和示出会议纪要的窗口490可被显示在第二用户终端400上。此外，访问用户显示窗口469指示出第二用户(例如，“用户B”)属于“群组1-1”并且在与第二用户属于相同群组的用户之中的“用户A”当前在访问服务器100。A window 470 showing a document being collaboratively edited, a window 480 showing a video call image of a first user (for example, “User A”), and a window 490 showing meeting minutes may be displayed on the second user terminal 400 . Furthermore, the visiting user display window 469 indicates that the second user (for example, "User B") belongs to "Group 1-1" and that "User A" among users belonging to the same group as the second user is currently visiting Server 100.
示出正被协作编辑的文档的窗口570、示出第一用户(例如，“用户A”)的视频呼叫图像的窗口580和示出会议纪要的窗口590可被显示在第三用户终端500上。此外，访问用户显示窗口569指示出第三用户(例如，“用户C”)属于“群组1-2”并且在与第三用户属于相同群组的用户之中的“用户A”当前在访问服务器100。A window 570 showing a document being collaboratively edited, a window 580 showing a video call image of a first user (for example, “User A”), and a window 590 showing meeting minutes may be displayed on the third user terminal 500 . In addition, the visiting user display window 569 indicates that a third user (for example, "User C") belongs to "Group 1-2" and that "User A" among users belonging to the same group as the third user is currently visiting Server 100.
换言之，由于第一和第二用户即“用户A”和“用户B”属于“群组1-1”，并且第一和第三用户即“用户A”和“用户C”属于“群组1-2”，所以可以看出第二和第三用户由于对当前群组的分割而不属于相同群组。In other words, since the first and second users, namely "User A" and "User B" belong to "Group 1-1", and the first and third users, namely "User A" and "User C" belong to "Group 1-1". -2", so it can be seen that the second and third users do not belong to the same group due to the division of the current group.
如果要协作编辑两种类型的文档并且对于每类文档需要协作，则如图35所示，通过将群组分割成多个子群组可实现高效的协作。If two types of documents are to be collaboratively edited and collaboration is required for each type of document, as shown in FIG. 35 , efficient collaboration can be achieved by dividing a group into multiple subgroups.
图36根据示范性实施例图示了在用于提供协作服务的服务器100中限制正被协作编辑的文档的编辑范围的过程。由于当多个用户在文档上彼此协作时文档被协作编辑，所以可对每个用户预先指定编辑范围以防止编辑期间的冲突。FIG. 36 illustrates a process of limiting an editing range of a document being collaboratively edited in the server 100 for providing a collaboration service, according to an exemplary embodiment. Since a document is collaboratively edited when a plurality of users collaborate with each other on the document, an editing range can be specified in advance for each user to prevent conflicts during editing.
首先，将参考图36描述第一编辑范围被第一用户锁定的示例。First, an example in which the first editing range is locked by the first user will be described with reference to FIG. 36 .
第一用户可通过使用第一用户终端300来指定第一编辑范围(操作S3605)。The first user may designate a first editing range by using the first user terminal 300 (operation S3605).
第一用户终端300可将第一用户指定的第一编辑范围发送到服务器100(操作S3610)。The first user terminal 300 may transmit the first editing range designated by the first user to the server 100 (operation S3610).
服务器100可基于第一编辑范围锁定正被协作编辑的文档的与第一编辑范围相对应的部分(操作S3615)。The server 100 may lock a portion of the document being collaboratively edited based on the first editing range corresponding to the first editing range (operation S3615).
服务器100可将锁定了第一编辑范围的文档作为基于web的文档发送到第一至第三用户终端300、400和500(操作S3620)。The server 100 may transmit the document in which the first editing range is locked to the first to third user terminals 300, 400, and 500 as a web-based document (operation S3620).
第一至第三用户终端300、400和500可分别经由web浏览器显示锁定了第一编辑范围并被作为基于web的文档发送的文档(操作S3625)。The first to third user terminals 300, 400, and 500 may display the document in which the first editing range is locked and transmitted as a web-based document via a web browser, respectively (operation S3625).
接下来，将参考图36描述第二编辑范围被第二用户锁定的示例。Next, an example in which the second editing range is locked by the second user will be described with reference to FIG. 36 .
第二用户可通过使用第二用户终端400来指定第二编辑范围(操作S3630)。The second user may designate a second editing range by using the second user terminal 400 (operation S3630).
第二用户终端400可将第二用户指定的第二编辑范围发送到服务器100(操作S3635)。The second user terminal 400 may transmit the second editing range designated by the second user to the server 100 (operation S3635).
服务器100可基于第二编辑范围锁定正被协作编辑的文档的与第二编辑范围相对应的部分(操作S3640)。The server 100 may lock a portion of the document being collaboratively edited based on the second editing range corresponding to the second editing range (operation S3640).
服务器100可将锁定了第二编辑范围的文档作为基于web的文档发送到第一至第三用户终端300、400和500(操作S3645)。The server 100 may transmit the document in which the second editing range is locked to the first to third user terminals 300, 400, and 500 as a web-based document (operation S3645).
第一至第三用户终端300、400和500可分别经由web浏览器显示锁定了第二编辑范围并被作为基于web的文档发送的文档(操作S3650)。The first to third user terminals 300, 400, and 500 may display the document in which the second editing range is locked and transmitted as a web-based document via a web browser, respectively (operation S3650).
最后，将参考图36描述第三编辑范围被第三用户锁定的示例。Finally, an example in which the third editing range is locked by the third user will be described with reference to FIG. 36 .
第三用户可通过使用第三用户终端500来指定第三编辑范围(操作S3655)。The third user may designate a third editing range by using the third user terminal 500 (operation S3655).
第三用户终端500可将第三用户指定的第三编辑范围发送到服务器100(操作S3660)。The third user terminal 500 may transmit the third editing range designated by the third user to the server 100 (operation S3660).
服务器100可基于第三编辑范围锁定正被协作编辑的文档的与第三编辑范围相对应的部分(操作S3665)。The server 100 may lock a portion of the document being collaboratively edited based on the third editing range corresponding to the third editing range (operation S3665).
服务器100可将锁定了第三编辑范围的文档作为基于web的文档发送到第一至第三用户终端300、400和500(操作S3670)。The server 100 may transmit the document in which the third editing range is locked to the first to third user terminals 300, 400, and 500 as a web-based document (operation S3670).
第一至第三用户终端300、400和500可分别经由web浏览器显示锁定了第三编辑范围并被作为基于web的文档发送的文档(操作S3675)。The first to third user terminals 300, 400, and 500 may display the document in which the third editing range is locked and transmitted as a web-based document via a web browser, respectively (operation S3675).
现在将参考图37至图40详细描述显示对于每个用户锁定了编辑范围的文档的方法。A method of displaying documents whose editing range is locked for each user will now be described in detail with reference to FIGS. 37 to 40 .
图37根据示范性实施例图示了在用于接收协作服务的第一用户终端300中由第一用户锁定第一编辑范围371的示例。FIG. 37 illustrates an example in which a first editing range 371 is locked by a first user in a first user terminal 300 for receiving a collaboration service, according to an exemplary embodiment.
参考图37，示出正被协作编辑的文档的窗口370、示出视频呼叫图像的窗口380和示出会议纪要的窗口390可被显示在第一用户终端300上。在此情况下，当第一用户(例如，“安”)指定窗口370中显示的文档中的第一页并且请求用于提供协作服务的服务器(图36中的100)锁定第一编辑范围371时，锁定了第一编辑范围371的文档可如图37所示被显示。可以利用与每个用户相对应的预定颜色、图案或标记指示出每个用户的编辑范围被锁定，以便其他用户可认识到它。Referring to FIG. 37 , a window 370 showing a document being collaboratively edited, a window 380 showing a video call image, and a window 390 showing meeting minutes may be displayed on the first user terminal 300 . In this case, when the first user (for example, "Ann") designates the first page in the document displayed in the window 370 and requests the server for providing the collaboration service (100 in FIG. 36 ) to lock the first editing range 371 , the document in which the first editing range 371 is locked can be displayed as shown in FIG. 37 . It may be indicated that each user's editing range is locked with a predetermined color, pattern or mark corresponding to each user so that other users can recognize it.
此外，第一用户的视频呼叫图像被输出到窗口380，并且第一用户说出的文本被显示在窗口390中。换言之，与说出会议纪要中的文本的用户相关联的视频呼叫图像可与会议纪要一起被显示。为此，在窗口380中可只显示与会议纪要中的文本相对应的视频呼叫图像。Also, the video call image of the first user is output to the window 380 and the text spoken by the first user is displayed in the window 390 . In other words, a video call image associated with the user who uttered the text in the meeting minutes may be displayed along with the meeting minutes. For this reason, only the video call image corresponding to the text in the meeting minutes may be displayed in the window 380 .
图38根据示范性实施例图示了在用于接收协作服务的第一用户终端300中由第二用户锁定第二编辑范围372的示例。FIG. 38 illustrates an example in which the second editing range 372 is locked by the second user in the first user terminal 300 for receiving a collaboration service, according to an exemplary embodiment.
参考图38，示出正被协作编辑的文档的窗口370、示出视频呼叫图像的窗口380和示出会议纪要的窗口390可被显示在第一用户终端300上。在此情况下，当第二用户(例如，“白”)利用第二用户终端400指定正被协作编辑的文档中的第二页并且请求服务器(图36中的100)锁定第二编辑范围372时，锁定了第二编辑范围372的文档可如图38所示被显示。Referring to FIG. 38 , a window 370 showing a document being collaboratively edited, a window 380 showing a video call image, and a window 390 showing meeting minutes may be displayed on the first user terminal 300 . In this case, when the second user (for example, "Bai") designates the second page in the document being collaboratively edited using the second user terminal 400 and requests the server (100 in FIG. 36 ) to lock the second editing range 372 , the document in which the second editing range 372 is locked can be displayed as shown in FIG. 38 .
此外，第二用户的视频呼叫图像被输出到窗口380，并且第二用户说出的文本被显示在窗口390中。换言之，与说出会议纪要中的文本的用户相关联的视频呼叫图像可与会议纪要一起被显示。为此，在窗口380中可只显示与会议纪要中的文本相对应的视频呼叫图像。Also, the video call image of the second user is output to the window 380 , and the text spoken by the second user is displayed in the window 390 . In other words, a video call image associated with the user who uttered the text in the meeting minutes may be displayed along with the meeting minutes. For this reason, only the video call image corresponding to the text in the meeting minutes may be displayed in the window 380 .
图39根据示范性实施例图示了在用于接收协作服务的第一用户终端300中由第三用户锁定第三编辑范围373的示例。FIG. 39 illustrates an example in which a third editing range 373 is locked by a third user in the first user terminal 300 for receiving a collaboration service, according to an exemplary embodiment.
参考图39，示出正被协作编辑的文档的窗口370、示出视频呼叫图像的窗口380和示出会议纪要的窗口390可被显示在第一用户终端300上。在此情况下，当第三用户(例如，“崔”)利用第三用户终端500指定正被协作编辑的文档中的第三页并且请求服务器(图36中的100)锁定第三编辑范围373时，锁定了第三编辑范围373的文档可如图39所示被显示。Referring to FIG. 39 , a window 370 showing a document being collaboratively edited, a window 380 showing a video call image, and a window 390 showing meeting minutes may be displayed on the first user terminal 300 . In this case, when the third user (for example, "Cui") designates the third page in the document being collaboratively edited using the third user terminal 500 and requests the server (100 in FIG. 36 ) to lock the third editing range 373 , the document in which the third editing range 373 is locked can be displayed as shown in FIG. 39 .
此外，第三用户的视频呼叫图像被输出到窗口380，并且第三用户说出的文本被显示在窗口390中。换言之，与说出会议纪要中的文本的用户相关联的视频呼叫图像可与会议纪要一起被显示。为此，在窗口380中可只显示与会议纪要中的文本相对应的视频呼叫图像。Also, the video call image of the third user is output to the window 380 , and the text spoken by the third user is displayed in the window 390 . In other words, a video call image associated with the user who uttered the text in the meeting minutes may be displayed along with the meeting minutes. For this reason, only the video call image corresponding to the text in the meeting minutes may be displayed in the window 380 .
参考图37至图39，第一至第三用户中的每一者可对正被协作编辑的文档中的每一页指定编辑范围。另外，第一至第三用户中的每一者在他或她自己的用户终端上查看的文档的页号与会议纪要中的文本一起被显示。可通过转换每个用户的视频呼叫图像中的语音来获得文本。关于文本发生的时间的信息也可与文本和页号一起被显示，并且与会议纪要中的最新文本相对应的用户的视频呼叫图像被显示。Referring to FIGS. 37 to 39 , each of the first to third users may designate an editing range for each page in a document being collaboratively edited. In addition, the page number of the document that each of the first to third users viewed on his or her own user terminal is displayed together with the text in the meeting minutes. The text is obtained by translating the speech in each user's video call image. Information about when the text occurred may also be displayed along with the text and page number, and the user's video call image corresponding to the latest text in the meeting minutes is displayed.
图40根据示范性实施例图示了在用于接收协作服务的第一用户终端300中对于页中的多个区域锁定第一至第三编辑范围371至373的示例。FIG. 40 illustrates an example in which first to third editing ranges 371 to 373 are locked for a plurality of regions in a page in the first user terminal 300 for receiving a collaboration service, according to an exemplary embodiment.
参考图40，示出正被协作编辑的文档的窗口370、示出视频呼叫图像的窗口380和示出会议纪要的窗口390可被显示在第一用户终端300上。Referring to FIG. 40 , a window 370 showing a document being collaboratively edited, a window 380 showing a video call image, and a window 390 showing meeting minutes may be displayed on the first user terminal 300 .
当第一用户(例如，“安”)指定在窗口370中显示的文档中的第一页中的区域为第一编辑范围371并且请求用于提供协作服务的服务器(图36中的100)锁定该区域时，锁定了第一编辑范围371的文档可如图40所示被显示。When the first user (for example, "Ann") designates the area in the first page of the document displayed in the window 370 as the first editing range 371 and requests the server (100 in FIG. 36 ) for providing the collaboration service to lock In this area, the document with the first editing range 371 locked can be displayed as shown in FIG. 40 .
另外，当第二用户(例如，“白”)利用第二用户终端400指定正被协作编辑的文档的第一页中的一区域为第二编辑范围372并且请求服务器(图36中的100)锁定第二编辑范围372时，锁定了第二编辑范围372的文档可如图40所示被显示。In addition, when the second user (for example, "Bai") uses the second user terminal 400 to designate an area in the first page of the document being collaboratively edited as the second editing range 372 and requests the server (100 in FIG. 36 ) When the second editing range 372 is locked, the document in which the second editing range 372 is locked may be displayed as shown in FIG. 40 .
在此情况下，当第三用户(例如，“崔”)利用第三用户终端500指定正被协作编辑的文档的第一页中的区域为第三编辑范围373并且请求服务器(图36中的100)锁定第三编辑范围373时，锁定了第三编辑范围373的文档可如图40所示被显示。In this case, when a third user (for example, "Cui") utilizes the third user terminal 500 to designate the area in the first page of the document being collaboratively edited as the third editing range 373 and requests the server (in FIG. 100) When the third editing range 373 is locked, the document in which the third editing range 373 is locked may be displayed as shown in FIG. 40 .
此外，第三用户的视频呼叫图像被输出到窗口380，并且第三用户说出的文本被显示在窗口390中。换言之，与说出会议纪要中的文本的用户相关联的视频呼叫图像可与会议纪要一起被显示。为此，在窗口380中可只显示与会议纪要中的文本相对应的视频呼叫图像。Also, the video call image of the third user is output to the window 380 , and the text spoken by the third user is displayed in the window 390 . In other words, a video call image associated with the user who uttered the text in the meeting minutes may be displayed along with the meeting minutes. For this reason, only the video call image corresponding to the text in the meeting minutes may be displayed in the window 380 .
参考图40，第一至第三用户中的每一者可对正被协作编辑的文档内的一页的每个区域指定编辑范围。另外，第一至第三用户中的每一者在他或她自己的用户终端上查看的文档的页号与会议纪要中的文本一起被显示。可通过转换每个用户的视频呼叫图像中的语音来获得文本。关于文本发生的时间的信息也可与文本和页号一起被显示，并且与会议纪要中的最新文本相对应的用户的视频呼叫图像被显示。Referring to FIG. 40 , each of the first to third users may designate an editing range for each area of a page within a document being collaboratively edited. In addition, the page number of the document that each of the first to third users viewed on his or her own user terminal is displayed together with the text in the meeting minutes. The text is obtained by translating the speech in each user's video call image. Information about when the text occurred may also be displayed along with the text and page number, and the user's video call image corresponding to the latest text in the meeting minutes is displayed.
图41根据示范性实施例图示了在用于提供协作服务的服务器100中编辑被协作编辑的文档的过程。FIG. 41 illustrates a process of editing a collaboratively edited document in the server 100 for providing a collaboration service, according to an exemplary embodiment.
首先，将参考图41详细描述被协作编辑的文档被第一用户根据第一编辑信息来编辑并被显示的示例。First, an example in which a collaboratively edited document is edited by a first user according to first editing information and displayed will be described in detail with reference to FIG. 41 .
第一用户可在第一用户终端300中编辑被协作编辑的文档(操作S4105)。The first user may edit the collaboratively edited document in the first user terminal 300 (operation S4105).
第一用户终端300可将第一编辑信息发送到服务器100(操作S4110)。The first user terminal 300 may transmit the first editing information to the server 100 (operation S4110).
服务器100可存储第一编辑信息(操作S4115)。The server 100 may store the first editing information (operation S4115).
服务器100可将编辑的文档作为基于web的文档发送到第一至第三用户终端300、400和500(操作S4120)。The server 100 may transmit the edited document to the first to third user terminals 300, 400, and 500 as a web-based document (operation S4120).
第一至第三用户终端300、400和500可分别经由web浏览器显示被根据第一编辑信息编辑并被作为基于web的文档发送的文档(操作S4125)。The first to third user terminals 300, 400, and 500 may display the document edited according to the first editing information and transmitted as a web-based document via a web browser, respectively (operation S4125).
接下来，将参考图41详细描述被协作编辑的文档被第二用户根据第二编辑信息来编辑并被显示的示例。Next, an example in which a collaboratively edited document is edited by the second user according to the second editing information and displayed will be described in detail with reference to FIG. 41 .
第二用户可在第二用户终端400中编辑被协作编辑的文档(操作S4130)。The second user may edit the collaboratively edited document in the second user terminal 400 (operation S4130).
第二用户终端400可将第二编辑信息发送到服务器100(操作S4135)。The second user terminal 400 may transmit the second editing information to the server 100 (operation S4135).
服务器100可存储第二编辑信息(操作S4140)。The server 100 may store the second editing information (operation S4140).
服务器100可将编辑的文档作为基于web的文档发送到第一至第三用户终端300、400和500(操作S4145)。The server 100 may transmit the edited document to the first to third user terminals 300, 400, and 500 as a web-based document (operation S4145).
第一至第三用户终端300、400和500可分别经由web浏览器显示被根据第二编辑信息编辑并被作为基于web的文档发送的文档(操作S4150)。The first to third user terminals 300, 400, and 500 may display the document edited according to the second editing information and transmitted as a web-based document via a web browser, respectively (operation S4150).
现在将参考图42和图43描述被协作编辑的文档被第一和第二用户根据第一编辑信息和第二编辑信息顺序编辑的示例。An example in which a collaboratively edited document is sequentially edited by first and second users according to first editing information and second editing information will now be described with reference to FIGS. 42 and 43 .
图42根据示范性实施例图示了在用于接收协作服务的第一用户终端300中由第一用户编辑被协作编辑的文档的示例。FIG. 42 illustrates an example of editing a collaboratively edited document by a first user in a first user terminal 300 for receiving a collaboration service, according to an exemplary embodiment.
参考图42，示出正被协作编辑的文档的窗口370、示出视频呼叫图像的窗口380和示出会议纪要的窗口390可被显示在第一用户终端300上。Referring to FIG. 42 , a window 370 showing a document being collaboratively edited, a window 380 showing a video call image, and a window 390 showing meeting minutes may be displayed on the first user terminal 300 .
当第一用户(例如，“安”)编辑在窗口370中显示的文档的第一页中的一部分，通过视频呼叫图像说出关于对该部分的编辑并且向用于提供协作服务的服务器(图41中的100)请求编辑时，如图42所示那样指示的具有由指示“安”的“A”表示的被编辑部分的文档可被显示。When the first user (for example, "Ann") edits a part of the first page of the document displayed in the window 370, the video call image speaks about the editing of the part and sends a message to the server for providing the collaboration service (FIG. 100) in 41) When editing is requested, a document having an edited portion indicated by "A" indicating "An" indicated as shown in FIG. 42 may be displayed.
可利用与每个用户相对应的预定颜色、图案或标记来指示被编辑部分以使得其他用户可认识到谁编辑了该部分。The edited portion may be indicated with a predetermined color, pattern, or mark corresponding to each user so that other users can recognize who edited the portion.
参考图42，第一用户可编辑作为正被协作编辑的文档中的目录的一部分的目标，通过视频呼叫图像说出关于对该部分的编辑，并且在会议纪要中显示通过转换视频呼叫图像中的第一用户的语音来获得的文本。Referring to FIG. 42 , the first user can edit an object that is part of a table of contents in a document being collaboratively edited, speak about the edit to the part through the video call image, and display in the meeting minutes by converting the object in the video call image. The first user's voice to get the text.
图43根据示范性实施例图示了在用于接收协作服务的第二用户终端400中由第二用户编辑被协作编辑的文档的示例。FIG. 43 illustrates an example of editing a collaboratively edited document by a second user in a second user terminal 400 for receiving a collaboration service, according to an exemplary embodiment.
参考图43，示出正被协作编辑的文档的窗口470、示出视频呼叫图像的窗口480和示出会议纪要的窗口490可被显示在第二用户终端400上。Referring to FIG. 43 , a window 470 showing a document being collaboratively edited, a window 480 showing a video call image, and a window 490 showing meeting minutes may be displayed on the second user terminal 400 .
当第二用户(例如，“白”)编辑正被协作编辑的文档的第二页中的一部分，通过视频呼叫图像说出关于对该部分的编辑并且向用于提供协作服务的服务器(图41中的100)请求编辑时，如图43所示那样指示的具有由指示“白”的“B”表示的被编辑部分的文档可被显示。When the second user (for example, "Bai") edits a part in the second page of the document being collaboratively edited, the video call image speaks about the editing of the part and sends a message to the server for providing the collaborative service (FIG. 41 When editing is requested in 100) in , a document having an edited portion indicated by "B" indicating "white" indicated as shown in FIG. 43 can be displayed.
可利用与每个用户相对应的预定颜色、图案或标记来指示被编辑部分以使得其他用户可认识到谁编辑了该部分。The edited portion may be indicated with a predetermined color, pattern, or mark corresponding to each user so that other users can recognize who edited the portion.
参考图43，第二用户可利用触摸笔编辑正被协作编辑的文档的第二页中的一部分，通过视频呼叫图像说出关于对该部分的编辑，并且在会议纪要中显示通过转换视频呼叫图像中的第二用户的语音来获得的文本。Referring to FIG. 43 , the second user can edit a part of the second page of the document being collaboratively edited using a touch pen, speak about the edits to the part through the video call image, and display in the meeting minutes The text obtained from the voice of the second user.
图44根据示范性实施例图示了在用于接收协作服务的第二用户终端400中利用会议纪要来识别正被协作编辑的文档的编辑信息的示例。FIG. 44 illustrates an example of identifying editing information of a document being collaboratively edited using a meeting minute in the second user terminal 400 for receiving a collaboration service, according to an exemplary embodiment.
参考图44，示出正被协作编辑的文档的窗口470、示出视频呼叫图像的窗口480和示出会议纪要的窗口490可被显示在第二用户终端400上。当在窗口490中累积了文本时，在窗口490的右侧可创建滚动条。Referring to FIG. 44 , a window 470 showing a document being collaboratively edited, a window 480 showing a video call image, and a window 490 showing meeting minutes may be displayed on the second user terminal 400 . When text is accumulated in the window 490 , a scroll bar may be created on the right side of the window 490 .
服务器100可从第二用户终端400接收关于用户从会议纪要中选择的文本的信息并且向第二用户终端400发送关于正被协作编辑的文档的与所选择的文本同步的被编辑部分的信息。详细而言，如果在窗口490中选择了另一用户的文本，则与所选择的文本相对应的文档的编辑信息可被显示在窗口470中。这在会议纪要与文档同步时是可能的。The server 100 may receive from the second user terminal 400 information on the text selected by the user from the meeting minutes and transmit to the second user terminal 400 information on the edited portion of the document being collaboratively edited synchronized with the selected text. In detail, if another user's text is selected in the window 490 , editing information of a document corresponding to the selected text may be displayed in the window 470 . This is possible when meeting minutes are synchronized with documents.
图45根据示范性实施例图示了在用于接收协作服务的第二用户终端400中利用会议纪要来编辑正被协作编辑的文档的示例。FIG. 45 illustrates an example of editing a document being collaboratively edited using a meeting minute in the second user terminal 400 for receiving a collaboration service, according to an exemplary embodiment.
参考图45，示出正被协作编辑的文档的窗口470、示出视频呼叫图像的窗口480和示出会议纪要的窗口490可被显示在第二用户终端400上。Referring to FIG. 45 , a window 470 showing a document being collaboratively edited, a window 480 showing a video call image, and a window 490 showing meeting minutes may be displayed on the second user terminal 400 .
用于提供协作服务的服务器(图41中的100)可从第二用户终端400接收关于用户从会议纪要中选择的文本的信息并且识别出是否有正被协作编辑的文档的与所选择的文本同步的被编辑部分。详细而言，如果第二用户从窗口490中选择他或她自己的文本并且没有与所选择的文本相对应的文档的编辑信息，则可利用所选择的文本作为文档的编辑信息来编辑该文档。这样，可利用在窗口490中显示的文本来编辑在窗口470中显示的文档。The server (100 in FIG. 41 ) for providing a collaboration service may receive from the second user terminal 400 information about the text selected by the user from the meeting minutes and recognize whether there is a text associated with the selected text of the document being collaboratively edited. The edited part of the synchronization. In detail, if the second user selects his or her own text from the window 490 and there is no editing information of the document corresponding to the selected text, the document can be edited using the selected text as the editing information of the document . In this way, the document displayed in window 470 can be edited using the text displayed in window 490 .
图46根据示范性实施例图示了如下示例：在用于接收协作服务的用户终端中，对于正被协作编辑的文档的图像、视频呼叫图像和会议纪要中的每一者设定设备以便利用向用户终端注册的其他设备分开显示文档的图像、视频呼叫图像和会议纪要。FIG. 46 illustrates an example in which, in a user terminal for receiving a collaboration service, a device is set for each of an image of a document being collaboratively edited, a video call image, and a meeting minutes so as to be utilized, according to an exemplary embodiment. Other devices registered to the user terminal separately display images of documents, images of video calls, and meeting minutes.
详细而言，图46图示了图像特定设备设定窗口366。如果用户难以查看对正被协作编辑的文档的编辑、会议纪要和视频呼叫图像，则可对每个图像执行设备设定以使得文档的图像、视频呼叫图像和会议纪要中的至少一者被显示在当前向用户终端注册的设备上。In detail, FIG. 46 illustrates an image-specific device setting window 366 . If it is difficult for the user to view editing of a document being collaboratively edited, meeting minutes, and video call images, device settings may be performed for each image so that at least one of the document's image, video call image, and meeting minutes is displayed On the device currently registered with the user terminal.
图47根据示范性实施例图示了在多个设备上分开显示正被协作编辑的文档、视频呼叫图像和会议纪要的示例。FIG. 47 illustrates an example of separately displaying a document being collaboratively edited, a video call image, and meeting minutes on a plurality of devices, according to an exemplary embodiment.
当如上文参考图46所述对于每个图像完成设备设定时，文档、视频呼叫图像和会议纪要可被分别分开显示在PC300-1、智能TV300-2和平板PC300-3上。When device setting is completed for each image as described above with reference to FIG. 46, documents, video call images, and meeting minutes can be separately displayed on PC 300-1, smart TV 300-2, and tablet PC 300-3, respectively.
图48根据示范性实施例图示了通过向用于提供协作服务的服务器100请求终止协作服务来终止协作服务并将协作编辑的文档发送到另一用户终端的过程。FIG. 48 illustrates a process of terminating a collaboration service and transmitting a collaboratively edited document to another user terminal by requesting the server 100 for providing the collaboration service to terminate the collaboration service, according to an exemplary embodiment.
参考图48，第一用户终端300可向服务器100请求终止协作服务(操作S4805)。Referring to FIG. 48 , the first user terminal 300 may request the server 100 to terminate the collaboration service (operation S4805).
服务器100可存储正被协作编辑的文档并终止用于处理文档的程序(操作S4810)。The server 100 may store the document being collaboratively edited and terminate a program for processing the document (operation S4810).
服务器100可存储会议纪要和视频呼叫图像(操作S4815)。The server 100 may store meeting minutes and video call images (operation S4815).
如果文档、会议纪要和视频呼叫图像全都被存储，服务器100可终止视频呼叫图像服务(操作S4820)。在此情况下，服务器100也可存储用于审查的文档、用于审查的视频呼叫图像和用于审查的会议纪要。用于审查的文档、用于审查的视频呼叫图像和用于审查的会议纪要指的是其中编辑信息与文本信息同步的图像，即，保留了对在利用协作服务对文档的协作编辑期间编辑的部分的指示的文档和与被编辑部分同步的图像。If the documents, minutes, and video call image are all stored, the server 100 may terminate the video call image service (operation S4820). In this case, the server 100 may also store documents for review, video call images for review, and meeting minutes for review. Documents for review, video call images for review, and meeting minutes for review refer to images in which editing information is synchronized with text information, that is, images edited during collaborative editing of a document using a collaboration service are preserved. The indicated document of the section and the image synchronized with the edited section.
第一用户终端300向服务器100请求共享被协作编辑的文档(操作S4825)。例如，为了与没有协作编辑文档的第四用户共享利用协作服务来协作编辑的文档，第一用户终端300可向服务器100请求共享该文档。The first user terminal 300 requests the server 100 to share the collaboratively edited document (operation S4825). For example, in order to share a document collaboratively edited using a collaboration service with a fourth user who has not collaboratively edited the document, the first user terminal 300 may request the server 100 to share the document.
服务器100可检索第一用户终端300请求的文档(操作S4830)。The server 100 may retrieve the document requested by the first user terminal 300 (operation S4830).
服务器100可将检索的文档发送到第四用户终端600(操作S4835)。The server 100 may transmit the retrieved document to the fourth user terminal 600 (operation S4835).
第四用户终端600可显示发送来的文档(操作S4840)。在第四用户终端600的屏幕上显示的文档是基于web的文档。在服务器100上执行的文档可被显示在第四用户终端600上执行的web浏览器屏幕上。The fourth user terminal 600 may display the transmitted document (operation S4840). The document displayed on the screen of the fourth user terminal 600 is a web-based document. A document executed on the server 100 may be displayed on a web browser screen executed on the fourth user terminal 600 .
图49根据示范性实施例图示了用于审查的文档、用于审查的视频呼叫图像和用于审查的会议纪要被彼此同步的示例。FIG. 49 illustrates an example in which a document for review, a video call image for review, and a meeting minute for review are synchronized with each other, according to an exemplary embodiment.
参考图49，可以使用于审查的文档、用于审查的视频呼叫图像和用于审查的会议纪要彼此同步。Referring to FIG. 49, a document for review, a video call image for review, and a meeting minute for review can be synchronized with each other.
例如，当第一至第三用户在2014年5月21日参与视频呼叫时，第一用户(例如，“安”)可在2014年5月21日上午09:03在文档中输入句子“增强拥有的专利的利用率”，同时输出说“我将写下目标是增强拥有的专利的利用率”的语音。在此情况下，服务器100可将文档中的句子“增强拥有的专利的利用率”与会议纪要中的会议细节“我将写下目标是增强拥有的专利的利用率”同步。另外，在第一至第三用户在2014年5月21日参与视频呼叫时，当第一用户在文档中输入句子“增强拥有的专利的利用率”时输出的视频呼叫图像可与该文档和会议纪要同步。For example, when the first to third users participate in a video call on May 21, 2014, the first user (e.g., "Ann") may enter the sentence "enhanced Utilization ratio of owned patents", while outputting a voice saying "I will write that the goal is to enhance the utilization ratio of owned patents". In this case, the server 100 may synchronize the sentence "enhance the utilization of owned patents" in the document with the meeting details "I will write that the goal is to enhance the utilization of owned patents" in the minutes of the meeting. In addition, when the first to third users participated in a video call on May 21, 2014, the video call image output when the first user entered the sentence "enhance the utilization of owned patents" in the document can be compared with the document and Synchronization of meeting minutes.
换言之，句子“增强拥有的专利的利用率”可与会议细节“我将写下目标是增强拥有的专利的利用率”同步。从而，句子“增强拥有的专利的利用率”、会议细节“我将写下目标是增强拥有的专利的利用率”和在2014年5月21日上午09:03输出的视频呼叫图像可彼此同步。In other words, the sentence "enhance the utilization of owned patents" can be synchronized with the meeting details "I will write that the goal is to enhance the utilization of owned patents". Thus, the sentence "enhance the utilization rate of owned patents", the details of the meeting "I will write that the goal is to enhance the utilization rate of owned patents" and the video call image output at 09:03 am on May 21, 2014 can be synchronized with each other .
图50根据示范性实施例图示了向用于提供协作服务的服务器100请求用于审查的文档并且审查文档的编辑的过程。FIG. 50 illustrates a process of requesting a document for review from the server 100 for providing a collaboration service and reviewing editing of the document, according to an exemplary embodiment.
参考图50，第三用户终端500可向服务器100请求用于审查的文档(操作S5005)。例如，第三用户可经由第三用户终端500登录到服务器100中并且从第三用户已经执行的协作服务的列表中的文档之中选择用于审查的文档。第三用户终端500随后可根据经由用户输入单元(图2中的220)接收的第三用户的选择信息向服务器100请求用于审查的文档。Referring to FIG. 50, the third user terminal 500 may request a document for review from the server 100 (operation S5005). For example, a third user may log in to the server 100 via the third user terminal 500 and select a document for review from among documents in a list of collaboration services that the third user has performed. The third user terminal 500 may then request a document for review to the server 100 according to the third user's selection information received via the user input unit (220 in FIG. 2 ).
服务器100可响应于该请求检索用于审查的文档(操作S5010)。例如，服务器100可从存储在文档DB(图3中的155)中的文档中检索与来自第三用户终端500的请求相对应的用于审查的文档。The server 100 may retrieve a document for review in response to the request (operation S5010). For example, the server 100 may retrieve a document for review corresponding to a request from the third user terminal 500 from among documents stored in the document DB (155 in FIG. 3 ).
服务器100可将用于审查的文档发送到第三用户终端500(操作S5015)。The server 100 may transmit the document for review to the third user terminal 500 (operation S5015).
第三用户终端500可从接收到的用于审查的文档中选择被编辑部分(操作S5050)。例如，如果第三用户终端500显示用于审查的文档，并且第三用户选择用于审查的文档中的句子或段落，则可从用于审查的文档中选择被编辑部分。The third user terminal 500 may select an edited portion from the received document for review (operation S5050). For example, if the third user terminal 500 displays a document for review, and the third user selects a sentence or a paragraph in the document for review, an edited portion may be selected from the document for review.
第三用户终端500可将关于所选择的被编辑部分的编辑信息发送到服务器100(操作S5025)。The third user terminal 500 may transmit editing information on the selected edited portion to the server 100 (operation S5025).
服务器100可识别与发送的编辑信息同步的用于审查的会议纪要和用于审查的视频呼叫图像中的部分(操作S5030)。例如，服务器100可基于综合管理DB(图3中的151)中包含的同步信息从图像DB(图3中的157)确定与编辑信息同步的用于审查的会议纪要和用于审查的视频呼叫图像。The server 100 may identify parts in the meeting minutes for review and the video call image for review synchronized with the transmitted editing information (operation S5030). For example, the server 100 may determine from the image DB (157 in FIG. 3 ) the meeting minutes for review and the video calls for review synchronized with the editing information based on the synchronization information contained in the comprehensive management DB (151 in FIG. 3 ). image.
服务器100可将与编辑信息同步的用于审查的会议纪要和用于审查的视频呼叫图像发送到第三用户终端500(操作S5035)。The server 100 may transmit the meeting minutes for review and the video call image for review synchronized with the editing information to the third user terminal 500 (operation S5035).
第三用户终端500可输出与编辑信息同步的用于审查的会议纪要和用于审查的视频呼叫图像(操作S5040)。例如，第三用户终端500可经由输出单元(图2中的250)输出接收到的用于审查的会议纪要和用于审查的视频呼叫图像。The third user terminal 500 may output the meeting minutes for review and the video call image for review synchronized with the editing information (operation S5040). For example, the third user terminal 500 may output the received meeting minutes for review and video call images for review via the output unit ( 250 in FIG. 2 ).
现在将参考图51描述在操作S5040中输出的同步图像的示例。An example of the sync image output in operation S5040 will now be described with reference to FIG. 51 .
图51根据示范性实施例图示了如下示例：当用于审查的文档的被编辑部分被选择时，均与所选择的被编辑部分同步的用于审查的会议纪要和用于审查的视频呼叫图像在用于接收协作服务的第三用户终端500中被输出。51 illustrates an example of meeting minutes for review and video calls for review, both synchronized with the selected edited portion, when an edited portion of a document for review is selected, according to an exemplary embodiment. The image is output in the third user terminal 500 for receiving the collaboration service.
详细而言，图51图示了用于审查的文档的图像570、和示出与用于审查的文档图像570同步的用于审查的视频呼叫图像的窗口580以及与用于审查的文档图像570同步的用于审查的会议纪要590被输出到第三用户终端500的示例。In detail, FIG. 51 illustrates an image 570 of a document for review, and a window 580 showing a video call image for review synchronized with the document image for review 570 and a window 580 that is synchronized with the document image for review 570. The synchronized meeting minutes for review 590 are output to an instance of the third user terminal 500 .
在一个示范性实施例中，示出视频呼叫图像的窗口580可被显示在弹出窗口或另一窗口中。在另一示范性实施例中，视频呼叫图像可响应于选择对可编辑文档的编辑或者该编辑的指示符而被显示在弹出窗口或另一窗口中。在另外一个示范性实施例中，视频呼叫图像可响应于从项目的文本记录、日志数据或会议纪要中选择项目而被显示在弹出窗口或另一窗口中。In one exemplary embodiment, the window 580 showing a video call image may be displayed in a pop-up window or another window. In another exemplary embodiment, the video call image may be displayed in a pop-up window or another window in response to selecting an edit to the editable document or an indicator of the edit. In another exemplary embodiment, the video call image may be displayed in a pop-up window or another window in response to selecting an item from its text record, log data, or meeting minutes.
参考图51，第三用户终端500可在用于审查的图像570中选择表示句子或段落的被编辑部分。例如，第三用户终端500可选择指明句子“增强拥有的专利的利用率”的被编辑部分。Referring to FIG. 51 , the third user terminal 500 may select an edited portion representing a sentence or a paragraph in an image for review 570 . For example, the third user terminal 500 may select an edited portion indicating the sentence "Enhance utilization of owned patents".
第三用户终端500可输出与所选择的被编辑部分同步的用于审查的会议纪要590。例如，假定当第一至第三用户在2014年5月21日参与视频呼叫时，第一用户(例如，“安”)在2014年5月21日上午09:03在文档中编辑句子“增强拥有的专利的利用率”，同时输出说“我将写下目标是增强拥有的专利的利用率”的语音。在此情况下，第三用户终端500可输出用于审查的会议纪要590，其中会议细节“我将写下目标是增强拥有的专利的利用率”被以粗体指示。The third user terminal 500 may output the meeting minutes for review 590 synchronized with the selected edited portion. For example, assume that when the first to third users participated in a video call on May 21, 2014, the first user (for example, "Ann") edited the sentence "enhanced Utilization ratio of owned patents", while outputting a voice saying "I will write that the goal is to enhance the utilization ratio of owned patents". In this case, the third user terminal 500 may output a meeting minutes for review 590 in which meeting details "I will write that the goal is to enhance the utilization of owned patents" are indicated in bold.
第三用户终端500也可输出用于示出与所选择的被编辑部分同步的用于审查的视频呼叫图像的窗口580。与开展2014年5月21日的视频会议的时间长度相对应的再现条可被显示在用于示出用于审查的视频呼叫图像的窗口580上。另外，用于示出用于审查的视频呼叫图像的窗口580可从与2014年5月21日上午09:03的时间相对应的重放位置被显示。然而，示范性实施例不限于此，而用于示出用于审查的视频呼叫图像的窗口580可以是与2014年5月21日上午09:03相对应的重放位置处的静止图像。The third user terminal 500 may also output a window 580 showing a video call image for review synchronized with the selected edited portion. A reproduction bar corresponding to the length of time for conducting the video conference on May 21, 2014 may be displayed on the window 580 showing a video call image for review. In addition, a window 580 showing a video call image for review may be displayed from a playback position corresponding to a time of 09:03 am on May 21, 2014. However, exemplary embodiments are not limited thereto, and the window 580 showing a video call image for review may be a still image at a playback position corresponding to 09:03 am on May 21, 2014.
图52根据示范性实施例图示了向用于提供协作服务的服务器100请求用于审查的视频呼叫图像并且审查文档的编辑的过程。FIG. 52 illustrates a process of requesting a video call image for review from the server 100 for providing a collaboration service and reviewing editing of a document, according to an exemplary embodiment.
参考图52，第三用户终端500可向服务器100请求用于审查的视频呼叫图像(操作S5205)。例如，第三用户可经由第三用户终端500登录到服务器100中并且从第三用户已经执行的协作服务的列表中的视频呼叫图像之中选择用于审查的视频呼叫图像。第三用户终端500随后可根据经由用户输入单元(图2中的220)接收的第三用户的选择信息向服务器100请求用于审查的视频呼叫图像。Referring to FIG. 52, the third user terminal 500 may request a video call image for review from the server 100 (operation S5205). For example, a third user may log in to the server 100 via the third user terminal 500 and select a video call image for review from among video call images in a list of collaboration services that the third user has performed. The third user terminal 500 may then request the server 100 for a video call image for review according to the third user's selection information received via the user input unit (220 in FIG. 2 ).
服务器100可检索用于审查的视频呼叫图像(操作S5210)。例如，服务器100可从存储在图像DB157中的图像中检索与来自第三用户终端500的请求相对应的用于审查的视频呼叫图像。The server 100 may retrieve a video call image for review (operation S5210). For example, the server 100 may retrieve a video call image for review corresponding to a request from the third user terminal 500 from among images stored in the image DB 157 .
服务器100可将用于审查的视频呼叫图像发送到第三用户终端500(操作S5215)。The server 100 may transmit the video call image for review to the third user terminal 500 (operation S5215).
第三用户终端500可从接收到的用于审查的视频呼叫图像中选择要再现的部分(操作S5220)。例如，如果第三用户终端500为用于审查的视频呼叫图像显示再现条，并且第三用户选择再现条上的一点，则可从用于审查的视频呼叫图像中选择要再现的部分。The third user terminal 500 may select a portion to be reproduced from the received video call image for review (operation S5220). For example, if the third user terminal 500 displays a reproduction bar for a video call image for review, and the third user selects a point on the reproduction bar, a portion to be reproduced may be selected from the video call image for review.
第三用户终端500可将关于所选择的要再现的部分的信息发送到服务器100(操作S5225)。The third user terminal 500 may transmit information on the selected portion to be reproduced to the server 100 (operation S5225).
服务器100可识别与发送的关于要再现的部分的信息同步的用于审查的会议纪要和用于审查的文档中的部分(操作S5230)。例如，服务器100可基于综合管理DB151中包含的同步信息分别从文档DB155和图像DB157中确定与关于要再现的部分的信息同步的用于审查的文档和用于审查的会议纪要。The server 100 may identify a part in the minutes for review and the document for review synchronized with the transmitted information about the part to be reproduced (operation S5230). For example, the server 100 may determine, from the document DB 155 and the image DB 157 , documents for review and meeting minutes for review synchronized with information about parts to be reproduced, respectively, based on synchronization information contained in the comprehensive management DB 151 .
服务器100可将与关于要再现的部分的信息同步的用于审查的会议纪要和用于审查的文档发送到第三用户终端500(操作S5235)。The server 100 may transmit the minutes for review and the document for review synchronized with the information on the part to be reproduced to the third user terminal 500 (operation S5235).
第三用户终端500可输出与关于要再现的部分的信息同步的用于审查的会议纪要和用于审查的文档(操作S5240)。例如，第三用户终端500可经由输出单元250输出接收到的用于审查的会议纪要和用于审查的文档。The third user terminal 500 may output the minutes for review and the document for review synchronized with the information about the part to be reproduced (operation S5240). For example, the third user terminal 500 may output the received meeting minutes for review and documents for review via the output unit 250 .
现在将参考图53描述在操作S5240中输出的同步图像的示例。An example of the sync image output in operation S5240 will now be described with reference to FIG. 53 .
图53根据示范性实施例图示了如下示例：当用于审查的视频呼叫图像的要被再现的一部分被选择时，均与所选择的被再现部分同步的用于审查的会议纪要和用于审查的文档在用于接收协作服务的第三用户终端500中被输出。53 illustrates an example in which, when a part of a video call image for review to be reproduced is selected, the minutes for review and the minutes for review are all synchronized with the selected reproduced part, according to an exemplary embodiment. The reviewed document is output in the third user terminal 500 for receiving the collaboration service.
详细而言，图53图示了示出用于审查的视频呼叫图像的窗口580和均与用于审查的视频呼叫图像同步的用于审查的会议纪要590和用于审查的文档的图像570被输出到第三用户终端500的示例。In detail, FIG. 53 illustrates that a window 580 showing a video call image for review and an image 570 of a meeting minutes for review 590 and a document for review both synchronized with the video call image for review are displayed. An example of output to the third user terminal 500.
参考图53，第三用户终端500可在用于审查的视频呼叫图像中选择要再现的部分。例如，第三用户终端500可通过选择输出到第三用户终端500的用于审查的视频呼叫图像的再现条上的一点来从用于审查的视频呼叫图像中选择要再现的部分。Referring to FIG. 53, the third user terminal 500 may select a portion to be reproduced in a video call image for review. For example, the third user terminal 500 may select a portion to be reproduced from the video call image for review by selecting a point on a reproduction bar of the video call image for review output to the third user terminal 500 .
第三用户终端500可输出与所选择的要再现的部分同步的用于审查的会议纪要590。例如，假定在第一至第三用户在2014年5月21日参与视频呼叫时，第一用户(例如，“安”)输出说“我将写下目标是增强拥有的专利的利用率”的语音。如果所选择的要再现的部分包括2014年5月21日上午09:03，则第三用户终端500可输出指明句子“我将写下目标是增强拥有的专利的利用率”的用于审查的会议纪要590。The third user terminal 500 may output the minutes for review 590 synchronized with the selected portion to be reproduced. For example, assume that when the first to third users participated in a video call on May 21, 2014, the first user (e.g., "Ann") outputs a message saying "I will write that the goal is to enhance the utilization of owned patents." voice. If the selected part to be reproduced includes 09:03 am on May 21, 2014, the third user terminal 500 may output an excerpt for examination specifying the sentence "I will write that the goal is to enhance the utilization rate of owned patents." Minutes 590.
第三用户终端500还可输出与所选择的要再现的部分同步的用于审查的文档的图像570。例如，假定在第一至第三用户在2014年5月21日记录会议纪要的同时第一用户(例如，“安”)在2014年5月21日上午09:03编辑文档中的句子“增强拥有的专利的利用率”。如果所选择的要再现的部分包括2014年5月21日上午09:03，则第三用户终端500可输出包括句子“增强拥有的专利的利用率”的用于审查的文档的图像570。The third user terminal 500 may also output an image 570 of a document for review synchronized with the selected portion to be reproduced. For example, assume that while the first to third users are recording meeting minutes on May 21, 2014, the first user (for example, "Ann") edits the sentence "Enhance Utilization of owned patents". If the selected portion to be reproduced includes 09:03 am on May 21, 2014, the third user terminal 500 may output an image 570 of a document for examination including a sentence 'Enhance utilization of owned patents'.
与开展2014年5月21日的视频会议的时间长度相对应的再现条可被显示在用于示出视频呼叫图像的窗口580上。另外，用于审查的视频呼叫图像可从与2014年5月21日上午09:03的时间相对应的重放位置被显示。然而，示范性实施例不限于此，而用于审查的视频呼叫图像可以是与2014年5月21日上午09:03相对应的重放位置处的静止图像。A reproduction bar corresponding to the length of time for conducting the video conference on May 21, 2014 may be displayed on the window 580 showing a video call image. Additionally, a video call image for review may be displayed from a playback position corresponding to a time of 09:03 AM on May 21, 2014. However, exemplary embodiments are not limited thereto, and the video call image used for review may be a still image at a playback position corresponding to 09:03 am on May 21, 2014.
图54根据示范性实施例图示了向用于提供协作服务的服务器100请求用于审查的会议纪要并审查文档的编辑的过程。FIG. 54 illustrates a process of requesting a meeting minute for review and reviewing editing of a document from the server 100 for providing a collaboration service, according to an exemplary embodiment.
参考图54，第三用户终端500可向服务器100请求用于审查的会议纪要(操作S5405)。例如，第三用户可经由第三用户终端500登录到服务器100中并且从第三用户已经执行的协作服务的列表中的会议纪要之中选择用于审查的会议纪要。第三用户终端500随后可根据经由用户输入单元220接收的第三用户的选择信息向服务器100请求用于审查的会议纪要。Referring to FIG. 54, the third user terminal 500 may request the server 100 for meeting minutes for review (operation S5405). For example, a third user may log in to the server 100 via the third user terminal 500 and select a meeting minutes for review from among meeting minutes in a list of collaboration services that the third user has performed. The third user terminal 500 may then request the server 100 for meeting minutes for review according to the third user's selection information received via the user input unit 220 .
服务器100可检索用于审查的会议纪要(操作S5410)。例如，服务器100可从存储在图像DB157中的会议纪要中检索与来自第三用户终端500的请求相对应的用于审查的会议纪要。The server 100 may retrieve the meeting minutes for review (operation S5410). For example, the server 100 may retrieve the minutes for review corresponding to the request from the third user terminal 500 from the meeting minutes stored in the image DB 157 .
服务器100可将用于审查的会议纪要发送到第三用户终端500(操作S5415)。The server 100 may transmit the meeting minutes for review to the third user terminal 500 (operation S5415).
第三用户终端500可从接收到的用于审查的会议纪要中选择要再现的部分(操作S5420)。例如，如果第三用户终端500显示用于审查的会议纪要，并且第三用户选择用于审查的会议纪要中的区域，则与所选择的区域相对应的时间点处的文本可被选择。The third user terminal 500 may select a portion to be reproduced from the received meeting minutes for review (operation S5420). For example, if the third user terminal 500 displays the meeting minutes for review, and the third user selects an area in the meeting minutes for review, text at a time point corresponding to the selected area may be selected.
第三用户终端500可将关于所选择的文本的信息发送到服务器100(操作S5425)。The third user terminal 500 may transmit information on the selected text to the server 100 (operation S5425).
服务器100可识别与发送的文本信息同步的用于审查的视频呼叫图像和用于审查的文档中的部分(操作S5430)。例如，服务器100可基于综合管理DB151中包含的同步信息分别从文档DB155和图像DB157中确定与文本信息同步的用于审查的文档和用于审查的视频呼叫图像。The server 100 may identify a video call image for review and a portion of a document for review synchronized with the transmitted text information (operation S5430). For example, the server 100 may determine a document for review and a video call image for review synchronized with text information from the document DB 155 and the image DB 157 based on synchronization information contained in the comprehensive management DB 151 , respectively.
服务器100可将与文本信息同步的用于审查的视频呼叫图像和用于审查的文档发送到第三用户终端500(操作S5435)。The server 100 may transmit the video call image for review and the document for review synchronized with the text information to the third user terminal 500 (operation S5435).
第三用户终端500可输出与文本信息同步的用于审查的视频呼叫图像和用于审查的文档(操作S5440)。例如，第三用户终端500可经由输出单元250输出接收到的用于审查的视频呼叫图像和用于审查的文档。The third user terminal 500 may output a video call image for review and a document for review synchronized with the text information (operation S5440). For example, the third user terminal 500 may output the received video call image for review and the document for review via the output unit 250 .
现在将参考图55详细描述在操作S5440中输出的同步图像的示例。An example of the sync image output in operation S5440 will now be described in detail with reference to FIG. 55 .
图55根据示范性实施例图示了如下示例：当用于审查的会议纪要中的文本被选择时，均与所选择的文本同步的用于审查的视频呼叫图像和用于审查的文档在用于接收协作服务的第三用户终端500中被输出。FIG. 55 illustrates an example in which, when text in meeting minutes for review is selected, a video call image for review and a document for review, both synchronized with the selected text, are in use, according to an exemplary embodiment. It is output in the third user terminal 500 receiving the collaboration service.
详细而言，图55图示了用于审查的会议纪要590、以及均与用于审查的会议纪要590同步的用于审查的视频呼叫图像580和用于审查的文档的图像570被输出到第三用户终端500的示例。In detail, FIG. 55 illustrates that a meeting minutes 590 for review, and a video call image 580 for review and an image 570 of a document for review both synchronized with the meeting minutes 590 for review are output to the second Example of a three-user terminal 500 .
参考图55，第三用户终端500可选择用于审查的会议纪要590中的特定时间点处的文本。例如，第三用户终端500可选择与2014年5月21日上午09:03的会议细节相对应的文本“我将写下目标是增强拥有的专利的利用率”。Referring to FIG. 55 , the third user terminal 500 may select text at a specific time point in the meeting minutes 590 for review. For example, the third user terminal 500 may select the text "I will write that the goal is to enhance the utilization rate of owned patents" corresponding to the meeting details at 09:03 am on May 21, 2014.
第三用户终端500可输出与所选择的文本同步的用于审查的视频呼叫图像。与开展2014年5月21日的视频会议的时间长度相对应的再现条可被显示在用于审查的视频呼叫图像上。另外，用于审查的视频呼叫图像可从与2014年5月21日上午09:03的时间相对应的重放位置被显示。然而，示范性实施例不限于此，而用于审查的视频呼叫图像可以是与2014年5月21日上午09:03相对应的重放位置处的静止图像。The third user terminal 500 may output a video call image for review synchronized with the selected text. A reproduction bar corresponding to the length of time the video conference on May 21, 2014 was conducted may be displayed on the video call image for review. Additionally, a video call image for review may be displayed from a playback position corresponding to a time of 09:03 AM on May 21, 2014. However, exemplary embodiments are not limited thereto, and the video call image used for review may be a still image at a playback position corresponding to 09:03 am on May 21, 2014.
第三用户终端500还可输出与所选择的文本同步的用于审查的文档的图像570。例如，假定在第一至第三用户在2014年5月21日记录会议纪要的同时第一用户(例如，“安”)在2014年5月21日上午09:03编辑句子“增强拥有的专利的利用率”。如果与所选择的文本相对应的时间是2014年5月21日上午09:03，则第三用户终端500可输出指示句子“增强拥有的专利的利用率”的用于审查的文档的图像570。The third user terminal 500 may also output an image 570 of a document for review synchronized with the selected text. For example, assume that a first user (e.g., "Ann") edits the sentence "enhancing owned patent utilization rate". If the time corresponding to the selected text is 09:03 am on May 21, 2014, the third user terminal 500 may output an image 570 of a document for examination indicating the sentence "enhance the utilization ratio of owned patents" .
图56是根据示范性实施例的提供协作服务的方法的流程图。FIG. 56 is a flowchart of a method of providing a collaboration service, according to an exemplary embodiment.
参考图56，根据本实施例的提供协作服务的方法包括由图3的用于提供协作服务的服务器按时间顺序执行的操作。从而，虽然下面省略了，但以上关于服务器100的描述可应用到图56的方法。Referring to FIG. 56 , the method of providing a collaboration service according to the present embodiment includes operations performed by the server for providing a collaboration service of FIG. 3 in chronological order. Thus, although omitted below, the above description about the server 100 is applicable to the method of FIG. 56 .
服务器100从请求协作服务的用户终端接收与编辑文档的每个用户相关联的视频呼叫图像和关于被编辑的文档的编辑信息(操作S5610)。The server 100 receives a video call image associated with each user editing a document and editing information on the edited document from a user terminal requesting the collaboration service (operation S5610).
服务器100将基于与每个用户相关联的视频呼叫图像中包括的语音生成的会议纪要的细节与根据接收到的编辑信息编辑的文档同步(操作S5620)。The server 100 synchronizes details of the meeting minutes generated based on the voice included in the video call image associated with each user with the document edited according to the received editing information (operation S5620).
服务器100存储接收到的与每个用户相关联的视频呼叫图像、会议纪要的细节和被编辑的文档(操作S5630)。The server 100 stores the received video call image, details of meeting minutes, and edited document associated with each user (operation S5630).
图57是根据示范性实施例的接收协作服务的方法的流程图。FIG. 57 is a flowchart of a method of receiving a collaboration service, according to an exemplary embodiment.
参考图57，根据本实施例的接收协作服务的方法包括由图2的用户终端200按时间顺序执行的操作。从而，虽然下面省略了，但以上关于用户终端200的描述可应用到图57的方法。Referring to FIG. 57 , the method of receiving a collaboration service according to the present embodiment includes operations performed by the user terminal 200 of FIG. 2 in chronological order. Thus, although omitted below, the above description about the user terminal 200 is applicable to the method of FIG. 57 .
用户终端200获取通过对用户的语音和视频执行信号处理而获得的视频呼叫图像和关于被编辑的文档的编辑信息(操作S5710)。The user terminal 200 acquires a video call image obtained by performing signal processing on the user's voice and video and editing information on the edited document (operation S5710).
用户终端200将所获取的视频呼叫图像和编辑信息发送到用于提供协作服务的服务器100(操作S5720)。The user terminal 200 transmits the acquired video call image and editing information to the server 100 for providing a collaboration service (operation S5720).
用户终端200从服务器100接收与编辑文档的每个用户相关联的视频呼叫图像、基于与每个用户相关联的视频呼叫图像中包括的语音生成的会议纪要和与会议纪要的细节同步的文档(操作S5730)。The user terminal 200 receives from the server 100 a video call image associated with each user editing the document, a meeting minutes generated based on voice included in the video call image associated with each user, and a document synchronized with details of the meeting minutes ( Operation S5730).
用户终端200输出接收到的与每个用户相关联的视频呼叫图像、会议纪要和文档(操作S5740)。The user terminal 200 outputs the received video call image, meeting minutes, and documents associated with each user (operation S5740).
根据示范性实施例的提供协作服务的方法或接收协作服务的方法可被记录在可在计算机上执行的程序中，并且通过可利用计算机可读记录介质运行或执行这些程序的通用数字计算机和一个或多个处理器来实现。计算机可读记录介质的示例包括诸如磁存储介质(例如，软盘、硬盘等等)和光记录介质(例如，CD-ROM或DVD)之类的记录介质。A method of providing a collaborative service or a method of receiving a collaborative service according to an exemplary embodiment can be recorded in a program executable on a computer, and a general-purpose digital computer that can run or execute these programs using a computer-readable recording medium and a or multiple processors. Examples of the computer-readable recording medium include recording media such as magnetic storage media (eg, floppy disk, hard disk, etc.) and optical recording media (eg, CD-ROM or DVD).
虽然已参考附图描述了一个或多个示范性实施例，但本领域普通技术人员将会理解，在不脱离由所附权利要求限定的发明构思的精神和范围的情况下，可对其进行各种形式和细节上的改变。从而，本文描述的示范性实施例应当仅在描述意义上来加以考虑，而不是为了限制的。发明构思的范围不由对示范性实施例的详细描述限定，而由所附权利要求来限定，并且在所附权利要求及其等同物的范围内的所有差异都将被解释为包括在发明构思中。While one or more exemplary embodiments have been described with reference to the drawings, those of ordinary skill in the art will appreciate that modifications may be made thereto without departing from the spirit and scope of the inventive concept as defined by the appended claims. Various changes in form and detail. Accordingly, the exemplary embodiments described herein should be considered in a descriptive sense only and not for purposes of limitation. The scope of the inventive concept is defined not by the detailed description of the exemplary embodiments but by the appended claims, and all differences within the scope of the appended claims and their equivalents will be construed as being included in the inventive concept .
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR20140062625 | 2014-05-23 | ||
| KR10-2014-0062625 | 2014-05-23 | ||
| US14/556,616 | 2014-12-01 | ||
| US14/556,616US20150341399A1 (en) | 2014-05-23 | 2014-12-01 | Server and method of providing collaboration services and user terminal for receiving collaboration services |
| KR1020150018870AKR102319417B1 (en) | 2014-05-23 | 2015-02-06 | Server and method for providing collaboration services and user terminal for receiving collaboration services |
| KR10-2015-0018870 | 2015-02-06 | ||
| US14/705,147US10277643B2 (en) | 2014-05-23 | 2015-05-06 | Server and method of providing collaboration services and user terminal for receiving collaboration services |
| US14/705,147 | 2015-05-06 |
| Publication Number | Publication Date |
|---|---|
| CN105100679Atrue CN105100679A (en) | 2015-11-25 |
| CN105100679B CN105100679B (en) | 2020-10-20 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510270712.XAExpired - Fee RelatedCN105100679B (en) | 2014-05-23 | 2015-05-25 | Server and method for providing collaboration service and user terminal for receiving collaboration service |
| Country | Link |
|---|---|
| CN (1) | CN105100679B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107479811A (en)* | 2016-06-08 | 2017-12-15 | 南京跃豚智能科技有限公司 | The method and mobile terminal with managing meeting, recording meeting are established in ession for telecommunication |
| CN108377258A (en)* | 2018-01-16 | 2018-08-07 | 广州市信富信息科技有限公司 | A kind of long-range multiterminal collaboration method and system based on Cloud Server |
| CN109151372A (en)* | 2018-10-23 | 2019-01-04 | 国家电网公司 | A kind of video conferencing system based on Internet of Things |
| CN110413966A (en)* | 2018-04-27 | 2019-11-05 | 富士施乐株式会社 | Document management apparatus and non-transitory computer-readable medium |
| CN110446001A (en)* | 2019-07-12 | 2019-11-12 | 视联动力信息技术股份有限公司 | Video conference processing method, device, electronic equipment and medium based on view networking |
| CN110677614A (en)* | 2019-10-15 | 2020-01-10 | 广州国音智能科技有限公司 | Information processing method, device and computer readable storage medium |
| CN111142995A (en)* | 2019-12-13 | 2020-05-12 | 西安万像电子科技有限公司 | Data processing method, system and device |
| CN111818294A (en)* | 2020-08-03 | 2020-10-23 | 上海依图信息技术有限公司 | Method, medium and electronic device for multi-person conference real-time display combined with audio and video |
| CN111885345A (en)* | 2020-08-14 | 2020-11-03 | 广州视睿电子科技有限公司 | Teleconference implementation method, teleconference implementation device, terminal device and storage medium |
| CN111953852A (en)* | 2020-07-30 | 2020-11-17 | 北京声智科技有限公司 | Call record generation method, device, terminal and storage medium |
| CN113836871A (en)* | 2021-08-20 | 2021-12-24 | 北京仿真中心 | Collaborative discussion and collaborative editing integration method |
| CN114339123A (en)* | 2021-12-24 | 2022-04-12 | 北京达佳互联信息技术有限公司 | Video conference interaction method and related equipment |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020002562A1 (en)* | 1995-11-03 | 2002-01-03 | Thomas P. Moran | Computer controlled display system using a graphical replay device to control playback of temporal data representing collaborative activities |
| US20030099459A1 (en)* | 2000-11-10 | 2003-05-29 | Noboru Yanagita | Program additional data creating device, video program editing device, and video program data creating device |
| US20040107270A1 (en)* | 2002-10-30 | 2004-06-03 | Jamie Stephens | Method and system for collaboration recording |
| CN1659655A (en)* | 2002-04-16 | 2005-08-24 | 三星电子株式会社 | Information storage medium for recording interactive content version information and method for recording and reproducing the same |
| US20060026502A1 (en)* | 2004-07-28 | 2006-02-02 | Koushik Dutta | Document collaboration system |
| CN101330388A (en)* | 2007-06-20 | 2008-12-24 | 中国科学院自动化研究所 | Collaborative editing method based on integrated seminar hall |
| US20110055702A1 (en)* | 2006-05-01 | 2011-03-03 | Gabriel Jakobson | Document revisions in a collaborative computing environment |
| US20110125784A1 (en)* | 2009-11-25 | 2011-05-26 | Altus Learning Systems, Inc. | Playback of synchronized media archives augmented with user notes |
| US20110209052A1 (en)* | 2007-06-29 | 2011-08-25 | Microsoft Corporation | Integrated collaborative user interface for a document editor program |
| US20120317296A1 (en)* | 2011-06-07 | 2012-12-13 | International Business Machines Corporation | Associating communications in collaboration sessions |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020002562A1 (en)* | 1995-11-03 | 2002-01-03 | Thomas P. Moran | Computer controlled display system using a graphical replay device to control playback of temporal data representing collaborative activities |
| US20030099459A1 (en)* | 2000-11-10 | 2003-05-29 | Noboru Yanagita | Program additional data creating device, video program editing device, and video program data creating device |
| CN1659655A (en)* | 2002-04-16 | 2005-08-24 | 三星电子株式会社 | Information storage medium for recording interactive content version information and method for recording and reproducing the same |
| US20040107270A1 (en)* | 2002-10-30 | 2004-06-03 | Jamie Stephens | Method and system for collaboration recording |
| US20060026502A1 (en)* | 2004-07-28 | 2006-02-02 | Koushik Dutta | Document collaboration system |
| US20110055702A1 (en)* | 2006-05-01 | 2011-03-03 | Gabriel Jakobson | Document revisions in a collaborative computing environment |
| CN101330388A (en)* | 2007-06-20 | 2008-12-24 | 中国科学院自动化研究所 | Collaborative editing method based on integrated seminar hall |
| US20110209052A1 (en)* | 2007-06-29 | 2011-08-25 | Microsoft Corporation | Integrated collaborative user interface for a document editor program |
| US20110125784A1 (en)* | 2009-11-25 | 2011-05-26 | Altus Learning Systems, Inc. | Playback of synchronized media archives augmented with user notes |
| US20120317296A1 (en)* | 2011-06-07 | 2012-12-13 | International Business Machines Corporation | Associating communications in collaboration sessions |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107479811A (en)* | 2016-06-08 | 2017-12-15 | 南京跃豚智能科技有限公司 | The method and mobile terminal with managing meeting, recording meeting are established in ession for telecommunication |
| CN108377258A (en)* | 2018-01-16 | 2018-08-07 | 广州市信富信息科技有限公司 | A kind of long-range multiterminal collaboration method and system based on Cloud Server |
| CN110413966A (en)* | 2018-04-27 | 2019-11-05 | 富士施乐株式会社 | Document management apparatus and non-transitory computer-readable medium |
| CN109151372A (en)* | 2018-10-23 | 2019-01-04 | 国家电网公司 | A kind of video conferencing system based on Internet of Things |
| CN110446001A (en)* | 2019-07-12 | 2019-11-12 | 视联动力信息技术股份有限公司 | Video conference processing method, device, electronic equipment and medium based on view networking |
| CN110677614A (en)* | 2019-10-15 | 2020-01-10 | 广州国音智能科技有限公司 | Information processing method, device and computer readable storage medium |
| CN111142995A (en)* | 2019-12-13 | 2020-05-12 | 西安万像电子科技有限公司 | Data processing method, system and device |
| CN111953852A (en)* | 2020-07-30 | 2020-11-17 | 北京声智科技有限公司 | Call record generation method, device, terminal and storage medium |
| CN111818294A (en)* | 2020-08-03 | 2020-10-23 | 上海依图信息技术有限公司 | Method, medium and electronic device for multi-person conference real-time display combined with audio and video |
| CN111885345A (en)* | 2020-08-14 | 2020-11-03 | 广州视睿电子科技有限公司 | Teleconference implementation method, teleconference implementation device, terminal device and storage medium |
| CN113836871A (en)* | 2021-08-20 | 2021-12-24 | 北京仿真中心 | Collaborative discussion and collaborative editing integration method |
| CN114339123A (en)* | 2021-12-24 | 2022-04-12 | 北京达佳互联信息技术有限公司 | Video conference interaction method and related equipment |
| Publication number | Publication date |
|---|---|
| CN105100679B (en) | 2020-10-20 |
| Publication | Publication Date | Title |
|---|---|---|
| US10810360B2 (en) | Server and method of providing collaboration services and user terminal for receiving collaboration services | |
| TWI691849B (en) | Server and method for providing collaborative service and user terminal receiving collaborative service | |
| CN105100679B (en) | Server and method for providing collaboration service and user terminal for receiving collaboration service | |
| CN112241865B (en) | A method for collaborative document processing and related device | |
| EP4130963A1 (en) | Object dragging method and device | |
| CN110597774B (en) | File sharing method, system, device, computing equipment and terminal equipment | |
| JP6700254B2 (en) | Real-time sharing during a call | |
| US20250168212A1 (en) | Privacy Management And Adaptive Layouts Within A Communication Session | |
| US10431187B2 (en) | Terminal apparatus, screen recording method, program, and information processing system | |
| RU2700188C2 (en) | Representing computing environment on multiple devices | |
| CN104205120B (en) | electronic meeting system | |
| US20090193345A1 (en) | Collaborative interface | |
| US10798153B2 (en) | Terminal apparatus and server and method of controlling the same | |
| KR20140081220A (en) | user terminal apparatus and contol method thereof | |
| WO2022252932A1 (en) | Electronic document editing method and apparatus, and device and storage medium | |
| CN105320897A (en) | Information processing system, information processing apparatus, and information processing method | |
| JP2012194625A (en) | Document management device, document editing method and program | |
| JP2011134122A (en) | Information processing apparatus, conference system, information processing method, conference support method, and computer program | |
| JP5088153B2 (en) | CONFERENCE TASK SUPPORT METHOD, CONFERENCE TASK SUPPORT SYSTEM, USER INTERFACE DEVICE, AND PROGRAM | |
| US20250110619A1 (en) | System and graphical user interface for generating cross-platform content in a collaboration platform | |
| KR101427308B1 (en) | System for publicating online album by oneself | |
| US20230353802A1 (en) | Systems and methods for multi-party distributed active co-browsing of video-based content | |
| JP2014238667A (en) | Information terminal, information processing program, information processing system, and information processing method | |
| US20150067056A1 (en) | Information processing system, information processing apparatus, and information processing method | |
| CN116974431A (en) | Document display control method and device, electronic equipment and storage medium |
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | Granted publication date:20201020 | |
| CF01 | Termination of patent right due to non-payment of annual fee |