Summary of the invention
The object of the present invention is to provide and handheld mobile device that projecting apparatus is interactive and the method interactive with projecting apparatus, this Apparatus and method for can be on handheld mobile device the play content of displaying projector synchronously.
For addressing the above problem, the present invention provides a kind of handheld mobile device interactive with projecting apparatus, comprising:
The wireless connections module is used for setting up wireless connections with projecting apparatus;
Video input module is used to receive the vision signal of projecting apparatus and is stored into memory module;
Memory module, the vision signal that is used to store the projecting apparatus that receives;
The video decode module is used for the vision signal of memory module is decomposed into audio signal and picture signal and sends to audio processing modules and image processing module respectively;
Audio processing modules is used for audio signal is carried out audio frequency transcoding and processed compressed formation audio-frequency information;
Image processing module is used for picture signal is carried out video code conversion and processed compressed formation image information;
Playing module is used to play said audio-frequency information and shows said image information.
Further, in the said equipment, said handheld mobile device also comprises:
Operational module is used for said playing module images displayed information is carried out convergent-divergent, rotation, modification, annotations and comments operation.
Further, in the said equipment, said convergent-divergent, rotation, modification, annotations and comments operation are independent of the play content on the said projecting apparatus.
Further, in the said equipment, said handheld mobile device also comprises:
Interception module is used for said playing module images displayed information is carried out the screenshotss operation.
Further, in the said equipment, said interception module also is used for modification, markup information that said modification, mark operation form are carried out the screenshotss operation.
Further, in the said equipment, said screenshotss operation comprises that the whole playing process in the said playing module is carried out video record forms complete video and storage.
Further, in the said equipment, the operation of said screenshotss comprises sometime image information and/or modification, markup information in the playing module is stored as the picture image.
Further, in the said equipment, extract the word content in said image information and/or modification, the markup information and be stored as document through OCR technology.
Further, in the said equipment, said vision signal is handled through video code conversion before being stored into memory module.
Further, in the said equipment, adopt MPEG4, H.264 or the AVC method carry out said video code conversion and handle.
According to another side of the present invention, the method interactive with projecting apparatus is provided, comprising:
Handheld mobile device and projecting apparatus are set up wireless connections;
Receive the vision signal of projecting apparatus and be stored into memory module;
Vision signal in the memory module is decomposed into audio signal and picture signal and carries out transcoding and processed compressed formation audio-frequency information and image information respectively;
Said audio-frequency information and image information are play on said handheld mobile device.
Further, in said method, after the said step that audio-frequency information and image information are play on said handheld mobile device, also comprise:
The image information of playing on the said handheld mobile device is carried out convergent-divergent, rotation, modification, annotations and comments operation.
Further, in said method, said convergent-divergent, rotation, modification, annotations and comments operation are independent of the play content on the said projecting apparatus.
Further, in said method, also comprise after the step that audio-frequency information and image information are play on said handheld mobile device:
The image information of playing on the said handheld mobile device is carried out the screenshotss operation.
Further, in said method, the image information of on to said handheld mobile device, playing carries out also comprising after the step of screenshotss operations:
Modification, markup information that said modification, mark operation are formed carry out the screenshotss operation.
Further, in said method, extract the word content in said image information and/or modification, the markup information and be stored as document through OCR technology.
Further, in said method, said screenshotss operation comprises that the whole playing process with said handheld mobile device carries out video record formation complete video and storage.
Further, in said method, the operation of said screenshotss comprises the image information sometime in the playing process of said handheld mobile device and/or modification, markup information is stored as the picture image.
Further, in said method, extract the word content in said image information and/or modification, the markup information and be stored as document through OCR technology.
Further, in said method, said vision signal is stored up into handling through video code conversion before the memory module.
Further, in said method, adopt MPEG4, H.264 or the AVC method carry out said video code conversion and handle.
The present invention is through setting up wireless connections with handheld mobile device and projecting apparatus; And receive the vision signal of projecting apparatus and be stored into memory module; Vision signal in the memory module is decomposed into audio signal and picture signal and carries out transcoding and processed compressed formation audio-frequency information and image information respectively; Said audio-frequency information and image information are play on said handheld mobile device, realized the purpose of the play content of synchronous displaying projector on handheld mobile device.
In addition, the present invention can provide personalized lantern slide display mode for the user through the image information of playing on the said handheld mobile device is carried out convergent-divergent, rotary manipulation.
In addition; The present invention is through making amendment, annotate and comment on operation to the image information of playing on the said handheld mobile device; Realize that handheld mobile device is when showing that magic lantern is play; The user can operate on the screen of handheld mobile device through writing pen, finger touch play content is marked and delineates, and makes things convenient for user's record notes on lantern slide.
And; The present invention is through carrying out the screenshotss operation to the image information and the said modification of playing on the said handheld mobile device, modification, the markup information that marks operation formation; And support saves as video, picture and word content; Thereby realized the content of lantern slide and the content of user oneself mark are saved on the handheld mobile device with different forms at any time automatically, made things convenient for the user to consult from now on.
Embodiment
Below in conjunction with accompanying drawing and specific embodiment the present invention is proposed with interactive handheld mobile device of projecting apparatus and the method further explain interactive with projecting apparatus.According to following explanation and claims, advantage of the present invention and characteristic will be clearer.
As shown in Figure 1, one embodiment of the invention provides handheld mobile devices 1 a kind of and projecting apparatus 2 interactions, and said handheld mobile device 1 comprises:
Wireless connections module 11; Be used for setting up wireless connections with projecting apparatus, specifically, described handheld mobile device includes but not limited to equipment such as smart mobile phone, PDA, Pad; These equipment have the wireless connections module can be connected to projecting apparatus 2; Said projecting apparatus 2 also has the wireless network link block, carries out wireless connections with convenient and handheld mobile device 1, sends the wireless connections request by handheld mobile device 1 to projecting apparatus 2; After projecting apparatus 2 is received connection request, give handheld mobile device 1 by projecting apparatus 2 and connect mandate.The mode of the obtaining mandate mode of authentication that can access to your password, as need the password of handheld mobile device 1 input appointment just can obtain the authorization; Perhaps adopt the white list mode, by projecting apparatus 2 apparatus settings mandate white lists, only to the open authority that connects of the handheld mobile device in the white list.After obtaining the connection mandate, handheld mobile device 1 ability and projecting apparatus 2 are accomplished and are set up wireless connections, and the beginning transceive data.
Video input module 12 is used to receive the vision signal of projecting apparatus and is stored into memory module, specifically, can vision signal be stored in the SDRAM memory module, so that follow-up video decode is handled.
Memory module 13, the vision signal that is used to store the projecting apparatus that receives, this memory module 13 is interim spatial cache as vision signal, said memory module 13 for example is the SDRAM chip.
Video decode module 14; Be used for the vision signal of memory module 13 is decomposed into audio signal and picture signal and sends to audio processing modules 15 and image processing module 16 respectively; Specifically; Video decode module 14 can read video flowing from memory module 13, and audio signal is decomposed out give audio processing modules 15 and handle, and picture signal is decomposited transfer to image processing module 16 and handle.
Audio processing modules 15; Be used for audio signal is carried out audio frequency transcoding and processed compressed formation audio-frequency information; Specifically; Audio processing modules 15 can carry out audio frequency transcoding and processed compressed, so that audio-frequency information is play in the microphone of handheld mobile device 1 after receiving the audio signal that video decode module 14 transmits.
Image processing module 16; Be used for picture signal is carried out video code conversion and processed compressed formation image information; Specifically; Image processing module 16 can carry out video code conversion and processed compressed, so that image information shows in the display screen of handheld mobile device 1 after receiving the image information that video decode module 14 transmits.
Playing module 17; Be used to play said audio-frequency information and show said image information; Specifically; Playing module 17 control audio signals are play in the microphone of handheld mobile device 1; And the control image information shows in the display screen of handheld mobile device 1, thereby realizes that the content synchronization that handheld mobile device is play projecting apparatus 2 is shown on the handheld mobile device display screen, the lantern slide that the user can play through handheld mobile device 1 direct viewing projecting apparatus 2 in projecting apparatus 2 playing lantern slides.
Further, said handheld mobile device also comprises:
Operational module 18; The convergent-divergent, rotation, modification, the annotations and comments that are used for said playing module 17 images displayed information are carried out are operated, and said convergent-divergent, rotation, modification, annotations and comments operation are independent of the play content on the said projecting apparatus 2, specifically; When playing module 17 playing image information; The user can use gesture operation image information to be carried out operations such as convergent-divergent, rotation on the touch screen of handheld mobile device 1, and identifies operations such as these convergent-divergents, rotation by operational module 18, only acts on handheld mobile device 1 for operations such as the convergent-divergent of image and rotations; Can't feed back on the projecting apparatus 2; Also can the file of playing on the projecting apparatus 2 not exerted an influence, in addition, the user can also be through 18 pairs of use writing pens of operational module, gesture operation is made amendment to image information in touch-screen and annotate and comment on operation; And identify these by operational module 18 and revise operations such as annotations and comments; And the content of these annotations and comments and modification can't cause the file modifying that projecting apparatus 2 is play, and only is to change in the display image screen information of handheld mobile device 1, and convergent-divergent, rotary manipulation can provide personalized lantern slide display mode for the user; Revise, annotate and comment on operation and can make things convenient for user's record notes on lantern slide, and these operations can not ring the file content of playing on the projecting apparatus 2.
Further, said handheld mobile device also comprises:
Interception module 19; Be used for said playing module images displayed information is carried out the screenshotss operation; In addition; Said interception module 19 also is used for modification, markup information that said modification, mark operation form are carried out the screenshotss operation; The operation of said screenshotss comprises that the whole playing process in the said playing module 17 is carried out video record forms complete video and storage, and said screenshotss operation also comprises sometime said image information and/or modification, markup information in the playing module 17 is stored as the picture image, through the OCR technology said image information and/or modification, markup information is extracted word content and is stored as document further; And as the remarks explanation of picture image; Specifically, handheld mobile device can directly be delineated through writing pen or touch operation and carries out that label character etc. is revised, the annotations and comments operation the image information of its screen display, and by operational module 18 these modifications, annotations and comments operation is discerned; In addition, handheld mobile device 1 content that can preserve screen display at any time comprises image information and the annotations and comments that image information is done, modification information.
Specifically; Because memory module 13 can only be preserved vision signal temporarily; The user can use interception module 19 to come the video that needs long preservation, picture image and the word content of intercepting and be saved in the handheld mobile device long-term storage device; In the SD card, the user can check the content of intercepting afterwards like this, and video intercepting module 19 is supported as above the intercepting preserving type of three kinds of pictures, video, document; Thereby realized the content of lantern slide and the content of user oneself mark are saved in the purpose on the handheld mobile device at any time automatically with different forms, made things convenient for the user to consult from now on.
Further, said vision signal is stored up memory module 13 (being the SDRAM chip in the present embodiment) and is handled through video code conversion before, adopt MPEG4, H.264 or the AVC method carry out said video code conversion and handle;, specifically, vision signal is before being stored memory module 13; At first can pass through video code conversion and handle, its objective is redundant information (comprising spatial domain redundant information and time domain redundant information), the I picture data are carried out data compression in order to reduce video flowing; Make broadcast smooth more; And the storage pressure of minimizing SDRAM chip, but can bring resolution loss to a certain extent, because the view screen limited size of handheld mobile device; Therefore the loss of resolution brought of this video compression algorithm can be ignored, and video code conversion can use but be not limited to the video compression algorithm of following algorithm: MPEG4/H.264/AVC.
As shown in Figure 2, according to another side of the present invention, a kind of method interactive with projecting apparatus is provided, comprising:
Step S1, handheld mobile device and projecting apparatus are set up wireless connections;
Step S2, the vision signal that receives projecting apparatus also is stored into memory module, and said vision signal is stored up into handling through video code conversion before the memory module, and said video code conversion is handled and is adopted video compression algorithm to include but not limited to MPEG4, H.264 or AVC;
Step S3 is decomposed into the vision signal in the memory module audio signal and picture signal and carries out transcoding and processed compressed formation audio-frequency information and image information respectively;
Step S4 plays said audio-frequency information and image information on said handheld mobile device, thereby has realized the purpose of the play content of synchronous displaying projector on handheld mobile device.
Further, also comprise afterwards in the said step (step S4 in like Fig. 2) that audio-frequency information and image information are play on said handheld mobile device:
Step S51; The convergent-divergent that identification is carried out the image information of playing on the said handheld mobile device, rotation, modification, annotations and comments operation; Said convergent-divergent, rotation, modification, annotations and comments operation are independent of the play content on the said projecting apparatus, and wherein, convergent-divergent, rotary manipulation can provide personalized lantern slide display mode for the user; Revise, annotate and comment on operation and can make things convenient for user's record notes on lantern slide, and these operations can not ring the file content of playing on the projecting apparatus.
Further, also comprise afterwards in the said step (like Fig. 2 step S4) that audio-frequency information and image information are play on said handheld mobile device:
Step S52 carries out the screenshotss operation to the image information of playing on the said handheld mobile device.
Further, the image information of on to said handheld mobile device, playing carries out also comprising after the step of screenshotss operations (step S52):
Step S53, modification, the markup information that the above is revised to said handheld mobile device, the mark operation forms carries out the screenshotss operation, through the OCR technology said image information and/or modification, markup information extracted word content and is stored as document.
Further, said screenshotss operation comprises that the whole playing process with handheld mobile device carries out video record formation complete video and storage; The operation of said screenshotss also comprises the said image information sometime in the playing process of handheld mobile device and/or modification, markup information is stored as the picture image; Through the OCR technology said image information and/or modification, markup information are extracted word content and be stored as document; Thereby realized the content of lantern slide and the content of user oneself mark are saved on the handheld mobile device with different forms at any time automatically, made things convenient for the user to consult from now on.
The present invention is through setting up wireless connections with handheld mobile device and projecting apparatus; And receive the vision signal of projecting apparatus and be stored into memory module; Vision signal in the memory module is decomposed into audio signal and picture signal and carries out transcoding and processed compressed formation audio-frequency information and image information respectively; Said audio-frequency information and image information are play on said handheld mobile device, realized the purpose of the play content of synchronous displaying projector on handheld mobile device.
In addition, the present invention can provide personalized lantern slide display mode for the user through the image information of playing on the said handheld mobile device is carried out convergent-divergent, rotary manipulation.
In addition; The present invention is through making amendment, annotate and comment on operation to the image information of playing on the said handheld mobile device; Realize that handheld mobile device is when showing that magic lantern is play; The user can operate on the screen of handheld mobile device through writing pen, finger touch play content is marked and delineates, and makes things convenient for user's record notes on lantern slide.
And; The present invention is through carrying out the screenshotss operation to the image information and the said modification of playing on the said handheld mobile device, modification, the markup information that marks operation formation; And support saves as video, picture and word content; Thereby realized the content of lantern slide and the content of user oneself mark are saved on the handheld mobile device with different forms at any time automatically, made things convenient for the user to consult from now on.Each embodiment adopts the mode of going forward one by one to describe in this specification, and what each embodiment stressed all is and the difference of other embodiment that identical similar part is mutually referring to getting final product between each embodiment.For the embodiment disclosed method, because corresponding with the disclosed system of embodiment, so description is fairly simple, relevant part is partly explained referring to method and is got final product.
The professional can also further recognize; The unit and the algorithm steps of each example of describing in conjunction with embodiment disclosed herein; Can realize with electronic hardware, computer software or the combination of the two; For the interchangeability of hardware and software clearly is described, the composition and the step of each example described prevailingly according to function in above-mentioned explanation.These functions still are that software mode is carried out with hardware actually, depend on the application-specific and the design constraint of technical scheme.The professional and technical personnel can use distinct methods to realize described function to each certain applications, but this realization should not thought and exceeds scope of the present invention.
Obviously, those skilled in the art can carry out various changes and modification to invention and not break away from the spirit and scope of the present invention.Like this, if of the present invention these revise and modification belongs within the scope of claim of the present invention and equivalent technologies thereof, then the present invention also is intended to comprise these change and modification.