US20110296322A1 - Markup Based Extensibility for User Interfaces - Google Patents

Abstract

Methods, systems, and computer products are provided for exposing the programming of an application user interface to allow modification of the associated user interface to include adding, removing, disabling, enabling and repurposing new or existing user interface components.

Description

• This application is a continuation of prior U.S. application Ser. No. 11/217,071, filed Aug. 30, 2005, the entire contents of which is incorporated herein by reference.
BACKGROUND
• With the advent of the computer age, computer and software users have grown accustomed to user-friendly software applications that help them write, calculate, organize, prepare presentations, send and receive electronic mail, make music, and the like. For example, modern electronic word processing applications allow users to prepare a variety of useful documents. Modern spreadsheet applications allow users to enter, manipulate, and organize data. Modern electronic slide presentation applications allow users to create a variety of slide presentations containing text, pictures, data or other useful objects. Modern database applications allow users to store, organize and exchange large amounts of data.
• Most software applications provide one or more graphical user interfaces through which a user enters and edits data and from which the user accesses and utilizes various functionalities of the associated software application. A typical user interface includes a work area in which data may be entered, edited, and reviewed. Additionally, user interfaces typically include one or more buttons and/or controls operative for selecting the functionalities provided by the associated software application. For example, buttons or controls may be provided for printing or saving a document, buttons or controls may be provided for applying formatting properties to aspects of a document, and the like.
• Often, a third party software developer creates a software add-in that may be added to an existing application for providing functionality not available from the existing application. For example, an add-in software application may provide a feature to a word processing application for adding specialized footnotes or endnotes to a document. Typically, in addition to providing additional functionality, the add-in application provides one or more new user interface components to the existing application user interfaces, such as a new toolbar, button(s), or other control(s), for accessing the additional functionality.
• According to one prior method, third party developers are given access to an object model associated with an application's existing user interfaces for allowing customization of the existing user interfaces according to the needs of third party add-in software. Unfortunately, such prior methods have shortcomings because the object models for given user interfaces are not typically designed around common uses across a variety of different applications, for example, word processing applications, spreadsheet applications, slide presentation applications, and the like, and often such applications exhibit different and perhaps undesirable behaviors in association with custom user interface components.
• It is with respect to these and other considerations that the present invention has been made.
SUMMARY
• This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended as an aid in determining the scope of the claimed subject matter.
• Embodiments of the present invention solve the above and other problems by providing methods, systems and computer products for exposing a software application user interface programming to third party application add-in developers to allow modification of existing application user interfaces to include new or modified user interface components associated with add-in applications. According to aspects of the invention, an Extensible Markup Language (XML) schema that governs XML programming that may be used to modify a given user interface is exposed to third party developers to allow them to specify changes to the user interface programming according the associated XML schema. For example, if a third party developer desires to add a new button or control to an existing user interface that would be linked to a functionality of an add-in application, the third party developer can modify the existing programming of the user interface according to the grammatical and syntax rules dictated by the associated XML schema. According to an aspect of the invention, XML or other suitable representations of user interface modifications do not necessarily follow the same programming language as the original user interface. Moreover, the original built-in user interface programming may be very complex, and the XML schema exposed according to the present invention may be only a subset of the overall programming for the original user interface. When the modified programming is executed by the host software application, the user interface is rendered with the changes made by the third party developer. For example, if the programming of the user interface is modified to add a new button, then the new button will be rendered in the user interface in response to the modification to the programming for the user interface so long as the modification is done according to the associated XML schema.
• According to aspects of the invention, new user interface components may be added to existing user interfaces and may be linked to associated add-in functionality. The sizes of new user interface components may be automatically scaled to fit available display space as a window in which the user interface is displayed is reduced or enlarged. In addition, according to aspects of the invention, end users of a modified user interface may remove added user interface components if desired. If a particular software add-in is un-installed, the added or modified user interface components associated with the un-installed add-in are not shown in the subsequently rendered user interface.
• According to other aspects of the invention, existing user interface components such as buttons or controls may be disabled or may be removed altogether by third parties. In addition, existing user interface components may be repurposed so that the repurposed components exhibit different behaviors when selected.
• According to other aspects of the invention, by accessing the schema exposed for modifying an existing user interface, third party contextual user interfaces and contextual user interface buttons or controls may be added to existing user interfaces that are exposed in the existing user interfaces when a document object associated with the added contextual user interface is selected. In addition, controls, which when selected cause the application of one or more add-in functionalities to a selected object, may be added to a gallery or collection of controls that are deployed in the existing user interface for applying one or more functionalities of the application to a selected object.
• According to other aspects of the invention, the XML schema may be utilized to build start-from-scratch user interfaces that are customized according to the needs of a third party add-in to the associated software application. When such a start-from-scratch user interface solution is rendered, the resulting user interface may bear little resemblance to the application user interface normally exposed to users for the associated software application. That is, when the associated document is launched, a customized user interface for providing the user functionality to the launched document is rendered according to the customized user interface provided for the document.
• These and other features and advantages, which characterize the present invention, will be apparent from a reading of the following detailed description and a review of the associated drawings. It is to be understood that both the foregoing general description and the following detailed description are explanatory only and are not restrictive of the invention as claimed.
BRIEF DESCRIPTION OF THE DRAWINGS
• FIG. 1 illustrates an exemplary computing operating environment for embodiments of the present invention.
• FIG. 2 is a computer screen display showing an example user interface that may be modified according to embodiments of the present invention.
• FIG. 3 is a simplified block diagram showing a relationship between an example user interface and an XML representation of the example user interface that may be amended for modifying the example user interface according to embodiments of the present invention.
• FIG. 4 is a computer screen display showing an example contextual user interface that may be modified according to embodiments of the present invention.
• FIG. 5 is a computer screen display showing an example gallery of selectable controls user interface that may be modified according to embodiments of the present invention.
DETAILED DESCRIPTION
• As briefly described above, embodiments of the present invention are directed to methods, systems, and computer products for exposing the programming of an application user interface to allow modification of an associated user interface to include adding, removing, disabling, enabling and repurposing new or existing user interface components. In the following detailed description, references are made to the accompanying drawings that form a part hereof, and in which are shown by way of illustrations specific embodiments or examples. These embodiments may be combined, other embodiments may be utilized, and structural changes may be made without departing from the spirit or scope of the present invention. The following detailed description is therefore not to be taken in a limiting sense, and the scope of the present invention is defined by the appended claims and their equivalents.
• Referring now to the drawings, in which like numerals refer to like elements through the several figures, aspects of the present invention and an exemplary computing operating environment will be described.FIG. 1 and the following discussion are intended to provide a brief, general description of a suitable computing environment in which the invention may be implemented. While the invention will be described in the general context of program modules that execute in conjunction with an application program that runs on an operating system on a personal computer, those skilled in the art will recognize that the invention may also be implemented in combination with other program modules.
• Generally, program modules include routines, programs, components, data structures, and other types of structures that perform particular tasks or implement particular abstract data types. Moreover, those skilled in the art will appreciate that the invention may be practiced with other computer system configurations, including hand-held devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, minicomputers, mainframe computers, and the like. The invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.
• Embodiments of the invention may be implemented as a computer process (method), a computing system, or as an article of manufacture, such as a computer program product or computer readable media. The computer program product may be a computer storage media readable by a computer system and encoding a computer program of instructions for executing a computer process. The computer program product may also be a propagated signal on a carrier readable by a computing system and encoding a computer program of instructions for executing a computer process.
• With reference toFIG. 1, one exemplary system for implementing the invention includes a computing device, such ascomputing device100. In a basic configuration, thecomputing device100 typically includes at least oneprocessing unit102 andsystem memory104. Depending on the exact configuration and type of computing device, thesystem memory104 may be volatile (such as RAM), non-volatile (such as ROM, flash memory, etc.) or some combination of the two.System memory104 typically includes anoperating system105 suitable for controlling the operation of a networked personal computer, such as the WINDOWS® operating systems from MICROSOFT CORPORATION of Redmond, Wash. Thesystem memory104 may also include one ormore software applications106,120 and may includeprogram data107. This basic configuration is illustrated inFIG. 1 by those components within dashedline108.
• According to embodiments of the invention, theapplication106 may comprise many types of programs, such as an electronic mail program, a calendaring program, an Internet browsing program, and the like. An example of such programs is OUTLOOK® manufactured by MICROSOFT CORPORATION. Theapplication106 may also comprise a multiple-functionality software application for providing many other types of functionalities. Such a multiple-functionality application may include a number of program modules, such as a word processing program, a spreadsheet program, a slide presentation program, a database program, and the like. An example of such a multiple-functionality application is OFFICE™ manufactured by MICROSOFT CORPORATION. The add-insoftware application120 may comprise any software application that may be added to theapplications106 for enhancing or providing additional functionality to theapplications106 as described herein. In addition, an add-in software application, as described herein, may include document-based software solutions, for example, a spreadsheet document that includes attached toolbars, or a word processing document that contains a macro or other code that adds a toolbar with buttons or controls.
• Thecomputing device100 may have additional features or functionality. For example, thecomputing device100 may also include additional data storage devices (removable and/or non-removable) such as, for example, magnetic disks, optical disks, or tape. Such additional storage is illustrated inFIG. 1 by removable storage109 and non-removable storage110. Computer storage media may include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules, or other data.System memory104, removable storage109 and non-removable storage110 are all examples of computer storage media. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by computingdevice100. Any such computer storage media may be part ofdevice100.Computing device100 may also have input device(s)112 such as keyboard, mouse, pen, voice input device, touch input device, etc. Output device(s)114 such as a display, speakers, printer, etc. may also be included. These devices are well known in the art and need not be discussed at length here.
• Thecomputing device100 may also containcommunication connections116 that allow the device to communicate withother computing devices118, such as over a network in a distributed computing environment, for example, an intranet or the Internet.Communication connection116 is one example of communication media. Communication media may typically be embodied by computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. The term computer readable media as used herein includes both storage media and communication media.
• FIG. 2 is an illustration of a computer screen display showing an example user interface that may be modified according embodiments of the present invention. As should be understood by those skilled in the art, the example user interface illustrated inFIG. 2 is for purposes of example and illustration only. That is, embodiments of the present invention may be utilized for a vast array of different user interfaces having different user interface components and different user interface layouts. Thus, the description of the present invention in terms of the example user interface illustrated inFIG. 2 should not be taken as restrictive or limiting in any way of the claimed invention.
• The user interface illustrated inFIG. 2 includes a ribbon-shaped user interface for displaying selectable controls associated with task-based functionality available under a given software application, such as thesoftware application106 illustrated inFIG. 1. Afirst section210 of theuser interface200 includes generic selectable controls for functionality not associated with a particular task, such as word processing versus spreadsheet data analysis. For example, thesection210 includes selectable controls for general file commands such as “file open,” “file save” and “print.” According to one embodiment of the present invention, the selectable controls included in thefirst section210 are controls that may be utilized by a variety of software applications, for example, a word processing application, spreadsheet application, slide presentation application, and the like. That is, the selectable controls included in thefirst section210 may be controls that are generally found and used across a number of different software applications.
• Adjacent to thefirst section210 of theuser interface200 is a task-based tab section. The tab section includes selectable tabs associated with task-based functionality provided by a given software application. For purposes of example, the task-based tabs illustrated inFIG. 2 are associated with tasks that may be performed using a word processing application. For example, a “Writing”tab215 is associated with functionality that may be utilized for performing writing tasks. An “Insert”tab220 is associated with functionality associated with performing insert operations or tasks. A “Page Layout”tab230 is associated with functionality provided by the associated application for performing or editing page layout attributes of a given document.
• As should be appreciated, many other task-based tabs or selectable controls may be added to the tab section of the user interface for calling functionality associated with other tasks. For example, task tabs may be added for text effects, document styles, review and comment, and the like. And, as described above, theuser interface200 may be utilized for a variety of different software applications. For example, if theuser interface200 is utilized for a slide presentation application, tabs contained in the tab section may include such tabs as “Create Slides,” “Insert,” “Format,” “Drawing Effects,” and the like associated with a variety of tasks that may be performed by a slide presentation application. Similarly, tabs that may be utilized in the tab section of theuser interface200 for a spreadsheet application140 may include such tabs as “Data” or “Data Entry,” “Lists,” “Pivot Tables,” “Analysis,” “Formulas,” “Pages and Printing,” and the like associated with tasks that may be performed using a spreadsheet application.
• Immediately beneath thegeneric controls section210 and the task-based tab section is a selectable functionality control section for displaying selectable functionality controls associated with a selectedtab215,220,230 from the task-based tab section. According to embodiments of the present invention, when a particular tab, such as the “Writing”tab215 is selected, selectable functionality available from the associated software application for performing the selected task, for example, a writing task, is displayed in logical groupings. For example, referring toFIG. 2, a firstlogical grouping240 is displayed under a heading “Clipboard.” According to embodiments of the present invention, theclipboard section240 includes selectable functionality controls logically grouped together and associated with clipboard actions underneath the general task of writing.
• Selectable controls presented in the “Formatting”section250 may include such selectable controls as text justification, text type, font size, line spacing, boldface, italics, underline, etc. Accordingly, functionalities associated with formatting operations are logically grouped together underneath the overall task of “Writing.” A thirdlogical grouping260 is presented under the heading “Writing Tools.” Thewriting tools section260 includes such writing tools as find/replace, autocorrect, etc. According to embodiments of the present invention, upon selection of a different task-based tab from the tab section, a different set of selectable functionality controls in different logical groupings is presented in theuser interface200 associated with the selected task-based tab. For example, if the “Insert”task tab220 is selected, the selectable functionality controls presented in theuser interface200 are changed from those illustrated inFIG. 2 to include selectable functionality controls associated with the insert task.
• As described herein, often third party application or solution developers provide software applications or modules that may be added to an existing application for adding functionality to the existing application. For example, a software developer may produce a software application or module that may be added to a word processing application for adding additional formatting properties or other functionalities that are not available in the host application (e.g., word processing application, spreadsheet application, slide presentation application, etc.), or the third party add-in application or module may modify or enhance functionalities already provided by the host application. As described herein, embodiments of the present invention provide access to the programming associated with one or more user interfaces of a host application to allow a third party application developer to modify the user interfaces of the host application to provide for user interface components that are applicable to added or modified functionality provided by a given add-in application or module.
• As will be appreciated, embodiments of the present invention are not limited to use in association with add-in applications. For example, a third party developer may utilize aspects of the invention to modify components of an application user interface without regard to added functionality. For example, a third party may desire to change the behavior of a user interface component apart from any added functionality as described herein.
• FIG. 3 is a simplified block diagram showing a relationship between an example user interface and an XML representation of the example user interface that may be amended for modifying the example user interface according to embodiments of the present invention. Referring toFIG. 3, auser interface305 of ahost application106, for example, a word processing application, spreadsheet application, slide presentation application, and the like, is illustrated having aFile command button310, aTab1 button315, and aTab2 button320. As described above with reference toFIG. 2, theexample user interface305, illustrated inFIG. 3, is for purposes of example only and is not limiting of the vast number of buttons, controls, or other selectable functionalities that may be provided in a given user interface according to embodiments of the present invention. Theexample user interface305 includes a first logical grouping of buttons or controls325 and a second logical grouping of buttons or controls330. According theexample user interface305, theTab2 button320 has been selected for providing the first and second logical groupings of buttons or controls325,330.
• According to embodiments of the present invention, theuser interface305 is programmed and structured according to a markup language such as the Extensible Markup Language (XML). As should be understood, other languages suitable for programming and structuring auser interface305 as described herein may be utilized. As shown inFIG. 3, anXML file340 is illustrated for providing the XML programming and structure for theexample user interface305. For example, a <UI> root tag is provided having three children tags <FILE>, <TAB1> and <TAB2>. The <TAB2> tag includes two children tags including the <LG1> tag (first logical grouping of buttons or controls) and the <LG2> tag (second logical grouping of buttons or controls). As should be understood,XML file340 is not intended to illustrate a well-formed XML file, but is provided for purposes of illustration only.
• An XML schema document or file (not shown) is provided by the developers of the host application that provides the XML grammatical and syntax rules applicable to XML used for programming and structuring theuser interface305, for example, for adding, removing or otherwise modifying new or existing tags to theXML file340. For example, the XML schema may dictate the types and names of XML tags that may be added to theXML file340. For example, the XML schema associated with theuser interface305 may require that each tab tag must include at least one logical grouping child tag. For another example, the XML schema associated with theuser interface305 may dictate that certain XML in theXML file340 may not be altered, for example, logical grouping tags under a given tab tag of theoriginal user interface305 may not be altered by a third party.
• For another example, the XML schema may dictate certain formatting properties that may or may not be applied to theuser interface305 via changes to theXML file340. The entireXML schema file340 and the entire associated XML schema file may be exposed to third party developers. Alternatively, only a subset of the XML file340 associated with the hostapplication user interface305 and only a subset of the associated XML schema file may be exposed to third party developers for allowing them to make a limited number and limited types of changes to the hostapplication user interface305.
• TheXML file340 for the hostapplication user interface305 and the associated XML schema file are exposed to athird party350 for allowing thethird party350 to make changes to theXML file340 according to the grammatical and syntax rules provided by the associated XML schema file for modifying theuser interface305, as described herein. For example, thethird party350 may provide a software application add-in that provides an additional functionality not presently available in the host application. For example, the third party may desire to add a third tab button to theuser interface305 which when selected provides an additional logical grouping of buttons or controls underneath the added third tab button for providing buttons and/or controls for selecting functionality provided by the third party application add-in. For example, a third party application add-in may add a functionality for providing specialized endnotes or footnotes to a word processing application. In order to expose the functionality provided by the add-in to users, the third party developer may need to provide an additional tab in theuser interface305, for example, a “footnotes/endnotes” tab. In addition to adding the “footnotes/endnotes” tab, the third party developer may wish to add an additional logical grouping of buttons or controls that are displayed in theuser interface305 upon selection of the “footnotes/endnotes” tab which will provide buttons and/or controls for selecting various aspects of the added footnotes and endnotes functionality. As should be appreciated, existing buttons or controls may similarly be removed from theuser interface305 by modifying the associatedXML file340.
• According to one embodiment, the markup exposed to the third party developer via theXML file340 is of an incremental nature so that the third party developer is provided limited ability to modify the hostapplication user interface305. Thus, according to one embodiment, the third party developer does not receive anXML file340 allowing them to insert their own user interface components at any location. Instead, according to this embodiment, theXML file340 and the associated schema exposed to the third party developer allow the third party developer to specify a desired location for a new user interface component, for example, insert new component after existing component ABC, and the host application then integrates the amended XML file with the overall XML file representing the hostapplication user interface305 for rendering the amendeduser interface307.
• According to one embodiment, the amendedXML file355 provided by each third party developer is identified by a unique XML namespace to prevent one third party application add-in from modifying user interface components supplied by or modified by another third party add-in. Alternatively, the third-party add infile355 may be identified by other means, for example, by a globally unique identifier (GUID) or by a local filename identification.
• Once theXML representation340 of the hostapplication user interface305 is accessed by thethird party350, thethird party350 may amend the XML applied to theuser interface305 in accordance with the associated XML schema file for adding the desired buttons or controls to theuser interface305. The resulting amendedXML file355 illustrates changes made to theXML file355 for theuser interface305. For example, referring to the amendedXML file355, thethird party developer350 has added a <TAB3>tag360 and an <LG4> tab (fourth logical grouping of buttons and/or controls)365. TheXML file355 illustrates the incremental nature of the modifications that may be made to the existing user interface according to embodiments of the present invention. That is, because the example modifications are directed to the addition of a new user interface tab (TAB3) and associated logical grouping of buttons or controls (LG4), theXML file355 need only make the incremental change of adding the new tab and logical grouping to the existing user interface as opposed to making global changes to the exposed XML for theuser interface305.
• Once the desired changes made to theXML file340 are applied to thehost user interface305, an amendeduser interface307 may be rendered, as illustrated inFIG. 3. Referring to the amendeduser interface307, the addedthird tab370 and the added fourth logical grouping of buttons and/or controls375 are shown. Once the added tabs and logical grouping of buttons or controls are linked to the associated functionality of the third party application add-in, selection of those added tabs, buttons or controls causes execution of the associated added functionality. Thus, by gaining access to the exposed XML file and associated XML schema for the host application user interface, the third party application developer is able to modify the hostapplication user interface305 for providing required buttons and/or controls for selecting functionality of the associated add-in application.
• The following is an excerpt of an example XML file that has been modified by or supplied by a third party developer for adding a “Data Analysis” button or control to the end of a tools menu where the “Data Analysis” button is to be inserted after a logical grouping of buttons or controls labeled as “Data Tools.” As illustrated in the example XML, such XML syntax as <insertAfter> is dictated by the associated XML schema file for allowing the third party application developer to insert a button referred to as “Data Analysis” after a logical grouping of buttons or controls referred to as “GroupingDataTools.” As should be understood by those skilled in the art, the example XML that follows is for purposes of illustration only and is not limiting of the claimed invention.

• <tab id=”msoTcidDataTab”>
  <chunk id=”atpk:MyChunk” insertAfter=”GroupingDataTools”>
  <bigButton label=”Data Analysis”
  onAction=”atpk:dosomething” image=”someImage”>
  </chunk>
  </tab>

• Changes to theXML file340 may be made by third party developers according to different methods. According to one embodiment, theXML file340 and the associated schema may be accessed by a third party application developer at the application level. For example, a button or control may be provided in theuser interface305 for allowing the third party application developer to access theXML file340 and the associated schema utilized for programming and structuring the user interface. As should be understood, theXML file340 and the associated schema file may be provided through other means such as through a developer tool or developer application that may be utilized by the third party application developer for preparing modifications to theXML file340 in accordance with the associated XML schema file for applying to the host application when the third party application add-in is loaded onto the host application.
• According to another embodiment, theuser interface305 associated with a given host application may be customized on a document level. That is, a document-baseduser interface305 may contain customizations made to the user interface particular to a given document. For example, a user may create a customized document, for example, a sales template document for use by hundreds or thousands of sales representatives of a large company. Because the document will be used by so many people, it may be desirable to a third party application developer to customize a user interface provided by the host application, for example, a spreadsheet application, so that customized buttons or controls are rendered in the user interface when the particular document is launched.
• A file format for such a document-based solution may be utilized in which various functionalities and properties associated with the document exist as related components hosted in a container file. For example, the container file may contain one component representative of user entered data, another component representative of document structure, for example, template structure, another component representative of formatting properties applied to the document, another component representative of document-based user interfaces customized for the document, and so on. A third party application developer may enter such a document container and access the XML representation file and associated XML schema applicable to the user interface component of the document. Once the developer has accessed the XML file and the associated XML schema for theuser interface305, the developer may customize the user interface by modifying the XML in accordance with the associated XML schema, as described above.
• According to another embodiment, the modifiedXML file355 and the associated XML schema file may be attached as a resource to a component object model (COM) add-in supplied by the third party application developer for providing functionality of the add-in application. When the COM add-in is applied to the host application, for example, a word processing application, the modifiedXML file355 is consumed by the host application for rendering the resulting modifieduser interface307.
• Referring back toFIG. 3, as described above, third party software application add-ins may be utilized for adding new user interface components to the existing user interface of a host application, for example, a word processing application, a spreadsheet application, a slide presentation application and the like. According to one embodiment of the present invention, a start-from-scratch mode is provided where theXML file340 exposed to the third party application developer removes all but essential user interface components from the associated host application user interface. The associated XML schema then provides the third party application developer the ability to add back original user interface components, for example, thefirst tab315, thesecond tab320, and the logical grouping controls325 and330. In addition, the third party application developer may then add new user interface components according to the associated schema file.
• According to this embodiment, a shortcut is provided for allowing the removal of all but essential user interface components from the host application user interface and for allowing the add-in developer to have a great deal of control over the customization of the user interface because the add-in developer is able to start with virtually a blank slate user interface from which to build the customized user interface. According to one embodiment, this shortcut is an XML attribute, which when set to “true,” causes a removal of most or all original user interface components.
• Some areas of a given hostapplication user interface305 and some components of the user interface may be restricted from access by add-in developers. That is, some areas of the host application user interface and some components may be specified such that third party add-in developers may not remove or otherwise modify those areas or components. For example, referring to the hostapplication user interface305 inFIG. 3, it may be desired that thefile button310 for providing certain functionalities across a variety of applications, for example, a word processing application, a spreadsheet application, a slide presentation application, and the like, should not be altered, removed or repurposed in any manner by a third party add-in developer. Thus, thefile button310 may be restricted from access by third party add-in developers. Likewise, once user interface components are added to a given user interface, those components may be designated as restricted to prevent additional third party add-in applications from making changes to those user interface components provided by a previous add-in.
• According to one embodiment of the present invention, if a third party add-in application is un-installed from the host application, the customized XML file applied to the host application user interface for adding or otherwise modifying user interface components in association with the un-installed add-in application is parsed and changes to the host application user interface in association with the add-in application are disabled so that changes to the host application user interface are not rendered in the user interface when the associated add-in application is un-installed Likewise, upon closing a document-based solution that modified the original graphical user interface, the graphical user interface is rendered such that changes to the graphical user interface associated with the modification to the XML representation are not rendered in the graphical user interface
• By accessing theXML file340 representing the hostapplication user interface305, existing user interface components may be repurposed so that repurposed components subsequently exhibit different behaviors. For example, an existing user interface component may be enabled, disabled, or may be specified for being associated with a different application action. For example, a third party application developer may desire that a given button, for example, a “print” button in a host application user interface may only be utilized for printing a document according to a prescribed print setting associated with the third party application add-in. For another example, a given function button or control may be disabled from use where the function conflicts with the operation of a function added to the host application by an add-in application.
• FIG. 4 is a computer screen display showing an example contextual user interface that may be modified according to embodiments of the present invention. As should be understood by those skilled in the art, the contextual user interface illustrated inFIG. 4 is for purposes of example only and is not limiting of the many different layouts and types of content that may be applied to and included in a contextual user interface that may be provided in association with a selected document object. Thus, the contextual user interface illustrated inFIG. 4 is not limiting or restrictive of the claimed invention in any way. For example, the contextual user interface illustrated inFIG. 4, described below, is in the form of a user interface menu that deploys in association with a selected object. However, this embodiment of the present invention may be implemented in other forms such as the addition of buttons or controls, such as tabs, to anoriginal user interface305 that are deployed in the user interface upon the selection of an object in an electronic document.
• Referring toFIG. 4, a document including an embeddedpicture object410 is illustrated in a word processing application workspace. According to embodiments of the present invention, thecontext menu420 may be launched adjacent to or near a selected object through a variety of methods, including but not limited to, selection of an given document object such as theexample picture object410. Thecontext menu420 includes selectable functionality controls that are relevant to editing the selected object in the selected document. That is, thecontext menu420 is populated with one or more selectable functionality controls that may be utilized for editing a particular selected object in a selected document. For example, referring to thecontext menu420 illustrated inFIG. 4, the context menu is launched in the context of a selectedpicture object410. Accordingly, the selectable functionality controls, such as the paste control, copy control, position control, reset picture control, and the like provide functionality to a user for editing attributes of the selectedpicture object410. As should be understood by those skilled in the art, if thecontext menu420 is launched in the context of another type of object, then the selectable functionality controls populated in thecontext menu420 will be related to the other type of object.
• According to embodiments of the present invention, by exposing theXML file340 and associated XML schema for thecontextual user interface420, third party developers may add or modify user interface content contained in thecontextual user interface420 for creating customized contextual user interface content and components associated with add-in functionality that may be applied to a selected document object. For example, referring toFIG. 4, a third party add-in application may provide additional functionality for modifying or formatting thepicture object410 over the functionality provided in the host applicationcontextual user interface420. As described above with reference toFIG. 3, the third party add-in developer may add, disable, repurpose or otherwise modify user interface components in thecontextual user interface420 in association with the third party application add-in. For example, if the add-in application provides an additional formatting functionality that may be utilized for picture objects410, an additional formatting button or group of formatting buttons and/or controls may be added to thecontextual user interface420 which will be rendered in thecontextual user interface420 when thepicture object410 is selected for editing. As described above, instead of modifying thecontextual user interface420, new functionality controls, for example, new tabs may be added to a user interface305 (illustrated inFIG. 3) that are deployed in theuser interface305 upon the selection of an associated object.
• Alternatively, in addition to modifying an existing contextual user interface, a new contextual user interface may be added to the host application. For example, if a given add-in application adds one or more functionalities for use on a selected object, anXML file340 and an associated XML schema may be exposed for creating a new contextual user interface for the associated add-in functions that will be launched in association with a selected object. According to this embodiment, a start-from-scratch XML file340 may be provided as described above to allow the creation and deployment of a newcontextual user interface420.
• FIG. 5 illustrates a computer screen display showing an example gallery or collection ofselectable controls430 that may be modified according to embodiments of the present invention. As should be understood, the gallery ofcontrols user interface430 illustrated inFIG. 5 is for purposes of example only and is not restrictive of the different user interface layouts and different user interface content that may be applied to and included in a gallery of controls user interface, as described herein. Referring now toFIG. 5, a pop-out gallery of images is illustrated adjacent to thecontext menu420. As should be understood such a gallery of controls may be deployed in other configurations. For example, a gallery of controls according to embodiments of the invention may be deployed in-line in theuser interface200, or the gallery may be deployed as a drop-down user interface under a selected button or control in theuser interface200. According to embodiments eachcontrol435,440,445 contained in the gallery of controls represents one or more functionalities, for example, formatting functionalities that will be applied to a selected object if a given control in the gallery is selected.
• A given add-in application may add functionality to the host application for providing additional functionalities (e.g., formatting properties) to a selected object and for which one or more additional controls may be desired in a host application gallery of controls. For example, referring to the example gallery of controls illustrated inFIG. 5, a third party add-in application may provide a formatting setting that automatically places the example picture object in the upper left hand corner of the example document and simultaneously applies a different formatting to the text contained in the document in which the picture object is included. If desired, the add-in application developer may modify the host application gallery ofcontrols user interface430 to provide an additional control showing the application of the add-in formatting properties to the selected document and picture object. As described above with reference toFIGS. 3 and 4, the add-in application author may specify the location in the gallery of controls at which the new control should be placed. For example, the add-in developer may specify that the new control should be inserted after the “Top Left”control440.
• In addition to modifying an existing gallery of controls user interface, a new gallery ofcontrols user interface430 may be added to the host application. For example, if a given add-in application adds one or more functionalities for use on a selected object, anXML file340 and an associated XML schema may be exposed for creating a new gallery of controls user interface for the associated add-in functions that will be launched in association with a selected object. According to this embodiment, a start-from-scratch XML file340 may be provided as described above to allow the creation and deployment of a newcontextual user interface420.
• After user interface components are added to the host application user interface as described above with reference toFIGS. 3,4, and5, according to one embodiment of the present invention, the host application may automatically scale the sizes of the added user interface components as display space for the modified user interface is reduced or enlarged. For example, if a logical grouping of buttons or controls is added to a host application user interface, and the logical grouping of buttons or controls contains three large buttons associated with add-in functionality, the host application may automatically scale the displayed buttons if the window size containing the user interface is reduced. For example, if the window size containing the user interface is reduced such that the three large example buttons may no longer be displayed without crowding other user interface components, the three large buttons may be replaced with three smaller versions of the three large buttons. If the window size is further reduced, the smaller versions of the three buttons may be removed altogether, and a small text identification for the three functionalities associated with the three buttons may be utilized in place of the three large buttons.
• Customized user interface components may be refreshed automatically by the host application when conditions affecting the customized user interface components change. For example, if a customized user interface component is added to a hostapplication user interface305 that provides a logo or picture associated with a given type of information (first data), the logo or picture may be disabled and automatically refreshed when associated information or data changes. For example, an add-in weather application may provide a button or control to the host application user interface which when selected provides a weather forecast for a specified area. The button or control in the user interface may be decorated with a picture associated with the current weather, for example, a sunny picture for sunny weather, a cloudy picture for cloudy weather, and so on. According to this embodiment of the present invention, if the current weather condition changes such that the picture or logo provided for the added button or control is no longer applicable, the current picture or logo may be automatically disabled, and the button or control may be refreshed with a different picture or logo that is applicable to the current information, for example, the current weather conditions.
• According to embodiments, the host application keeps track of the identity of each added or modified user interface component relative to the software application add-in responsible for the added or modified user interface component. According to one embodiment, upon hovering over or focusing on an added user interface component, for example, hovering a mouse pointer over an added user interface component, a tool tip or other dialog may be presented to identify the software application add-in responsible for the added or modified user interface component and for directing the user to help content available for describing or providing other information about the software application add-in associated with the added or modified user interface component.
• As described herein, software application user interface programming is exposed to allow modification of existing application user interfaces to include adding, removing, disabling, enabling and repurposing new or existing user interface components associated with add-in applications. It will be apparent to those skilled in the art that various modifications or variations may be made in the present invention without departing from the scope or spirit of the invention. Other embodiments of the present invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein.

Claims (20)

1. A method for modifying a graphical user interface, comprising:

displaying, by a computing device, a user interface for a host software application, the user interface containing a ribbon-shaped graphical user interface, the ribbon-shaped graphical user interface comprising a first tab, the first tab comprising one or more selectable controls for selecting one or more functionalities of the host software application;

providing an Extensible Markup Language (XML) representation of the ribbon-shaped graphical user interface;

receiving a modification to the XML representation, the modification adding an add-in XML element to the XML representation, the add-in XML element corresponding to an add-in control;

after receiving the modification to the XML representation, receiving, from a user, a selection of an object in a document displayed in the user interface; and

exposing, by the computing device, the add-in control in the ribbon-shaped graphical user interface in response to receiving the selection of the object.

2. The method ofclaim 1, further comprising:

receiving an add-in application at the computing device, the add-in application providing one or more additional functionalities to the host software application;

receiving a selection of the add-in control after exposing the add-in control; and

invoking a given functionality in response to receiving the selection of the add-in control, the given functionality being among the one or more additional functionalities provided by the add-in application.

3. The method ofclaim 2, wherein the given functionality provides a formatting property to the object.

4. The method ofclaim 2, further comprising:

determining that a user-controlled pointer is hovering over the add-in control; and

presenting a tool tip in response to determining that the user-controlled pointer is hovering over the add-in control, the tool tip providing information that identifies the add-in application as responsible for the add-in control.

5. The method ofclaim 1, further comprising:

receiving a selection of the add-in control after exposing the add-in control; and

invoking a given functionality in response to receiving the selection of the add-in control, the given functionality being among the one or more functionalities of the host software application.

6. The method ofclaim 1,

wherein the method further comprises: prior to receiving the modification, generating the user interface for the host software application by rendering an initial version of the XML representation, the initial version of the XML representation including a tab XML element and one or more control XML elements, the tab XML element corresponding to the first tab, the one or more control XML elements corresponding to the one or more selectable controls;

wherein providing the XML representation comprises: providing a start-from-scratch version of the XML representation to a developer, the start-from-scratch version of the XML representation not including the tab XML element or the one or more control XML elements; and

wherein receiving the modification to the XML representation comprises: receiving a modified version of the XML representation, the modified version of the XML representation containing the add-in XML element, the tab XML element, and the one or more control XML elements.

7. The method ofclaim 1,

wherein prior to receiving the modification, the XML representation comprises a tab XML element, the tab XML element corresponding to the first tab;

wherein the modification adds the add-in XML element as a child element of the tab XML element; and

wherein exposing the add-in control comprises exposing the add-in control in the first tab.

8. The method ofclaim 7,

wherein prior to receiving the modification, the XML representation comprises a first group XML element and a second group XML element, the first group XML element corresponding to a first group of controls in the first tab, the second group XML element corresponding to a second group of controls in the first tab, the first group XML element and the second group XML element being child elements of the tab XML element, the add-in XML element being a child element of the first group XML element; and

wherein exposing the add-in control in the first tab comprises exposing the add-in control in the first group of controls in the first tab and not in the second group of controls.

9. The method ofclaim 1,

wherein prior to receiving the modification, the XML representation comprises a first tab XML element, the first tab XML element corresponding to the first tab;

wherein the modification adds a second tab XML element to the XML representation, the second tab XML element corresponding to a second tab, the add-in control being in the second tab; and

wherein the method comprises exposing the second tab in the ribbon-shaped graphical user interface in response to receiving the selection of the object, thereby exposing the add-in control in the ribbon-shaped graphical user interface in response to receiving the selection of the object.

10. The method ofclaim 1,

wherein the XML representation includes a control XML element, the control XML element corresponding to a given control, the given control being among the one or more selectable controls, the given control being for selecting a given functionality, the given functionality being among the one or more functionalities of the host software application; and

wherein the modification modifies the control XML element to disable the given control without removing the given control from the ribbon-shaped graphical user interface.

11. A computing device comprising:

one or more computer storage media that store:

instructions; and

an Extensible Markup Language (XML) representation of a ribbon-shaped graphical user interface, the ribbon-shaped graphical user interface comprising a first tab, the first tab comprising one or more selectable controls for selecting one or more functionalities of a host software application; and

a processing unit that reads the instructions from the one or more computer storage media and executes the instructions, execution of the instructions by the processing unit causing the computing device to:

display a user interface for the host software application, the user interface containing the ribbon-shaped graphical user interface; and

after receiving a modification to the XML representation:

display a document in the user interface for the host software application, the document containing an object; and

expose an add-in control in the ribbon-shaped graphical user interface in response to receiving a selection of the object, the modification adding an add-in XML element to the XML representation, the add-in XML element corresponding to the add-in control.

12. The computing device ofclaim 11, wherein execution of the instructions by the processing unit causes the computing device to invoke a functionality provided by the host software application in response to receiving a selection of the add-in control.

13. The computing device ofclaim 11, wherein execution of the instructions by the processing unit causes the computing device to invoke a given functionality in response to receiving a selection of the add-in control, the given functionality provided by an add-in application that adds functionality to the host software application.

14. The computing device ofclaim 11, wherein the add-in XML element specifies that the add-in control is located after one of the selectable controls.

15. The computing device ofclaim 11, wherein execution of the instructions by the processing unit causes the computing device to:

integrate an amended XML file with an overall XML file, the amended XML file containing the modification to the XML representation, the overall XML file containing the XML representation; and

render an amended user interface for the host software application after integrating the amended XML file with the overall XML file.

16. The computing device ofclaim 15,

wherein the amended XML file is associated with an add-in application that adds functionality to the host software application; and

wherein execution of the instructions by the processing unit causes the computing device to:

uninstall the add-in application; and

parse the amended XML file and disable changes to the user interface such that the changes to the user interface are not rendered in the user interface after the add-in application is uninstalled.

17. The computing device ofclaim 15, wherein the amended XML file is attached as a resource to a component object model (COM) add-in for providing functionality of an add-in application.

18. The computing device ofclaim 11, wherein execution of the instructions by the processing unit causes the computing device to prevent a third-party application add-in from modifying user interface components in the ribbon-shaped graphical user interface that are supplied by or modified by a second third-party application add-in.

19. A computer storage medium that stores instructions, execution of the instructions by a processing unit of a computing device configuring the computing device such that the computing device:

renders a ribbon-shaped graphical user interface from an Extensible Markup Language (XML) representation of the ribbon-shaped graphical user interface, the ribbon-shaped graphical user interface comprising a first tab, the first tab comprising one or more selectable controls for selecting one or more functionalities of a host software application;

displays a user interface for the host software application, the user interface including the ribbon-shaped graphical user interface;

integrates an amended XML file with an overall XML file, the amended XML file containing a modification to the XML representation, the modification to the XML representation including an add-in XML element, the add-in XML element representing an add-in control;

displays, in the user interface for the host software application, a document that includes an object;

after integrating the amended XML file with the overall XML file, exposes the add-in control in the ribbon-shaped graphical user interface when the object is selected, the add-in control not being in the ribbon-shaped graphical user interface prior to receiving the modification to the XML representation.

20. The computer storage medium ofclaim 19,

wherein the XML representation includes a control XML element, the control XML element corresponding to a given control, the given control being among the selectable controls in the ribbon-shaped graphical user interface, the control XML element including an attribute that specifies a first functionality of the host software application; and

wherein execution of the instructions configures the computing device such that after integrating the amended XML file with the overall XML file, the computing device performs a second functionality in response to receiving a selection of the given control.

Images