10	1.25	0.666667
15	2.5	0.333333
20	3.75	0.222222
25	5	0.166667
30	6.25	0.133333
35	7.5	0.111111
40	8.75	0.095238
45	10	0.083333
50	11.25	0.074074
55	12.5	0.066667
60	13.75	0.060606
65	15	0.055556
70	16.25	0.051282
75	17.5	0.047619
80	18.75	0.044444
85	20	0.041667
90	21.25	0.039216
95	22.5	0.037037
100	23.75	0.035088
105	25	0.033333
110	26.25	0.031746
115	27.5	0.030303
120	28.75	0.028986
125	30	0.027778
130	31.25	0.026667
135	32.75	0.025445
140	33	0.025253
145	34.25	0.024331
150	35.5	0.023474
155	36.75	0.022676
160	37	0.022523

Control of a visual-image stream replay in response to a user's exercise level according to an embodiment of the invention is illustrated in Table 1. The control will be illustrated with respect to an exercising user generating a user-exercise signal of 45 user-exercise signals per minute from apedometer30 worn on the user's12 leg. Applying the first correlation parameter embodied in Table 1, 45 hits per minute is correlated with an exercise level expressed as a speed of 10 miles per hour. The exercise level may be displayed to theuser12 on the display screen of thedisplay18, or displayed on thecollector40. Applying the second correlation parameter, dividing the camera mount speed of 25 mph by the exercise-level speed of 10 mph results in a ratio of 2.5. The 2.5 ratio is multiplied by the native frame-display time of {fraction (1/30)}^thof a second to produce a modified frame-display time of 0.083333. This modified frame-display time slows down the presentation of the visual-image stream, and simulating the user moving slower through the scene than the speed at which the camera traversed it. Continuing with the example, if a user-exercise signal of 115 signals per minute is generated by thepedometer30, the correlated exercise level is 27.5 miles per hour. The camera-mount speed divided by the exercise level is 25/27.5, or a 0.90909 ratio, which when multiplied by the native frame-display time of {fraction (1/30)}^thof a second produces a modified frame-display time of 0.030303. This speeds up the presentation of the visual-image stream, and simulates the user moving faster through the scene than did the camera.

As will be appreciated by those skilled in the art, the frame display time of 0.666667 seconds per frame, associated with an exercise level of 1.25 mph in Table 1, the display will be very jerky. A shorter frame display time is needed for the eye to perceive smooth motion. If the camera mount speed were slowed from 25 mph to 2.5 mph, ten times as many frames would be taken over a fixed distance, and the frame display time would be correspondingly reduced by a factor of ten. Thus, the frame display time of 0.666667 seconds (corresponding to 1.5 frames per second) would be reduced to a much shorter frame display time of 0.066667 seconds per frame (corresponding to 15 frames per second), producing a rate of frame display that would appear smooth to the eye. This creates a problem, however, for display of the video-image sequence at a user speed of 25 mph, as this user speed would correspond not to a frame rate of 30 frames per second, but rather to a frame rate of 300 frames per second, a speed with which thecomputing device28 may not be able to cope. To mitigate this effect, when a user speed exceeds the camera mount speed by, for example a factor of two, thecomputing device28 could instruct theplayer56 to begin displaying only alternate frames. As the ratio of camera mount speed to user speed increases, the number of frames skipped per frame displayed could be increased. This allows for a video-image stream to be used over a wider range of user speeds.

Frame dropping may be accomplished according to an algorithm or may use a simple look-up table. For example, in one embodiment of the invention, and as shown in Table 2 below, frame dropping occurs when the user speed exceeds the camera mount speed by the indicated amount.

	TABLE 2


	Multiple of Camera Mount	Frame Drop
	Speed (MCMS)	Rate

	MCMS <= 1.25	0
	1.25 < MCMS <= 2.25	1
	2.25 < MCMS <= 3.25	2
	3.25 < MCMS <= 4.25	3
	4.25 < MCMS <= 5.25	4

That is, where the user speed is 1.25 or less times as great as the camera mount speed, no frames would be dropped. It may be necessary, because of data compression, to process frames not displayed, in order to have all necessary image display information.

Table 3 provides further examples of frame drop rate as a function of camera mount speed and the user speed that relates to the user exercise level. In addition, it provides corresponding frame durations without frame dropping (Raw Frame Duration) and with frame dropping (Modified Frame Duration).

TABLE 3


Camera			Raw Frame Duration	Frame	Modified	Frames
Mount	User		(CameraSpeed/	Drop	Frame	per
Speed	Speed	Multiple	UserSpeed) *(1/30)	Rate	Duration	Second

4	1	0.25	0.133333333	0	0.133333333	7.5
4	2	0.5	0.066666667	0	0.066666667	15.0
4	3	0.75	0.044444444	0	0.044444444	22.5
4	4	1	0.033333333	0	0.033333333	30.0
4	5	1.25	0.026666667	0	0.026666667	37.5
4	6	1.5	0.022222222	1	0.044444444	22.5
4	7	1.75	0.019047619	1	0.038095238	26.3
4	8	2	0.016666667	1	0.033333333	30.0
4	9	2.25	0.014814815	1	0.02962963	33.8
4	10	2.5	0.013333333	2	0.04	25.0
4	11	2.75	0.012121212	2	0.036363636	27.5
4	12	3	0.011111111	2	0.033333333	30.0
4	13	3.25	0.01025641	2	0.030769231	32.5
4	14	3.5	0.00952381	3	0.038095238	26.3
4	15	3.75	0.008888889	3	0.035555556	28.1
4	16	4	0.008333333	3	0.033333333	30.0
4	17	4.25	0.007843137	3	0.031372549	31.9
4	18	4.5	0.007407407	4	0.037037037	27.0
4	19	4.75	0.007017544	4	0.035087719	28.5
4	20	5	0.006666667	4	0.033333333	30.0
4	21	5.25	0.006349206	4	0.031746032	31.5

In this example, the camera mount speed is 4 mph, and no frame dropping occurs until the user speed exceeds 5 mph. Where the user speed is greater than 1.25 times the camera mount speed, but less than or equal 2.25 times the camera mount speed, one frame would be dropped for every frame displayed. For example, for a camera mount speed of 4 mph and a user speed of 8 mph, the multiple of the camera mount speed would be 2. This falls between 1.25 times and 2.5 times the camera mount speed, so every other frame would be dropped. At 14 mph, the ratio of user speed to camera mount speed would be 3.5, and accordingly three out of four frames would be dropped. To achieve the display of an apparent user speed equal to the user speed, the frame duration would also have to be adjusted. In calculating this adjustment, the frame dropping rate has to be taken into account. At 10 mph in Table 3, for example, the frame display without frame dropping would be 0.0133 seconds, but if two out of three frames are dropped, the duration would have to be further adjusted by multiplying 0.0133 seconds by 3, which produces a frame duration of 0.40 seconds, about 25 frames per second. At 19 mph in Table 3, where four out of five frames are being dropped, the adjustment factor would be 5, and so the frame display duration would be 0.007*5, or 0.035 seconds.

In addition to permitting a video-image stream recording to be used across a greater speed range, recording of video-image streams at a lower camera mount speed and using frame dropping to accommodate higher user speeds also enhances the realism of the video stream replay. From experience, realism is degraded at frame durations below about ⅓ of normal. A video stream recorded at 6 mph could be used at a user speed of 30 mph with the dropping of five out of six frames. The video-image stream playback at ½ the camera mount speed could be slowed by adjusting the frame display rate to a walking speed of 3 mph, producing 15 frames a second, without undue degrading of realism.

Simulation adjustments may be applied based on the user-exercise signal. For example, the replay may be paused, and an appropriate message displayed, if a user exceeds a predetermined number of strides per minute or a predetermined heart rate. The user may also be allowed to pause the simulation and may thereafter continue at the place in the simulation at which the pause occurred, or the replay may be paused when the user stops exercising.

Still or animated graphics may be applied to displays to provide information or entertainment. For example, an animated pacer within a “rear view mirror” inset may be progressively enlarged to motivate the exerciser to increase effort and may change front to back orientation to indicate the pacer has passed the exerciser. Heart rate or other physiological data may be displayed. User and or companion's course progress may be displayed. A real time pie chart of the relative time spent in predetermined heart-rate zones may be displayed.

Two cameras may produce two video-streams to be edited or synchronized during replay to display a visual three-dimensional view using two head-mounted displays, shutter glasses, glasses with differently colored lenses or other commercially available visual three-dimensional display.

Data, visuals and or sound may be distributed by the system to connected exerciser and or trainer computing device. Real time exercise data may be exchanged between connected systems and or to a central system that may or may not be monitored by a person real time.

FIG. 3 illustrates a use-sequence diagram80 of the visual-image stream replay-control system10, according to an embodiment of the invention. Prior to use, thesystem10 is initialized and theexercise apparatus14 is readied, the simulationcomputing device program50 is loaded onto thecomputing device28, the medium having the recorded visual-image stream is loaded into the visual-image stream player56, and thecollector40 is placed in a convenient position relative to the user. In the group ofsteps82, the user attaches thesensor30 to their body, the simulationcomputing device program50 is started, and initial user and program inputs are entered in preparation for exercising. In the group ofsteps84, theprogram50 opens and displays the visual-image stream in pause mode. As the user exercises, theprogram50 polls thecollector40 for a buffered user-exercise signal. Upon receiving a user-exercise signal, theprogram50 determines a user-exercise level and from that and the camera mount speed, determines a modified frame-display time and outputs the modified frame-display time or rate to the visual-image stream playback program and/or hardware. In the group ofsteps86, theprogram50 either terminates on detection of the end of the course or on receiving of a user-inputted stop command, or pauses replay on detection of a user-inputted pause command, or where the user has stopped exercising, as determined from the failure to receive a user-exercise signal for a period of time, or, in an alternate embodiment, where the user-exercise level is below a minimum value.

FIG. 4 illustrates a flowchart showing aprocess90 executed by the simulationcomputing device program50 that polls thecollector40 and determines a modified frame-display time, according to an embodiment of the invention. Atprocess step92, theprocess90 regularly polls thecollector40 for a buffered user-exercise signal, the polling rate illustrated as once a second. At thedecision step94, if the polled buffered user-exercise signal includes new data, the process flow moves tosteps96 and determines whether the replay rate (frame-display time) should be changed. After that determination is made and any replay rate changes made, theprocess90 moves to areturn99. At thedecision step94, if the polled buffered user-exercise signal does not include new data, the process flow moves to step98 and determines if the replay rate (frame-display time) should be slowed or theplayer56 paused. This provides for slow speeds and a smooth transition to pause. After that determination is made and any replay rate change made, theprocess90 moves to thereturn99.

Theprocess90 atsteps98 allows slow simulated speeds—where it takes longer than one second to complete one repetitive cycle that, in the case of Table 1, is speeds of less than 13.75 mph. Theprocess90 also allows the replay to “coast to a stop” when the user stops exercising. The slowest practical simulated speed in the example illustrated in Table 1 andFIG. 4 is probably about 5 mph. One may assume this slow rate is no longer “exercise,” but in a rehabilitation setting it may well be. When a stationary exerciser will be used for rehabilitation, or at the user's option, the visual-image stream replay-control system10 may allow a user to select a camera-mount speed different from that associated with the visual-image stream. Using Table 1 as an example, the visual-image stream replay-control system10 may allow a user to override the native camera-mount speed of 25 mph with a different speed, such as 6.25 mph. Thus, the visual-image stream would be replayed or presented to a user undergoing rehabilitation at its normal or native rate when the user's cadence is at 30 hits per minute instead of 105. This allows a user to customize the program presentation for their particular exercise situation. This also demonstrates the desirability of producing multiple-sensor hits per repetitive cycle so that, at slower cadences, a more refined measurement of the user-exercise level can be obtained.

FIG. 5 further explains a method of frame dropping according to one embodiment of the invention. Local, temporary variables (appended with “Temp”) are used to prevent unpredictable replay behavior. It must be remembered theprogram50 is proceeding to display the video stream on another thread and it is undesirable to affect that behavior while this thread is processing. In thefirst step100, the frame dropping program module receives the user camera mount speed into TempCameraSpeed, user speed into TempUserSpeed and makes use of the NativeFrameRate and DropFrameRate variables from the simulation—video replay code. The camera mount speed may be the actual camera mount speed at which the visual-image stream was created, or the user may input a camera mount speed adjustment to account for different types of exercise equipment (e.g., treadmill vs. stationary bicycle), or to account for reduced physical capability, as may be experienced where the system is used in a rehabilitation environment. For example, a rehabilitating user of a stationary bicycle may not be capable of achieving a cadence corresponding to 25 mph, but rather may be able to achieve a user speed of only 12.5 mph despite working as hard as he or she can. Adjusting the camera mount speed to 12.5 mph will allow the user to experience the apparent speed of 25 mph of the video-image stream despite only being able to achieve half the cadence normally required for that speed. Alternatively, as the cadence, user speed and frame display time are all related by algorithm or by look-up table (such as Table 1), the frame dropping program module could obtain information such as the frame-display time directly from the algorithm or table rather than having it provided by theprogram50. The camera mount speed may be embedded in the visual-image stream data file, or may be stored in association with it. For example, the camera mount speed data may reside in a file header, may form a part of the file name for the visual-image stream data, or may be stored in a separate file identifiable as related to the file or files containing the visual-image stream data. The camera mount speed may change at different points in the visual-image stream. If the camera mount speed is not embedded in the visual-image stream it may be stored separately with a separate frame index number associated with each camera mount speed so that the simulationcomputing device program50 can determine at what points in the visual-image stream the various camera mount speeds should be applied.

Step102 determines the Multiple of the Camera Mount Speed (MCMS=TempUserSpeed divided by TempCameraMountSpeed). Step103 uses MCMS to determine the temporary frame drop rate (TempDropFrameRate), typically by conditional branching. In the present embodiment, this is accomplished using a look-up table, such as Table 2. If the camera mount speed is, for example, 4 mph and the user speed is 15 mph, the ratio of these numbers would be 3.75. According to Table 2, this would correspond to a frame drop rate of 3, meaning that three frames should be dropped for each frame displayed. Put another way, only one of four frames should be displayed. At 20 mph, of course, the ratio would be 5, and the frame drop rate would be 4, meaning that four frames should be dropped for each frame that is displayed, and that only one of five frames should be displayed.

In thenext step104, the program module compares the calculated frame drop rate (TempDropFrameRate) with the prior frame drop rate (DropFrameRate). If thecollector40 is polled every second, and if it is desired to (conditionally) avoid changing the frame drop rate until the changed frame drop rate has been repeatedly calculated for three seconds, a counter is incremented instep105 and the results are compared to 3. If there is no drop rate change, if the drop rate increases, if the drop rate decreases by more than 1, or if the drop rate decreases by 1 and the drop rate counter is 3 the program module proceeds to thestep106.

Otherwise, instep104 the drop rate decreased by one and the drop rate counter is less than three, thus step105 increases the drop rate counter, sets TempFrameDurate=(TempCameraSpeed/TempUserSpeed)*(1/NativeFrameRate)*(TempDropFrameRate+2). That is, it bases the calculation on the current drop rate, rather than the calculated drop rate. Thenext step107 determines if the resulting frame rate is equal to or greater than ⅔ of the native frame rate (20 for NTSC or16 for PAL). If so the program proceeds atstep108. If not the logic proceeds atstep106.

Step106 sets the drop rate counter to zero, and adjusts the frame display time (TempFrameDuration). For example, for a frame drop rate of three, the sum of the frames to be dropped, namely 3, and the one frame to be displayed, equals 4, so the frame display time (TempCameraSpeed/TempUserSpeed)*(1/NativeFrameRate) is multiplied by 4.

Thenext step108 must set all three player variables atomically. That is, once this code starts executing it must complete before releasing control to the operating system to process other threads (ie video stream replay code). Else an unpredictable replay rate will occur. The computing device module returns to theprogram50. Theprogram50 then uses this information to omit the display of the appropriate number of frames and to display the appropriate frame for the adjusted time.

Myriad additions and modifications to thesystem10 may be made to enhance the user experience. For example, alternate video image streams may be produced by using multiple cameras, and the user may be allowed to switch between the video-image streams during exercise. For example, in addition to the straight-ahead view, a side view of a bicycle trip along a ridge could be provided to allow the user to enjoy the view of the valley below. This picture could be displayed by itself, or picture-in-picture could be provided showing both the straight-ahead and side views.

The user may also choose to have still images displayed on command or at various calculated, periodic or predetermined points in the visual-image stream. Exercise may continue during display of the stills, and the video-image stream may be recommenced at the point at which the still image was brought up, or at a position down the path corresponding to where the user would have been had the still image not been displayed. The still images may be scenic views, flora or fauna, seasonal change views, informational displays or the like. Transitions to the stills may be abrupt, or may be presented otherwise, as by fades, sweeps or the like. The call-up point for the still image may be according to data stored in or with the visual-image stream, or the still image may be incorporated in the visual-image stream itself. In one embodiment, display of still images is accomplished by use of an index. The file name of the still may contain a frame time stamp, including a frame index, for the point in the visual-image stream where the still is to be displayed. When the display-stills option is selected, the system selects a required time period, for example, five seconds, from the frame index to allow the system overhead time to open, prepare and buffer the image for display. At the appropriate time in the display of the visual-image stream, the system displays the still for the preset or user-selected length of time. For example, the system may cache the display time stamp along with the full directory file specification in an indexed memory buffer with an open-index. Every time the system reads a time stamp that has a frame index of zero, it may check to determine if a still image file is available for the location. If so, a thread may be started to open, process and buffer the image. For speedy retrieval, it may be best to store the still images separately from the video-image stream content.

A variety of different methods may be used to allow a user to communicate with thecollector40 orcomputing device28. These include keypads, infrared remote controls, voice command systems implemented in thecomputing device28 or elsewhere, and so forth. The controllers may be used to call up menus, select options, input data to the controller or computing device system, pause, stop the display, apply virtual brakes, change virtual gears, steer a virtual course, etc.

While the purpose of the present system is to provide a video image stream that simulates the traversing of a course at a rate related to the output level of the user, the measurement of physical function of the user is superior to measuring cycles or motion of a piece of exercise equipment. However, other embodiments may take into consideration user and machine data, such as resistance setting or inseam data in the calculation of user speed. For example, using a treadmill as an example, an adjustment factor could be added to provide a correlation between, for example, inseam length and stride. Thus, a user with a 30″ inseam might have an expected stride four inches shorter than a person with an inseam length of 33 or 34 inches. Such data may be input by theuser12 to thecollector40 orcomputing device28 at the time of system startup or during the course of exercise. Similarly, the stride length, and hence the distance traveled each time a user-exercise signal is output may be correlated such that a user-exercise signal frequency consistent with a jogging pace might presume a longer stride length than walking and a running pace might be presumed to have a stride length that is even longer. In such case, the user speed might more than double with a doubling in the frequency of the user-exercise signals.

User interest may be enhanced by use of data exchange among exercise systems and/or with a server or monitor system. Using graphic overlays, voice or text communication, picture-in-picture displays and the like, the exercise systems can provide simulations of group exercise, for example, in which a stationary cyclist, or avatar for the stationary cyclist, who is “behind” the user is displayed in the context of his or her course location in a picture-in-picture display or virtual rear-view mirror. Riders ahead of the user could likewise be displayed in a picture-in-picture display. Locations of other riders on the same course could likewise be indicated by graphics, as by symbols that traverse a bar graph, by symbols that move along the course on a map and the like. Riders of one fitness level may be allowed to adjust the correlation between their user-exercise signal rate and the user-exercise level so that they are competitive with riders of another fitness level in order to render them competitive.

Trainers or medical personnel could use data exchange from the user with a monitor system to monitor the progress of the user in real time or at a later time, and could provide encouragement, instructions and other feedback by such means as voice, text, image or other data exchange with the user system.

Data exchange may be accomplished by direct links, such as cable or wireless links, if the systems are in proximity to one another, or data exchange may be accomplished over a network, including the Internet, via dial-up, or by other data communications methods. Stored information from other users, or other sessions of the same user, could be used to provide virtual groups, in effect time-shifting their traverse of the course. Such data may consist of the frame index number and elapsed time for the course. Because data exchange may be accomplished over distances, such embodiments of the invention would allow for virtual groups to exercise together despite their physical separation, and for trainers and medical personnel to interact with the users from remote locations.

For users who prefer such group exercise, but who are embarrassed by their fitness level or physical appearance, such virtual group exercise can provide the encouragement such a user requires without the embarrassment. Users may even choose to remain anonymous. Group sessions may be arranged through a server or web page that allows such anonymity, or may be arranged by groups of users who communicate among themselves by other means.

Identification of the user location along the course can be derived from the frame index for the frame that is being displayed. Since video image streams comprise a series of images, two exercisers to whom the same frame is being displayed, and who accordingly see the same image, are at the same location in the course. The total number of images that comprise the video image data are known or can be determined. Actual distances along the course can be computed, if desired, from the frame index and camera mount speed(s). For example, for a segment recorded with a camera mount speed of 5 meters per second during which thirty frames per second are taken, each successive frame would represent an incremental distance traveled by the camera of {fraction (5/30)}ths or ⅙^thmeter. If the camera mount speed for a subsequent segment increases to 6 meters per second at the same 30 frames per second video image capture rate, then the incremental distance between frames for this segment would be {fraction (6/30)}ths, or ⅕^thmeter. Thus, the information required to locate a particular exerciser in a given course is relatively minimal. Calculation of the relative distance between users and theuser12 may be computed based on their locations along the course. For purposes of picture-in-picture display, the size of the other users or of a pacer may be altered based on the relative distance between such user or pacer and theuser12.

A virtual group may be created by auser12 by using a virtual pacer. This pacer's speed may be a constant that may be selected by the user at the start of exercise, and that may be changed during exercise if desired. Theuser12 may record a previous exercise session and use himself or herself as the pacer in a subsequent exercise session.

A model may be used as the pacer, and the video stream of the model traversing the course may be displayed to the user, for example, in a picture-in-picture inset.

Size may be determined using a formula or a look-up table, for example. Table 4 provides an example of a lookup table that might be used.

	TABLE 4


		Height of
		enclosing
	Length of	Pacer
	Separation	Rectangle
	(feet)	(percentage)

	<= 10	100
	> 10 <= 20	90
	> 20 <= 30	80
	> 30 <= 40	70
	> 40 <= 50	60
	> 50 <= 60	50
	> 60 <= 70	40
	> 70 <= 80	30
	> 80 <= 90	20
	> 90 <= 100	10

The dimension of the rectangle displaying the pacer or another user may be determined from the resolution of the user display. The width may be a function of the height of the rectangle. The example set forth in Table 4 above assumes a full-size height determined by the resolution of the display device.

The user/pacer display may disappear at distances greater than 30.5 meters (100 feet). Cropping or other means may further enhance the pacer display. The relative size of the pacer and enclosing rectangle may remain constant. A display overlay may provide a numeric indication of distance between theuser12 and the user or pacer displayed in the rectangle.

Where a pacer is displayed rather than a user with whom real time data is being exchanged, thesystem10 may allow for keyboard or other input to reset the pacer to a distance such as 5 meters. Other user inputs may start or terminate the pacer display before or during exercise. Theuser12 may choose between constant-size display of a pacer or other user with digital or analog distance display, or may choose variable pacer/user rectangle size based on distance, or other combinations of displays. Theuser12 or group of users that are exchanging data may also choose a group member to act as pacer.

Identifying the position of other users to theuser12 of thesystem10 may be accomplished in a variety of ways. For example, a horizontal bar could be overlaid onto the video image stream being displayed on thedisplay18. Locations of other users in their respective systems could be indicated by symbols positioned along the horizontal bar. Other users, or a computing device-provided pacer could also be displayed, as by picture-in-picture, showing the user/pacer in a virtual rear view mirror if behind theuser12 or by a rear view of the user/pacer if ahead. The user/pacer could also be displayed by overlaying an image on the video-image stream display.

Referring toFIG. 6, in one embodiment, when a group session is opened by the user, two ports may be opened. For example,Port1 may be opened to receive data andPort2 to send data. A central computing device or web site may contain system identification information such as the identities and system addresses of group members, and, possibly, may also contain pre-recorded pacer or even user data from previous exercise sessions. Each group member may receive the system identification information of others selected to participate in group exercise.

A trainer or medical person may also receive system identification information for one or more of the group members.

Port

1 receives and buffers incoming member data. Data is cleared from the port as it is read.Port2 is used for sending data from thesystem10 and is likewise buffered for sending and cleared after sending. In one embodiment, the system of each group member periodically (e.g., every second) sends via its Port2 a packet of information toPort1 of the systems of the other group members. This data transmission may be direct from the users' systems or may be mediated by a server. The data may include member ID of the group member, course ID and current frame count. A trainer or medical person may also receive, for example, cadence, heart rate, device resistance, and so forth.

In one embodiment, when a group session is opened by the user, or when an external pacer is selected, in thestep200

Ports

1 and2 are opened.Port1 receives data from the external system and Port two transmits data from thesystem10 to an external system. The transmission and receiving of data may be via wired or wireless connection, via a computer network, via modem over telephone lines, via the Internet or the like. A central computing device or web site may contain the identities and system addresses of all group members, or thesystem10 may be configured to operate in a peer-to-peer relationship with other systems.

In thenext step201, the system or systems in the group send identifying information to each other and receive identifying information from other members of the group. The data is buffered and transmitted viaPort2, and, once sent by thesystem10, the buffered data is deleted. Similarly, the data received throughPort1 by the system is buffered and is deleted once it is read by thesystem10. During group sessions,

Ports

1 and2 are periodically polled, for example, once a second, to send and receive data.

The systems send and receive a predetermined data set that may include system identification information, course identification information, frame index number and the like.

Other data may also be sent, such as heart rate, breathing rate, cadence, device resistance level, ramp setting, and the like. Information may also be exchanged with a monitor system that receives data for display to medical personnel, a trainer or coach, or the like.

If theuser12 elects to designate a group member as a pacer, or if an external pacer is selected, in the step203 a separate process is started. In thisstep203, the data on the pacer, such as the pacer's frame index number, is received by this process, and a separation distance is calculated. In thenext step204, pacer information is provided to the user. This may be by providing a screen inset simulating a rear view or forward view, with an image of the pacer or of a simulated exerciser being presented in greater or lesser size, may include a display of the distance between theuser12 and pacer in digital or analog form, or, taken together with prior pacer data, a display indicative of whether the distance between theuser12 and pacer is increasing or decreasing.

The calculation of separation distance may be accomplished based on the location along the course. The frame index of theuser12 and pacer may be compared and the difference between them provides information for the calculation. For example, if the camera mount speed is 10 mph (16 kph), and the native frame rate of the video image stream is 30 frames per second, the distance per frame would be 10 mph*5280 ft/ml divided by 3600 seconds per hour and divided by 30 frames per second, or about 0.5 ft (0.15 m) per frame. Accordingly, if the user frame index is greater than the pacer frame index by 100 frames, the user would be approximately 50 feet (15 m) ahead of the pacer. The time difference between the pacer and user can be calculated from the speed corresponding to the user exercise level, the distance per frame and the number of frames separating the user and the pacer. For example, a separation distance of fifty feet (100 frames/0.5 ft/frame) would correspond to a “lead” of 2.5 seconds at a speed of 20 ft/sec. A negative number, of course, would represent a distance or time by which theuser12 lags the pacer.

Regardless of the choice made instep202, a process is started in thestep210. In thisstep210, the progress of each member of the group is calculated from data such as the frame index. For a course the video stream for which was calculated at a single camera mount speed and frame rate, the completion ratio may be the frame index divided by the total number of frames in the video image stream. For example, if the native display time for the video image stream is 30 minutes (1800 seconds), at a native frame rate of 30 frames per second, the video image stream would be comprised of 54000 frames. If the frame index for the first frame is 1 and the frame index for the frame corresponding to a user location is 13500 then the completion ratio is 13,500/54000, or 1/4, indicating that the user has traversed 25% of the course.

In thenext step211, the completion ratios of the members of the group, including theuser12 are displayed. One form of display might be a horizontal line representing the full extent of the course. The location of various group members along the course could be indicated by symbols placed along the line at locations indicative of the completion ratio. In the foregoing example, the group member that had reached frame13500 might be indicated by a marker displayed ¼ of the way along the line. Different symbols, symbols of different colors and the like may be used to differentiate the group members on the display.

In local group sessions comprised of more than onesystem10, asystem10 that transmits wirelessly or by wire among the sensors, collectors and computing devices must identify and operate on the appropriate user sensor data.

In one embodiment, asystem10 may collect data from sensors from multiple users who form a group. In such case, a single user who is a member of the group may be designated as the leader, and all members of the group would view the same scene driven by the leader. That is, the leader's position on the course would be displayed to all users irrespective of where in the course these other group members actually are. Position information for each of theconnected users12 in the group may be displayed. For example, a position bar may be marked with distinct symbols along its length indicating the location of each of theusers12 of the group. Different colors and/or shapes may be used to distinguish among theusers12. Auser12 who has completed 75% of the course may be represented by a symbol at the 75% position along the length of the bar. As such, theusers12 in the group would be able to know where they are along the course relative to the leader and other members of the group. The determination ofuser12 location along the course may be made by keeping track of the frame count for eachuser12, even though it is the leader's view and not the frame corresponding to this frame count that is displayed to theuser12.

Data from all connected users may be logged or transmitted to remote systems as previously described. If a single computing device receives data from multiple users and displays different and appropriate frames to eachuser12, each instance would function as, and may be considered, aseparate system10.

In light of this disclosure, it will be recognized by one skilled in the art that the functions and operation of the various embodiments disclosed may be implemented in software, in firmware, in special purpose digital logic, or any combination thereof.

Although the present invention has been described in considerable detail with reference to certain preferred embodiments, other embodiments are possible. Therefore, the spirit or scope of the appended claims should not be limited to the description of the embodiments contained herein.