TECHNICAL FIELDThe present disclosure relates generally to avoiding a potential collision of an obstacle and an accessory component of a work machine and, for example, to avoiding a potential collision of an obstacle and an adjustable ladder of a milling machine.
BACKGROUNDA work machine may include an accessory component, such as an adjustable ladder, that may be adjusted from one position to another position (e.g., from a deployed position to a stowed position, or vice versa). In some cases, an operator of the work machine may adjust (e.g., manually or by using an adjustment device) the accessory component (e.g., cause the accessory component to adjust from a first position to a second position) to account for an operating environment of the work machine. For example, an operator of a milling machine may adjust an adjustable ladder (e.g., that may be used by the operator to climb up or down the milling machine) to prevent the adjustable ladder from colliding with obstacles (e.g., mailboxes, bushes, and/or the like) that are adjacent to a work surface of the milling machine when the milling machine is in operation.
Often, however, the operator of the work machine may not notice an obstacle and/or may forget to adjust the accessory component, which may allow the obstacle to collide with the accessory component. This may damage the accessory component and/or the work machine. Further, the operator of the work machine may need to continually adjust the accessory component to avoid many different obstacles while operating the work machine. This may be a time-consuming process, which may cause the work machine to be operated in an inefficient manner.
One attempt to provide a control unit that can be configured to raise a ladder (e.g., of a machine) from a deployed position to a stowed position is disclosed in U.S. Patent Application Publication No. 2017/0144604 (“the '604 publication”) to Doy, published on May 25, 2017. In particular, the '604 publication discloses that the control unit can be configured to move the ladder from its deployed position to its stowed position when an operator starts to move the machine or an implement of the machine, such as a blade.
While the control unit of the '604 publication may be effective at preventing damage to a ladder of a machine by moving the ladder to a stowed position when an operator starts to move the machine or an implement of the machine, the '604 publication does not disclose automatically adjusting a position of the ladder based on determining that an obstacle may collide with the ladder while the machine is moving along a projected path. The system of the present disclosure solves one or more of the problems set forth above and/or other problems in the art.
SUMMARYAccording to some implementations, a method may include obtaining sensing data from at least one sensing device associated with a work machine; determining, based on the sensing data, a projected path of the work machine; determining, based on the sensing data, a location of at least one obstacle; determining that the at least one obstacle is in a portion of the projected path of the work machine, wherein the portion of the projected path of the work machine is associated with an accessory component of the work machine; identifying, based on determining that the at least one obstacle is in the portion of the projected path of the work machine, a potential collision of the at least one obstacle and the accessory component of the work machine; and causing the accessory component to adjust from a first position to a second position to avoid the potential collision of the at least one obstacle and the accessory component.
According to some implementations, a control system for an adjustable ladder of a milling machine may comprise a controller configured to: obtain the sensing data from at least one sensing device; determine, based on the sensing data, a projected path of the milling machine; identify, based on the projected path of the milling machine and a location of at least one obstacle, a potential collision of the at least one obstacle and the adjustable ladder of the milling machine; and cause the adjustable ladder to adjust from a first position to a second position to avoid the potential collision of the at least one obstacle and the adjustable ladder.
According to some implementations, a work machine may comprise an accessory component and a controller configured to: obtain sensing data from the at least one sensing device to identify a location of at least one obstacle; identify, based on the location of the at least one obstacle, a potential collision of the at least one obstacle and the accessory component; and cause the accessory component to adjust from a first position to a second position to avoid the potential collision of the at least one obstacle and the accessory component.
BRIEF DESCRIPTION OF THE DRAWINGSFIG. 1 is diagram of an example machine described herein.
FIGS. 2-4 are diagrams of an example adjustable ladder of the machine ofFIG. 1.
FIG. 5 is a diagram of an example environment in which systems and/or methods, described herein, may be implemented.
FIG. 6 is a flowchart of an example process for adjusting an accessory component of a work machine to avoid a potential collision of an obstacle and the accessory component.
DETAILED DESCRIPTIONFIG. 1 is a diagram of anexample machine100 described herein. The term “machine” or “work machine” may refer to any machine that performs an operation associated with an industry such as, for example, paving, mining, construction, farming, transportation, or any other industry. For example, themachine100 may include a mobile machine, such as a milling machine (also referred to as a cold planer) shown inFIG. 1, or any other type of mobile machine.
As shown inFIG. 1, themachine100 operates on aground surface102 for performing a milling operation on theground surface102. Themachine100 includes aframe104 and anengine enclosure106 attached to theframe104. Theengine enclosure106 houses an engine (not shown). The engine may be an internal combustion engine that provides propulsion power to themachine100 and/or also powers one or more components of themachine100.
Themachine100 includes afront end108 and arear end110. A pair offront tracks112 are proximate to thefront end108 of themachine100. Further, a pair ofrear tracks114 are proximate to therear end110 of themachine100. Themachine100 has anoperator platform116. An operator of themachine100 may sit or stand at theoperator platform116 to operate themachine100. Theoperator platform116 may include various input and/or output devices, such as acontrol panel118. Thecontrol panel118 may include a user interface that allows the operator to provide inputs for performing one or more machine tasks. Further, thecontrol panel118 may include one or more lights, one or more speakers, one or more displays, and/or the like to provide notifications, alerts, and/or the like to the operator to assist in operating themachine100.
Themachine100 also includes arotor chamber120 enclosed by afirst plate122 and a second plate (not shown). A rotor (not shown) that is rotatably coupled to theframe104 lies within therotor chamber120. The rotor includes a generally cylindrical member and a number of cutting assemblies disposed on the cylindrical member. A portion of the cutting assemblies contact theground surface102 for removing material (e.g., paving material) therefrom.
Themachine100 includes aconveyor system124 that may be pivotally connected to theframe104 and is used to transport the material away from therotor chamber120 and into a receptacle (not shown). Theconveyor system124 includes one or more conveyors for transportation of the material. Further, themachine100 includes ascraper door126 that is used to clean a portion of theground surface102 that is milled by themachine100.
As further shown inFIG. 1, themachine100 may further include an accessory component, such asadjustable ladder128. Theadjustable ladder128 is further described herein in connection withFIGS. 2-5. The accessory component may be capable of adjusting from a first position to one or more additional positions (e.g., capable of adjusting from a deployed position to one or more stowed positions). Themachine100 may also include at least onesensing device130 disposed on or near the accessory component. The at least onesensing device130 is further described herein in connection withFIG. 5. The at least onesensing device130 may be operably connected to theoperator platform116, the accessory component, thecontrol panel118, and/or acontrol device132. Thecontrol device132 is further described herein in connection withFIG. 5.
Themachine100 may operate in an operating environment that may include at least oneobstacle134. Anobstacle134 may include a rock, a mailbox, a bush, a fire hydrant, and/or any other type of object. As themachine100 travels along a path (e.g., on the ground surface102), themachine100 and/or the accessory component (e.g., the adjustable ladder128) may have a potential to collide with the at least oneobstacle134. Some implementations described herein are directed to adjusting a position of the accessory component (e.g., the adjustable ladder128) to avoid the potential collision of the at least oneobstacle134 and the accessory component.
As indicated above,FIG. 1 is provided as an example. Other examples may differ from what was described in connection withFIG. 1.
FIG. 2 is a diagram of an exampleadjustable ladder128 that may be used with the machine ofFIG. 1. As shown inFIG. 2, theadjustable ladder128 may be in a deployed position200 (e.g., theadjustable ladder128 may extend down toward the ground surface102 (not shown inFIG. 2) in a “lowered” position). Accordingly, alowermost portion202 of theadjustable ladder128 may be a particular distance from the ground surface102 (e.g., a particular height above ground level) to allow an operator to climb up to or down from theoperator platform116 on themachine100.
Theadjustable ladder128 may include and/or may be attached to amoveable platform204 that connects to theoperator platform116. Theadjustable ladder128 may include one or more adjustment points206 (e.g., one or more hinges, one or more pivot points, and/or the like) to allow theadjustable ladder128 to adjust from the deployedposition200 to another position (e.g., a stowed position as described herein). In some implementations, an adjustment device208 (e.g., such as a powered hinge) may be configured to engage one or more parts of theadjustable ladder128 to cause theadjustable ladder128 to adjust from the deployedposition200 to another position (e.g., as described herein). Theadjustment device208 may be operably connected to thecontrol device132 to allow thecontrol device132 to control adjustment of theadjustable ladder128 from one position (e.g., deployed position200) to another position (e.g., a stowed position as described herein).
As indicated above,FIG. 2 is provided as an example. Other examples may differ from what is described in connection withFIG. 2.
FIG. 3 is a diagram of an exampleadjustable ladder128 that may be used with the machine ofFIG. 1. As shown inFIG. 3, theadjustable ladder128 may be in a first stowed position300 (e.g., in a first “raised” position), such that thelowermost portion202 of theadjustable ladder128 may be a particular distance from the ground surface102 (e.g., a particular height above ground level) that is greater than a distance from theground surface102 of thelowermost portion202 of theadjustable ladder128 when the adjustable ladder is in the deployedposition200.
Thecontrol device132 may cause theadjustment device208 to engage one or more or parts of theadjustable ladder128 to cause theadjustable ladder128 to adjust to the first stowed position300 (e.g., from the deployed position200). At least one part of theadjustable ladder128 may adjust (e.g., rotate, slide, pivot, and/or the like) via the one or more adjustment points206.
As indicated above,FIG. 3 is provided as an example. Other examples may differ from what is described in connection withFIG. 3.
FIG. 4 is a diagram of an exampleadjustable ladder128 that may be used with the machine ofFIG. 1. As shown inFIG. 4, theadjustable ladder128 may be in a second stowed position400 (e.g., in a second “raised” position), such that thelowermost portion202 of theadjustable ladder128 may be a particular distance from the ground surface102 (e.g., a particular height above ground level) that is greater than a distance from theground surface102 of thelowermost portion202 of theadjustable ladder128 when the adjustable ladder is in the deployedposition200 and/or the firststowed position300.
Thecontrol device132 may cause theadjustment device208 to engage one or more parts of theadjustable ladder128 to cause theadjustable ladder128 to adjust to the second stowed position400 (e.g., from the deployedposition200 and/or the first stowed position300). At least one part of theadjustable ladder128 may adjust (e.g., rotate, slide, pivot, and/or the like) via the one or more adjustment points206.
As indicated above,FIG. 4 is provided as an example. Other examples may differ from what is described in connection withFIG. 4.
FIG. 5 is a diagram of anexample environment500 in which systems and/or methods described herein may be implemented. As shown inFIG. 5,environment500 includes thecontrol panel118, theadjustable ladder128, the at least onesensing device130, and/or thecontrol device132. Devices ofenvironment500 may interconnect via wired connections, wireless connections, or a combination of wired and wireless connections.
Thecontrol panel118 may include a user interface that includes one or more input devices, such as a dial, a knob, a slider, a joystick, and/or the like to control themachine100 and/or theadjustable ladder128. Thecontrol panel118 may be configured to generate one or more commands to control themachine100 and/or theadjustable ladder128. Thecontrol panel118 may include one or more lights, one or more speakers, one or more displays, and/or the like to provide notifications, alerts, and/or the like regarding operation of themachine100 and/or theadjustable ladder128.
Thecontrol device132 may be a controller, an electronic control unit (ECU), and/or the like of themachine100. Thecontrol device132 may be implemented as a processor, such as a central processing unit (CPU), a graphics processing unit (GPU), an accelerated processing unit (APU), a microprocessor, a microcontroller, a digital signal processor (DSP), a field-programmable gate array (FPGA), an application-specific integrated circuit (ASIC), and/or another type of processing component. The processor may be implemented in hardware, firmware, and/or a combination of hardware and software. Thecontrol device132 may include one or more processors capable of being programmed to perform a function. One or more memories, including a random-access memory (RAM), a read only memory (ROM), and/or another type of dynamic or static storage device (e.g., a flash memory, a magnetic memory, and/or an optical memory) may store information and/or instructions for use by thecontrol device132. Thecontrol device132 may include a memory (e.g., a non-transitory computer-readable medium) capable of storing instructions that, when executed, cause the processor to perform one or more processes and/or methods described herein. Thecontrol device132 may be configured to generate one or more commands to cause theadjustable ladder128 to adjust from one position to another position.
The at least onesensing device130 may include any type of sensor configured to capture sensing data (e.g., image data, video data, distance data, and/or the like) associated with themachine100. For example, the at least onesensing device130 may capture sensing data concerning a physical area around, in front, to the back, to the side, and/or the like ofmachine100. The at least one sensing device140 may include at least one camera device, at least one radar device, at least one light detection and ranging (LIDAR) device, at least one sonar device, and/or the like to capture the image data, the video data, the distance data, and/or the like that comprises the sensing data.
The at least onesensing device130 may be configured to send the sensing data (e.g., directly or via one or more other components or devices of the machine100) to thecontrol device132. The at least onesensing device130 may send the sensing data to thecontrol device132 as the at least onesensing device130 collects the sensing data (e.g., as a data stream, as a data signal, and/or the like).
Thecontrol device132 may receive the sensing data from the at least onesensing device130. Thecontrol device132 may parse the sensing data to identify the image data, the video data, the distance data, and/or the like that comprises the sensing data. Thecontrol device132 may separately receive the image data, the video data, the distance data, and/or the like that comprises the sensing data from the at least onesensing device130.
Thecontrol device132 may process the sensing data to identify and/or determine a projected path of themachine100. Thecontrol device132 may process the sensing data to identify and/or determine a location of at least one obstacle134 (e.g., in a field of view of the at least one sensing device130). For example, thecontrol device132 may process the sensing data using one or more computer vision techniques (e.g., a 3-D modeling technique, an optical flow processing technique, an object recognition and/or tracking technique, and/or the like) to identify and/or determine the projected path of themachine100 and/or the location of the at least oneobstacle134.
Thecontrol device132 may identify and/or determine that a portion of the projected path ofmachine100 is associated with a projected path of theadjustable ladder128. For example, when theadjustable ladder128 is disposed on a right side of the machine100 (e.g., attached to the right side offrame104 of the machine100), thecontrol device132 may identify and/or determine that a right-most portion of the projected path of themachine100 may be associated with the projected path of theadjustable ladder128. The client device may process the sensing data (e.g., using one or more of the computer vision techniques described herein) to directly identify and/or determine the projected path of the adjustable ladder128 (e.g., without identifying and/or determining the projected path of the machine100).
Thecontrol device132 may determine whether the at least oneobstacle134 is in the portion of the projected path ofmachine100 and/or the projected path of the adjustable ladder128 (e.g., the location of the at least one obstacle is coextensive with at least some of the portion of the projected path ofmachine100 and/or the projected path of the adjustable ladder128). When thecontrol device132 determines that the at least oneobstacle134 is not in the portion of the projected path of themachine100 and/or the projected path of theadjustable ladder128, thecontrol device132 may identify and/or determine that the at least oneobstacle134 will not collide with theadjustable ladder128.
When thecontrol device132 determines that the at least oneobstacle134 is in the portion of the projected path of themachine100 and/or the projected path of theadjustable ladder128, thecontrol device132 may identify and/or determine a potential collision of the at least oneobstacle134 and theadjustable ladder128. Thecontrol device132 may determine that an uppermost portion of the at least oneobstacle134 is a first height above ground level and that thelowermost portion202 of theadjustable ladder128 is a second height above ground level. Thecontrol device132 may identify and/or determine, based on the first height above ground level and the second height above ground level, the potential collision of the at least one obstacle and the adjustable ladder of the milling machine (e.g., when the first height is greater than or equal to the second height).
Thecontrol device132 may cause (e.g., based on identifying and/or determining the potential collision of the at least oneobstacle134 and the adjustable ladder128) one or more lights, one or more speakers, one or more displays, and/or the like of thecontrol panel118 to provide one or more notifications, alerts, and/or the like (e.g., concerning the potential collision of the at least oneobstacle134 and the adjustable ladder128). For example, thecontrol device132 may cause at least one light to be activated (e.g., cause the at least one light to turn on, blink, and/or the like), cause at least one speaker to output at least one sound (e.g., cause an output of at least one notification sound, at least one alert sound, at least one warning sound, and/or the like), cause at least one display to display at least one message (e.g., that indicates the potential collision of the at least oneobstacle134 and the adjustable ladder128), and/or the like.
Thecontrol device132 may cause (e.g., based on identifying and/or determining the potential collision of the at least oneobstacle134 and the adjustable ladder128) theadjustable ladder128 to adjust from a first position to a second position (e.g., to avoid the potential collision of the at least oneobstacle134 and the adjustable ladder128). For example, when theadjustable ladder128 is initially in a deployed position (e.g., deployed position200), thecontrol device132 may cause theadjustable ladder128 to adjust to a stowed position (e.g., first stowedposition300 or second stowed position400). Thecontrol device132 may send one or more commands to theadjustment device208, which may cause theadjustment device208 to engage with a part of theadjustable ladder128. The part of theadjustable ladder128 may rotate on a hinge, slide along another part of the adjustable ladder128 (e.g., via a telescoping process), pivot on a pivot point, and/or the like to cause theadjustable ladder128 to adjust from the first position to the second position.
Additionally, or alternatively, thecontrol device132 may generate a recommendation to adjust theadjustable ladder128 from the first position to the second position (e.g., to avoid the potential collision of the at least one obstacle and the accessory component) and may cause the recommendation to be displayed on at least one display of thecontrol panel118. The operator may see the recommendation and may interact with thecontrol panel118 to cause thecontrol panel118 to generate a response. The response may indicate that theadjustable ladder128 is to be adjusted from the first position to the second position, or, alternatively, that theadjustable ladder128 is not to be adjusted. Thecontrol panel118 may send the response to thecontrol device132. When the response indicates that theadjustable ladder128 is to be adjusted from the first position to the second position, thecontrol device132 may cause, based on the response, theadjustable ladder128 to adjust from the first position to the second position. When the response indicates that theadjustable ladder128 is not to be adjusted, thecontrol device132 may prevent theadjustable ladder128 from being adjusted.
In this way, thecontrol device132 may adjust theadjustable ladder128 to avoid the potential collision of the at least oneobstacle134 and theadjustable ladder128. For example, adjusting theadjustable ladder128 from the first position to the second position may cause thelowermost portion202 of theadjustable ladder128 to be a height above ground level that is greater than a height above ground level of an uppermost portion of the at least oneobstacle134, which may cause theadjustable ladder128 to pass above the at least one obstacle without colliding with the at least oneobstacle134.
Thecontrol device132 may receive, after causing theadjustable ladder128 to adjust (e.g., from the first position to the second position) as described herein, a command to adjust theadjustable ladder128 from the second position to the first position. For example, the operator may interact with thecontrol panel118 to cause thecontrol panel118 to generate and send the command to the control device132 (e.g., to cause theadjustable ladder128 to adjust from a stowed position to a deployed position for use by the operator). Accordingly, thecontrol device132 may cause theadjustable ladder128 to adjust from the second position to the first position.
Thecontrol device132 may receive, after causing theadjustable ladder128 to adjust (e.g., from the first position to the second position) as described herein, additional sensing data (e.g., sensing data associated with a time period after theadjustable ladder128 has adjusted to the second position) from the at least one sensing device130 (e.g., in a similar manner as described herein in relation to receiving sensing data from the at least one sensing device130). Thecontrol device132 may process the additional sensing data to determine that themachine100 has ceased moving and may thereby cause theadjustable ladder128 to adjust from the second position to another position, such as the first position (e.g., to cause theadjustable ladder128 to adjust from a stowed position to a deployed position for use by the operator).
Thecontrol device132 may process the additional sensing data to identify and/or determine an updated projected path of themachine100, an updated projected path of theadjustable ladder128, and/or an updated location of the at least one obstacle134 (e.g., in a similar manner as described herein in relation to identifying and/or determining the projected path of themachine100, the projected path of theadjustable ladder128, and/or the location of the of the at least one obstacle134). Thecontrol device132 may determine whether the at least oneobstacle134 is in a portion of the updated projected path of machine100 (e.g., that is associated with the adjustable ladder128) and/or the updated projected path of theadjustable ladder128.
When thecontrol device132 determines that the at least oneobstacle134 is not in the portion of the updated projected path of themachine100 and/or the updated projected path of theadjustable ladder128, thecontrol device132 may identify and/or determine that the at least oneobstacle134 will not collide with theadjustable ladder128. Accordingly, thecontrol device132 may cause theadjustable ladder128 to adjust from the second position to another position, such as the first position (e.g., to allow theadjustable ladder128 to be deployed for use by the operator of the machine100).
When thecontrol device132 determines that the at least oneobstacle134 is in the portion of the updated projected path of themachine100 and/or the updated projected path of theadjustable ladder128, thecontrol device132 may identify and/or determine an additional potential collision of the at least oneobstacle134 and theadjustable ladder128. Thecontrol device132 may cause the one or more lights, the one or more speakers, the one or more displays, and/or the like of thecontrol panel118 to provide one or more notifications, alerts, and/or the like (e.g., concerning the additional potential collision of the at least oneobstacle134 and the adjustable ladder128). Thecontrol device132 may cause (e.g., based on identifying and/or determining the additional potential collision of the at least oneobstacle134 and the adjustable ladder128) theadjustable ladder128 to adjust from the second position to a third position (e.g., to avoid the additional potential collision of the at least oneobstacle134 and the adjustable ladder128) in a similar manner as described herein in relation to causing theadjustable ladder128 to adjust from the first position to the second position.
As indicated above,FIG. 5 is provided as an example. Other examples may differ from what is described in connection withFIG. 5.
FIG. 6 is a flowchart of anexample process600 for adjusting an accessory component of a work machine to avoid a potential collision of an obstacle and the accessory component. One or more process blocks ofFIG. 6 may be performed by a control device (e.g., control device132). One or more process blocks ofFIG. 6 may be performed by another device or a group of devices separate from or including the control device, such as at least one sensing device (e.g., at least one sensing device130), a control panel (e.g., control panel118), and/or the like.
As shown inFIG. 6,process600 may include obtaining sensing data from at least one sensing device associated with a work machine (block610), as described herein. As further shown inFIG. 6,process600 may include determining, based on the sensing data, a projected path of an accessory component of the work machine (block620), as described herein. As further shown inFIG. 6,process600 may include determining, based on the sensing data, a location of at least one obstacle (block630), as described herein.
As further shown inFIG. 6,process600 may include determining that the at least one obstacle is in the projected path of the accessory component of the work machine (block640), as described herein. As further shown inFIG. 6,process600 may include identifying, based on determining that the at least one obstacle is in the projected path of the accessory component of the work machine, a potential collision of the at least one obstacle and the accessory component of the work machine (block650), as described herein. As further shown inFIG. 6,process600 may include causing the accessory component to adjust from a first position to a second position to avoid the potential collision of the at least one obstacle and the accessory component (block660), as described herein.
Process600 may include additional implementations, such as any single implementation or any combination of implementations described below and/or in connection with one or more other processes described elsewhere herein.
AlthoughFIG. 6 shows example blocks ofprocess600, in some implementations,process600 may include additional blocks, fewer blocks, different blocks, or differently arranged blocks than those depicted inFIG. 6. Additionally, or alternatively, two or more of the blocks ofprocess600 may be performed in parallel.
INDUSTRIAL APPLICABILITYThe disclosed control device (e.g., the control device132) may be used to adjust any accessory component (e.g.,adjustable ladder128, as well as any other adjustable accessory component) of a work machine to avoid a potential collision of at least one obstacle and the accessory component. The control device is able to obtain sensing data to identify a projected path of the accessory component and a location of the at least one obstacle. The control device is thereby able to identify a potential collision of the at least one obstacle and the accessory component and cause the accessory component to adjust from one position to another position.
In this way, by automatically adjusting the accessory component when the at least one obstacle is in a projected path of the accessory component, the control device may cause the accessory component to avoid the potential collision of the at least one obstacle and the accessory component. This may prevent damage to the accessory component and/or the work machine, which reduces a likelihood that the accessory component and/or the work machine will need to be repaired. Further, this may allow an operator of the work machine to focus on other aspects of operating the work machine rather than on monitoring the accessory component. This may cause the work machine to be operated in a more efficient manner.