XML annotation format
When you want to download annotations from Computer Vision Annotation Tool (CVAT)you can choose one of several data formats. The document describes XML annotation format.Each format has X.Y version (e.g. 1.0). In general the major version (X) is incremented when the data format hasincompatible changes and the minor version (Y) is incremented when the data format is slightly modified(e.g. it has one or several extra fields inside meta information).The document will describe all changes for all versions of XML annotation format.
Version 1.1
There are two different formats for images and video tasks at the moment.The both formats have a common part which is described below. From the previous versionflipped tag was added.Alsooriginal_size tag was added for interpolation mode to specify frame size.In annotation mode each image tag haswidth andheight attributes for the same purpose.
For what isrle, seeRun-length encoding
<?xml version="1.0" encoding="utf-8"?><annotations><version>1.1</version><meta><task><id>Number: id of the task</id><name>String: some task name</name><size>Number: count of frames/images in the task</size><mode>String: interpolation or annotation</mode><overlap>Number: number of overlapped frames between segments</overlap><bugtracker>String: URL on an page which describe the task</bugtracker><flipped>Boolean: were images of the task flipped? (True/False)</flipped><created>String: date when the task was created</created><updated>String: date when the task was updated</updated><labels><label><name>String: name of the label (e.g. car, person)</name><type>String: any, bbox, cuboid, ellipse, mask, polygon, polyline, points, skeleton, tag</type><attributes><attribute><name>String: attribute name</name><mutable>Boolean: mutable (allow different values between frames)</mutable><input_type>String: select, checkbox, radio, number, text</input_type><default_value>String: default value</default_value><values>String: possible values, separated by newlinesex. value 2ex. value 3</values></attribute></attributes><svg>String: label representation in svg, only for skeletons</svg><parent>String: label parent name, only for skeletons</parent></label></labels><segments><segment><id>Number: id of the segment</id><start>Number: first frame</start><stop>Number: last frame</stop><url>String: URL (e.g. http://cvat.example.com/?id=213)</url></segment></segments><owner><username>String: the author of the task</username><email>String: email of the author</email></owner><original_size><width>Number: frame width</width><height>Number: frame height</height></original_size></task><dumped>String: date when the annotation was dumped</dumped></meta> ...</annotations>Annotation
Below you can find description of the data format for images tasks.On each image it is possible to have many different objects. Each object can have multiple attributes.If an annotation task is created withz_order flag then each object will havez_order attribute which is usedto draw objects properly when they are intersected (ifz_order is bigger the object is closer to camera).In previous versions of the format onlybox shape was available.In later releasesmask,polygon,polyline,points,skeletons andtags were added.Please see below for more details:
<?xml version="1.0" encoding="utf-8"?><annotations> ...<imageid="Number: id of the image (the index in lexical order of images)"name="String: path to the image"width="Number: image width"height="Number: image height"><boxlabel="String: the associated label"xtl="Number: float"ytl="Number: float"xbr="Number: float"ybr="Number: float"occluded="Number: 0 - False, 1 - True"z_order="Number: z-order of the object"><attributename="String: an attribute name">String: the attribute value</attribute> ...</box><polygonlabel="String: the associated label"points="x0,y0;x1,y1;..."occluded="Number: 0 - False, 1 - True"z_order="Number: z-order of the object"><attributename="String: an attribute name">String: the attribute value</attribute> ...</polygon><polylinelabel="String: the associated label"points="x0,y0;x1,y1;..."occluded="Number: 0 - False, 1 - True"z_order="Number: z-order of the object"><attributename="String: an attribute name">String: the attribute value</attribute> ...</polyline><polylinelabel="String: the associated label"points="x0,y0;x1,y1;..."occluded="Number: 0 - False, 1 - True"z_order="Number: z-order of the object"><attributename="String: an attribute name">String: the attribute value</attribute> ...</polyline><pointslabel="String: the associated label"points="x0,y0;x1,y1;..."occluded="Number: 0 - False, 1 - True"z_order="Number: z-order of the object"><attributename="String: an attribute name">String: the attribute value</attribute> ...</points><taglabel="String: the associated label"source="manual or auto"><attributename="String: an attribute name">String: the attribute value</attribute> ...</tag><skeletonlabel="String: the associated label"z_order="Number: z-order of the object"><pointslabel="String: the associated label"occluded="Number: 0 - False, 1 - True"outside="Number: 0 - False, 1 - True"points="x0,y0;x1,y1"><attributename="String: an attribute name">String: the attribute value</attribute></points> ...<attributename="String: an attribute name">String: the attribute value</attribute> ...</skeleton><masklabel="String: the associated label"source="manual or auto"occluded="Number: 0 - False, 1 - True"rle="RLE mask"left="Number: left coordinate of the image where the mask begins"top="Number: top coordinate of the image where the mask begins"width="Number: width of the mask"height="Number: height of the mask"z_order="Number: z-order of the object"></mask> ...</image> ...</annotations>Example:
<?xml version="1.0" encoding="utf-8"?><annotations><version>1.1</version><meta><task><id>4</id><name>segmentation</name><size>27</size><mode>annotation</mode><overlap>0</overlap><bugtracker></bugtracker><flipped>False</flipped><created>2018-09-25 11:34:24.617558+03:00</created><updated>2018-09-25 11:38:27.301183+03:00</updated><labels><label><name>car</name><attributes></attributes></label><label><name>traffic_line</name><attributes></attributes></label><label><name>wheel</name><attributes></attributes></label><label><name>plate</name><attributes></attributes></label><label><name>s1</name><type>skeleton</type><attributes></attributes><svg><line x1="36.87290954589844" y1="47.732025146484375" x2="86.87290954589844" y2="10.775501251220703" stroke="black" data-type="edge" data-node-from="2" stroke-width="0.5" data-node-to="3"></line><line x1="25.167224884033203" y1="22.64841079711914" x2="36.87290954589844" y2="47.732025146484375" stroke="black" data-type="edge" data-node-from="1" stroke-width="0.5" data-node-to="2"></line><circle r="1.5" stroke="black" fill="#b3b3b3" cx="25.167224884033203" cy="22.64841079711914" stroke-width="0.1" data-type="element node" data-element-id="1" data-node-id="1" data-label-name="1"></circle><circle r="1.5" stroke="black" fill="#b3b3b3" cx="36.87290954589844" cy="47.732025146484375" stroke-width="0.1" data-type="element node" data-element-id="2" data-node-id="2" data-label-name="2"></circle><circle r="1.5" stroke="black" fill="#b3b3b3" cx="86.87290954589844" cy="10.775501251220703" stroke-width="0.1" data-type="element node" data-element-id="3" data-node-id="3" data-label-name="3"></circle></svg></label><label><name>1</name><type>points</type><attributes></attributes><parent>s1</parent></label><label><name>2</name><type>points</type><attributes></attributes><parent>s1</parent></label><label><name>3</name><type>points</type><attributes></attributes><parent>s1</parent></label></labels><segments><segment><id>4</id><start>0</start><stop>26</stop><url>http://localhost:8080/?id=4</url></segment></segments><owner><username>admin</username><email></email></owner></task><dumped>2018-09-25 11:38:28.799808+03:00</dumped></meta><imageid="0"name="filename000.jpg"width="1600"height="1200"><boxlabel="plate"xtl="797.33"ytl="870.92"xbr="965.52"ybr="928.94"occluded="0"z_order="4"></box><polygonlabel="car"points="561.30,916.23;561.30,842.77;554.72,761.63;553.62,716.67;565.68,677.20;577.74,566.45;547.04,559.87;536.08,542.33;528.40,520.40;541.56,512.72;559.10,509.43;582.13,506.14;588.71,464.48;583.23,448.03;587.61,434.87;594.19,431.58;609.54,399.78;633.66,369.08;676.43,294.52;695.07,279.17;703.84,279.17;735.64,268.20;817.88,264.91;923.14,266.01;997.70,274.78;1047.04,283.55;1063.49,289.04;1090.90,330.70;1111.74,371.27;1135.86,397.59;1147.92,428.29;1155.60,435.97;1157.79,451.32;1156.69,462.28;1159.98,491.89;1163.27,522.59;1173.14,513.82;1199.46,516.01;1224.68,521.49;1225.77,544.52;1207.13,568.64;1181.91,576.32;1178.62,582.90;1177.53,619.08;1186.30,680.48;1199.46,711.19;1206.03,733.12;1203.84,760.53;1197.26,818.64;1199.46,840.57;1203.84,908.56;1192.88,930.49;1184.10,939.26;1162.17,944.74;1139.15,960.09;1058.01,976.54;1028.40,969.96;1002.09,972.15;931.91,974.35;844.19,972.15;772.92,972.15;729.06,967.77;713.71,971.06;685.20,973.25;659.98,968.86;644.63,984.21;623.80,983.12;588.71,985.31;560.20,966.67"occluded="0"z_order="1"></polygon><polylinelabel="traffic_line"points="462.10,0.00;126.80,1200.00"occluded="0"z_order="3"></polyline><polylinelabel="traffic_line"points="1212.40,0.00;1568.66,1200.00"occluded="0"z_order="2"></polyline><pointslabel="wheel"points="574.90,939.48;1170.16,907.90;1130.69,445.26;600.16,459.48"occluded="0"z_order="5"></points><taglabel="good_frame"source="manual"></tag><skeletonlabel="s1"source="manual"z_order="0"><pointslabel="1"occluded="0"source="manual"outside="0"points="54.47,94.81"></points><pointslabel="2"occluded="0"source="manual"outside="0"points="68.02,162.34"></points><pointslabel="3"occluded="0"source="manual"outside="0"points="125.87,62.85"></points></skeleton><masklabel="car"source="manual"occluded="0"rle="3, 5, 7, 7, 5, 9, 3, 11, 2, 11, 2, 12, 1, 12, 1, 26, 1, 12, 1, 12, 2, 11, 3, 9, 5, 7, 7, 5, 3"left="707"top="888"width="13"height="15"z_order="0"></mask></image></annotations>Interpolation
Below you can find description of the data format for video tasks.The annotation contains tracks. Each track corresponds to an object which can be presented on multiple frames.The same object cannot be presented on the same frame in multiple locations.Each location of the object can have multiple attributes even if an attribute is immutable for the object it will becloned for each location (a known redundancy).
<?xml version="1.0" encoding="utf-8"?><annotations> ...<trackid="Number: id of the track (doesn't have any special meeting)"label="String: the associated label"source="manual or auto"><boxframe="Number: frame"xtl="Number: float"ytl="Number: float"xbr="Number: float"ybr="Number: float"outside="Number: 0 - False, 1 - True"occluded="Number: 0 - False, 1 - True"keyframe="Number: 0 - False, 1 - True"><attributename="String: an attribute name">String: the attribute value</attribute> ...</box><polygonframe="Number: frame"points="x0,y0;x1,y1;..."outside="Number: 0 - False, 1 - True"occluded="Number: 0 - False, 1 - True"keyframe="Number: 0 - False, 1 - True"><attributename="String: an attribute name">String: the attribute value</attribute></polygon><polylineframe="Number: frame"points="x0,y0;x1,y1;..."outside="Number: 0 - False, 1 - True"occluded="Number: 0 - False, 1 - True"keyframe="Number: 0 - False, 1 - True"><attributename="String: an attribute name">String: the attribute value</attribute></polyline><pointsframe="Number: frame"points="x0,y0;x1,y1;..."outside="Number: 0 - False, 1 - True"occluded="Number: 0 - False, 1 - True"keyframe="Number: 0 - False, 1 - True"><attributename="String: an attribute name">String: the attribute value</attribute></points><maskframe="Number: frame"outside="Number: 0 - False, 1 - True"occluded="Number: 0 - False, 1 - True"rle="RLE mask"left="Number: left coordinate of the image where the mask begins"top="Number: top coordinate of the image where the mask begins"width="Number: width of the mask"height="Number: height of the mask"z_order="Number: z-order of the object"></mask> ...</track><trackid="Number: id of the track (doesn't have any special meeting)"label="String: the associated label"source="manual or auto"><skeletonframe="Number: frame"keyframe="Number: 0 - False, 1 - True"><pointslabel="String: the associated label"outside="Number: 0 - False, 1 - True"occluded="Number: 0 - False, 1 - True"keyframe="Number: 0 - False, 1 - True"points="x0,y0;x1,y1"></points> ...</skeleton> ...</track> ...</annotations>Example:
<?xml version="1.0" encoding="utf-8"?><annotations><version>1.1</version><meta><task><id>5</id><name>interpolation</name><size>4620</size><mode>interpolation</mode><overlap>5</overlap><bugtracker></bugtracker><flipped>False</flipped><created>2018-09-25 12:32:09.868194+03:00</created><updated>2018-09-25 16:05:05.619841+03:00</updated><labels><label><name>person</name><attributes></attributes></label><label><name>car</name><attributes></attributes></label><label><name>s1</name><type>skeleton</type><attributes></attributes><svg><line x1="36.87290954589844" y1="47.732025146484375" x2="86.87290954589844" y2="10.775501251220703" stroke="black" data-type="edge" data-node-from="2" stroke-width="0.5" data-node-to="3"></line><line x1="25.167224884033203" y1="22.64841079711914" x2="36.87290954589844" y2="47.732025146484375" stroke="black" data-type="edge" data-node-from="1" stroke-width="0.5" data-node-to="2"></line><circle r="1.5" stroke="black" fill="#b3b3b3" cx="25.167224884033203" cy="22.64841079711914" stroke-width="0.1" data-type="element node" data-element-id="1" data-node-id="1" data-label-name="1"></circle><circle r="1.5" stroke="black" fill="#b3b3b3" cx="36.87290954589844" cy="47.732025146484375" stroke-width="0.1" data-type="element node" data-element-id="2" data-node-id="2" data-label-name="2"></circle><circle r="1.5" stroke="black" fill="#b3b3b3" cx="86.87290954589844" cy="10.775501251220703" stroke-width="0.1" data-type="element node" data-element-id="3" data-node-id="3" data-label-name="3"></circle></svg></label><label><name>1</name><type>points</type><attributes></attributes><parent>s1</parent></label><label><name>2</name><type>points</type><attributes></attributes><parent>s1</parent></label><label><name>3</name><type>points</type><attributes></attributes><parent>s1</parent></label></labels><segments><segment><id>5</id><start>0</start><stop>4619</stop><url>http://localhost:8080/?id=5</url></segment></segments><owner><username>admin</username><email></email></owner><original_size><width>640</width><height>480</height></original_size></task><dumped>2018-09-25 16:05:07.134046+03:00</dumped></meta><trackid="0"label="car"><polygonframe="0"points="324.79,213.16;323.74,227.90;347.42,237.37;371.11,217.37;350.05,190.00;318.47,191.58"outside="0"occluded="0"keyframe="1"></polygon><polygonframe="1"points="324.79,213.16;323.74,227.90;347.42,237.37;371.11,217.37;350.05,190.00;318.47,191.58"outside="1"occluded="0"keyframe="1"></polygon><polygonframe="6"points="305.32,237.90;312.16,207.90;352.69,206.32;355.32,233.16;331.11,254.74"outside="0"occluded="0"keyframe="1"></polygon><polygonframe="7"points="305.32,237.90;312.16,207.90;352.69,206.32;355.32,233.16;331.11,254.74"outside="1"occluded="0"keyframe="1"></polygon><polygonframe="13"points="313.74,233.16;331.11,220.00;359.53,243.16;333.21,283.16;287.95,274.74"outside="0"occluded="0"keyframe="1"></polygon><polygonframe="14"points="313.74,233.16;331.11,220.00;359.53,243.16;333.21,283.16;287.95,274.74"outside="1"occluded="0"keyframe="1"></polygon></track><trackid="1"label="s1"source="manual"><skeletonframe="0"keyframe="1"z_order="0"><pointslabel="1"outside="0"occluded="0"keyframe="1"points="112.07,258.59"></points><pointslabel="2"outside="0"occluded="0"keyframe="1"points="127.87,333.23"></points><pointslabel="3"outside="0"occluded="0"keyframe="1"points="195.37,223.27"></points></skeleton><skeletonframe="1"keyframe="1"z_order="0"><pointslabel="1"outside="1"occluded="0"keyframe="1"points="112.07,258.59"></points><pointslabel="2"outside="1"occluded="0"keyframe="1"points="127.87,333.23"></points><pointslabel="3"outside="1"occluded="0"keyframe="1"points="195.37,223.27"></points></skeleton><skeletonframe="6"keyframe="1"z_order="0"><pointslabel="1"outside="0"occluded="0"keyframe="0"points="120.07,270.59"></points><pointslabel="2"outside="0"occluded="0"keyframe="0"points="140.87,350.23"></points><pointslabel="3"outside="0"occluded="0"keyframe="0"points="210.37,260.27"></points></skeleton><skeletonframe="7"keyframe="1"z_order="0"><pointslabel="1"outside="1"occluded="0"keyframe="1"points="120.07,270.59"></points><pointslabel="2"outside="1"occluded="0"keyframe="1"points="140.87,350.23"></points><pointslabel="3"outside="1"occluded="0"keyframe="1"points="210.37,260.27"></points></skeleton><skeletonframe="13"keyframe="0"z_order="0"><pointslabel="1"outside="0"occluded="0"keyframe="0"points="112.07,258.59"></points><pointslabel="2"outside="0"occluded="0"keyframe="0"points="127.87,333.23"></points><pointslabel="3"outside="0"occluded="0"keyframe="0"points="195.37,223.27"></points></skeleton><skeletonframe="14"keyframe="1"z_order="0"><pointslabel="1"outside="1"occluded="0"keyframe="1"points="112.07,258.59"></points><pointslabel="2"outside="1"occluded="0"keyframe="1"points="127.87,333.23"></points><pointslabel="3"outside="1"occluded="0"keyframe="1"points="195.37,223.27"></points></skeleton></track></annotations>