TI1K Dataset 👆🖐️

The dataset has been used in Affine Transformation of Virtual Object in the egocentric vision where real-time fingertip detection and tracking system is introduced. If you are interested, please visit the GitHub page. The dataset has been developed and updated for the following papers. If you use the dataset, please cite the the papers as

Paper

Affine transformation of virtual 3D object using 2D localization of fingertips 🔗

@article{alam2020affine,
  title={Affine transformation of virtual 3D object using 2D localization of fingertips},
  author={Alam, Mohammad Mahmudul and Rahman, SM Mahbubur},
  journal={Virtual Reality \& Intelligent Hardware},
  volume={2},
  number={6},
  pages={534--555},
  year={2020},
  publisher={Elsevier}
}

Detection and Tracking of Fingertips for Geometric Transformation of Objects in Virtual Environment 🔗

@inproceedings{alam2019detection,
  title={Detection and Tracking of Fingertips for Geometric Transformation of Objects in Virtual Environment},
  author={Alam, Mohammad Mahmudul and Rahman, SM Mahbubur},
  booktitle={2019 IEEE/ACS 16th International Conference on Computer Systems and Applications (AICCSA)},
  address = {Abu Dhabi, United Arab Emirates},
  pages={1--8},
  year={2019},
  organization={IEEE}
}

Dataset Description

Thumb Index 1000 (TI1K) is a dataset of 1000 hand images with the hand bounding box, and thumb and index fingertip positions. The dataset includes the natural movement of thumb and index fingers making it suitable for mixed reality (MR) applications.

The dataset contains images only with the thumb and index fingers of both hands of resolution 640x480. All the annotations of the training and test images are in the "label.txt" file in the Annotation folder. The format of the annotation is:

[name of the image, xtl, ytl, xbr, ybr, xt, yt, xi, yi]

• xtl = x coordinate of the top left corner of the hand bounding box
• ytl = y coordinate of the top left corner of the hand bounding box
• xbr = x coordinate of the bottom right corner of the hand bounding box
• ybr = y coordinate of the bottom right corner of the hand bounding box
• xt = x coordinate of the thumb
• yt = y coordinate of the thumb
• xi = x coordinate of the index
• yi = y coordinate of the index

*All the values are normalized.

Example Image of the Dataset

Here is a sample image from the dataset along with its ground truth annotation:

The total dataset is split into two parts. Among 1000 images, 900 images are for the training set and 100 images for the test set.

Evaluation

For evaluation purpose of the real-time fingertip detection and tracking system, real-time video of both left- and right-hand fingers have been taken. The evaluation folder contains three folders of four videos of the hand finger movement of the four participants. All the video file in the '.mp4' format contains 50 frame sequences with resolution 640x480 at 10 frames per second. Each folder contains the corresponding annotations too. The format of the annotation of the videos is as same as the dataset images.