Our research is proposing an algorithm and technical implementation of a system that can recognize positions and orientations of IR (Infrared) LED (Light Emitting Diode) markers that are invisible to a naked human eye. The system is made to work with Oculus Rift DK2 head-mounted display coupled with a 111 Hz IRLeap Motion camera. It adds functionality to these devicesby allowing them to track different kinds of objects using active IR markers. Up to now, the most common way for tracking markers for augmented reality were using fiducial markers that are visible to human eye orother static markers. Such marker systems require flat surface for attaching a sticker of a fiducial marker. With our system it is possible to create invisible markers and they can be attached to objects without flat surfaces. As aproof of the conceptwe made a virtual ping-pong game where the player uses a physical table tennis paddle fitted with active IR markers. At the time of the research, no such tracking systems were available in public domain. Currently similar commercial systems are in development by Oculus and other companies. Limitations of hardware that we found in our research might be one of the main reasons why the commercial product is not yet completed. In case of Oculus Rift’s IRcamera, it has insufficient 30 Hz frame-rate to support active IR markers. We found that even with the capture rate of 111 Hz the proposed system works 3 times slower than conventional fiducial markers, but starting at this frame rate it can be applied for real-time applications.