Achieving subpixel accuracy in object tracking presents significant advantages for motion and deformation analysis. While accuracies exceeding 0.01 pixels are attainable under optimal conditions, sustaining these conditions is often limited to short durations. The heating of devices can induce sensor and housing expansion, resulting in image distortions. In this study, we investigate thermal effects by capturing static sequences of a binary target comprising a matrix of circles. Images were captured every two minutes over a 15-hour period. Subpixel tracking of image drifts and deformations was achieved by locating the centroid of each circle. We evaluated the performance of a Basler Ace2 camera both in its standard configuration and with a heat sink accessory, demonstrating the effectiveness of the heat sink in reducing stabilization time and minimizing drift and distortions. Our findings indicate that while incorporating a heat sink offers advantages, potential drawbacks must also be considered.
The design and adjustment of image-based detection and tracking systems require the use of calibrated sliders on which to place the targets. Scientific-grade sliders often provide high precision and repeatability (1 micron), although they are frequently expensive and can only move small-size and lightweight targets, limiting their applications.
In our research work, we need to conduct motion detection tests with subpixel precision by tracking natural textures on stone materials. The test samples used in the laboratory can weight more than 1 kg to have a statistically representative amount of texture details. This weight makes them too heavy for scientific sliders.
In this work, we propose the use of photographic sliders as precision displacement systems. Since these systems are designed for artistic purposes, precise calibration is necessary for their use in accurate displacements. The calibration procedure involves the precise tracking of a circular target’s centroid location with subpixel accuracy. To achieve this, the slider’s speed and the camera’s acquisition time are adjusted, ensuring that interframe is around 0,1 pixels. The same trajectory is assessed at various displacement speed to determine both the repeatability and linearity in velocity and positioning.
The tests were conducted using a Thorlabs DDS100/M linear slider and an Edelkrone One photographic slider. The results demonstrate that the photographic slider delivers a similar level of precision at just one-fifth of the cost when compared to the Thorlabs slider.
Object tracking with subpixel accuracy is crucial in experiments where the object’s apparent movement on the camera sensor is very small. This situation can occur when the movement is inherently minimal or when it takes place at a significant distance from the camera. Achieving accuracies beyond 0.01 pixels requires careful planning and noise cancellation to obtain precise and consistent results. Therefore, it is imperative to meticulously design experiments in the laboratory to determine the true performance under the best possible conditions.
To achieve high subpixel accuracy, it is necessary to find a balance among the camera's features, the object to camera distance, and the object’s speed. These parameters collectively define the final pixel-to-millimeter ratio, which ultimately determines the method’s accuracy.
Additionally, selecting the appropriate algorithm is fundamental for accurately determining the target’s position. In our case, we employ normalized cross-correlation between images with analytic interpolation of the correlation peak.
A drawback of subpixel tracking approach is that tracking targets with subpixel accuracy makes the system highly sensitive to thermal errors. Heating of the electronics can lead to the expansion of the camera casing and sensor, resulting in drifts and distortions in the final image.
In our presentation, we will show different combinations that ensure precise subpixel accuracy while accounting for observed thermal distortions. Following our results with Basler cameras, our recommendation is to use the lowest target speed with a temporal resolution to achieve an apparent interframe shift of less than 0.004 pixels and at least 2 hours of stabilization time.
Object tracking with subpixel accuracy often needs targets with special shapes, which include random dot patterns, circular objects or targets with irregular contours. Unfortunately, in majority of real applications no such objects are found or cannot be attached to the region of interest and non-optimal objects must be used. Among those, we will analyze here the performance of rectangular objects that may be common in natural or artificial targets. Object tracking has been performed through the two most common methods that appear in the literature: centroid calculation and cross-correlation with peak interpolation. Numerical simulations show that tracking results for such objects are highly dependent of the object orientation with respect to the direction of movement. This is due to the interference of the object borders and the sensor and how is the subpixel information obtained. Best results are obtained for object orientations from 5 to 30 deg with respect to the normal to the displacement directions. Experimental results confirm the simulations and allow us to establish that, although object alignment provides a better image on the sensor with sharper borders, this situation is not desirable for accurate subpixel tracking, with accuracies varying from accuracies of 0.08 px (RMS error) with aligned objects to 0.02px with a misaligned target.
Some materials undergo an hygric expansion when they are soaked. In porous rocks, this effect is enhanced by the pore space that allows the water to reach every part of its volume and to hydrate the most of their swelling parts. This enlargement has negative structural consequences in the vicinity since adjacent elements will support some compressions or displacements. Recently image-based methods have arisen in this field due to their advantages versus traditional methods. Among all image processing methods, digital image correlation (DIC) is one of the most used in all areas. In this work, we propose a new methodology based on DIC for the calculation of the hygric expansion of materials. We use porous sandstone, with dimensions 14x14x30 mm to measure its hygric swelling using an industrial digital camera and a telecentric objective. We took one image every 5 minutes to characterize the whole swelling process. Due the large magnification, the whole 14 mm length of one contour was not in the image and therefore we lost the image scale reference. To solve this, a 1951 USAF test was used to calibrate the imagen. The telecentric objective and a narrow deep of field allowed to have the specimen surface exactly on the same plane that the USAF test was during the calibration. The image was pointed to one corner of the specimen, to obtain information not only of its vertical displacement due to its expansion but also of its horizontal movement. Preliminary results show that the proposed methodology provides reliable information of the hygric swelling using a non-contact methodology, with an accuracy of 1 micron.
A technique for obtaining subpixel resolution when tracking through cross-correlation consists of interpolating the obtained function and then refine the peak location. Although the technique provides accurate location results, the peak is always biased towards the closest integer coordinate. This effect is known as peak-locking error and is a major limit to the experimental accuracy of this calculation technique. This error may be different depending on the algorithm used to fit and interpolate the correlation peak but no systematic analysis was found in the literature. In our study we explore the three most common interpolation methods: thin-plate splines, second-order polynomial fit and Gaussian fit together with the influence of the extent of local interpolation area around the peak. Additionally, we have checked the influence of the image blurring on the results, since it is reported as one effective method to reduce the peak-locking error. Finally, the optimal adjustment found is the Gaussian fit with no blur and a neighborhood around the correlation peak of 11x11 pixels.
The behaviour of a construction safety net and its supporting structure was monitored with a high speed camera and
image processing techniques. A 75 kg cylinder was used to simulate a falling human body from a higher location in a
sloped surface of a building under construction. The cylinder rolled down over a ramp until it reaches the net. The
behaviour of the net and its supporting structure was analysed through the movement of the cylinder once it reaches the
net. The impact was captured from a lateral side with a high speed camera working at 512 frames per second. In order to
obtain the cylinder position each frame of the sequence was binarized. Through morphological image processing the
contour of the cylinder was isolated from the background and with a Hough transform the presence of the circle was
detected. With this, forces and accelerations applying on the net and the supporting structure have been described,
together with the trajectory of the cylinder. All the experiment has been done in a real structure in outdoors location.
Difficulties found in the preparation on the experiment and in extracting the final cylinder contour are described and
some recommendations are giving for future implementations.
Analysis of vibrations and displacements is a hot topic in structural engineering. Video cameras can provide good
accuracy at reasonable cost. Proper system configuration and adequate image processing algorithms provide a reliable
method for measuring vibrations and displacements in structures. In this communication we propose using a pocket
camera (Casio) for measuring small vibrations and displacements. Low end cameras can acquire high speed video
sequences at very low resolutions. Nevertheless, many applications do not need precise replication of the scene, but
detecting its relative position. By using targets with known geometrical shapes we are able to mathematically obtain
subpixel information about its position and thus increase the system resolution. The proposal is demonstrated by using
circular and elliptic targets on moving bodies The used method combines image processing and least squares fitting and
the obtained accuracy multiplies by 10 the original resolution. Results form the low-end camera (400 euros) working at
224×168 px are compared with those obtained with a high-end camera (10000 euros) with a spatial resolution of 800×560 px.
Although the low-end camera introduces a lot of noise in the detected trajectory, we obtained that results are comparable.
Thus for particular applications, low-end pocket cameras can be a real alternative to more sophisticated and expensive
devices.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.