Point Tracker

Point Tracker

Tracks a coloured point across frames and reports its position, while also measuring brightness in a separate sensor area. Useful for stabilising a camera feed against small drift, automatically nudging a layer to compensate for camera shake, monitoring a calibration marker on a stage to detect that the camera has been bumped, watching exposure on a known reference area to detect lighting changes, and storing a reference position/luminance for later comparison. Pick a colour and starting position, then use the auto-correct features to keep the layer locked on the marker.

Point Tracker - Settings

Initial color and position

Initial color and position — pick the colour and starting point of the marker to track.

Initial color and position
Property Description
Pick initial color and position Open the colour-picker overlay so the marker can be sampled directly from the live image. Click on the marker in the preview to set both its colour and its starting position in one step.
Selected color Colour of the marker the tracker is locked onto. Pick a saturated, distinctive colour for best results. Use the pick command rather than entering values by hand.
Scan area center X Centre X of the search area, in pixels. Where the tracker starts looking. Set automatically when the marker is picked from the preview.
Scan area center Y Centre Y of the search area, in pixels. Where the tracker starts looking. Set automatically when the marker is picked from the preview.

Tolerance

Tolerance — how forgiving the colour match is and how big the search area is.

Tolerance
Property Description
Scan area size Size of the box the tracker searches inside. [default=100x100 pixels]. Smaller boxes are faster and ignore distractions further away, but the marker must stay within the box. Larger boxes cope with faster movement at the cost of catching unrelated colour.
Search Tolerance How forgiving the colour match is. [min=0, max=300, default=300]. Higher values accept more variation in hue/saturation. Lower values demand a closer match. If the tracker grabs onto the wrong objects, lower this; if it loses the marker under changing lighting, raise it.
Min # matching pixels Minimum number of matching pixels needed before the tracker considers the marker found. [min=1, max=10000, default=24]. Raise to ignore tiny patches of stray colour. Lower to detect very small markers in distant shots.

Output

Output — what the tracker draws on top of the image.

Output
Property Description
Tracker output What the operator draws on the output image. [default=Input]. Input passes the image through unchanged. Detected pixels highlights matched pixels. Tracker area outlines the search box. Center point shows a crosshair on the detected centre. Use Detected pixels or Tracker area while tuning, then switch to Input for production.

Point detection

Point detection — read-only results for the most recent frame.

Point detection
Property Description
# matching pixels How many pixels in this frame matched the marker colour (read-only). Compare against MinimumPixelCount to understand whether Found will be true.
Point found True when enough matching pixels were found this frame (read-only). The recommended trigger flag for scripts. Watch this to detect that the marker is currently visible.
Center X Centre X of the detected marker, in pixels (read-only).
Center Y Centre Y of the detected marker, in pixels (read-only).

Point storage

Point storage — save a reference position to compare future frames against.

Point storage
Property Description
Store position Store the current detected centre as a reference position. Run this once after framing the shot. The tracker then reports drift relative to that stored position and can auto-correct it via Move Layer Automatically.
Stored position X The reference X position saved by Store Position. Used as the baseline that Position Change values are measured against.
Stored position Y The reference Y position saved by Store Position. Used as the baseline that Position Change values are measured against.
Storage name Name used to share the position with other operators via shared application settings. Defaults to the operator name. Change to coordinate multiple trackers or to expose the value to scripts under a known key.
Date/time When the reference position was last saved. Useful for warning operators that calibration is stale.

Position Auto correct

Position Auto correct — automatically move the layer so the marker stays at the stored position.

Position Auto correct
Property Description
Position change X Horizontal drift from the stored reference position, in pixels (read-only). Positive means the marker has moved right, negative means left.
Position change Y Vertical drift from the stored reference position, in pixels (read-only). Positive means the marker has moved down, negative means up.
Position change X (Avg) Horizontal drift averaged across the last 10 frames (read-only). Smoother than the instantaneous value — recommended for layer correction.
Position change Y (Avg) Vertical drift averaged across the last 10 frames (read-only). Smoother than the instantaneous value — recommended for layer correction.
Move layer automatically How the layer is moved to compensate for marker drift. [default=None]. None means the operator only reports values. Yes, use instant values reacts immediately and may look jittery. Yes, use average values (10 frames) is smoother and recommended for live use.
On failed point detection What to do when the marker can't be detected. [default=Restore to default]. Restore to default snaps the layer back to its untracked position. Keep last correction holds the most recent correction in place — better when brief drop-outs are expected.

Luminance sensor

Luminance sensor — measure brightness in a separate area to detect lighting changes.

Luminance sensor
Property Description
Show sensor area Outline the luminance sensor rectangle on the output image. [default=false]. Useful while positioning the sensor area. Turn off in production unless this visualisation is wanted.
Left Left edge of the luminance sensor rectangle, in pixels. [min=0, max=3840, default=auto]. Place the sensor on a stable, evenly-lit reference area such as a calibration card.
Top Top edge of the luminance sensor rectangle, in pixels. [min=0, max=3840, default=auto].
Width Width of the luminance sensor rectangle, in pixels. [min=0, max=640, default=256].
Height Height of the luminance sensor rectangle, in pixels. [min=0, max=640, default=192].
Luminance Current luminance shown as a percentage string (read-only).

Luminance storage

Luminance storage — save a reference brightness so changes can be detected and compensated.

Luminance storage
Property Description
Store luminance Save the current luminance reading as the reference brightness. Run this once after the lighting is set. The tracker then reports drift relative to this value and can compensate it via Luminance autocorrect.
Stored luminance (%) Stored reference luminance, formatted as a percentage string.
Luminance change (%) Current luminance change formatted as a percentage string (read-only).
Luminance autocorrect Automatically scale the layer's brightness to match the stored reference. [default=false]. Useful when ambient light shifts during a long shoot and you want the layer to keep its original look.

Warnings and Errors

Warnings and Errors — what the tracker reports when conditions stop matching the saved reference.

Property Description
Error on point lost Log an error if the marker is lost while a reference position is stored. [default=false]. Useful in unattended setups so an alert is raised when the camera or marker is bumped out of view.
Error on position changed Log a warning when the marker drifts past the position threshold. [default=true]. Combine with PositionErrorThresHoldPixels to define how much movement counts as drift.
Error on luminance changed Log a warning when measured luminance differs from the stored reference. [default=true]. Combine with LuminanceErrorThresHoldPercentage to define how much change counts as a problem.
Position error threshold (pixels) How many pixels of drift are allowed before a position warning is logged. [min=2, max=20, default=8]. Lower values are stricter and good for tightly-framed shots. Higher values tolerate camera shake.
Luminance error threshold (%) How many percent the luminance may differ before a brightness warning is logged. [min=2, max=20, default=6]. Lower values are stricter; higher values tolerate normal lighting variation.
Reset Reset all settings to their defaults (tolerance, scan area size, sensor area, error thresholds, stored references).

Inherits from: AbstractOperator, AbstractAudioMetering.

See also: Point Tracker in Script Engine Objects.