TPL-2026-026·preprint·2026-08-24

From Pixels to Club Physics: An Evidence-Bounded Architecture for Monocular Golf-Club Pose, Kinematics, and Training Data

golf-computer-visionsports-biomechanicskeypoint-estimationmeasurementdataset-audit
A golfer captured as five club landmarks transition from image pixels into an evidence-bounded motion model

Abstract

Markerless golf-swing systems often move too quickly from visible pixels to physical claims. This technical review combines an audit of public GitHub and Roboflow resources, recent golf-club pose research, and a project-specific five-landmark evidence contract to define what a monocular Swing Trainer can and cannot infer. We classify available sources by semantic compatibility, rights, and evaluation value; derive the propagation from image-coordinate error to velocity uncertainty; and propose a staged architecture separating observation, interpolation, calibration, kinematics, and coaching. The review finds that public data can support detector warm starts, but no verified openly downloadable commercial corpus found in our audit supplies hundreds of examples in the exact target schema. Further, uncalibrated single-view tracks directly support image-plane motion—not physical clubhead speed, face angle, or three-dimensional swing plane. We provide a reproducibility and validation protocol designed to keep missing evidence missing and to prevent visually convincing overlays from outrunning their measurement basis.

1. Introduction

Golf-club motion is both visually salient and unusually difficult to measure. The shaft is thin, the head changes appearance with orientation, and the fastest portion of the downswing concentrates blur, occlusion, and large inter-frame displacement into the moment users care about most. Recent systems such as CADDIE explicitly identify thin geometry, motion blur, and self-occlusion as central club-pose problems [1]. GolfPose likewise shows that adding club landmarks changes the golf-pose problem rather than merely extending a human skeleton [2].

The product temptation is to treat a recovered screen-space trajectory as physics. A rendered arc appears metric even when its coordinates are only pixels. This paper takes the opposite posture: define the observation contract first, attach every stronger inference to a validation requirement, and preserve missing evidence rather than replacing it with a visually satisfying estimate.

This is a technical review and architecture paper, not a model-results paper. No trained Swing Trainer club model, real five-point golden set, physical-device accuracy result, or validated clubhead-speed result is reported. Public-source counts are pinned to the versions audited on 16 August 2026 and can change.

2. Research Questions

We ask four bounded questions: (1) Which public or author-accessible sources can support a commercial five-landmark golf-club model? (2) Which landmark semantics preserve useful club geometry without claiming unobserved variables? (3) What quantities follow directly from monocular image tracks, and where do calibration and external instruments become necessary? (4) What evaluation design prevents video leakage and missing-evidence bias?

3. Methods

3.1 Source discovery and qualification

Discovery covered official GitHub repositories, paper pages, Roboflow Universe project versions, Kaggle, Hugging Face, and locally staged artifacts. A source was not classified by topical relevance alone. Qualification recorded exact version, media and annotation provenance, license or access condition, landmark semantics, source grouping, checksum, and permitted role: detector warm start, relabeling candidate, research-only input, quarantined material, or possible final-schema truth.

The audit applied a strict semantic rule: a dataset with five numbered points is not compatible unless the five anatomical or equipment landmarks are defined. A point cannot be renamed merely because it occupies a similar region. This rule is especially important across CADDIE, GolfPose, and Roboflow, whose club schemas were created for different objectives.

3.2 Evidence contract

The target five-point-club.v1 contract contains grip, shaft-grip junction, hosel, inner clubhead, and outer clubhead. Each landmark carries one of five states: observed, occluded, outside-frame, not-present, or not-annotatable. Coordinates exist only for observed evidence and use normalized image coordinates with a top-left origin. Predicted, filtered, or interpolated positions are prohibited from the golden labels.

3.3 Kinematic derivation

Let an observed landmark at frame i be pi = (ui, vi) in pixels and let its measured timestamp be ti. The directly observed displacement is Δpi = pi+1pi; the image-plane velocity estimate is Δpi / Δti. It has units of pixels per second, not metres per second.

If the standard deviation of independent localization error is σp per coordinate, first-difference velocity uncertainty scales approximately as √2σp/Δt. Differentiation therefore amplifies localization noise, while smaller frame intervals increase sensitivity to timestamp and position error. Acceleration introduces another difference and is more fragile still. Filtering can reduce variance but introduces assumptions, lag, and potential peak suppression; the observed and filtered series must remain distinguishable.

A physical speed estimate requires a mapping from image motion to spatial motion. Under a calibrated planar assumption this can be represented by a homography, but a golf club does not remain on a single known image-parallel plane. General three-dimensional recovery requires additional constraints, multiview geometry, stereo, an instrumented reference, or an independently validated learned reconstruction. A body or club prior can regularize an estimate; it does not make depth directly observed.

4. Results

4.1 Dataset fitness

SourceScaleClub labelsRights/accessDefensible role
CADDIE GolfClub72,000 frames5: grip, shaft, neck, head-in, head-outNo public data license/download verifiedBest semantic candidate; author request required
GolfPose17,738 frames / 6 subjects5: shaft, hosel, heel, toe-down, toe-upAuthorization + custom EULAAlternate head or transfer research; not direct mapping
Roboflow SwingFeed v37,842 imagesDetection classesCC BY 4.0 version auditedDetector warm start and hard-negative mining
Roboflow Golf-keypoint v2233 images14 keypointsCC BY 4.0 version auditedRelabeling or exploratory pose work
Roboflow Club Keypoints v6220 images3 club keypointsCC BY 4.0 version auditedRelabeling base; not five-point truth
CaddieSet1,757 shots / 8 golfersBody features + ball/shot metadataMIT repositoryView metadata and calibration research
Table 1Source audit by intended role. Counts describe the audited source versions, not a merged training set.

Compatibility requires landmark meaning, provenance, and license—not merely a matching keypoint count.

CADDIE is the closest semantic candidate: its paper describes 72,000 annotated frames, seven subjects, six locations, three club types, synchronized multiview sequences, and five shaft/head landmarks [1]. The audited paper and repository searches did not yield a public dataset download with commercial reuse terms; it therefore remains an author-access candidate, not acquired production data.

GolfPose provides an official implementation, reported train/test separation by golfer, and a custom EULA that allows commercial model training after authorization while restricting raw-data redistribution [2]. Its five club landmarks—shaft, hosel, heel, toe-down, and toe-up—do not directly equal the target contract. Its strongest defensible roles are alternate-head research, representation transfer, or manually governed conversion where the source pixels support new annotations.

The audited Roboflow exports are useful but stage-specific. SwingFeed’s 7,842 images support detector pretraining and hard-negative mining [9]. The 233-image fourteen-point and 220-image three-point exports can seed relabeling or exploratory pose work [8] [7]. None is final five-point truth as downloaded.

4.2 From observation to claim

LayerDirectly supported outputAdditional requirementBlocked overclaim
Observation2D landmark coordinates + visibility stateHuman-reviewed golden labelsA missing or blurred point has a true coordinate
TemporalImage-plane displacement and event timingMeasured timestamps; declared filteringA smooth curve is ground truth
Calibrated 2DPlane-referenced distance/speedIntrinsics, scale, fixed geometry, planar assumptionOne ground scale calibrates arbitrary depth motion
3D kinematicsPhysical trajectory and velocityMultiview/stereo or independently validated reconstructionSingle-view pixels uniquely determine 3D path
Club deliveryFace angle, path, attack, impact variablesInstrumented reference and error studyFive landmarks automatically equal launch-monitor output
CoachingScoped evidence cards or validated feedbackOutcome-linked study and policy gatesPose similarity proves a universal swing fault
Table 2Claim ladder for a monocular golf-club system.

Each layer inherits uncertainty from the layers beneath it.

Single-video golf research demonstrates that useful proficiency and repeatability signals can be extracted from two-dimensional pose and clubhead tracks [4]. That result supports careful image-plane analysis; it does not erase projective ambiguity. Laboratory clubhead-speed studies typically use multi-camera motion analysis, launch monitors, or instrumented clubs [5] [6], illustrating the additional measurement basis behind physical quantities.

4.3 Architecture implication

The defensible pipeline is staged: detect golfer and club; estimate five visible landmarks; emit visibility and uncertainty; preserve raw timestamped observations; optionally create a separately labeled filtered track; calibrate only within a declared geometry; validate physical variables against an external reference; then expose only claims that passed their layer-specific gate. Coaching must consume evidence with its provenance and blocked fields intact.

5. Evaluation and Reproducibility Protocol

Every original clip receives a source-group identifier. All derivatives—frames, crops, transcodes, and augmented versions—remain in the same split. Every clip from one golfer remains in one split. The manifest is frozen and hashed before training. This blocks the common error of placing near-identical neighboring frames or the same golfer’s appearance in both training and test.

Evaluation must report paired pixel and normalized errors per landmark; ground-truth visibility counts; missing predictions; unexpected predictions where truth is unobserved; and outlier examples. Results are stratified at minimum by face-on versus down-the-line view, and should additionally cover club type, lighting, blur, occlusion, and framing. A mean error without missing detections is insufficient.

No PCK radius or pass threshold is proposed here. CADDIE reports PCK@5px in its own captured conditions [1]; importing five pixels as a universal product threshold would ignore resolution, crop scale, camera distance, and downstream use. The application threshold must be justified by the physical or interaction error it permits in the target capture setup.

6. Discussion

The central finding is architectural rather than algorithmic: measurement claims should be typed. A system that stores observed, filtered, calibrated, reconstructed, and coached outputs in one undifferentiated trajectory invites evidence laundering. Separating those layers lets the product remain useful early. Users can review a visible path and timing pattern while the engineering team continues validation for physical metrics.

The data result is similarly non-binary. Public resources are not useless because they fail the final schema. They become valuable when assigned a bounded role. Detector images teach scene context. Alternate landmark sets teach representation. Owned footage supplies target-camera truth and clean rights. Author-access datasets can expand diversity when terms and semantics are documented. The dangerous move is merging those roles into one folder and treating file count as evidence quality.

The physics result is a limit, not a defeat. Image-plane paths can support repeatability, timing, view-specific comparisons, and falsifiable tests. Calibration may unlock plane-referenced quantities in controlled setups. Three-dimensional club delivery and impact variables require additional observation or external validation. The boundary tells the product what to build next.

7. Limitations

This review did not obtain or inspect the raw CADDIE GolfClub dataset. Roboflow counts and license labels are version-specific and do not independently establish underlying-media ownership. No annotation agreement study was run. No model was trained. No phone capture was compared with optical motion capture, radar, stereo high-speed video, or a launch monitor. The uncertainty derivation describes generic first-difference behavior and is not a measured error budget for Swing Trainer hardware.

8. Conclusion

A credible monocular Swing Trainer begins by refusing to confuse visibility with physics. The available GitHub and Roboflow work provides useful foundations, but it does not remove the need for target-schema labels, source-disjoint evaluation, calibrated geometry, and external physical validation. Five club landmarks are best understood as an auditable observation interface: enough structure to study motion, enough missing-state discipline to preserve uncertainty, and no automatic license to claim clubhead speed or three-dimensional delivery.

References

  1. Jung, C., Yang, F., Blanchard, N., & Wong, H. (2026). CADDIE: Compact Adaptive Detection-Driven Inference for Real-Time Golf Club Pose Estimation. CVPR Workshops, 9978–9987. https://openaccess.thecvf.com/content/CVPR2026W/CVsports/html/Jung_CADDIE_Compact_Adaptive_Detection-Driven_Inference_for_Real-Time_Golf_Club_Pose_CVPRW_2026_paper.html
  2. Lee, M.-H., Zhang, Y.-C., Wu, K.-R., & Tseng, Y.-C. (2025). GolfPose: From Regular Posture to Golf Swing Posture. International Conference on Pattern Recognition, 387–402. Official implementation: https://github.com/MingHanLee/GolfPose
  3. Jung, S., Hong, S., Jeong, J., Jeong, S., Choi, J., Kim, H., & Lee, W. (2025). CaddieSet: A Golf Swing Dataset with Human Joint Features and Ball Information. CVPR Workshops, 5988–5996. https://github.com/damilab/CaddieSet
  4. Kim, et al. (2023). Extracting proficiency differences and individual characteristics in golfers' swing using single-video markerless motion analysis. Scientific Reports, 13. https://pmc.ncbi.nlm.nih.gov/articles/PMC10684732/
  5. MacKenzie, S. J., & Sprigings, E. J. (2017). The most important factor in producing clubhead speed in golf. Journal of Biomechanics, 54, 138–143. https://doi.org/10.1016/j.jbiomech.2017.01.007
  6. Grober, R. D. (2010). An accelerometer based instrumentation of the golf club: measurement and signal analysis. arXiv:1001.0956. https://arxiv.org/abs/1001.0956
  7. Annotateathon. Golf Club Keypoints, version 6. Roboflow Universe. Audited 2026-08-16. https://universe.roboflow.com/annotateathon/golf-club-keypoints
  8. Kilkenny Robo. Golf-keypoint, version 2. Roboflow Universe. Audited 2026-08-16. https://universe.roboflow.com/kilkennyrobo/golf-keypoint
  9. SwingFeed. Golf detector dataset, version 3. Roboflow Universe. Audited 2026-08-16. https://universe.roboflow.com/swingfeed/golf-49wbh-spfor

Evidence status: architecture and source audit; no trained-model or physical-device performance claim.

← All research