Xbox Game Automation - MLB The Show

MLB The Show 26 — Auto-Swing Automation Project
Platform & Setup:

Xbox Series X running MLB The Show 26
Accessed via Xbox Remote Play (browser-based, xbox.com)
Input via Xbox Keyboard/Mouse Chrome Extension
Automation tool: Macro Recorder Pro (macrorecorder.com)
PC running Windows 11

What's Already Working:

Macro fully automates pitching (two-button sequence with timing)
Macro detects hitting vs pitching state using pixel color detection on fixed UI elements (scoreboard indicators)
Between-pitch waiting handled with generous timers
Fielding and baserunning handled by in-game auto settings
End of game managed manually, then new game loaded

The One Unsolved Problem:
Auto-swing timing. The swing button (spacebar, mapped to Xbox A button) needs to fire at the right moment during the at-bat. The challenge is that pitch timing varies by pitcher, so a fixed timer isn't reliable enough.

Candidate Trigger Events (pick one):
-Ball release from pitcher's hand — most consistent visual moment, happens at roughly the same screen position every pitch
-Pitcher's foot plant — slightly earlier, also consistent
-Batter's leg kick/stride — visible on the batter side, consistent timing
-Open to suggestions

This will be strictly used on offline play on the easiest difficulty. I can share videos of the setup so you can see