Puzzle first then forget smoothly: A puzzle-based method for identifying similar jockey silks for on-site horse race spectators

Puzzle first then forget smoothly: A puzzle-based method for identifying similar jockey silks for on-site horse race spectators Meiji University Yuki Miyazaki, Satoshi Nakamura 0

Prix de l'Arc de Triomphe • Held in Paris last Sunday • One of the worldʼs most prestigious horse races A race that attracts international attention Enjoy Horse Racing More 1

Background • Spectators need to find the horse they support during a race • They identify the horse using its number, jockey cap, coat color, and jockey silks. Jockey Cap Jockey Silks Horse Number Coat Color https://youtu.be/wOtdqohsy2w?si=bgtfyymLcpTHYjcX 2

• https://youtu.be/wOtdqohsy2w?si=bgtfyymLcpTHYjcX

Background Horse numbers are commonly used to identify racehorses. However, they can often be hidden by other horses. Horse Number Not visible https://youtu.be/wOtdqohsy2w?si=bgtfyymLcpTHYjcX 3

• https://youtu.be/wOtdqohsy2w?si=bgtfyymLcpTHYjcX

Background Horse numbers are commonly used to identify racehorses. However, they can often be hidden by other horses. The race becomes less enjoyable Not visible Horse Number if spectators cannot find their target horse! https://youtu.be/wOtdqohsy2w?si=bgtfyymLcpTHYjcX 4

• https://youtu.be/wOtdqohsy2w?si=bgtfyymLcpTHYjcX

Tracking System • Easy for beginners to understand and locate each horse • The overlay disappears near the finish and draws attention to the large screen • Relying too much on such systems makes it harder to watch the horses compete with your own eyes. JRA Official Channel: 2024 Victoria Mile (G1), Ten Happy Rose https://youtu.be/wOtdqohsy2w?si=bgtfyymLcpTHYjcX JRA Official Channel: 2024 Prix de lʼArc de Triomphe (G1), Bluestocking https://youtu.be/pGraxDBcfDM?si=2goLroe3HdWFo-7F 5

Background The variety of jockey silks usually lets spectators identify a horse uniquely, even when its number or the tracking overlay is not visible Jockey Silks JRA Official Channel: 2024 Victoria Mile (G1), Ten Happy Rose https://youtu.be/wOtdqohsy2w?si=bgtfyymLcpTHYjcX 6

Background If spectators only roughly remember the target silk, they may be confused when several horses wear similar silks. JRA Official Channel: 2025 Kyoto Kimpai (G3), Sakura Toujours https://youtu.be/4s8lVSLwKPM?si=mMXakbiehTtZ̲f56 7

Background If spectators only roughly remember the target silk, they may be confused when several horses wear similar silks. Distinguishing similar silks is important during a race JRA Official Channel: 2025 Kyoto Kimpai (G3), Sakura Toujours https://youtu.be/4s8lVSLwKPM?si=mMXakbiehTtZ̲f56 8

Background Multiple races are held at a racetrack each day. The horse you support, and its silk, often changes from race to race. Remembering the previous silk may cause confusion in the next race. Race 1 Race 2 Race 3 Race 12 Horse You Support Other Horses sly Previou Silk ized Memor ears Reapp 9

Background Multiple races are held at a racetrack each day. The horse you support, and its silk, often changes from race to race. Remembering the previous silk may cause confusion in the next race. Race 1 Horse You Support Other Horses Race 2 Race 3 Race 12 Spectators need to forget the memorized silks soon after each race! sly Previou Silk ized Memor ears Reapp 10

What Support Do We Aim to Provide? 1. Quickly learn to identify the target jockey silks before the race 2. Enjoy the race without relying on system assistance 3. Forget the memorized silks soon after the race Recognize these silks as those of the horse you support! Target Horseʼs Silks Similar Silks 11

Puzzle Method • Swapping cells within the same silk Ø Memorize the pattern and color scheme • Swapping cells between different silks Ø Memorize the differences between silks

Experiments Does the Puzzle Method Support Memorization and Forgetting? Image Recognition Experiment Does Memorization Improve Race Viewing? Race Engagement Comparison Experiment Video Recognition Experiment 13

Exp 1. Image Recognition Experiment • Compared with a coloring method used by race announcers • Image recognition test with moving and partially occluded silks • N = 12, both methods https://www.radionikkei.jp/keibablog/150928.html Coloring Method Image Recognition Test 14

• https://www.radionikkei.jp/keibablog/150928.html

Experiment 1 Results Recognition Accuracy ØPuzzle Method: 88.0% (95/108) ØColoring Method: 86.1% (93/108) The coloring method tended to show lower forgettability because complex patterns left stronger memory traces. 15

Exp 2. Video Recognition Experiment • We conducted a video recognition test in which participants selected the jockey silk they had memorized from a short race video of about five seconds. Video Recognition Test • We again used the coloring method for comparison. • N = 28 ØPuzzle Method vs. Coloring Method Ø14 participants per method 16

Video Recognition Test Video recognition requires careful test design Estimating horse positions from race flow would not test silk recognition. All target silks appear in each video so participants can select them in any order. Short clips are looped so participants can view them multiple times if they miss a target silk. Identify jockey silks from short video clips without relying on race flow. 5s 17

Experiment 2 Results The puzzle method showed higher overall accuracy than the coloring method, while the coloring method showed lower accuracy in front view footage. Side View Footage, such as Straights Front View Footage, such as Curves 18

Subjective Evaluation of Forgettability Experiment 1 ØDid you recall silks from the previous task during the recognition test? (1: Not at all 5: Very frequently) Coloring: 4.25 ØPuzzle: 2.67 Experiment 2 ØDid you feel confused by recalling previously memorized silks? (1: Not confused 5: Very confused) Coloring: 2.92 ØPuzzle: 2.38 19

Experiments 1 and 2 Discussions Recognition ØThe puzzle method helped distinguish visually similar silks, especially when the viewpoint changed. Forgettability ØThe puzzle method tended to reduce interference from previously memorized silks. The puzzle method encourages attention to differences between similar silks without creating excessively strong memory traces. 20

Experiments 1 and 2 provided several insights into memorization and forgetting of jockey silks using the puzzle method. But do spectators really need to memorize jockey silks before the race? 21

Exp 3. Race Engagement Comparison Experiment Spectators can refer to silk images on a smartphone during the race without memorizing them in advance. No memorization burden and no need to rely on memory. Spectators may look at their smartphone instead of focusing on the race. N = 32, both methods Memorization Memorization Reference Reference Puzzle Method Race Engagement Ø Flow / Immersion Ø Target Horse Tracking Ø Race Engagement / Involvement Ø Satisfaction / Value Image Reference Method 22

Race Engagement Measures We adapted engagement measures from prior studies to the context of race video viewing. 1. Flow / Immersion : Evaluates concentration, immersion, enjoyment, and excitement during race viewing. 2. Race Engagement / Involvement : Evaluates understanding, prediction, and active involvement in the race. 3. Satisfaction / Value : Evaluates satisfaction and perceived value of the race viewing experience. 4. Target Horse Tracking : An original scale for evaluating identification and attention to the target horse. 1. Kim et al. [2019], Koufaris [2002], Ghani et al. [1991]. 3. Brady et al. [2005], Yoshida et al. [2013] 2. Mamada et al. [2023], Saito et al. [2020], Jennett et al. [2008] 23

Experiment 3 Results & Discussions Scale Score（1 to 7） Number of Gaze Away Count • The puzzle condition received higher race engagement ratings than the image reference condition. • The puzzle condition also reduced gaze away events. Race Flow Target Horse Satisfaction Immersion Tracking Engagement Value Involvement Puzzle Image Reference 24

Experiment 3 Results & Discussions Scale Score（1 to 7） Number of Gaze Away Count Using the puzzle before viewing may have not only helped spectators identify the target horse, but also encouraged more active race viewing by having them actively interact with the silks in advance. Race Flow Target Horse Satisfaction Immersion Tracking Engagement Value Involvement Puzzle Image Reference 25

Experiments Summery • Helps spectators distinguish visually similar jockey silks. • Tends to reduce confusion caused by previously memorized silks. • May help spectators stay focused on the race and watch more actively. 26

Field Studies at Tokyo Racecourse We investigated how the proposed method is used at actual racecourses and what benefits and challenges arise in Tokyo. Tokyo Ø39 undergraduate and graduate students used the proposed method across 158 races. • Easier to find and follow the target horse • More exciting and enjoyable race viewing • Need for a faster and less burdensome interaction 27

Field Studies at ParisLongchamp Racecourse Paris ØWe also conducted a field study with a small group of participants at the Prix de l'Arc de Triomphe last weekend. 28

Differences Between Tokyo and Paris Tokyo Paris ØBetting slips / QR codes ØMore preparation time ØTouch screen betting terminals ØLess preparation time 29