Amazon Nova fuels F1-inspired AI racing experience for fans

Amazon Nova is powering the Real-Time Race Track (RTRT), an interactive Formula 1-inspired experience that lets fans design custom racing circuits while receiving AI-generated strategic insights and shareable racing posters. The multimodal AI platform addresses growing fan expectations for participatory sports content by combining text, speech, image, and data processing in real-time while maintaining cost-efficiency for scalable deployment.

What you should know: The RTRT transforms passive F1 viewers into active participants through a comprehensive circuit design experience powered by Amazon Nova’s multimodal capabilities.

• Fans can draw racing tracks of different lengths and shapes while receiving real-time AI recommendations for modifications.
• Amazon Nova Pro analyzes completed tracks to generate metrics like top speed, projected lap times, and two viable race strategies focused on tire management.
• Users can consult Amazon Nova Sonic, a speech-to-speech model, for strategic track design recommendations.
• The experience concludes with Amazon Nova Canvas creating retro-inspired racing posters that users can download and share.

Why this matters: Modern sports audiences expect interactive, customizable experiences rather than passive viewing, creating both opportunities and technical challenges for brands and rights holders.

• Static digital content no longer captures attention as fans gravitate toward immersive formats that allow them to influence or co-create event aspects.
• Delivering real-time, multimodal engagement requires seamless integration of text, speech, image, and data processing while maintaining cost-efficiency for free fan experiences.
• Amazon Nova models provide cost-effective solutions with “among the best price-performance in their respective class” for scalable fan engagement.

How it works: The system uses sophisticated prompt engineering and multimodal inputs to transform simple line drawings into comprehensive racing circuit analyses.

• Each track segment includes visible coordinate markers that enable Amazon Nova Pro to perform accurate path analysis and generate color-coded track sectors.
• Multiple system prompts define Amazon Nova Pro’s role at different stages while ensuring responses are ready for front-end consumption.
• Location-based customization allows users to select any global location, with Amazon Nova Pro generating appropriate track names and simulating realistic conditions using regional weather and climate data.

Technical implementation: The architecture combines vision analysis, strategic recommendations, and creative generation through carefully crafted prompts and conditioning images.

• Vision analysis processes user drawings with coordinate markers to produce structured output for UI integration.
• Prompt examples include specific instructions: “The system is designed to analyze the input image of a completed racetrack path outline. You must always return valid JSON.”
• Amazon Nova Canvas uses conditioning images and bold illustration prompts to create consistent, aesthetically appealing racing posters without sponsor logo complications.

What they’re saying: The collaboration demonstrates practical applications of generative AI in sports entertainment.

• “Today’s sports audiences expect more than passive viewing—they want to participate, customize, and share,” the authors explain regarding evolving fan expectations.
• The system employs responsible AI practices by “instructing the model not to generate content that might infringe on existing race tracks or other copyrighted material.”
• Jake Friedman, President and Co-founder of Wildlife, co-authored the post, bringing expertise from work recognized with the Titanium Grand Prix at Cannes Lions for “boundary-busting, envy-inspiring work.”