Bose Frames With Bose AR: Gesture-Input For Interactive Audio
Project Overview
Led the partnership between Earplay and Bose for the launch of Bose Frames smart glasses, creating one of the first gesture-controlled interactive audio experiences. This innovative collaboration showcased the potential of combining spatial input with voice commands for storytelling, establishing new standards for wearable entertainment technology.
Strategic Innovation
- Hardware Integration: First interactive audio story platform to integrate spatial gesture recognition with voice commands
- Launch Partnership: Selected as key launch partner for Bose Frames debut at SXSW
- Platform Evolution: Successfully expanded Earplay’s capabilities to include hardware-based gesture recognition
- Event Integration: Featured at CES and SXSW, demonstrating next-generation interactive entertainment
Role Details
- Partnership & Business Development Lead
- Technical Integration Oversight
- Product Strategy Development
- Launch Coordination
- Content Production
Project Leadership
Partnership Development & Management
- Negotiated and secured development funding through strategic partnership with Bose
- Managed relationship from initial pitch through successful public launch
- Coordinated with Bose’s hardware and software teams for SDK integration
- Selected as one of three partners for CES demonstration installation
Product Innovation
- Produced the “Head Games” interactive story specifically for gesture controls
- Created seamless user experience combining voice and spatial inputs
- Developed new onboarding flow incorporating hardware calibration
- Established QA protocols for hardware-software integration
Technical Development
- Architected integration of Bose SDK with Earplay iOS application, creating a first-of-its-kind system combining spatial recognition with voice commands
- Developed comprehensive gesture recognition framework translating head movements into story interaction inputs
- Implemented robust calibration methodology and onboarding system ensuring consistent user experience
- Created modular interaction framework supporting simultaneous voice and gesture inputs with extensive testing protocols
- Established QA standards for hardware-software integration, working closely with Bose engineering team
Launch Strategy
Event Progression
- Internal Bose Demonstration
- Developed and presented prototype experience
- Showcased potential of gesture-based storytelling
- Secured position as strategic launch partner
- CES Preview Installation
- One of three selected partners for retailer demonstrations
- Presented technology to key Bose partners and customers
- Validated market potential for gesture-based stories
- SXSW Public Launch
- Coordinated content release with hardware availability
- Demonstrated technology to public audience
- Successfully launched “Head Games” in Earplay app
Intro Audio
Head Games
Project Impact & Innovation
Platform Expansion
- Expanded interactive storytelling to include gesture controls
- Created new standards for wearable entertainment
- Demonstrated viable use case for smart glasses technology
- Advanced capabilities of audio storytelling platform
Technical Achievements
- Established methodology for hardware-software integration
- Created reusable gesture recognition systems
- Developed multi-input story advancement framework
- Built scalable platform for future hardware partnerships
This pioneering collaboration showcased the potential of combining spatial and voice inputs in interactive storytelling while setting new standards for wearable entertainment technology. Through innovative technical implementation and strategic partnership management, we successfully expanded the possibilities of interactive audio experiences across new hardware platforms.