World’s first AI movie camera transforms footage in real-time

Movie making is more than just pointing a camera at a scene. It typically requires hours of editing before it’s ready for release. However, the world’s first AI movie camera can help you cut post-production time significantly. 

The CMR-M1 applies AI effects and backgrounds to footage, letting you apply your vision while filming.

READ: AI learns vocabulary from baby with a webcam

Its creators demonstrated its capabilities by using its “Snowy Illusion” setting, turning people and scenes into icy figures. The device is currently in the testing stage. 

How does the AI movie camera work?

The CMR-M1 is SpecialGuestX and 1stAveMachine’s project. The former is a creative technology agency, and the latter is a global mixed-media production company. 

UK-based publication Little Black Book says the AI movie camera’s name stands for Camera Mark 1. Also, it drew inspiration from the Ciné Kodak, the world’s first 16mm movie camera. 

The CMR-M1 works like a traditional film camera but has professional features like interchangeable lenses and a tripod base.

More importantly, it records real images and sends them to a cloud server, where Stable Diffusion applies a specific AI effect. 

This unique camera has five Stable Diffusion style cards called LoRA (Low-Raking Adaption). Moreover, it has a wheel that lets an operator switch between real and AI overlays.

This prototype is not for sale because it is part of SpecialGuestX’s research to create physical interfaces for generative AI. However, it may enter commercial use as it improves further. 

“We believe that movie creation is inherently physical. Filmmakers are used to using cameras, lenses, tripods, and lighting, and AI has to be a new tool that enhances creativity,”  said Miguel Espada, co-founder, and executive creative technologist of SpecialGuestX. 

“In the spirit of creative experimentation, we designed a camera that serves as a physical interface to AI models.”

“The CRM-M1 is a prototype for how hands-on creators will use AI rather than sitting at a keyboard,” said Sam Penfield, EP partner of 1stAveMachine.

Read more...