Kaiber’s new app helps artists create music videos using generative AI tools

Key Takeaways:

– Kaiber is a generative AI creative studio that has launched a new mobile app.
– The app offers AI tools for creators, musicians, and artists, including text-to-video, image-to-video, and video-to-video.
– Kaiber leverages open-source projects and proprietary technology to create artistic tools.
– Users can upload images/videos or type in their own ideas to generate animated content.
– Kaiber offers two animation styles: “Flipbook” and “Motion.”
– Users can customize camera movement, aspect ratios, and video duration.
– The app allows users to add their own music and includes an Audio Reactivity feature.
– Kaiber has partnered with three independent artists to launch a “Create with” feature.
– Creators who pay for an account own the videos they make.
– Kaiber offers an affiliate program with a 10% commission on subscription referrals.
– The app is available on iOS and Android devices with a seven-day free trial.
– Users must choose from three subscription tiers: Explorer, Pro, and Artist.
– Kaiber came out of beta with over two million users and has more than five million sign-ups.
– The company’s studio technology has supported over two million artists, including Kid Cudi and Linkin Park.
– Kaiber is bootstrapped and reported seven figures in gross revenue in its first few months.
– The founders, Victor Wang and Eric Gao, are childhood best friends who started Kaiber after their previous startup, Secret Garden, folded due to the FTX crash.

TechCrunch:

Kaiber, the generative AI creative studio behind the music videos of popular artists Kid Cudi and Linkin Park, announced today the launch of its new mobile app to give creators, musicians and artists a range of AI tools, including text-to-video, image-to-video and video-to-video.

Founded in 2022, Kaiber leverages various open-source projects like AnimatedDiff, Automatic1111, ControlNet and Deforum, among others. It also touts a proprietary layer of technology to fuse it all together into one artistic tool.

Like other AI video generators (Runway, Meta’s Make-A-Video and Google’s Imagen Video) Kaiber allows users to either upload images/videos or type in their own ideas to generate animated content.

Kaiber offers two types of animation style—”Flipbook,” a frame-by-frame effect, or “Motion,” a fluid style where content smoothly transitions between frames. Users can describe how they want the video to look or select from Kaiber’s pre-prompted subjects and styles.

Kaiber allows users to customize the camera movement, whether they want the animation to zoom in/out, rotate clockwise or counterclockwise or move up, down, left or right. There are also different aspect ratios, depending on which platform the creator wants to upload the video. For instance, 16:9 for YouTube, 9:16 for TikTok and 1:1, 3:4 or 4:3 for Instagram. The longest video duration allowed is eight minutes, but the company plans to support longer videos in the future. Videos take 30 minutes to generate.

Image Credits: Kaiber

Additionally, users can also add their own music, making the app an affordable alternative for independent artists who don’t want to pay an animation studio hundreds of thousands of dollars for just one video. Plus, Kaiber includes an Audio Reactivity feature, meaning the output responds to whatever audio the user uploads.

“Our mobile app brings Kaiber’s core capabilities — such as text-to-video, image-to-video, and video-to-video — into a compact, user-friendly format,” co-founder and CEO Victor Wang told TechCrunch.

Wang added, “While some advanced tools like comprehensive storyboarding and specific text-to-video models remain web-exclusive, customers should expect feature parity very soon.”

Alongside the app launch, Kaiber has partnered with three independent artists to launch a “Create with” feature, which is exclusive to the mobile experience. Users can create content using music and generative AI styles catered to each artist.

Notably, one artist is the co-founder and CTO of the company— Eric Gao, whose stage name is Oksami. He has over 53,000 Spotify listeners and nearly 58,000 YouTube subscribers. Users can sample four of his most popular songs, including Midnight Diner, which has over one million streams on Spotify. The two other artists featured on the app are Yung Bae and August Kamp.

Regarding commercial rights, creators who pay for an account own the videos they make. Users with free accounts get a Commons Noncommercial 4.0 Attribution International License, meaning they have permission to use the content but can’t sell it. Videos made with a free account will come with the Kaiber logo watermark.

Kaiber also offers an affiliate program, which lets creators earn a 10% commission on subscription referrals. Affiliates continue to earn commission for as long as a referred customer remains a subscriber.

Kaiber’s app is available on iOS and Android devices. While there is a seven-day free trial (comes with 100 credits), users must choose from three subscription tiers: Explorer ($5/month for 300 credits), Pro ($15/month for 1,0000 credits) and Artist ($30/month for 2,500 credits). One credit equals a one-second-long video. However, the credit cost also varies depending on which feature is being used.

“Our core thesis is that the creative process is hard,” co-founder and head of creative Jacky Lu told us. “But the creative process has common denominators across all modalities like music, video, images, and other forms of art– humans make stuff in similar patterns. And to make the best art, we need intuitive and simple tools and the ability to be inspired by others. Now with gen AI, we can make art with others and with machines.”

Kaiber came out of beta this past May with over two million users and now touts more than five million sign-ups. Kid Cudi’s AI-powered lyric videos and Linkin Park’s AI music video helped put Kaiber’s name on the map, along with a viral TikTok trend called “Astral Jump.” The company’s studio technology offering — Kaiber Studios — has supported over two million artists with generative audio and video, including GrimesWu-Tang ClanMoney Man, Don Diablo and Mike Shinoda.

Kaiber is entirely bootstrapped. In the first few months of launching, the company reported seven figures in gross revenue.

Wang and Gao are childhood best friends whose mothers immigrated to America from Shanghai together. They started their first startup, Secret Garden, in February 2022 as a response to the web3 NFT craze. The company’s first sale grossed $1.2 million, profiting around $300,000, enough to seed the business. Unfortunately, however, the FTX crash wiped out Secret Garden’s funds, and they had no choice but to fold.

“The FTX.us crash tested our resilience, but our determination only grew stronger, leading to the birth of Kaiber from the ashes of Secret Garden,” Wang said. “It’s a narrative of overcoming adversity, fueled by passion and an unwavering belief in the transformative power of AI in the music and visual arts.”


Source link

AI Eclipse TLDR:

Kaiber, a generative AI creative studio known for its work on music videos for popular artists Kid Cudi and Linkin Park, has announced the launch of its new mobile app. The app provides creators, musicians, and artists with a range of AI tools, including text-to-video, image-to-video, and video-to-video capabilities. Founded in 2022, Kaiber utilizes various open-source projects and proprietary technology to merge these tools into one artistic platform. Similar to other AI video generators like Runway, Meta’s Make-A-Video, and Google’s Imagen Video, Kaiber allows users to upload images/videos or input their own ideas to generate animated content. The app offers two animation styles: “Flipbook,” which creates a frame-by-frame effect, and “Motion,” which produces fluid transitions between frames. Users can customize camera movements, aspect ratios, and video durations. Additionally, users can add their own music, making it an affordable alternative for independent artists who may not have the resources to hire an animation studio. The app also features an Audio Reactivity feature, where the output responds to the audio uploaded by the user. Kaiber has partnered with three independent artists to launch a “Create with” feature, allowing users to create content using music and generative AI styles tailored to each artist. The app is available on iOS and Android devices, and users can choose from three subscription tiers: Explorer, Pro, and Artist. Users who pay for an account own the videos they create, while free account users have permission to use the content but cannot sell it. Kaiber also offers an affiliate program, allowing creators to earn a 10% commission on subscription referrals.