Adobe adds more AI and Udio upends AI music🎵
Is Sora coming to Premiere Pro?
Total reading time around 5 minutes.
Welcome to Visually AI!
It’s been an extremely busy week for me, with several new video and music tools launching!
I apologize for the delayed newsletter, but I try to gather as much information as possible to keep you informed.
I still didn’t have time to try everything, but I can share a few things I’ve had a chance to learn about.
🔮AI News This Week
Adobe Premier Pro gets more AI
Adobe Premiere Pro is adding more AI features, including:
Object Addition & Object Removal: Use video inpainting to replace or add moving objects in a shot
Generative Extend: Add more video to the beginning or end of clips
Generative B-Roll: Quickly create placeholders and b-roll
We’re not sure when these features will be available, but Adobe threw in a HUGE teaser about the future of advanced video AI models… with Sora?
From the Adobe Blog:
“This week, at the National Association of Broadcasters conference in Las Vegas, we showed some early “sneaks” of how professional video editors could, in the future, leverage the Runway or Open AI Sora video generation models, integrated in Premiere Pro, to generate b-roll to edit into their project, or how they could use either Firefly or third-party models like Pika with the Generative Extend tool to add a few seconds to the end of a shot.”
So, we don’t know when third-party AI models like Sora, or RunwayML will be available for Adobe subscribers.
I will let you know when as soon as I find out, though!
Watch Adobe’s announcement here:
Udio
Udio is latest AI music tool and it’s been getting a LOT of attention!
Of course, it’s being compared to Suno AI and some people are choosing sides.
I wrote about Suno AI’s Version 3 last week, with a sample of my first Suno-created music track, here.
Personally, I am all for more competition, options, and types of generative AI tools, especially when they are free!
Udio is currently free and allows you to generate up to 600 songs per month.
Try Udio here.
It’s very simple to use, and you don’t need to know anything about music. Just type a short description of what you want to hear and choose Custom, Instrumental, or Auto-generated with lyrics:
When you’re finished, you can download the audio file and/or a video, like this one:
This is a link to my cinematic score for a Viking drama called “Saga of the North.”
I used that track in this video clip for a project I’m working on:
🖼️AI Visual Tools & Tech Updates
LTX Studio - My first video
I got early access to LTX Studio’s all-in-one AI video platform and I finally got a chance to test it.
You don't need experience in writing scripts or storyboards with LTX Studio.
Just describe what you want to see in your video on your homepage. Or choose one of the suggested prompts.
LTX Studio will generate characters automatically, but you can make changes to the attributes, bio, and upload an image for a Face Switch if you want a specific character.
There are several settings you can customize using the dropdown choices, or entering a description for:
Project Settings
Soundtrack
Characters
Voiceover
You can see and hear some examples of those settings and options in this quick video:
I didn’t make many edits or customize this first video, but I plan to add some of my own images and change the voices and sound effects.
I’ll share the updated version soon.
I wrote about several LTX Studio features in last week’s newsletter, here.
LTX Studio is continuing to give access to waitlist subscribers and you can join the Discord for news about early access. (waitlist) (Discord)
And, here is my first LTX Studio video:
My prompt for this video: "A film about a robot revolution"
Gemelo AI
You can create an AI Twin with Gemelo AI.
The brand describes it:
“Scale your brand’s voice and deliver personalized video at every touchpoint with your AI Twin”
Gemelo uses NVIDIA’s Maxine Live Portrait feature to generate photorealistic avatars, speech, and movements.
Gemelo AI Studio has two options for your AI Twin creation:
AI Video Twin: Upload a video of yourself speaking to train Gemelo’s AI and it creates a photorealistic twin with your voice, appearance, and mannerisms. Then, you can simply type what you want to say and it generates a realistic video, lip synced and pretty convincingly.
Synthetic Twin: Choose one of the preset avatars or upload your own to generate videos for your business or brand.
I tried it with my cloned voice and an uploaded image from Midjourney. Check it out below and tell me what you think in the comments!
You can see a comparison with my real voice in a video I posted on 𝕏, here.
You can try Gemelo AI here.
You could have your AI service, tool, or event seen by Visually AI’s community of over 9,400 subscribers:
🚀 This Week’s AI Tools
ChatSlide: Extracts information from any document and one-click AI-generated slides and accompanying videos from a simple text prompt. (link)
Voxio: AI-powered voice recorder turns your voice notes into organized, formatted Notion pages. (link)
Rendernet: Launched the Canvas feature that lets you generate unlimited images on a free-flow interface. (link)
getIMG: The AI art platform added Live Generation, AI Canvas and Image to Video features. (link)
Remix AI: Remix has some amazing features launching soon - I’ve been testing the updated app and it’s impressive. (link)
Stay tuned for more details, and take a look at this Loop result I got with the new features:
🖼️ Image Prompts
Prompt: Astronaut floating near a massive space station, Earth's curvature in the background, vivid Earth glow, complex equipment detail, outer space depth, photorealistic, sci-fi blockbuster style
Prompt: An arrangement of various citrus slices – lemon, lime, orange, and grapefruit – submerged in sparkling water, with bubbles clinging to the fruit, set against a light box for a luminous effect
🎁 Get it free: The AI Visual Creator’s Toolkit
Boost your content with my all-in-one, free visual AI toolkit!
Access AI-powered tools for AI-generated images, image editing, and more: Get your toolkit
📸 Free Gift: Realistic Photography Cheat Sheet
Prompt like a pro with easy-to-understand photography terms and example images to guide you as a reference for amazing photorealistic images.
Download your free guide: Photography Cheat Sheet
Thanks for reading, and have a creative week!