Research3h ago
Apple Research Improves Text-to-Sounding Video Sync
Researchers at Apple developed a new framework to fix modality interference in text-to-sounding video generation. The system addresses the gap between dense training captions and concise user prompts. By refining cross-modal feature interaction, the model ensures tighter synchronization between audio and visuals. This reduces the common misalignment found in joint audio-video training.