VideoDB Documentation

Quick Start Guide

Timeline and Assets

Ashutosh Trivedi

Timeline capabilities, allows for the editing of video streams in real time ⚡️. It's like having a straightforward yet powerful interface for a video editor that can be operated in real time, seamlessly integrated with your AI systems.

But first, let's talk about an exciting upgrade to our upload function. 👉 We now support the uploading of any type of audio and image files to VideoDB making it a truly multimedia database. Whether they are sound effects 📢, music files 🎼, podcasts 🎤 or logos 🌁 VideoDB automatically recognizes the file type, eliminating the need for you to specify whether the file or URL is audio, video, or image.

audio = conn.upload(url='audio link')

Timeline

You can now craft programmatic compilation streams with audio, image overlays using your video data in VideoDB. This introduces innovative personalization of video streams in real time.

The Timeline object provides you with two methods: add Asset objects inline using the add_inline function, and incorporate an overlay using the add_overlay function.

⁠

⁠

Assets

Here’s more information about Asset objects: Assets such as VideoAsset and AudioAsset objects can be generated from any uploaded content. There is no limit to the number of assets you can create. To define any asset, you must provide the identifier of the media and specify the segment of the media with start and end parameters.

⁠

⁠

These assets can be attached to the timeline either inline or as an overlay, allowing you to compile the timeline and instantly generate a new video stream.

⁠

Quickstart

First, update you SDK.

!pip install -U videodb

Here’s a sample snippet to get you started 👉

# Assets, Timeline

from videodb.asset import VideoAsset, AudioAsset, ImageAsset

from videodb.timeline import Timeline

# get video and audio [ These are random IDs please change ]

video = collection.get_video('m-7b104a71-a761-4b63-aad8-2d00738fbf4a')

audio = collection.get_audio('m-7b104371-g761-5b63-aad8-2d00738fbf4')

timeline = Timeline(conn)

video_asset = VideoAsset(

asset_id=video.id,

start=0,

end = 20

)

video_asset_2 = VideoAsset(

asset_id=video.id,

start=1900,

end = 2000

)

audio_asset = AudioAsset(

asset_id=audio.id,

start=0,

end=0.2,

disable_other_tracks=True,

fade_in_duration=0,

fade_out_duration=0,

)

# add inline assets

timeline.add_inline(video_asset)

timeline.add_inline(video_asset_2)

# add overlay at 20 sec mark in timeline.

timeline.add_overlay(20, audio_asset)

stream_url = timeline.generate_stream()

play_stream(stream_url)

Limitations

In a scenario where two or more overlay objects cannot overlap, it is necessary to perform calculations to ensure that the duration of previous overlay objects does not extend beyond the start time on the timeline. This is a common requirement in video editing, particularly in a two-track editor setup.

⁠

⁠

Video assets must be added sequentially; it is currently not possible to overlay a video asset on top of another video or audio.

⁠

⁠

Audio assets cannot be added sequentially.

⁠

⁠

We plan to maintain the limitation of two tracks for the foreseeable future, unless there is significant demand to increase this number. Our goal is to keep the timeline simple and prioritize automation.

⁠

Pro Tip

If you wish to extract audio from a video, please specify this in the "media_type" field. For instance, you can obtain audio from a YouTube video by doing so.

from videodb import MediaType

audio = conn.upload(url="https://youtu.be/IoDVfXFq5cU?si=BCU7ghvqY3YdCS78", media_type=MediaType.audio)

The types of media that can be uploaded are defined in the MediaType class.

⁠

Examples and Tutorials

Leveraging the capabilities of automation and AI-driven content understanding, the possibilities for creation and repurposing of your content are boundless with VideoDB.

We will soon be adding numerous tutorials on our GitHub related to content automation. Keep an eye on our

Discord server⁠

for regular updates.

Audio Overlays

⁠

Beep curse words in real-time⁠

Automatically detect and beep out curse words in a video.

Dub Audio in Multiple Languages:

⁠

Dubbing - Replace Soundtrack with New Audio⁠

Utilize services like Eleven Labs and Heygen to generate new audio tracks.

Apply techniques for background noise removal or voice amplification.

Create Compilations

Personalized Greetings: Use AI-generated audio to replace the user's name in a greeting like "Hey X, thanks for watching this video".

Add Music to Any Video

Enhance scenes with background music, such as adding intense music when a scene gets thrilling.

Incorporate a laughter track during funny moments in stand-up comedy videos.

Looping of Videos and Audios

Create humorous loops, such as Mark Zuckerberg repeating "meta, meta," or Sundar Pichai saying "AI, AI" in a speech.

Loop funny face turns in videos.

Produce music sampling videos with meme-like loops, inspired by creators like Yashraj Mukhate.

If you haven’t checked, last week, we introduced

StreamRAG⁠

, which links your VideoDB to ChatGPT.

Stay tuned for more innovative ways to repurpose and enhance your content using VideoDB's automation and AI-driven features 🤘

Want to print your doc?
This is not the way.

Try clicking the ⋯ next to your doc name or using a keyboard shortcut (

CtrlP

) instead.