VideoDB Documentation

VideoDB Documentation

Open Source Tools

PromptClip: Use Power of LLM to Create Clips

Ashutosh Trivedi

PromptClip is your new superpower for video editing with prompts. While editing, we all wanted to find that perfect moment in a video with ease. 👋🏼 Say goodbye to manually skimming, seeking the video and say hello to instant, AI-driven video consumption and creation

LLMs are great with text, but they don't help you consume or create video clips. We've got

⁠

PromptClip⁠

: an open source repo to get you started on AI driven video editing. For example, you can just say —

“Find the moment where Mr. Bean is attempting to cheat by peeking at the answer sheet of the man beside him”

⁠

Load content from console.videodb.io? Loading external content may reveal information to 3rd parties. Learn more Allow⁠

⁠

Process

Use natural language to describe the what you want.

Run prompts on the visual scenes and spoken content with the choice of your LLM.

Instantly get video compilation stream from VideoDB.

⁠

Download PromptClip

⁠

Get your API key from the

VideoDB console⁠

(Free for first 50 uploads, no credit card required 🎉)

Set Up Your Environment:

Add your VIDEO_DB_API_KEY to the .env file

Include your preferred LLM API key (OPENAI_API_KEY or ANTHROPIC_KEY) in .env

Install: Run pip install -r requirements.txt

Explore: Launch the Jupyter notebooks to start experimenting:

Create clips using only spoken content in the video

⁠

Create clips by analysing visual content in the video

⁠

Using combined audio-visual analysis

⁠

PromptClip in Action:

⁠

Prompt: Find every moment where a deal was offered

⁠

Load content from console.videodb.io? Loading external content may reveal information to 3rd parties. Learn more Allow⁠

⁠

Source: Shark Tank (

https://www.youtube.com/watch?v=HpUR7-Oe1ss⁠

)

⁠

Prompt: Show me moments in the video where the host discusses or reveals the pricing of the gadgets.

⁠

Load content from console.videodb.io? Loading external content may reveal information to 3rd parties. Learn more Allow⁠

⁠

Source: Useful Gadgets (

https://www.youtube.com/watch?v=bGmXrMW9ucU⁠

)

⁠

2. Visual/Scene Analysis

Prompt: Find the moment where Mr. Bean is attempting to cheat by peeking at the answer sheet of the man beside him

⁠

Load content from console.videodb.io? Loading external content may reveal information to 3rd parties. Learn more Allow⁠

⁠

3. Using both Visual and Spoken

Prompt : Find scenes explaining cricket rules using infographics

⁠

Load content from console.videodb.io? Loading external content may reveal information to 3rd parties. Learn more Allow⁠

⁠

Why PromptClip Will Transform Your Work

Efficiency: Reduce hours of manual video searching to mere seconds.

Creativity: Generate fresh perspectives and ideas from your existing content.

Precision: Extract exactly what you need, not just approximate matches.

Flexibility: Works with various video types, topics, and

languages.⁠

⁠

PromptClip is more than a tool; it's a new way of content interaction — The natural language way! Whether you're a content creator, researcher, or developer, PromptClip empowers you to unlock the full potential of your video content.

Watch PromptClip in Action

⁠

Here you can check more PromptClip examples

Prompt: “Find details about every sponsor”

⁠

Prompt: "Find sentences where anxiety is discussed"

⁠

Prompt: “How to control sugar cravings”

⁠

The Magic Behind PromptClip: VideoDB's Indexing Methods

⁠

PromptClip leverages VideoDB's advanced indexing techniques and Large Language Models (LLMs) to analyze and manipulate video content with unmatched power.

1. Spoken Word Indexing

Process: VideoDB transcribes the audio content and creates a searchable index of spoken words.

Implementation: Uses advanced speech recognition algorithms to generate accurate, transcripts.

2. Visual/Scene Indexing

Process: Analyzes video frames to identify objects, actions, and scene compositions.

Implementation: Employs sophisticated scene extraction algorithms and vision models for comprehensive visual understanding.

Customization: Allows for different extraction algorithms and custom prompts for scene description. Find detailed documentation for it in our

Scene Index Guide.⁠

⁠

Join the VideoDB Community

⁠

Your ideas drive PromptClip's evolution. Get involved:

Report issues or suggest features or contribute code via pull requests on our

Github

⁠

Share your innovative use cases on

Discord

⁠

For more information and support, refer to the

VideoDB documentation⁠

⁠

Want to print your doc?
This is not the way.

Try clicking the ⋯ next to your doc name or using a keyboard shortcut (

CtrlP

) instead.