Navigate videos - are emotions the next thing?

It really depends on a task we perform. Let's consider three tasks:

1. Find a movie of Sean Connery (either seen or not seen before by the user)

This is basically searching by attributes. An example is IMDB but some more interesting visualizations are used in e.g. FilmFinder which uses dynamic queries and a starfield display.

2. Find a video excerpt with a lion and a blond girl in it (either seen or not seen before by the user)

This task is a bit more complicated.

Christel and Martin (Information Visualization within a Digital Video Library) wrote:

Through the use of speech recognition (transcripts of speech), image processing (key frames of each camera shots), and natural language processing (headline generation), the digital video can be:

  • segmented into smaller pieces; each segment consists of a contiguous range of video and/or audio (or an extent of text such as a paragraph or chapter) that is deemed conceptually similar
  • analyzed to derive additional data (metadata) for creating alternate representations of the video
  • augmented with indices for fast searching and retrieval of segments

Several of these ideas are used in today's products. Key frames are used in e.g. iMovie. You tube has allowed users to add tags to videos which allows social tagging of videos.

Another interesting idea is to navigate videos by emotions. The idea is to record one's emotions via facial expressions and then let navigate that video by simply by remembering a feeling. Which opens new ideas to automatically gathered SOCIAL TAGS of FEELINGS. Imagine You Tube (or TV) record emotions of users (anonymously of course) and store these emotions in a database. People wouldn't even have to tag Now I want to see the top 10 movies in which people cried a lot. I want to see only funniest excepts of another movie. I want to ....

For several other possibilities read the Future applications in FAQ.


Trackback specific URI for this entry

This link is not meant to be clicked. It contains the trackback URI for this entry. You can use this URI to send ping- & trackbacks from your own blog to this entry. To copy the link, right click and select "Copy Shortcut" in Internet Explorer or "Copy Link Location" in Mozilla.

No Trackbacks


Display comments as Linear | Threaded

No comments

Add Comment

Enclosing asterisks marks text as bold (*word*), underscore are made via _word_.
E-Mail addresses will not be displayed and will only be used for E-Mail notifications.

To prevent automated Bots from commentspamming, please enter the string you see in the image below in the appropriate input box. Your comment will only be submitted if the strings match. Please ensure that your browser supports and accepts cookies, or your comment cannot be verified correctly.

Can you please write (or copy/paste) this text in the field below: i h a t e s p a m