Automate today for a better content tomorrow:

Transcription

1 Automate today for a better content tomorrow: AI applied to MAM systems Toni Vilalta Product Manager VSN

2 Introduction VSN is a global technology company specialized in providing advanced solutions for the broadcast and media sector. It offers solutions based on standard IT infrastructure solving the needs of creation, distribution, and management of audiovisual content in TV channels, public institutions, IPTV, universities, contents distributors and news agencies. I m a Telecommunications Engineer with a long experience as TV consultant and Project Manager for TV stations around the world. At VSN, I m in charge of the supervision, coordination and definition of new solutions, and of the continuous improvement of the existing ones, in direct contact with the Marketing, Sales, Operations and Development teams.

3 AI, Myth or reality? Global invest in Artificial Intelligence (AI) is expected to exceed US$100 billion in 2018 (Riot Research) It is growing at a compound annual rate of 15.4%, and it could reach nearly $1 trillion in revenues by 2050 (Morgan Stanley) Of the 500 IT professionals surveyed, 38% claimed that AI was the primary focus of emerging tech (Forbes/SADA systems) Artificial Intelligence / Machine Learning was ranked the 7th most commercially important trend to broadcast and media technology end-users in Devoncroft s 2018 BBS Broadcast Industry Global Trend Index.

4 AI, Myth or reality?

5 Is it worth investing in AI? Source: BBC, Artificial Intelligence in Broadcasting

6 Use Case: Journalism Innovation Hub (RTVE) ALMAGRO FESTIVAL Ingest FTP Upload to MAM MAM in Cloud Producers WATCHFOLDER Documentalists API Request Catalogged Content AI CLOUD SERVICES PROVIDERS Google Cloud Platform Microsoft Azure IBM Watson

7 Journalists & Producers Workflow Ingest from cameras & mobiles Advanced Intelligent Searches based on AI analysis Preview all ingested media Retrieve & Edit Cut Selections based on AI results Distribution of the consolidated material to several sources (web, playout, archive, )

8 Documentalists Workflow Review AI metadata results Real-time detection & recognition Video/audio transcription in several languages Validate proposed automatic metadata (terms, objects, faces, ) Archive & Retrieval

9

10

11

12 Analysis of the Results (Google API) Speech to Text API Type of Audio # words % Correct % Missing % Error Ambient ,64 21,13 52,23 Statements ,37 4,28 48,09 Interview ,28 8,82 7,90 Voiceover ,03 0,81 4,16

13 Analysis of the Results (Google API) Natural Language API Type of Entity # identified entities # unique entities % Correct entities Person % Organization % Event % Location % Consumer Good % Work of Art %

14 Analysis of the Results (Google API) Video Intelligence API Number of labels detected % Correct labels ,94

15 Automate today for a better content tomorrow: Some key features of AI nowadays in MAM systems Automatic metadata detection Advanced searches of content Content moderation Face recognition / detection Objects detection, audio effects,.. Brand detection, OCR, physical locations, Speech-to-text transcription, audo-translation Sentiment Analysis

16 Results of FIAT / IFTA Survey (2017)

17 What about AI applications in MAM systems in the near future? Everyday search databases will include AI Auto-roughcut / Auto-assembly Smart links to online DB s via object/facial recognition Auto-advertising based on brand recognition Auto-fill of edit timeline based on context Captioning & Subtitling Workflows Intelligent ads insertion, automatic segmentation for Broadcast The power of metadata. Monetize local databases

18 Is it worth investing in AI? - A.I. should continute to grow (as more media companies use it) - Richer metadata will improve content value - More content, for less cost

19 Thanks!