Choose your language

Choose your language

The website has been translated to English with the help of Humans and AI

Dismiss

Revolutionize Live Broadcasts with AI-Powered, Real-Time Content Segmentation

AI AI, Emerging media, VR & Live Video Production 4 min read
Profile picture for user Lewis Smithingham

Written by
Lewis Smithingham
SVP of Strategic Industries

The facade of the IBC convention hall is depicted. Large banners outside display text reading "Badge Collection," "Entrance," and "Redefining Media Leading Innovation." A futuristic image of a person wearing a virtual reality headset is featured. The foreground has a sign that reads "Welcome to IBC2024." People are gathered near the entrance, and a traffic cone is visible on the wet pavement.

We’ve just returned from IBC, the largest trade show and convention for broadcasters, and this year’s event was a whirlwind of innovation and cutting-edge technology. We had the opportunity to explore the latest advancements from industry leaders like NVIDIA and AWS, and I’m proud that we also showcased our own groundbreaking developments, including the debut of a new AI-powered product, StreamSearch.Flow.

StreamSearch.Flow is an advanced AI technology tailored for live broadcast environments, enabling broadcasters to pinpoint and segment particular objects, brand logos, keywords and more as they appear in content in real time. It isn’t just visuals that StreamSearch.Flow picks up; it can also recognize designated words within the audio stream, ensuring content—like real-time highlights, post-event recaps and more—is curated with precision.

Effortlessly capture and segment the content your fans crave.

While content segmentation itself isn't entirely new, StreamSearch.Flow stands out by offering broadcasters the capability to perform these tasks instantaneously during a broadcast. This means broadcasters are no longer limited to curating highlights post-broadcast, but can instead enhance viewer experience dynamically as events unfold, seamlessly delivering the output to live audiences across streaming channels.

This unique functionality is powered by NVIDIA Holoscan for Media, an AI-enabled, software-defined platform for live media. Additionally, StreamSearch.Flow integrates seamlessly with Monks.Flow, our professional managed AI service, providing broadcasters with a robust and comprehensive AI solution that enhances live broadcast operations effortlessly.

Why does this matter? Well, imagine being able to compile highlight reels based on precise criteria, such as capturing every slam dunk made by a basketball player wearing a specific brand's shoes. Or using real-time content segmentation to manage brand safety by instantly censoring inappropriate content, such as foul language, whether it's spoken or displayed on signs in crowd shots.

Similarly, StreamSearch.Flow can be used to verify how long a brand is featured for product placement or other sponsorship opportunities. For instance, during a morning show cooking segment, it can measure and verify the screen time devoted to a branded cooking product, ensuring that it receives the intended exposure in alignment with the brand's marketing goals. Similarly, in the context of a sponsored event, you could track the duration that a brand's logo is displayed on screen—confirming that it meets the agreed-upon airtime in the sponsorship agreement and, thus enhancing accountability and trust between sponsors and the broadcast team.

Each of these above use cases are possible, whether you’re streaming over the airwaves or on platforms like TikTok, Facebook Live, YouTube Live, Twitch and more. So, how does it all come together? Let’s look under the hood.

The Monks booth at IBC. The booth displays the text "Software-Defined Personalization Through Gen AI" and "Camera to Consumer." The setup includes three computer monitors. To the right, a large screen shows an image of a person wearing a coat, standing outdoors near a modern architectural structure.

IBC 2024 attendees had the chance to see StreamSearch.Flow and other demos in action at our booth.

Software-defined production paves the path for AI transformation in broadcast.

StreamSearch.Flow uses a highly adaptable large language model that can be tailored to meet the specific needs of a brand. By training the model to recognize keywords, logos or other content, broadcasters can ensure that their (or their audience’s) unique objectives are captured with ease. And because the model is trained specifically for their needs, brands mitigate the risk of sharing data with a publicly trained model, ensuring that sensitive information remains protected and proprietary.

AI tools like this thrive on software-defined production pipelines, which involve software to control and manage production processes in a way that is both flexible and automated. This replaces the traditional single-use hardware found in control rooms with versatile software applications. By integrating digital technologies instead—on premises or in the cloud—broadcasters can optimize their manufacturing and production workflows while reducing their physical footprint.

Traditionally, software-defined production involves using multiple virtual machines in the cloud, with each machine running a single software application due to the individual CPU requirements. Holoscan for Media enhances this approach through containerization, allowing multiple applications to share compute resources such as GPUs, CPUs, and RAM. This not only reduces the overall resources required but also facilitates lower latency and higher video quality. The efficiency of shared resources translates directly into superior performance and cost savings.

Holoscan for Media’s repertoire of applications for containerization is continuously expanding, with a substantial amount of software already containerized for broadcast pipelines. This makes it an ideal choice for us and our clients, supporting our vision that containerization will define the future of broadcasting by enabling functionality like StreamSearch.Flow.

A group of people gather around a robotic alien dressed in a beret and red scarf, holding a red apple, at a trade show. The puppet is seated at a small table, engaging with a seated woman in the foreground by drawing her portrait. Various exhibitors and displays are visible in the background.

In addition to seeing StreamSearch.Flow, attendees could have their portrait drawn by our robotic alien sketch artist, Sir Martian.

Keep ahead of emerging viewing habits and cultural affinities.

The ability to segment content in real time opens a new world of possibilities for enhancing viewer engagement. For example, broadcasters can move beyond traditional demographic categorizations, curating content that resonates with viewer interests and cultural affinities. This personalized approach ensures that the content delivered aligns more closely with what audiences truly care about, such as the sneaker-themed basketball highlights mentioned above, thereby offering new and exciting advertising opportunities for brands looking to sponsor tailored content.

Additionally, streaming platforms can act on the consumption data they have collected from viewers to provide highly targeted and personalized viewing experiences that reflect individual preferences. This level of customization not only enhances viewer satisfaction but also helps validate viewer identities, accommodating interests that might not traditionally fit within traditional broadcast contexts—like the intersection of fashion or music with sports.

As viewing patterns and demographics shift, particularly among audiences who prefer social platforms for viewing highlights rather than live events on TV, StreamSearch.Flow enables broadcasters to adapt seamlessly and maintain relevance with their younger, more digitally savvy fans.

The broadcast landscape is evolving. Are you ready for it?

Software-defined production is revolutionizing the broadcast industry, enabling broadcasters to work more efficiently and effectively than ever before. With the growing adoption of Holoscan for Media, broadcasters are empowered to take greater control of their workflows, enhancing their ability to deliver new and engaging viewing experiences to their audiences.

StreamSearch.Flow exemplifies the seamless integration of AI technology into broadcasting, helping broadcasters provide hyper-relevant content that resonates deeply with viewers. As the developer of one of many innovative technologies driving this transformation, we seek to demonstrate the potential of AI to reshape how content is curated and consumed.

We’ll continue to push the boundaries of what's possible in broadcasting, leveraging the latest technology from partners like NVIDIA to bring about the next wave of technological advancement—all to deliver cutting-edge solutions that meet the evolving needs of broadcasters and their audiences.

Related
Thinking

Make our digital heart beat faster

Get our newsletter with inspiration on the latest trends, projects and much more.

Thank you for signing up!

Continue exploring

Media.Monks needs the contact information you provide to us to contact you about our products and services. You may unsubscribe from these communications at any time. For information on how to unsubscribe, as well as our privacy practices and commitment to protecting your privacy, please review our Privacy Policy.

Choose your language

Choose your language

The website has been translated to English with the help of Humans and AI

Dismiss