BALTIMORE—NewsON, Sinclair’s news app that provides local news streamed live and on-demand from more than 280 local TV stations nationwide, has teamed up with Mindgrub to launch an Apple Vision Pro app for the service, marking Sinclair’s first foray into spatial computing specifically for local news delivery, “blending digital content with physical surroundings,” the companies said.

As Sinclair’s first spatial computing app built natively for Vision Pro devices, the NewsON app for Vision Pro introduces a unique “Newsroom immersion” feature, leveraging spatial aspects of the Vision Pro for displaying interactive news maps and a complete immersive environment.

NewsON’s Vision Pro app features partnerships with over 280 local TV stations in TV markets covering more than 90% of U.S. households and provides access to on-demand newscasts and short form story clips from local TV stations nationwide.Powered by RealityKit and SwiftUI, NewsON’s Vision Pro app also offers photorealistic 3D renderings and intuitive user experiences, Sinclair said.

“We’re always looking to embrace new outlets and ways of presenting local TV news and we’re excited to work with the team at Mindgrub to explore the possibilities of augmented reality in our new Vision Pro app. This is much more than just a repurposed mobile app. We’ve developed a native visionOS user experience and are excited to see how news audiences engage with this new form factor,” said Ron Stitt, VP and General Manager, NewsON.

“The possibilities with Apple Vision Pro are limitless, and we are thrilled to be at the forefront of exploring its potential. This collaboration with NewsON really highlights our commitment to innovation and pushing the boundaries of digital media,” said Mindgrub Founder & CEO Todd Marks.

Lauren Herda, Interactive Art Director at Mindgrub, highlights the app’s geospatial features, noting: “One of the major benefits of this app is that if something big is happening, you can find the station on our interactive map, and easily go directly to where news is happening,” said Lauren Herda, Interactive Art Director at Mindgrub, highlighting the app’s geospatial features.

Since its retail launch at the beginning of February 2024, Apple has reportedly sold less than 400,000 of the Apple Vision Pros, which retail for $3,500.

NEW YORK and ATLANTA—CBS News is teaming up with The Weather Channel to offer enhanced weather news and information to its viewers, the two companies announced today. 

The Weather Channel will provide its Emmy Award-winning Immersive Mixed Reality (IMR) technology to give CBS News viewers a "Virtual View" into American communities' weather conditions. Originating from TWC’s Atlanta studios, its IMR technology allows viewers to visualize future weather forecasts—to see how snow, rain, floods or tornadoes can affect a community before the conditions arrive. The partnership also draws upon live reporting from meteorologists Stephanie Abrams, Jim Cantore and Mike Bettes, as well as the entire Weather Channel meteorological and newsgathering team.

(Read: How The Weather Channel Virtually Destroyed its Studio)

The Weather Channel's reports will be featured during CBS News' award-winning morning and evening newscasts, "CBS Mornings," "CBS Saturday Morning" and "CBS Evening News with Norah O'Donnell." CBS News' 24/7 digital streaming news service will also showcase regular reports from The Weather Channel. 

The CBS News investigative team and the Weather Channel's meteorological and newsgathering teams will also partner on special investigative climate reports.

"By bringing together CBS News and the Weather Channel's weather teams and virtual view technology, we will not only be able to forecast the weather but show viewers what it's really going to look like," said Neeraj Khemlani, president and co-head of CBS News and Stations. "This is a holistic partnership that brings together the scale of both companies' reporting teams, technologies and audiences. In addition to the virtual forecasts and live reporting, we will also collaborate on field reporting and pair our investigative teams to expand our environmental investigative efforts. Together we will deliver deeper coverage of one of the most important stories of our time — the impact of the climate on the communities we live in."

"This year, the Weather Channel celebrates its 40th anniversary, and there's never been a more important time to provide viewers cutting-edge visual presentations and compelling storytelling about our weather," said Byron Allen, founder, chairman and CEO of the Weather Channel's parent company, Allen Media Group."This new collaboration is designed to offer the CBS News audience the most innovative weather reporting, as well as greater reach for the Weather Channel's brand. CBS News and the Weather Channel will work closely together to explore and investigate issues related to climate and our environment."

ATLANTA—The Weather Channel is now able to offer first-hand, virtual looks at what the weather in a city or town will be like with the new Virtual Views feature, an immersive technology offering hyper-realistic visualizations.

Based on The Weather Channel’s Immersive Mixed Reality (IMR) technology, Virtual Views transports the network’s on-camera meteorologists to cities to showcase the forecasted weather specific to that city before it happens. The technology debuted during an “AMHQ” segment, where meteorologist Stephanie Abrams previewed a rainy Miami that was forecasted for later that day.

Virtual Views is part of The Weather Channel’s IMR Weather Studio. Virtual Views combines HDR imagery, 3D LiDAR scanning and IMR to produce the virtualized scenes used during these segments. The Weather Channel can control the weather and visually display conditions using real-time data.

Weather Channel plans to integrate Virtual View IMR segments into its daily live programming and forecasts. It plans to feature landscapes/backdrops from around 50 U.S. cities.

ATLANTA—On June 20, 2018 The Weather Channel blew away its viewers by apparently bringing a tornado into its studio. With the help of 3D augmented reality graphics rendered by The Future Group’s Frontier graphics creation system (processed and played out by Ross Video’s UX control system) and Mo-Sys’ camera tracking system, TWC meteorologist Jim Cantore appeared to experience the real-time ravages of a tornado in-studio as it progressed from an EF0 (Enhanced Fujita scale; winds 65-85 mph) to an EF5 (winds over 200 mph).

As the twister intensified, TWC viewers saw Cantore jump back from a falling electrical pole pulsing with electricity inside the studio. He was subsequently menaced by a flying 2x4 wooden beam that blasted through a studio TV monitor, and narrowly missed by a mangled red sedan that crashed through the studio ceiling; the left front headlight still flashing and clicking as Cantore soldiered on with his commentary. (A hyper-realistic outdoor camera view was interspersed with the studio shots; allowing Cantore to explain the tornado’s evolution from EF0 to EF5 throughout the broadcast.)

Eventually the lights flickered as the TWC studio began to fall apart under the storm’s ferocity. Jim Cantore took refuge in a “safe room” before the signal was apparently “lost” as TWC went to commercial. After the commercial break, Cantore was seen standing outside in the apocalyptic chaos left by the EF5 tornado; until the TWC’s studio outline appeared around him in grid form, and then rematerialized to its original undamaged appearance. (For the record, Cantore’s introduction and after-commercial conclusion were done live; the rest was prerecorded.)

As convincing as the tornado vignette was to watch—the SFX was worthy of a Hollywood disaster movie—none of the mayhem was real. Which was precisely the point: TWC is adopting the wow factor of augmented and virtual reality graphics to make its TV content incredibly compelling. 

“This is our bold first step into immersive weather presentation,” said Michael Potts, vice president of design for the Weather Group. Referring to the channel’s approach as “immersive mixed reality,” Potts said “we’re dropping the boundaries between what is real and what isn’t real, so we can take our talent and put them into the weather, or bring the weather into our studio. The goal for doing so is to create a much more meaningful viewing experience for the audience.”

'EXPLAINER VIDEO'

Creating this complex “explainer video” (as Potts calls it) of TWC’s in-studio tornado was a massive effort, requiring “lots of brainstorming sessions between The Weather Channel and The Future Group,” said Lawrence Jones; head of North America Operations for The Future Group.

“After we had all these brainstorming sessions together, TWC sent us a script that we used to create movie-style storyboards of the tornado video,” Jones said. “Once we agreed upon those boards, we created concept art to depict what these graphics would look like; including the flying 2x4 and the photo-realistic car. For this to work, every graphic element and overlay had to be planned out perfectly, so that it could be done within the limits of the technology.”

It took two months for The Future Group’s teams in Bulgaria, Norway, and the United States to create the AR graphics for the video. The graphics included the virtual TWC studio that rematerialized around Cantore after the commercial break. Once reconstructed in full onscreen, the virtual studio was indistinguishable from the real studio.

These graphics were designed to run on The Future Group’s Frontier graphics engine, which is based on the Unreal Engine gaming graphics system created by Epic Games. Ross began partnering with The Future Group in 2015 when it announced a seven-figure investment in the company, followed by a technology partnership a year later.

“The original Unreal Engine wasn’t designed for broadcast,” said Gideon Ferber, director of product management and business development for Ross Video’s Virtual Solution division. “So The Future Group built their own version of the Unreal Engine that included broadcast features such as genlock, frame buffers, and Fill/Key output. Ross then added the tracking integration, control interface, and everything else you need to operate Frontier on-air in a broadcast setting.”

[Read: NAB Show: Epic Games Integrates Unreal Engine With Strategic Partners]

With The Future Group’s equipment in place at TWC’s Atlanta production center, the crew held rehearsals to iron out the bugs and ready the segment for broadcast. These rehearsals included an enthusiastic Cantore, who memorized theatrical-style blocking (knowing where he physically had to be at what time) and learning his lines, alongside his regular broadcast duties.

Cantore’s hard work resulted in a realistic, apparently spontaneous on-air performance as he endured (and educationally exploited) the tornado’s wrath.

“Jim brought an amazing amount of life to this,” said Potts. “Yes, the graphics are amazing, and the technology underneath it makes it possible. But our talent drives this thing. With a wonderful narrative to work with, Jim was the hero of this project.”

MORE CHAOS TO COME?

TWC’s success in blending real video and AR graphics in Cantore’s tornado segment has won the network lots of positive attention and justified its push into AR/VR-enhanced content. Right now, TWC hopes to produce 80 percent of its programming using AR/VR by 2020.

TWC will air its second AR-enhanced explainer video on July 31.

“We’re going to look at the power of lightning,” said Potts. This time Cantore can relax. Rather than TWC zapping him just weeks after dropping a car close to his head, “we’re going to spread the love and bring some other talent into this,” Potts said.