Adobe Reveals Object-Aware Editing Engine & New Gen AI Innovations In Photo, Video, Audio & 3D

Adobe Reveals Object-Aware Editing Engine & New Gen AI Innovations In Photo, Video, Audio & 3D



Adobe has unveiled Project Stardust a powerful new object-aware editing engine.

The editing engine uses generative AI to revolutionise image editing, and its latest collection of early-stage innovations, highlighting exciting new uses of generative AI and 3D technologies across multiple creative domains, including photo, video, audio, 3D, design and fashion applications.

Project Stardust enables users to easily select, edit and even delete complex elements in any image, making image editing more intuitive, accessible and time-efficient for any user.

“Adobe Sneaks are a can’t-miss, fan-favourite moment at MAX every year, and for good reason – nothing is more inspiring than brilliant employees demonstrating cutting-edge technologies that might power future Adobe products,” said Gavin Miller, vice president and fellow of Adobe Research. “Our passion for creators is at the heart of each Sneak, and this year’s showcase highlights exciting new ways generative AI and 3D technologies can supercharge creative expression, reimagining what Adobe tools make possible.”

This Sneaks event offered examples of how generative AI could reimagine video, audio, animation and motion graphics workflows, discovery and ideation processes. It should also cut post-production time from “days to minutes,” according to Adobe.

Photo

  • Project Stardust is a powerful new object-aware editor that revolutionizes image editing and magically moves or removes objects simply by clicking on them. With Project Stardust, users can easily select, edit and delete complex elements in any image – enabling them to select persons in a photograph, move them to a different place in the composition and fill in the background where they were previously standing. Users can also change elements like the colour of a person’s clothing and the position in which they’re standing – treating any image like a file with layers.
  • Project See Through is an AI-powered tool that makes it simple to remove reflections from photos. Glass reflections are an annoyance that everyone is familiar with in photos, obscuring the subject of the image, and often making it unusable. Though it’s difficult if not impossible to remove reflections using existing software, See Through dramatically simplifies the process.

Video & Audio

  • Project Fast Fill brings the power of Firefly generative AI to video for the first time. Leveraging Generative Fill technology – which Adobe Photoshop already uses to ease the addition, removal, or expansion of content in images with simple Firefly-powered text prompts – Project Fast Fill offers an early look at what human-prompted generative AI could enable inside Adobe video editing tools including Premiere Pro and After Effects.
  • Project Dub Dub Dub automates the video dubbing process, making a historically labour- and cost-intensive process as easy as clicking a button. Thanks to Project Dub Dub Dub’s AI capabilities, a recording or audio track of a video can be automatically translated to all supported languages while preserving the voice of the original speaker, temporally aligned with the original dialogue and ready to publish.
  • Project Scene Change makes it easy for video editors to composite a subject and scene, from two separate videos captured with different camera trajectories, into a scene with synchronized camera motion.
  • Project Res Up is a tool that easily converts video from low- to high-resolution using innovative diffusion-based upsampling technology.

3D & Design

  • Project Poseable represents a breakthrough in AI-based image generation models, making it easy for the image generator to seamlessly interact with large 3D objects, including poses from photos of real people. The prototype is integrated with Project Poseable which can create a 3D rendering from text input, take depth and perspective into consideration, and re-align the object. While creating 3D scenes with traditional skeletal systems is technically complex and time-consuming, Project Poseable offers an effortless alternative that makes it possible for anyone to expand their creative horizons.
  • Project Neo enables creators to incorporate 3D shapes in their 2D designs – all without requiring technical expertise in 3D creation tools. Today, creators of 2D designs such as infographics, posters, or logos are often limited in their ability to incorporate 3D elements given the complexity of those workflows, which can require years of experience. Project Neo enables creators to embrace simplified 3D design within 2D tools and methods.
  • Project Primrose blurs the line between technology and fashion, demonstrating the potential for flexible textile displays – and turning clothes into creative canvases. This interactive dress can offer infinite style possibilities, displaying content created with Adobe Firefly, After Effects, Stock and Illustrator.
  • Project Glyph Ease makes customized lettering more accessible by streamlining the tedious design process of glyphs – the specific design and shape elements of each letter character. Beginning with a hand-drawn letter shape, Project Glyph Ease uses AI to automatically generate an entire set of glyphs matching the input lettering style. Users can then easily edit the generated glyphs in Illustrator.
  • Project Draw & Delight offers a suite of generative AI tools that helps anyone along their creation journey, from transforming initial ideas – often represented as rough doodles or scribbles – into polished and refined sketches, then experimenting with colour palettes, style variations and different backgrounds.

Latest News

Women Paving the Path In Tech & Loyalty Share Key Insights
  • Technology

Women Paving the Path In Tech & Loyalty Share Key Insights

In the ever-evolving landscape of technology and loyalty, women are not just breaking barriers but reshaping the future. As we celebrate International Women’s Day and rally behind the theme of investing in women to accelerate progress, we made a conscious choice to forego the statistics that underscore the ongoing journey towards true gender parity. Instead, […]

Empowering Change: Women Leading The Generative AI Revolution In Marketing For International Women’s Day
  • Marketing

Empowering Change: Women Leading The Generative AI Revolution In Marketing For International Women’s Day

The theme for this year’s International Women’s Day, “Inspire Inclusion”, establishes a poignant tone for fostering authentic change. It perfectly mirrors the dynamic landscape of marketing, where change is the only constant. The last third-party cookie has finally crumbled, privacy laws are tightening, and now, Generative AI is quickly ushering in a new era of […]

Stevie-Ann Dovico Moves From NAB To Beyond Bank
  • Fintech

Stevie-Ann Dovico Moves From NAB To Beyond Bank

Stevie-Ann Dovico (lead image), has made the shift to customer-owned, Beyond Bank as its new chief information officer. The announcement came via Linkedin with happy to share that she is “ready to create real impact for and with our people, customers and communities” in her new role. Dovico replaces Fiona Floyd, who left the role […]

Redefining Tech Leadership: Deputy’s C-Suite Now 80% Women
  • Technology

Redefining Tech Leadership: Deputy’s C-Suite Now 80% Women

Deputy, the leading global people platform for hourly work, has announced the appointment of Sejal Patel Daswani (lead image) as its new chief people officer, resulting in a shift in the composition of its senior leadership, with women now making up 80% of the company’s C-Suite. Daswani has led people functions at every stage and […]

Acronis Names Cybersecurity Channel Veteran Kelly Johnson As General Manager For Australia & New Zealand
  • Technology

Acronis Names Cybersecurity Channel Veteran Kelly Johnson As General Manager For Australia & New Zealand

Acronis has appointed Kelly Johnson (lead image)as the new general manager for Australia and New Zealand. Johnson will lead the channel-focused business, strengthening relationships with distributors and supporting partners to meet the cybersecurity demands of modern businesses in the region. With the growing pressure on Australian businesses for cybersecurity and the drive to comply with […]

Aquent Salary Guide Reveals The Gender Pay Gap Persists In Marketing, Design & Technology Fields
  • Marketing
  • Technology

Aquent Salary Guide Reveals The Gender Pay Gap Persists In Marketing, Design & Technology Fields

Aquent has released its 2024 Australian Salary Guide for marketing, design, and technology talent. This year, it explores how marketing, design, and technology roles are expanding, deep dives into gender pay gaps, and examines the movement of salaries year-on-year—both in growth and decline. Paired with Aquent’s 2023 Talent Insights Report, the Salary Guide helps organisations […]

Tech Salaries Continue To Steady Out As Businesses Remain Cautious
  • Technology

Tech Salaries Continue To Steady Out As Businesses Remain Cautious

The hiring market is experiencing significant change, fluctuating between a frenzied candidate-short market and a more cautious employer-driven market, according to Talent’s ‘More Than Money Salary Guide 2024’. Tech and digital salaries continue to steady out but remain strong for key skillsets such as cybersecurity and AI. The report features key salaries, roles and skills […]

Surging Job Satisfaction For Australia’s Young Tech Workers Amid Labour Market Cooling
  • Technology

Surging Job Satisfaction For Australia’s Young Tech Workers Amid Labour Market Cooling

While 2021’s big workplace trend was The Great Resignation, 2024’s big trend is likely to be ‘The Big Stay’ in Australia, concludes modern HR platform HiBob in its latest research of young Australians working in the tech sector. The combination of decreasing Australian job vacancies and a remarkable increase in job satisfaction among Australia’s young tech workers in 2023 […]