You’re reading the Apple Newsroom

Apple researchers unveil new AI model for image manipulation with natural language input

Apple has unveiled “MGIE”, a new open-source AI model in collaboration with researchers from the University of California that transforms image editing through natural language instructions, according to a new report by VentureBeat.

MGIE leverages the power of Multimodal Large Language Models (MLLMs), adept at processing both text and images. These models interpret user commands, translating them into “expressive instructions” that precisely guide the editing process. Imagine saying “make the sky more dramatic,” and MGIE interprets it as “increase the saturation and contrast of the sky region by 30%.” This not only streamlines editing but also empowers users with a nuanced level of control.

The true magic of MGIE lies in its ability to “generate visual imagination,” capturing the essence of the desired edit beyond mere words. This internal representation fuels pixel-level manipulations, ensuring the model understands and executes your vision accurately. It’s like having a collaborative partner who not only comprehends your instructions but also visualizes your artistic intent.

MGIE caters to a vast array of editing needs, from simple adjustments like boosting brightness to complex tasks like adding objects or changing backgrounds. Whether you’re a social media enthusiast, an e-commerce entrepreneur, or an aspiring artist, MGIE unlocks a world of creative possibilities.

Key Features at a Glance:

  • Expressive Instruction-Based Editing: Clear and concise instructions ensure efficient, high-quality results.
  • Photoshop-Style Modifications: Familiar tools like cropping, resizing, and filters, alongside advanced edits like object manipulations and image blending.
  • Global Photo Optimization: Enhance overall quality with adjustments to brightness, contrast, and artistic effects.
  • Local Editing: Modify specific regions or objects with granular control over their attributes.

The open-source nature of MGIE makes it readily available for exploration and experimentation. Access code, data, and pre-trained models on GitHub, or experiment with the demo notebook and web demo for hands-on experience.

MGIE transcends its academic roots, offering a practical tool for diverse scenarios. Imagine crafting captivating visuals for social media, enhancing product images for e-commerce, or exploring your artistic vision with newfound ease. This technology empowers self-expression and ignites creative exploration.

Apple’s recent surge in AI investment hints at their vision for the future, with iOS 18 anticipated to be a major showcase for these advancements. MGIE stands as a prime example of this commitment, demonstrating the company’s push towards AI-powered tools that seamlessly integrate into user workflows.

This open-source initiative aligns with Apple’s broader strategy of promoting accessibility and collaboration within the developer community, potentially paving the way for even more innovative AI-powered features in future iOS releases. While MGIE isn’t directly confirmed for iOS 18, its release and open-source nature suggest its underlying technology could play a significant role in shaping the future of iPhone image editing and creative tools within the Apple ecosystem.

MGIE serves as a beacon of progress in multimodal AI, demonstrating its potential to revolutionize human-computer interaction. While advancements are still underway, the rapid pace of development suggests that assistive AI may soon become an indispensable creative partner.

Share this Article

Editor's Pick

Supercharged is not just another news outlet. We’re a platform on a mission to offer personalized and ad-free news directly to you. Discover more of Supercharged.

note icon

Did you know?

Easily add Supercharged to your Home Screen and stay informed on the go! Get instant updates and breaking news stories via push notifications directly on your iPhone and Apple Watch. Just tap the share icon, then "Add to Home Screen," and be the first to know.

Abdul Raouf Al Sbeei

Abdul Raouf Al Sbeei

Abdul Raouf is a reporter in the Apple Newsroom, where he translates news into insightful and relatable stories. Abdul believes words hold magic and have power often ignored. You can find him between tweets or book pages.

Read More

note icon

Did you know?

Easily add Supercharged to your Home Screen and stay informed on the go! Get instant updates and breaking news stories via push notifications directly on your iPhone and Apple Watch. Just tap the share icon, then "Add to Home Screen," and be the first to know.

You’re reading the Apple Newsroom

  • Loading stock data...

Apple researchers unveil new AI model for image manipulation with natural language input

Apple has unveiled “MGIE”, a new open-source AI model in collaboration with researchers from the University of California that transforms image editing through natural language instructions, according to a new report by VentureBeat.

MGIE leverages the power of Multimodal Large Language Models (MLLMs), adept at processing both text and images. These models interpret user commands, translating them into “expressive instructions” that precisely guide the editing process. Imagine saying “make the sky more dramatic,” and MGIE interprets it as “increase the saturation and contrast of the sky region by 30%.” This not only streamlines editing but also empowers users with a nuanced level of control.

The true magic of MGIE lies in its ability to “generate visual imagination,” capturing the essence of the desired edit beyond mere words. This internal representation fuels pixel-level manipulations, ensuring the model understands and executes your vision accurately. It’s like having a collaborative partner who not only comprehends your instructions but also visualizes your artistic intent.

MGIE caters to a vast array of editing needs, from simple adjustments like boosting brightness to complex tasks like adding objects or changing backgrounds. Whether you’re a social media enthusiast, an e-commerce entrepreneur, or an aspiring artist, MGIE unlocks a world of creative possibilities.

Key Features at a Glance:

  • Expressive Instruction-Based Editing: Clear and concise instructions ensure efficient, high-quality results.
  • Photoshop-Style Modifications: Familiar tools like cropping, resizing, and filters, alongside advanced edits like object manipulations and image blending.
  • Global Photo Optimization: Enhance overall quality with adjustments to brightness, contrast, and artistic effects.
  • Local Editing: Modify specific regions or objects with granular control over their attributes.

The open-source nature of MGIE makes it readily available for exploration and experimentation. Access code, data, and pre-trained models on GitHub, or experiment with the demo notebook and web demo for hands-on experience.

MGIE transcends its academic roots, offering a practical tool for diverse scenarios. Imagine crafting captivating visuals for social media, enhancing product images for e-commerce, or exploring your artistic vision with newfound ease. This technology empowers self-expression and ignites creative exploration.

Apple’s recent surge in AI investment hints at their vision for the future, with iOS 18 anticipated to be a major showcase for these advancements. MGIE stands as a prime example of this commitment, demonstrating the company’s push towards AI-powered tools that seamlessly integrate into user workflows.

This open-source initiative aligns with Apple’s broader strategy of promoting accessibility and collaboration within the developer community, potentially paving the way for even more innovative AI-powered features in future iOS releases. While MGIE isn’t directly confirmed for iOS 18, its release and open-source nature suggest its underlying technology could play a significant role in shaping the future of iPhone image editing and creative tools within the Apple ecosystem.

MGIE serves as a beacon of progress in multimodal AI, demonstrating its potential to revolutionize human-computer interaction. While advancements are still underway, the rapid pace of development suggests that assistive AI may soon become an indispensable creative partner.

Share this Article

Supercharged is not just another news outlet. We’re a platform on a mission to offer personalized and ad-free news directly to you. Discover more of Supercharged.

note icon

Did you know?

Easily add Supercharged to your Home Screen and stay informed on the go! Get instant updates and breaking news stories via push notifications directly on your iPhone and Apple Watch. Just tap the share icon, then "Add to Home Screen," and be the first to know.

Abdul Raouf Al Sbeei

Abdul Raouf Al Sbeei

Abdul Raouf is a reporter in the Apple Newsroom, where he translates news into insightful and relatable stories. Abdul believes words hold magic and have power often ignored. You can find him between tweets or book pages.

Read More

note icon

Did you know?

Easily add Supercharged to your Home Screen and stay informed on the go! Get instant updates and breaking news stories via push notifications directly on your iPhone and Apple Watch. Just tap the share icon, then "Add to Home Screen," and be the first to know.

Search

Affiliate links are a popular way for websites to make money, but they can also be annoying to readers. They can obstruct content, trick visitors, and even be scams.

Supercharged is committed to respecting your time, sanity, and convenience. That’s why we’re doing affiliate linking differently.

You Control What You See

Have you ever felt like you're bombarded with affiliate links and ads constantly? We understand how overwhelming that can be, which is why we want to give you some control with the option to expand the affiliate options that you find interesting.

We're Strict

We have a strict policy of showing you a maximum of five brands or products at once. It's simple: if we wouldn't buy it ourselves, we won't recommend it to you.

No Tracking or Creepy Cookies

For all of our affiliates, we work directly with the companies to offer discounts and deals for you. We do not use third-party affiliate managers, trackers, or platforms like Amazon, so you can be confident that you won't have to deal with tracking.

Secured By miniOrange