Skip to main navigation Skip to search Skip to main content

PhotoHandler: Manipulation of Portrait Images with StyleGANs Using Text

  • Geral Castillo-Arredond
  • , Dante Moreno-Carhuacusma
  • , Willy Ugarte
  • Universidad Peruana de Ciencias Aplicadas

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

There are many methods and approaches used for manipulation of images. However, according to the state of the art, the ones related to StyleGANs has shown better overall results when it comes to this task. In this work, we proposed to use StyleGANs in order to allow the manipulation of portrait images using text. We used a method called StyleCLIP which combine StyleGANs with CLIP, a neural network that connects text and images. This method has two numeric parameters, which are the manipulation strength and the disentanglement threshold. The contribution consists of adjusting these parameters based on the entered text in order to improve the result of the edited image. With this technology, we built an app that will help people with poor digital skills to edit their photos easily by using words. The opinion of the users of the application has been validated through a survey. The results obtained allowed us to demonstrate that our method make a satisfactory image edition for most users.

Original languageEnglish
Title of host publicationProceedings of the 20th International Conference on Smart Business Technologies, ICSBT 2023
EditorsSlimane Hammoudi, Fons Wijnhoven, Marten van Sinderen
PublisherScience and Technology Publications, Lda
Pages73-82
Number of pages10
ISBN (Electronic)9789897586675
DOIs
StatePublished - 2023
Event20th International Conference on Smart Business Technologies, ICSBT 2023 - Hybrid, Rome, Italy
Duration: 11 Jul 202313 Jul 2023

Publication series

NameICSBT International Conference on Smart Business Technologies
Volume2023-July
ISSN (Print)2184-772X

Conference

Conference20th International Conference on Smart Business Technologies, ICSBT 2023
Country/TerritoryItaly
CityHybrid, Rome
Period11/07/2313/07/23

Keywords

  • Image Manipulation
  • Mobile Application
  • NLP
  • Portrait Images
  • StyleCLIP
  • StyleGAN

Fingerprint

Dive into the research topics of 'PhotoHandler: Manipulation of Portrait Images with StyleGANs Using Text'. Together they form a unique fingerprint.

Cite this