kth.sePublications KTH
System disruptions
There are recurring service disruptions on some of the search portals due to high traffic. We are working to resolve the issue, you may temporarily encounter an error message.
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Dynamic CNN Models For Fashion Recommendation in Instagram
KTH, School of Electrical Engineering and Computer Science (EECS), Computer Science, Software and Computer systems, SCS.
KTH, School of Electrical Engineering and Computer Science (EECS), Computer Science, Software and Computer systems, SCS.ORCID iD: 0000-0003-2339-2337
KTH, School of Electrical Engineering and Computer Science (EECS), Computer Science, Software and Computer systems, SCS.
KTH, School of Electrical Engineering and Computer Science (EECS), Computer Science, Software and Computer systems, SCS.
Show others and affiliations
2018 (English)In: 2018 IEEE INT CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, UBIQUITOUS COMPUTING & COMMUNICATIONS, BIG DATA & CLOUD COMPUTING, SOCIAL COMPUTING & NETWORKING, SUSTAINABLE COMPUTING & COMMUNICATIONS / [ed] Chen, JJ Yang, LT, IEEE COMPUTER SOC , 2018, p. 1144-1151Conference paper, Published paper (Refereed)
Abstract [en]

Instagram as an online photo-sharing and social-networking service is becoming more powerful in enabling fashion brands to ramp up their business growth. Nowadays, a single post by a fashion influencer attracts a wealth of attention and a magnitude of followers who are curious to know more about the brands and style of each clothing item sitting inside the image. To this end, the development of efficient Deep CNN models that can accurately detect styles and brands have become a research challenge. In addition, current techniques need to cope with inherent fashion-related data issues. Namely, clothing details inside a single image only cover a small proportion of the large and hierarchical space of possible brands and clothing item attributes. In order to cope with these challenges, one can argue that neural classifiers should become adapted to large-scale and hierarchical fashion datasets. As a remedy, we propose two novel techniques to incorporate the valuable social media textual content to support the visual classification in a dynamic way. The first method is adaptive neural pruning (DynamicPruning) in which the clothing item category detected from posts' text analysis can be used to activate the possible range of connections of clothing attributes' classifier. The second method (DynamicLayers) is a dynamic framework in which multiple-attributes classification layers exist and a suitable attributes' classifier layer is activated dynamically based upon the mined text from the image. Extensive experiments on a dataset gathered from Instagram and a baseline fashion dataset (DeepFashion) have demonstrated that our approaches can improve the accuracy by about 20% when compared to base architectures. It is worth highlighting that with Dynamiclayers we have gained 35% accuracy for the task of multi-class multi-labeled classification compared to the other model.

Place, publisher, year, edition, pages
IEEE COMPUTER SOC , 2018. p. 1144-1151
Series
IEEE International Symposium on Parallel and Distributed Processing with Applications, ISSN 2158-9178
Keywords [en]
Neural Pruning, Dynamic Computation Graph, Dynamic CNN, Image Classification, Text Mining, Fashion Recommendation
National Category
Computer and Information Sciences
Identifiers
URN: urn:nbn:se:kth:diva-252671DOI: 10.1109/BDCloud.2018.00169ISI: 000467843200155Scopus ID: 2-s2.0-85063866491ISBN: 978-1-7281-1141-4 (print)OAI: oai:DiVA.org:kth-252671DiVA, id: diva2:1319767
Conference
16th IEEE ISPA / 17th IEEE IUCC / 8th IEEE BDCloud / 11th IEEE SocialCom / 8th IEEE SustainCom, DEC 11-13, 2018, Melbourne, AUSTRALIA
Note

QC 20190603

Available from: 2019-06-03 Created: 2019-06-03 Last updated: 2024-03-18Bibliographically approved
In thesis
1. Mining of User Profiles in Online Social Networks for Improved Personalized Recommendations
Open this publication in new window or tab >>Mining of User Profiles in Online Social Networks for Improved Personalized Recommendations
2020 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

We have focused on influencer-based marketing in online social networks as a source of implicit learning about the preferences of social media users. Those users who use social networks on a daily basis are also the online shoppers who are confronted with huge information overload and a wide variety of online products and brands to choose from. The role of digital influencers in promoting products and spreading information to a large scale of followers who engage with the influencers’ posts and interact with them is our key to better understanding of these followers’ tastes and future purchase intentions. Hence, the analysis and the extraction of fine-grained details (which we refer to as user profiling) from digital influencers media content serves in collecting more information about the implicit preferences of their followers. With this knowledge, the chances of offering social media users better personalized services are enhanced. In this thesis, we empower cross-domain recommendations through the development of novel methods and algorithms for improving personalization through the effective mining of user profiles in online social networks. We developed a semantic information extraction framework from social media textual content that is able to capture fine-grained attributes with respect to the defined online shops taxonomy. Results form the aforementioned framework have been applied as input to the approaches we proposed to incorporate extracted textual hints in supporting the visual fine-grained classification of social media images in a dynamic way. Our methods have improved the classification accuracy when compared to state-of-the-art approaches. Moreover, we suggested solutions for incorporating the extracted products’ meta-data in embedding-based personalized recommendation architectures where our strategies improved the recommendations’ quality. In order to speed up the process of preparing large scale social media images datasets for deep learning image analysis, we developed a complete framework for detailed annotation, object localization and semantic segmentation. As our focus is also directed towards the analysis of interactions between social media users, we proposed a neural reinforcement learning approach that is based on estimating the established trust levels between social media users for controlling the amount of recommended updates they get from each other. Moreover, we proposed enhanced topic modelling algorithm for supporting interpretable yet dynamic summarizations of large social media contents.

Abstract [sv]

Vi har fokuserat på influenserbaserad marknadsföring i sociala nätverk online som en källa till implicit lärande om sociala medianvändares preferenser. De användare som använder sociala nätverk dagligen är också online-shoppare som står inför enorm informationsöverbelastning och ett brett utbud av onlineprodukter och varumärken att välja mellan. Rollen hos digitala influenser när det gäller att marknadsföra produkter och sprida information till en stor skala av anhängare som engagerar sig i influencers inlägg och interagerar med dem är vår nyckel till bättre förståelse för dessa anhängares smak och framtida köpintentioner. Analysen och utvinningen av finkorniga detaljer (som vi kallar textit user profiling) från medieinnehåll för digitala influenser tjänar därför till att samla in mer information om deras implicita preferenser. Med denna kunskap tillämpad för att berika användarprofiler för sociala medier förbättras chanserna att erbjuda dem bättre anpassade tjänster. I denna avhandling ger vi rekommendationer över gränserna genom utveckling av nya metoder och algoritmer för att förbättra personalisering genom effektiv utvinning av användarprofiler i sociala nätverk online. Vi utvecklade en semantisk ram för informationsextraktion från textinnehåll i sociala medier som kan fånga finkorniga attribut med avseende på den definierade onlinebutikens taxonomi. Resultat från ovannämnda ramverk har använts som input till de tillvägagångssätt som vi föreslog för att införliva extraherade texttips för att stödja den visuella finkorniga klassificeringen av sociala mediebilder på ett dynamiskt sätt. Våra metoder har förbättrat klassificeringsnoggrannheten jämfört med toppmoderna metoder. Dessutom föreslog vi lösningar för att integrera de extraherade produkternas metadata i inbäddningsbaserade personliga rekommendationsarkitekturer där våra strategier förbättrade rekommendationernas kvalitet. För att påskynda processen att förbereda storskaliga bildmängder för sociala medier för djupinlärningsbildanalys utvecklade vi en komplett ram för detaljerad kommentar, objektlokalisering och semantisk segmentering. Eftersom vårt fokus också riktas mot analysen av interaktioner mellan användare av sociala medier, föreslog vi en neurologisk förstärkningsinlärningsmetod som baseras på att uppskatta de etablerade tillitsnivåerna mellan användare av sociala medier för att kontrollera mängden rekommenderade uppdateringar de får från varandra. Dessutom föreslog vi förbättrad ämnesmodelleringsalgoritm för att stödja tolkbara men dynamiska sammanfattningar av stora sociala medieinnehåll.

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2020. p. 133
Series
TRITA-EECS-AVL ; 2020:59
National Category
Computer Systems
Identifiers
urn:nbn:se:kth:diva-285522 (URN)978-91-7873-688-1 (ISBN)
Public defence
2020-12-03, Sal C, Kistagången 16, Kista, Stockholm, 16:00 (English)
Opponent
Supervisors
Note

QC 20201106

Available from: 2020-11-06 Created: 2020-11-06 Last updated: 2022-06-25Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Jaradat, ShathaDokoohaki, NimaHammar, KimWara, UmmalMatskin, Mihhail

Search in DiVA

By author/editor
Jaradat, ShathaDokoohaki, NimaHammar, KimWara, UmmalMatskin, Mihhail
By organisation
Software and Computer systems, SCS
Computer and Information Sciences

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 423 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf