kth.sePublikationer
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
ChannelComp: A general framework for computing by digital communication
KTH, Skolan för elektroteknik och datavetenskap (EECS), Datavetenskap, Nätverk och systemteknik.ORCID-id: 0000-0003-4519-9204
2023 (Engelska)Licentiatavhandling, sammanläggning (Övrigt vetenskapligt)
Abstract [en]

The imminent Internet of Things, fueled by 6G networks and machine learning technologies, is set to shift wireless communication to machine-centric paradigms, revolutionizing sectors such as healthcare or industrial automation through efficient data handling. However, this connectivity boom poses challenges, including straining existing communication systems due to increased data traffic and computational demands.

Over-the-air computation (OAC) presents a feasible solution, allowing the summation of transmitted signals at a common receiver through analog amplitude modulation. Designed to enable concurrent data collection and computation at the network edge, OAC seeks to lessen the central system burden, reducing latency and energy usage while enabling real-time analytics. This approach is particularly beneficial for federated learning, a machine learning technique that operates across decentralized devices. However, OAC's dependence on analog communication poses notable challenges, including signal distortion during transmission and the limited availability of devices supporting analog modulations. Digital modulation is a preferable alternative, recognized for its excellent channel correction capabilities and broad acceptance in modern wireless devices. Nevertheless, its integration into OAC is perceived as a significant hurdle, with overlapping digitally modulated signals threatening the fundamental concept of simultaneous data collection and computation.

The first part of the thesis provides an overview of communication systems, specifically focusing on the relevant OAC methodologies for analog and digital parts and their application in ML, particularly in training federated learning models. Subsequently, an exhaustive literature review concerning analog OAC techniques is undertaken, identifying existing limitations within this domain. The central thrust of our research is then introduced, proposing an innovative digital OAC approach along with a fresh perspective on the communication systems models designed for executing the computation. The chapter concludes with a summary of the principal contributions of each paper included within the thesis.

In the second part, we introduce ChannelComp, a groundbreaking computing approach compatible with current digital communication systems, including smartphones and IoT devices. A detailed analysis of ChannelComp's functions reveals how it enables digital modulation schemes to perform computations, addressing a critical gap in previous research. Moreover, introducing pre-coders designed for function computation over the multiple access channel, combined with a feasibility optimization problem framework, allows for seamless integration with current systems. Compared to OAC, restricted to analog modulations, ChannelComp exhibits broader computational capabilities and adherence to strict computation time constraints, thus showcasing its robust potential for future massive machine-type communications. This innovative method signifies a promising direction toward sustainable and efficient future wireless communication.

Abstract [sv]

Den nära förestående Internet of Things, drivet av 6G-nätverk och maskininlärningsteknologier, är på väg att förändra trådlös kommunikation till maskincentrerade paradigm, revolutionerande sektorer som hälso- och sjukvård samt industriell automatisering genom effektiv datahantering. Dock medför denna uppkopplingsboom utmaningar, inklusive påfrestningar på befintliga kommunikationssystem på grund av ökad datatrafik och beräkningsbehov.

Over-the-air-beräkning (OAC) framstår som en genomförbar lösning, genom att tillåta summering av överförda signaler hos en gemensam mottagare genom analog amplitudmodulering. Utformad för att möjliggöra samtidig datainsamling och beräkning vid nätverkskanten, strävar OAC efter att minska den centrala systembelastningen, minska latens och energiförbrukning samtidigt som det möjliggör realtidsanalys. Denna metod är särskilt fördelaktig för federerad inlärning, en maskininlärningsteknik som fungerar över decentraliserade enheter. Dock medför OAC:s beroende av analog kommunikation märkbara utmaningar, inklusive signal distortion under överföring och begränsad tillgänglighet av enheter som stöder analoga moduleringar. Digital modulering är ett föredraget alternativ, erkänt för dess utmärkta kanalkorrigeringsegenskaper och bred acceptans i moderna trådlösa enheter. Trots detta uppfattas dess integration i OAC som ett betydande hinder, med överlappande digitalt modulerade signaler som hotar den grundläggande konceptet med samtidig datainsamling och beräkning.

Den första delen av avhandlingen ger en översikt över kommunikationssystem, med särskilt fokus på relevanta OAC-metodiker för analoga och digitala delar och deras tillämpning i ML, särskilt vid träning av federerade inlärningsmodeller. Därefter genomförs en omfattande litteraturöversikt angående analoga OAC-tekniker, där befintliga begränsningar inom detta område identifieras. Forskningens centrala drivkraft introduceras sedan, med förslag på en innovativ digital OAC-metod tillsammans med ett nytt perspektiv på kommunikationssystemmodeller utformade för att utföra beräkningen. Kapitlet avslutas med en sammanfattning av de huvudsakliga bidragen från varje artikel inkluderad i avhandlingen.

I den andra delen introducerar vi ChannelComp, en ny och banbrytande beräkningsmetod som är kompatibel med nuvarande digitala kommunikationssystem, inklusive smartphones och IoT-enheter. En detaljerad analys av ChannelComp:s funktioner avslöjar hur den möjliggör digitala moduleringsscheman för att utföra beräkningar, vilket adresserar en kritisk lucka i tidigare forskning. Dessutom möjliggör introduktionen av förkodare utformade för funktionsberäkning över den fleraccessa kanalen, kombinerat med ett ramverk för genomförbarhetsoptimeringsproblem, en sömlös integration med nuvarande system. Jämfört med OAC, begränsad till analoga moduleringar, uppvisar ChannelComp bredare beräkningsmöjligheter och efterlevnad av strikta beräkningstidsbegränsningar, vilket visar dess robusta potential för framtida massiva maskintypkommunikationer. Denna innovativa metod signalerar en lovande riktning mot hållbar och effektiv framtida trådlös kommunikation.

Ort, förlag, år, upplaga, sidor
Stockholm: KTH Royal Institute of Technology, 2023. , s. 161
Serie
TRITA-EECS-AVL ; 2023:75
Nationell ämneskategori
Kommunikationssystem
Forskningsämne
Telekommunikation
Identifikatorer
URN: urn:nbn:se:kth:diva-338940ISBN: 978-91-8040-741-0 (tryckt)OAI: oai:DiVA.org:kth-338940DiVA, id: diva2:1808587
Presentation
2023-11-20, E32 https://kth-se.zoom.us/j/61848116543, Osquars backe 2, E-huset, huvudbyggnaden, Lindstedtsvägen 3, floor 3, Stockholm, 13:00 (Engelska)
Opponent
Handledare
Anmärkning

QC 20231031

Tillgänglig från: 2023-10-31 Skapad: 2023-10-31 Senast uppdaterad: 2023-11-13Bibliografiskt granskad
Delarbeten
1. Computing Functions Over-the-Air Using Digital Modulations.
Öppna denna publikation i ny flik eller fönster >>Computing Functions Over-the-Air Using Digital Modulations.
2023 (Engelska)Manuskript (preprint) (Övrigt vetenskapligt)
Abstract [en]

Over-the-air computation (AirComp) is a known technique in which wireless devices transmit values by analog amplitude modulation so that a function of these values is computed over the communication channel at a common receiver. The physical reason is the superposition properties of the electromagnetic waves, which naturally return sums of analog values. Consequently, the applications of AirComp are almost entirely restricted to analog communication systems. However, the use of digital communications for over-the-air computations would have several benefits, such as error correction, synchronization, acquisition of channel state information, and easier adoption by current digital communication systems. Nevertheless, a common belief is that digital modulations are generally unfeasible for computation tasks because the overlapping of digitally modulated signals returns signals that seem to be meaningless for these tasks. This paper breaks through such a belief and proposes a fundamentally new computing method, named ChannelComp, for performing over-the-air computations by any digital modulation. In particular, we propose digital modulation formats that allow us to compute a wider class of functions than AirComp can compute, and we propose a feasibility optimization problem that ascertains the optimal digital modulation for computing functions over-the-air. The simulation results verify the superior performance of ChannelComp in comparison to AirComp, particularly for the product functions, with around 10 dB improvement of the computation error.

Förlag
s. 5780-5786
Nationell ämneskategori
Datorsystem
Identifikatorer
urn:nbn:se:kth:diva-338914 (URN)
Konferens
IEEE International Conference on Communications
Anmärkning

QC 20231031

Tillgänglig från: 2023-10-30 Skapad: 2023-10-30 Senast uppdaterad: 2023-11-01Bibliografiskt granskad
2. ChannelComp: A General Method for Computation by Communications
Öppna denna publikation i ny flik eller fönster >>ChannelComp: A General Method for Computation by Communications
2023 (Engelska)Ingår i: IEEE Transactions on Communications, ISSN 0090-6778, E-ISSN 1558-0857, s. 1-1Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

Over-the-air computation (AirComp) is a well-known technique by which several wireless devices transmit by analog amplitude modulation to achieve a sum of their transmit signals at a common receiver. The underlying physical principle is the superposition property of the radio waves. Since such superposition is analog and in amplitude, it is natural that AirComp uses analog amplitude modulations. Unfortunately, this is impractical because most wireless devices today use digital modulations. It would be highly desirable to use digital communications because of their numerous benefits, such as error correction, synchronization, acquisition of channel state information, and widespread use. However, when we use digital modulations for AirComp, a general belief is that the superposition property of the radio waves returns a meaningless overlapping of the digital signals. In this paper, we break through such beliefs and propose an entirely new digital channel computing method named ChannelComp, which can use digital as well as analog modulations. We propose a feasibility optimization problem that ascertains the optimal modulation for computing arbitrary functions over-the-air. Additionally, we propose pre-coders to adapt existing digital modulation schemes for computing the function over the multiple access channel. The simulation results verify the superior performance of ChannelComp compared to AirComp, particularly for the product functions, with more than 10 dB improvement of the computation error.

Ort, förlag, år, upplaga, sidor
Institute of Electrical and Electronics Engineers (IEEE), 2023
Nationell ämneskategori
Kommunikationssystem
Identifikatorer
urn:nbn:se:kth:diva-338912 (URN)10.1109/tcomm.2023.3324999 (DOI)001164695100015 ()2-s2.0-85174823953 (Scopus ID)
Anmärkning

QC 20231031

Tillgänglig från: 2023-10-30 Skapad: 2023-10-30 Senast uppdaterad: 2024-06-18Bibliografiskt granskad
3. Channel Computing: Computation by Communications
Öppna denna publikation i ny flik eller fönster >>Channel Computing: Computation by Communications
2022 (Engelska)Patent (Övrig (populärvetenskap, debatt, mm))
Abstract [en]

The invention relates to a computer-implemented method, a system, and a receiver for in-channel function computation.

Nationell ämneskategori
Elektroteknik och elektronik
Identifikatorer
urn:nbn:se:kth:diva-338939 (URN)
Anmärkning

QC 20231031

Tillgänglig från: 2023-10-31 Skapad: 2023-10-31 Senast uppdaterad: 2023-10-31Bibliografiskt granskad
4. SumComp: Coding for Digital Over-the-AirComputation via the Ring of Integers
Öppna denna publikation i ny flik eller fönster >>SumComp: Coding for Digital Over-the-AirComputation via the Ring of Integers
(Engelska)Manuskript (preprint) (Övrigt vetenskapligt)
Abstract [en]

Communication and computation are traditionally treated as separate entities, allowing for individual optimizations. However, many applications focus on local information's functionality rather than the information itself. For such cases, harnessing interference for computation in a multiple access channel through digital over-the-air computation can notably increase the computation, as established by the ChannelComp method. However, the coding scheme originally proposed in ChannelComp may suffer from high computational complexity because it is general and is not optimized for specific modulation categories. Therefore, this study considers a specific category of digital modulations for over-the-air computations, QAM and PAM, for which we introduce a novel coding scheme called SumComp.

Furthermore, we derive an MSE analysis for SumComp coding in the computation of the arithmetic mean function and establish an upper bound on the MAE for a set of nomographic functions. Simulation results affirm the superior performance of SumComp coding compared to traditional analog over-the-air computation and the original coding in ChannelComp approaches regarding both MSE and MAE over a noisy multiple access channel. Specifically, SumComp coding shows approximately 10 dB improvements for computing arithmetic and geometric mean on the normalized MSE for low-noise scenarios.

Nationell ämneskategori
Kommunikationssystem
Identifikatorer
urn:nbn:se:kth:diva-338915 (URN)10.48550/arXiv.2310.20504 (DOI)
Anmärkning

Submitted to IEEE TCOM Journal.

QC 20231031

Tillgänglig från: 2023-10-30 Skapad: 2023-10-30 Senast uppdaterad: 2023-11-10Bibliografiskt granskad
5. Blind Federated Learning via Over-the-Air q-QAM
Öppna denna publikation i ny flik eller fönster >>Blind Federated Learning via Over-the-Air q-QAM
(Engelska)Manuskript (preprint) (Övrigt vetenskapligt)
Abstract [en]

In this work, we investigate federated edge learning over a fading multiple access channel. To alleviate the communication burden between the edge devices and the access point, we introduce a pioneering digital over-the-air computation strategy employing q-ary quadrature amplitude modulation, culminating in a low latency communication scheme. Indeed, we propose a new federated edge learning framework in which edge devices use digital modulation for over-the-air uplink transmission to the edge server while they have no access to the channel state information. Furthermore, we incorporate multiple antennas at the edge server to overcome the fading inherent in wireless communication.  We analyze the number of antennas required to mitigate the fading impact effectively. We prove a non-asymptotic upper bound for the mean squared error for the proposed federated learning with digital over-the-air uplink transmissions under both noisy and fading conditions.  Leveraging the derived upper bound, we characterize the convergence rate of the learning process of a non-convex loss function in terms of the mean square error of gradients due to the fading channel. Furthermore, we substantiate the theoretical assurances through numerical experiments concerning mean square error and the convergence efficacy of the digital federated edge learning framework. Notably, the results demonstrate that augmenting the number of antennas at the edge server and adopting higher-order modulations improve the model accuracy up to $60\%$.

Nationell ämneskategori
Kommunikationssystem
Identifikatorer
urn:nbn:se:kth:diva-338917 (URN)
Anmärkning

QC 20231031

Tillgänglig från: 2023-10-30 Skapad: 2023-10-30 Senast uppdaterad: 2023-11-01Bibliografiskt granskad
6. Blind Asynchronous Over-the-Air Federated Edge Learning
Öppna denna publikation i ny flik eller fönster >>Blind Asynchronous Over-the-Air Federated Edge Learning
2022 (Engelska)Ingår i: 2022 IEEE GLOBECOM Workshops, GC Wkshps 2022: Proceedings, Institute of Electrical and Electronics Engineers (IEEE) , 2022, s. 1834-1839Konferensbidrag, Publicerat paper (Refereegranskat)
Abstract [en]

Federated Edge Learning (FEEL) is a distributed machine learning technique where each device contributes to training a global inference model by independently performing local computations with their data. More recently, FEEL has been merged with over-the-air computation (OAC), where the global model is calculated over the air by leveraging the superposition of analog signals. However, when implementing FEEL with OAC, there is the challenge on how to precode the analog signals to overcome any time misalignment at the receiver. In this work, we propose a novel synchronization-free method to recover the parameters of the global model over the air without requiring any prior information about the time misalignments. For that, we construct a convex optimization based on the norm minimization problem to directly recover the global model by solving a convex semi-definite program. The performance of the proposed method is evaluated in terms of accuracy and convergence via numerical experiments. We show that our proposed algorithm is close to the ideal synchronized scenario by 10%, and performs 4times better than the simple case where no recovering method is used.

Ort, förlag, år, upplaga, sidor
Institute of Electrical and Electronics Engineers (IEEE), 2022
Nyckelord
Asynchronous, federated edge learning, over-the-air computation, time misalignment
Nationell ämneskategori
Datavetenskap (datalogi)
Identifikatorer
urn:nbn:se:kth:diva-333461 (URN)10.1109/GCWkshps56602.2022.10008588 (DOI)2-s2.0-85146155208 (Scopus ID)
Konferens
2022 IEEE GLOBECOM Workshops, GC Wkshps 2022, Virtual, Online, Brazil, Dec 4 2022 - Dec 8 2022
Anmärkning

Part of ISBN 9781665459754

QC 20230802

Tillgänglig från: 2023-08-02 Skapad: 2023-08-02 Senast uppdaterad: 2023-11-01Bibliografiskt granskad

Open Access i DiVA

summary(837 kB)155 nedladdningar
Filinformation
Filnamn SUMMARY02.pdfFilstorlek 837 kBChecksumma SHA-512
3279e2ff4195c3bf59f74e6bce8765f07873a476ea2c222c658fbcb856aadc92ceadd6293300fa7c086de4e46d0d9bc69d7b185ae6ce331a8a329ed7aff657bb
Typ summaryMimetyp application/pdf

Person

Razavikia, Saeed

Sök vidare i DiVA

Av författaren/redaktören
Razavikia, Saeed
Av organisationen
Nätverk och systemteknik
Kommunikationssystem

Sök vidare utanför DiVA

GoogleGoogle Scholar
Antalet nedladdningar är summan av nedladdningar för alla fulltexter. Det kan inkludera t.ex tidigare versioner som nu inte längre är tillgängliga.

isbn
urn-nbn

Altmetricpoäng

isbn
urn-nbn
Totalt: 522 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf