Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
ChannelComp: A general framework for computing by digital communication
KTH, Skolan för elektroteknik och datavetenskap (EECS), Datavetenskap, Nätverk och systemteknik.ORCID-id: 0000-0003-4519-9204
2023 (engelsk)Licentiatavhandling, med artikler (Annet vitenskapelig)
Abstract [en]

The imminent Internet of Things, fueled by 6G networks and machine learning technologies, is set to shift wireless communication to machine-centric paradigms, revolutionizing sectors such as healthcare or industrial automation through efficient data handling. However, this connectivity boom poses challenges, including straining existing communication systems due to increased data traffic and computational demands.

Over-the-air computation (OAC) presents a feasible solution, allowing the summation of transmitted signals at a common receiver through analog amplitude modulation. Designed to enable concurrent data collection and computation at the network edge, OAC seeks to lessen the central system burden, reducing latency and energy usage while enabling real-time analytics. This approach is particularly beneficial for federated learning, a machine learning technique that operates across decentralized devices. However, OAC's dependence on analog communication poses notable challenges, including signal distortion during transmission and the limited availability of devices supporting analog modulations. Digital modulation is a preferable alternative, recognized for its excellent channel correction capabilities and broad acceptance in modern wireless devices. Nevertheless, its integration into OAC is perceived as a significant hurdle, with overlapping digitally modulated signals threatening the fundamental concept of simultaneous data collection and computation.

The first part of the thesis provides an overview of communication systems, specifically focusing on the relevant OAC methodologies for analog and digital parts and their application in ML, particularly in training federated learning models. Subsequently, an exhaustive literature review concerning analog OAC techniques is undertaken, identifying existing limitations within this domain. The central thrust of our research is then introduced, proposing an innovative digital OAC approach along with a fresh perspective on the communication systems models designed for executing the computation. The chapter concludes with a summary of the principal contributions of each paper included within the thesis.

In the second part, we introduce ChannelComp, a groundbreaking computing approach compatible with current digital communication systems, including smartphones and IoT devices. A detailed analysis of ChannelComp's functions reveals how it enables digital modulation schemes to perform computations, addressing a critical gap in previous research. Moreover, introducing pre-coders designed for function computation over the multiple access channel, combined with a feasibility optimization problem framework, allows for seamless integration with current systems. Compared to OAC, restricted to analog modulations, ChannelComp exhibits broader computational capabilities and adherence to strict computation time constraints, thus showcasing its robust potential for future massive machine-type communications. This innovative method signifies a promising direction toward sustainable and efficient future wireless communication.

Abstract [sv]

Den nära förestående Internet of Things, drivet av 6G-nätverk och maskininlärningsteknologier, är på väg att förändra trådlös kommunikation till maskincentrerade paradigm, revolutionerande sektorer som hälso- och sjukvård samt industriell automatisering genom effektiv datahantering. Dock medför denna uppkopplingsboom utmaningar, inklusive påfrestningar på befintliga kommunikationssystem på grund av ökad datatrafik och beräkningsbehov.

Over-the-air-beräkning (OAC) framstår som en genomförbar lösning, genom att tillåta summering av överförda signaler hos en gemensam mottagare genom analog amplitudmodulering. Utformad för att möjliggöra samtidig datainsamling och beräkning vid nätverkskanten, strävar OAC efter att minska den centrala systembelastningen, minska latens och energiförbrukning samtidigt som det möjliggör realtidsanalys. Denna metod är särskilt fördelaktig för federerad inlärning, en maskininlärningsteknik som fungerar över decentraliserade enheter. Dock medför OAC:s beroende av analog kommunikation märkbara utmaningar, inklusive signal distortion under överföring och begränsad tillgänglighet av enheter som stöder analoga moduleringar. Digital modulering är ett föredraget alternativ, erkänt för dess utmärkta kanalkorrigeringsegenskaper och bred acceptans i moderna trådlösa enheter. Trots detta uppfattas dess integration i OAC som ett betydande hinder, med överlappande digitalt modulerade signaler som hotar den grundläggande konceptet med samtidig datainsamling och beräkning.

Den första delen av avhandlingen ger en översikt över kommunikationssystem, med särskilt fokus på relevanta OAC-metodiker för analoga och digitala delar och deras tillämpning i ML, särskilt vid träning av federerade inlärningsmodeller. Därefter genomförs en omfattande litteraturöversikt angående analoga OAC-tekniker, där befintliga begränsningar inom detta område identifieras. Forskningens centrala drivkraft introduceras sedan, med förslag på en innovativ digital OAC-metod tillsammans med ett nytt perspektiv på kommunikationssystemmodeller utformade för att utföra beräkningen. Kapitlet avslutas med en sammanfattning av de huvudsakliga bidragen från varje artikel inkluderad i avhandlingen.

I den andra delen introducerar vi ChannelComp, en ny och banbrytande beräkningsmetod som är kompatibel med nuvarande digitala kommunikationssystem, inklusive smartphones och IoT-enheter. En detaljerad analys av ChannelComp:s funktioner avslöjar hur den möjliggör digitala moduleringsscheman för att utföra beräkningar, vilket adresserar en kritisk lucka i tidigare forskning. Dessutom möjliggör introduktionen av förkodare utformade för funktionsberäkning över den fleraccessa kanalen, kombinerat med ett ramverk för genomförbarhetsoptimeringsproblem, en sömlös integration med nuvarande system. Jämfört med OAC, begränsad till analoga moduleringar, uppvisar ChannelComp bredare beräkningsmöjligheter och efterlevnad av strikta beräkningstidsbegränsningar, vilket visar dess robusta potential för framtida massiva maskintypkommunikationer. Denna innovativa metod signalerar en lovande riktning mot hållbar och effektiv framtida trådlös kommunikation.

sted, utgiver, år, opplag, sider
Stockholm: KTH Royal Institute of Technology, 2023. , s. 161
Serie
TRITA-EECS-AVL ; 2023:75
HSV kategori
Forskningsprogram
Telekommunikation
Identifikatorer
URN: urn:nbn:se:kth:diva-338940ISBN: 978-91-8040-741-0 (tryckt)OAI: oai:DiVA.org:kth-338940DiVA, id: diva2:1808587
Presentation
2023-11-20, E32 https://kth-se.zoom.us/j/61848116543, Osquars backe 2, E-huset, huvudbyggnaden, Lindstedtsvägen 3, floor 3, Stockholm, 13:00 (engelsk)
Opponent
Veileder
Merknad

QC 20231031

Tilgjengelig fra: 2023-10-31 Laget: 2023-10-31 Sist oppdatert: 2023-11-13bibliografisk kontrollert
Delarbeid
1. Computing Functions Over-the-Air Using Digital Modulations.
Åpne denne publikasjonen i ny fane eller vindu >>Computing Functions Over-the-Air Using Digital Modulations.
2023 (engelsk)Manuskript (preprint) (Annet vitenskapelig)
Abstract [en]

Over-the-air computation (AirComp) is a known technique in which wireless devices transmit values by analog amplitude modulation so that a function of these values is computed over the communication channel at a common receiver. The physical reason is the superposition properties of the electromagnetic waves, which naturally return sums of analog values. Consequently, the applications of AirComp are almost entirely restricted to analog communication systems. However, the use of digital communications for over-the-air computations would have several benefits, such as error correction, synchronization, acquisition of channel state information, and easier adoption by current digital communication systems. Nevertheless, a common belief is that digital modulations are generally unfeasible for computation tasks because the overlapping of digitally modulated signals returns signals that seem to be meaningless for these tasks. This paper breaks through such a belief and proposes a fundamentally new computing method, named ChannelComp, for performing over-the-air computations by any digital modulation. In particular, we propose digital modulation formats that allow us to compute a wider class of functions than AirComp can compute, and we propose a feasibility optimization problem that ascertains the optimal digital modulation for computing functions over-the-air. The simulation results verify the superior performance of ChannelComp in comparison to AirComp, particularly for the product functions, with around 10 dB improvement of the computation error.

Publisher
s. 5780-5786
HSV kategori
Identifikatorer
urn:nbn:se:kth:diva-338914 (URN)
Konferanse
IEEE International Conference on Communications
Merknad

QC 20231031

Tilgjengelig fra: 2023-10-30 Laget: 2023-10-30 Sist oppdatert: 2023-11-01bibliografisk kontrollert
2. ChannelComp: A General Method for Computation by Communications
Åpne denne publikasjonen i ny fane eller vindu >>ChannelComp: A General Method for Computation by Communications
2023 (engelsk)Inngår i: IEEE Transactions on Communications, ISSN 0090-6778, E-ISSN 1558-0857, s. 1-1Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

Over-the-air computation (AirComp) is a well-known technique by which several wireless devices transmit by analog amplitude modulation to achieve a sum of their transmit signals at a common receiver. The underlying physical principle is the superposition property of the radio waves. Since such superposition is analog and in amplitude, it is natural that AirComp uses analog amplitude modulations. Unfortunately, this is impractical because most wireless devices today use digital modulations. It would be highly desirable to use digital communications because of their numerous benefits, such as error correction, synchronization, acquisition of channel state information, and widespread use. However, when we use digital modulations for AirComp, a general belief is that the superposition property of the radio waves returns a meaningless overlapping of the digital signals. In this paper, we break through such beliefs and propose an entirely new digital channel computing method named ChannelComp, which can use digital as well as analog modulations. We propose a feasibility optimization problem that ascertains the optimal modulation for computing arbitrary functions over-the-air. Additionally, we propose pre-coders to adapt existing digital modulation schemes for computing the function over the multiple access channel. The simulation results verify the superior performance of ChannelComp compared to AirComp, particularly for the product functions, with more than 10 dB improvement of the computation error.

sted, utgiver, år, opplag, sider
Institute of Electrical and Electronics Engineers (IEEE), 2023
HSV kategori
Identifikatorer
urn:nbn:se:kth:diva-338912 (URN)10.1109/tcomm.2023.3324999 (DOI)001164695100015 ()2-s2.0-85174823953 (Scopus ID)
Merknad

QC 20231031

Tilgjengelig fra: 2023-10-30 Laget: 2023-10-30 Sist oppdatert: 2024-06-18bibliografisk kontrollert
3. Channel Computing: Computation by Communications
Åpne denne publikasjonen i ny fane eller vindu >>Channel Computing: Computation by Communications
2022 (engelsk)Patent (Annet (populærvitenskap, debatt, mm))
Abstract [en]

The invention relates to a computer-implemented method, a system, and a receiver for in-channel function computation.

HSV kategori
Identifikatorer
urn:nbn:se:kth:diva-338939 (URN)
Merknad

QC 20231031

Tilgjengelig fra: 2023-10-31 Laget: 2023-10-31 Sist oppdatert: 2023-10-31bibliografisk kontrollert
4. SumComp: Coding for Digital Over-the-AirComputation via the Ring of Integers
Åpne denne publikasjonen i ny fane eller vindu >>SumComp: Coding for Digital Over-the-AirComputation via the Ring of Integers
(engelsk)Manuskript (preprint) (Annet vitenskapelig)
Abstract [en]

Communication and computation are traditionally treated as separate entities, allowing for individual optimizations. However, many applications focus on local information's functionality rather than the information itself. For such cases, harnessing interference for computation in a multiple access channel through digital over-the-air computation can notably increase the computation, as established by the ChannelComp method. However, the coding scheme originally proposed in ChannelComp may suffer from high computational complexity because it is general and is not optimized for specific modulation categories. Therefore, this study considers a specific category of digital modulations for over-the-air computations, QAM and PAM, for which we introduce a novel coding scheme called SumComp.

Furthermore, we derive an MSE analysis for SumComp coding in the computation of the arithmetic mean function and establish an upper bound on the MAE for a set of nomographic functions. Simulation results affirm the superior performance of SumComp coding compared to traditional analog over-the-air computation and the original coding in ChannelComp approaches regarding both MSE and MAE over a noisy multiple access channel. Specifically, SumComp coding shows approximately 10 dB improvements for computing arithmetic and geometric mean on the normalized MSE for low-noise scenarios.

HSV kategori
Identifikatorer
urn:nbn:se:kth:diva-338915 (URN)10.48550/arXiv.2310.20504 (DOI)
Merknad

Submitted to IEEE TCOM Journal.

QC 20231031

Tilgjengelig fra: 2023-10-30 Laget: 2023-10-30 Sist oppdatert: 2023-11-10bibliografisk kontrollert
5. Blind Federated Learning via Over-the-Air q-QAM
Åpne denne publikasjonen i ny fane eller vindu >>Blind Federated Learning via Over-the-Air q-QAM
(engelsk)Manuskript (preprint) (Annet vitenskapelig)
Abstract [en]

In this work, we investigate federated edge learning over a fading multiple access channel. To alleviate the communication burden between the edge devices and the access point, we introduce a pioneering digital over-the-air computation strategy employing q-ary quadrature amplitude modulation, culminating in a low latency communication scheme. Indeed, we propose a new federated edge learning framework in which edge devices use digital modulation for over-the-air uplink transmission to the edge server while they have no access to the channel state information. Furthermore, we incorporate multiple antennas at the edge server to overcome the fading inherent in wireless communication.  We analyze the number of antennas required to mitigate the fading impact effectively. We prove a non-asymptotic upper bound for the mean squared error for the proposed federated learning with digital over-the-air uplink transmissions under both noisy and fading conditions.  Leveraging the derived upper bound, we characterize the convergence rate of the learning process of a non-convex loss function in terms of the mean square error of gradients due to the fading channel. Furthermore, we substantiate the theoretical assurances through numerical experiments concerning mean square error and the convergence efficacy of the digital federated edge learning framework. Notably, the results demonstrate that augmenting the number of antennas at the edge server and adopting higher-order modulations improve the model accuracy up to $60\%$.

HSV kategori
Identifikatorer
urn:nbn:se:kth:diva-338917 (URN)
Merknad

QC 20231031

Tilgjengelig fra: 2023-10-30 Laget: 2023-10-30 Sist oppdatert: 2023-11-01bibliografisk kontrollert
6. Blind Asynchronous Over-the-Air Federated Edge Learning
Åpne denne publikasjonen i ny fane eller vindu >>Blind Asynchronous Over-the-Air Federated Edge Learning
2022 (engelsk)Inngår i: 2022 IEEE GLOBECOM Workshops, GC Wkshps 2022: Proceedings, Institute of Electrical and Electronics Engineers (IEEE) , 2022, s. 1834-1839Konferansepaper, Publicerat paper (Fagfellevurdert)
Abstract [en]

Federated Edge Learning (FEEL) is a distributed machine learning technique where each device contributes to training a global inference model by independently performing local computations with their data. More recently, FEEL has been merged with over-the-air computation (OAC), where the global model is calculated over the air by leveraging the superposition of analog signals. However, when implementing FEEL with OAC, there is the challenge on how to precode the analog signals to overcome any time misalignment at the receiver. In this work, we propose a novel synchronization-free method to recover the parameters of the global model over the air without requiring any prior information about the time misalignments. For that, we construct a convex optimization based on the norm minimization problem to directly recover the global model by solving a convex semi-definite program. The performance of the proposed method is evaluated in terms of accuracy and convergence via numerical experiments. We show that our proposed algorithm is close to the ideal synchronized scenario by 10%, and performs 4times better than the simple case where no recovering method is used.

sted, utgiver, år, opplag, sider
Institute of Electrical and Electronics Engineers (IEEE), 2022
Emneord
Asynchronous, federated edge learning, over-the-air computation, time misalignment
HSV kategori
Identifikatorer
urn:nbn:se:kth:diva-333461 (URN)10.1109/GCWkshps56602.2022.10008588 (DOI)2-s2.0-85146155208 (Scopus ID)
Konferanse
2022 IEEE GLOBECOM Workshops, GC Wkshps 2022, Virtual, Online, Brazil, Dec 4 2022 - Dec 8 2022
Merknad

Part of ISBN 9781665459754

QC 20230802

Tilgjengelig fra: 2023-08-02 Laget: 2023-08-02 Sist oppdatert: 2023-11-01bibliografisk kontrollert

Open Access i DiVA

summary(837 kB)150 nedlastinger
Filinformasjon
Fil SUMMARY02.pdfFilstørrelse 837 kBChecksum SHA-512
3279e2ff4195c3bf59f74e6bce8765f07873a476ea2c222c658fbcb856aadc92ceadd6293300fa7c086de4e46d0d9bc69d7b185ae6ce331a8a329ed7aff657bb
Type summaryMimetype application/pdf

Person

Razavikia, Saeed

Søk i DiVA

Av forfatter/redaktør
Razavikia, Saeed
Av organisasjonen

Søk utenfor DiVA

GoogleGoogle Scholar
Antall nedlastinger er summen av alle nedlastinger av alle fulltekster. Det kan for eksempel være tidligere versjoner som er ikke lenger tilgjengelige

isbn
urn-nbn

Altmetric

isbn
urn-nbn
Totalt: 518 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf