Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Mutual Information Preserving Analysis of a Single Layer Feedforward Network
KTH, School of Electrical Engineering and Computer Science (EECS), Information Science and Engineering.
KTH, School of Electrical Engineering and Computer Science (EECS), Centres, ACCESS Linnaeus Centre.ORCID iD: 0000-0003-2638-6047
KTH, School of Electrical Engineering and Computer Science (EECS), Information Science and Engineering.ORCID iD: 0000-0002-7926-5081
2018 (English)In: Proceedings of the International Symposium on Wireless Communication Systems, VDE Verlag GmbH , 2018Conference paper, Published paper (Refereed)
Abstract [en]

We construct a single layer feed forward network and analyze the constructed system using information theoretic tools, such as mutual information and data processing inequality. We derive a threshold on the number of hidden nodes required to achieve a good classification performance. Classification performance is expected to saturate as we increase the number of hidden nodes more than the threshold. The threshold is further verified by experimental studies on benchmark datasets. Index Terms-Neural networks, mutual information, extreme learning machine, invertible function.

Place, publisher, year, edition, pages
VDE Verlag GmbH , 2018.
Keywords [en]
Data handling, Information theory, Learning systems, Wireless telecommunication systems, Benchmark datasets, Classification performance, Extreme learning machine, Feed-forward network, Hidden nodes, Index terms, Mutual informations, Single layer, Network layers
National Category
Computer and Information Sciences
Identifiers
URN: urn:nbn:se:kth:diva-247133DOI: 10.1109/ISWCS.2018.8491242Scopus ID: 2-s2.0-85056724949ISBN: 9781538650059 (print)OAI: oai:DiVA.org:kth-247133DiVA, id: diva2:1301872
Conference
15th International Symposium on Wireless Communication Systems, ISWCS 2018, 28 August 2018 through 31 August 2018
Note

QC 20190403

Available from: 2019-04-03 Created: 2019-04-03 Last updated: 2019-04-03Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopusconference

Authority records BETA

Javid, Alireza M.Chatterjee, SaikatSkoglund, Mikael

Search in DiVA

By author/editor
Javid, Alireza M.Chatterjee, SaikatSkoglund, Mikael
By organisation
Information Science and EngineeringACCESS Linnaeus Centre
Computer and Information Sciences

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 123 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf